Opportunities and challenges of diffusion models for generative AI

M Chen, S Mei, J Fan, M Wang - National Science Review, 2024 - academic.oup.com
Diffusion models, a powerful and universal generative artificial intelligence technology, have
achieved tremendous success and opened up new possibilities in diverse applications. In …

An overview of diffusion models: Applications, guided generation, statistical rates and optimization

M Chen, S Mei, J Fan, M Wang - arXiv preprint arXiv:2404.07771, 2024 - arxiv.org
Diffusion models, a powerful and universal generative AI technology, have achieved
tremendous success in computer vision, audio, reinforcement learning, and computational …

On the design fundamentals of diffusion models: A survey

Z Chang, GA Koulieris, HPH Shum - arXiv preprint arXiv:2306.04542, 2023 - arxiv.org
Diffusion models are generative models, which gradually add and remove noise to learn the
underlying distribution of training data for data generation. The components of diffusion …

Generative flows on discrete state-spaces: Enabling multimodal flows with applications to protein co-design

A Campbell, J Yim, R Barzilay, T Rainforth… - arXiv preprint arXiv …, 2024 - arxiv.org
Combining discrete and continuous data is an important capability for generative models.
We present Discrete Flow Models (DFMs), a new flow-based model of discrete data that …

Informed correctors for discrete diffusion models

Y Zhao, J Shi, L Mackey, S Linderman - arXiv preprint arXiv:2407.21243, 2024 - arxiv.org
Discrete diffusion modeling is a promising framework for modeling and generating data in
discrete spaces. To sample from these models, different strategies present trade-offs …

Generative diffusion models: A survey of current theoretical developments

MN Yeğin, MF Amasyalı - Neurocomputing, 2024 - Elsevier
Generative diffusion models showed high success in many fields with a powerful theoretical
background. They convert the data distribution to noise and remove the noise back to obtain …

How discrete and continuous diffusion meet: Comprehensive analysis of discrete diffusion models via a stochastic integral framework

Y Ren, H Chen, GM Rotskoff, L Ying - arXiv preprint arXiv:2410.03601, 2024 - arxiv.org
Discrete diffusion models have gained increasing attention for their ability to model complex
distributions with tractable sampling and inference. However, the error analysis for discrete …

Unlocking Guidance for Discrete State-Space Diffusion and Flow Models

H Nisonoff, J Xiong, S Allenspach… - arXiv preprint arXiv …, 2024 - arxiv.org
Generative models on discrete state-spaces have a wide range of potential applications,
particularly in the domain of natural sciences. In continuous state-spaces, controllable and …

Diffusion coefficient expression for asymmetric discrete random walk with unequal jump times, lengths, and probabilities

G Lin, S Zheng - Physica A: Statistical Mechanics and its Applications, 2024 - Elsevier
Random walk has wide applications in many fields, such as generative AI, biology, physics,
and chemistry. Asymmetric random walk could be described by the drift-diffusion equation …

Bridging discrete and continuous state spaces: Exploring the Ehrenfest process in time-continuous diffusion models

L Winkler, L Richter, M Opper - arXiv preprint arXiv:2405.03549, 2024 - arxiv.org
Generative modeling via stochastic processes has led to remarkable empirical results as
well as to recent advances in their theoretical understanding. In principle, both space and …