Dynamical regimes of diffusion models

G Biroli, T Bonnaire, V De Bortoli, M Mézard - Nature Communications, 2024 - nature.com
We study generative diffusion models in the regime where both the data dimension and the
sample size are large, and the score function is trained optimally. Using statistical physics …

The emergence of reproducibility and consistency in diffusion models

H Zhang, J Zhou, Y Lu, M Guo, P Wang… - Forty-first International …, 2023 - openreview.net
In this work, we investigate an intriguing and prevalent phenomenon of diffusion models
which we term as" consistent model reproducibility'': given the same starting noise input and …

A phase transition in diffusion models reveals the hierarchical nature of data

A Sclocchi, A Favero, M Wyart - Proceedings of the National Academy of …, 2025 - pnas.org
Understanding the structure of real data is paramount in advancing modern deep-learning
methodologies. Natural data such as images are believed to be composed of features …

Generalization in diffusion models arises from geometry-adaptive harmonic representation

Z Kadkhodaie, F Guth, EP Simoncelli… - arXiv preprint arXiv …, 2023 - arxiv.org
High-quality samples generated with score-based reverse diffusion algorithms provide
evidence that deep neural networks (DNN) trained for denoising can learn high-dimensional …

Diffusion models learn low-dimensional distributions via subspace clustering

P Wang, H Zhang, Z Zhang, S Chen, Y Ma… - arXiv preprint arXiv …, 2024 - arxiv.org
Recent empirical studies have demonstrated that diffusion models can effectively learn the
image distribution and generate new samples. Remarkably, these models can achieve this …

A geometric framework for understanding memorization in generative models

BL Ross, H Kamkari, T Wu, R Hosseinzadeh… - arXiv preprint arXiv …, 2024 - arxiv.org
As deep generative models have progressed, recent work has shown them to be capable of
memorizing and reproducing training datapoints when deployed. These findings call into …

Iterative ensemble training with anti-gradient control for mitigating memorization in diffusion models

X Liu, X Guan, Y Wu, J Miao - European Conference on Computer Vision, 2025 - Springer
Diffusion models, known for their tremendous ability to generate novel and high-quality
samples, have recently raised concerns due to their data memorization behavior, which …

Closed-form diffusion models

C Scarvelis, HSO Borde, J Solomon - arXiv preprint arXiv:2310.12395, 2023 - arxiv.org
Score-based generative models (SGMs) sample from a target distribution by iteratively
transforming noise using the score function of the perturbed target. For any finite training set …

Pioneering new paths: the role of generative modelling in neurological disease research

M Seiler, K Ritter - Pflügers Archiv-European Journal of Physiology, 2024 - Springer
Recently, deep generative modelling has become an increasingly powerful tool with seminal
work in a myriad of disciplines. This powerful modelling approach is supposed to not only …

Replication in visual diffusion models: A survey and outlook

W Wang, Y Sun, Z Yang, Z Hu, Z Tan… - arXiv preprint arXiv …, 2024 - arxiv.org
Visual diffusion models have revolutionized the field of creative AI, producing high-quality
and diverse content. However, they inevitably memorize training images or videos …