Dynamical regimes of diffusion models

G Biroli, T Bonnaire, V De Bortoli, M Mézard - Nature Communications, 2024 - nature.com
We study generative diffusion models in the regime where both the data dimension and the
sample size are large, and the score function is trained optimally. Using statistical physics …

A phase transition in diffusion models reveals the hierarchical nature of data

A Sclocchi, A Favero, M Wyart - Proceedings of the National Academy of …, 2025 - pnas.org
Understanding the structure of real data is paramount in advancing modern deep-learning
methodologies. Natural data such as images are believed to be composed of features …

On the design fundamentals of diffusion models: A survey

Z Chang, GA Koulieris, HPH Shum - arXiv preprint arXiv:2306.04542, 2023 - arxiv.org
Diffusion models are generative models, which gradually add and remove noise to learn the
underlying distribution of training data for data generation. The components of diffusion …

Mace: Mass concept erasure in diffusion models

S Lu, Z Wang, L Li, Y Liu… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
The rapid expansion of large-scale text-to-image diffusion models has raised growing
concerns regarding their potential misuse in creating harmful or misleading content. In this …

How do minimum-norm shallow denoisers look in function space?

C Zeno, G Ongie, Y Blumenfeld… - Advances in …, 2024 - proceedings.neurips.cc
Neural network (NN) denoisers are an essential building block in many common tasks,
ranging from image reconstruction to image generation. However, the success of these …

Memory in plain sight: A survey of the uncanny resemblances between diffusion models and associative memories

B Hoover, H Strobelt, D Krotov, J Hoffman… - … Memory {\&} Hopfield …, 2023 - openreview.net
Diffusion Models (DMs) have recently set state-of-the-art on many generation benchmarks.
However, there are myriad ways to describe them mathematically, which makes it difficult to …

In search of dispersed memories: Generative diffusion models are associative memory networks

L Ambrogioni - arXiv preprint arXiv:2309.17290, 2023 - arxiv.org
Hopfield networks are widely used in neuroscience as simplified theoretical models of
biological associative memory. The original Hopfield networks store memories by encoding …

Detecting Out-Of-Distribution Earth Observation Images with Diffusion Models

G Le Bellier, N Audebert - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
Earth Observation imagery can capture rare and unusual events such as disasters and
major landscape changes whose visual appearance contrasts with the usual observations …

Long-tailed diffusion models with oriented calibration

T Zhang, H Zheng, J Yao, X Wang, M Zhou… - The Twelfth …, 2024 - openreview.net
Diffusion models are acclaimed for generating high-quality and diverse images. However,
their performance notably degrades when trained on data with a long-tailed distribution. For …

Cascade of phase transitions in the training of Energy-based models

D Bachtis, G Biroli, A Decelle, B Seoane - arXiv preprint arXiv:2405.14689, 2024 - arxiv.org
In this paper, we investigate the feature encoding process in a prototypical energy-based
generative model, the Restricted Boltzmann Machine (RBM). We start with an analytical …