Sit: Exploring flow and diffusion-based generative models with scalable interpolant transformers

N Ma, M Goldstein, MS Albergo, NM Boffi… - … on Computer Vision, 2024 - Springer
Abstract We present Scalable Interpolant Transformers (SiT), a family of generative models
built on the backbone of Diffusion Transformers (DiT). The interpolant framework, which …

Protein design with guided discrete diffusion

N Gruver, S Stanton, N Frey… - Advances in neural …, 2024 - proceedings.neurips.cc
A popular approach to protein design is to combine a generative model with a discriminative
model for conditional sampling. The generative model samples plausible sequences while …

On the challenges and opportunities in generative ai

L Manduchi, K Pandey, R Bamler, R Cotterell… - arXiv preprint arXiv …, 2024 - arxiv.org
The field of deep generative modeling has grown rapidly and consistently over the years.
With the availability of massive amounts of training data coupled with advances in scalable …

Structure-Guided Adversarial Training of Diffusion Models

L Yang, H Qian, Z Zhang, J Liu… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Diffusion models have demonstrated exceptional efficacy in various generative applications.
While existing models focus on minimizing a weighted sum of denoising score matching …

Stochastic interpolants with data-dependent couplings

MS Albergo, M Goldstein, NM Boffi… - arXiv preprint arXiv …, 2023 - arxiv.org
Generative models inspired by dynamical transport of measure--such as flows and diffusions-
-construct a continuous-time map between two probability densities. Conventionally, one of …

What's the score? automated denoising score matching for nonlinear diffusions

R Singhal, M Goldstein, R Ranganath - arXiv preprint arXiv:2407.07998, 2024 - arxiv.org
Reversing a diffusion process by learning its score forms the heart of diffusion-based
generative modeling and for estimating properties of scientific systems. The diffusion …

DiffEnc: Variational diffusion with a learned encoder

BMG Nielsen, A Christensen, A Dittadi… - arXiv preprint arXiv …, 2023 - arxiv.org
Diffusion models may be viewed as hierarchical variational autoencoders (VAEs) with two
improvements: parameter sharing for the conditional distributions in the generative process …

A complete recipe for diffusion generative models

K Pandey, S Mandt - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
Abstract Score-based Generative Models (SGMs) have demonstrated exceptional synthesis
outcomes across various tasks. However, the current design landscape of the forward …

Neural Diffusion Models

G Bartosh, D Vetrov, CA Naesseth - arXiv preprint arXiv:2310.08337, 2023 - arxiv.org
Diffusion models have shown remarkable performance on many generative tasks. Despite
recent success, most diffusion models are restricted in that they only allow linear …

Generative fractional diffusion models

G Nobis, M Springenberg, M Aversa, M Detzel… - arXiv preprint arXiv …, 2023 - arxiv.org
We introduce the first continuous-time score-based generative model that leverages
fractional diffusion processes for its underlying dynamics. Although diffusion models have …