Deep generative modelling: A comparative review of vaes, gans, normalizing flows, energy-based and autoregressive models

S Bond-Taylor, A Leach, Y Long… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Deep generative models are a class of techniques that train deep neural networks to model
the distribution of training samples. Research has fragmented into various interconnected …

Normalizing flows for probabilistic modeling and inference

G Papamakarios, E Nalisnick, DJ Rezende… - Journal of Machine …, 2021 - jmlr.org
Normalizing flows provide a general mechanism for defining expressive probability
distributions, only requiring the specification of a (usually simple) base distribution and a …

Normalizing flows: An introduction and review of current methods

I Kobyzev, SJD Prince… - IEEE transactions on …, 2020 - ieeexplore.ieee.org
Normalizing Flows are generative models which produce tractable distributions where both
sampling and density evaluation can be efficient and exact. The goal of this survey article is …

Pointflow: 3d point cloud generation with continuous normalizing flows

G Yang, X Huang, Z Hao, MY Liu… - Proceedings of the …, 2019 - openaccess.thecvf.com
As 3D point clouds become the representation of choice for multiple vision and graphics
applications, the ability to synthesize or reconstruct high-resolution, high-fidelity point clouds …

Neural spline flows

C Durkan, A Bekasov, I Murray… - Advances in neural …, 2019 - proceedings.neurips.cc
A normalizing flow models a complex probability density as an invertible transformation of a
simple base density. Flows based on either coupling or autoregressive transforms both offer …

Neural ordinary differential equations

RTQ Chen, Y Rubanova… - Advances in neural …, 2018 - proceedings.neurips.cc
We introduce a new family of deep neural network models. Instead of specifying a discrete
sequence of hidden layers, we parameterize the derivative of the hidden state using a …

Ffjord: Free-form continuous dynamics for scalable reversible generative models

W Grathwohl, RTQ Chen, J Bettencourt… - arXiv preprint arXiv …, 2018 - arxiv.org
A promising class of generative models maps points from a simple distribution to a complex
distribution through an invertible neural network. Likelihood-based training of these models …

Analyzing inverse problems with invertible neural networks

L Ardizzone, J Kruse, S Wirkert, D Rahner… - arXiv preprint arXiv …, 2018 - arxiv.org
In many tasks, in particular in natural science, the goal is to determine hidden system
parameters from a set of measurements. Often, the forward process from parameter-to …

Diagnosing and enhancing VAE models

B Dai, D Wipf - arXiv preprint arXiv:1903.05789, 2019 - arxiv.org
Although variational autoencoders (VAEs) represent a widely influential deep generative
model, many aspects of the underlying energy function remain poorly understood. In …

Neural autoregressive flows

CW Huang, D Krueger, A Lacoste… - … on machine learning, 2018 - proceedings.mlr.press
Normalizing flows and autoregressive models have been successfully combined to produce
state-of-the-art results in density estimation, via Masked Autoregressive Flows …