On the origin of deep learning

H Wang, B Raj - arXiv preprint arXiv:1702.07800, 2017 - arxiv.org
This paper is a review of the evolutionary history of deep learning models. It covers from the
genesis of neural networks when associationism modeling of the brain is studied, to the …

Deep learning for source code modeling and generation: Models, applications, and challenges

THM Le, H Chen, MA Babar - ACM Computing Surveys (CSUR), 2020 - dl.acm.org
Deep Learning (DL) techniques for Natural Language Processing have been evolving
remarkably fast. Recently, the DL advances in language modeling, machine translation, and …

Deep learning enables fast and dense single-molecule localization with high accuracy

A Speiser, LR Müller, P Hoess, U Matti, CJ Obara… - Nature …, 2021 - nature.com
Single-molecule localization microscopy (SMLM) has had remarkable success in imaging
cellular structures with nanometer resolution, but standard analysis algorithms require …

[图书][B] Deep learning

I Goodfellow - 2016 - books.google.com
An introduction to a broad range of topics in deep learning, covering mathematical and
conceptual background, deep learning techniques used in industry, and research …

Variational lossy autoencoder

X Chen, DP Kingma, T Salimans, Y Duan… - arXiv preprint arXiv …, 2016 - arxiv.org
Representation learning seeks to expose certain aspects of observed data in a learned
representation that's amenable to downstream tasks like classification. For instance, a good …

Importance weighted autoencoders

Y Burda, R Grosse, R Salakhutdinov - arXiv preprint arXiv:1509.00519, 2015 - arxiv.org
The variational autoencoder (VAE; Kingma, Welling (2014)) is a recently proposed
generative model pairing a top-down generative network with a bottom-up recognition …

Deep unsupervised learning using nonequilibrium thermodynamics

J Sohl-Dickstein, E Weiss… - International …, 2015 - proceedings.mlr.press
A central problem in machine learning involves modeling complex data-sets using highly
flexible families of probability distributions in which learning, sampling, inference, and …

GFlowNet-EM for learning compositional latent variable models

EJ Hu, N Malkin, M Jain, KE Everett… - International …, 2023 - proceedings.mlr.press
Latent variable models (LVMs) with discrete compositional latents are an important but
challenging setting due to a combinatorially large number of possible configurations of the …

Neural autoregressive distribution estimation

B Uria, MA Côté, K Gregor, I Murray… - Journal of Machine …, 2016 - jmlr.org
We present Neural Autoregressive Distribution Estimation (NADE) models, which are neural
network architectures applied to the problem of unsupervised distribution and density …

Maximum-likelihood augmented discrete generative adversarial networks

T Che, Y Li, R Zhang, RD Hjelm, W Li, Y Song… - arXiv preprint arXiv …, 2017 - arxiv.org
Despite the successes in capturing continuous distributions, the application of generative
adversarial networks (GANs) to discrete settings, like natural language tasks, is rather …