Machine learning and the physical sciences

G Carleo, I Cirac, K Cranmer, L Daudet, M Schuld… - Reviews of Modern …, 2019 - APS
Machine learning (ML) encompasses a broad range of algorithms and modeling tools used
for a vast array of data processing tasks, which has entered most scientific disciplines in …

Advances in variational inference

C Zhang, J Bütepage, H Kjellström… - IEEE transactions on …, 2018 - ieeexplore.ieee.org
Many modern unsupervised or semi-supervised machine learning algorithms rely on
Bayesian probabilistic models. These models are usually intractable and thus require …

Virtual adversarial training: a regularization method for supervised and semi-supervised learning

T Miyato, S Maeda, M Koyama… - IEEE transactions on …, 2018 - ieeexplore.ieee.org
We propose a new regularization method based on virtual adversarial loss: a new measure
of local smoothness of the conditional label distribution given input. Virtual adversarial loss …

Vector approximate message passing

S Rangan, P Schniter… - IEEE Transactions on …, 2019 - ieeexplore.ieee.org
The standard linear regression (SLR) problem is to recover a vector x 0 from noisy linear
observations y= Ax 0+ w. The approximate message passing (AMP) algorithm proposed by …

Statistical physics of inference: Thresholds and algorithms

L Zdeborová, F Krzakala - Advances in Physics, 2016 - Taylor & Francis
Many questions of fundamental interest in today's science can be formulated as inference
problems: some partial, or noisy, observations are performed over a set of variables and the …

Direct-coupling analysis of residue coevolution captures native contacts across many protein families

F Morcos, A Pagnani, B Lunt… - Proceedings of the …, 2011 - National Acad Sciences
The similarity in the three-dimensional structures of homologous proteins imposes strong
constraints on their sequence variability. It has long been suggested that the resulting …

Inverse statistical problems: from the inverse Ising problem to data science

HC Nguyen, R Zecchina, J Berg - Advances in Physics, 2017 - Taylor & Francis
Inverse problems in statistical physics are motivated by the challenges of 'big data'in
different fields, in particular high-throughput experiments in biology. In inverse problems, the …

Optimal errors and phase transitions in high-dimensional generalized linear models

J Barbier, F Krzakala, N Macris… - Proceedings of the …, 2019 - National Acad Sciences
Generalized linear models (GLMs) are used in high-dimensional machine learning,
statistics, communications, and signal processing. In this paper we analyze GLMs when the …

Learned D-AMP: Principled neural network based compressive image recovery

C Metzler, A Mousavi… - Advances in neural …, 2017 - proceedings.neurips.cc
Compressive image recovery is a challenging problem that requires fast and accurate
algorithms. Recently, neural networks have been applied to this problem with promising …

Theoretical perspective on the glass transition and amorphous materials

L Berthier, G Biroli - Reviews of modern physics, 2011 - APS
A theoretical perspective is provided on the glass transition in molecular liquids at thermal
equilibrium, on the spatially heterogeneous and aging dynamics of disordered materials …