Differentiable visual computing for inverse problems and machine learning

A Spielberg, F Zhong, K Rematas… - Nature Machine …, 2023 - nature.com
Modern 3D computer graphics technologies are able to reproduce the dynamics and
appearance of real-world environments and phenomena, building on theoretical models in …

A survey of meta-reinforcement learning

J Beck, R Vuorio, EZ Liu, Z Xiong, L Zintgraf… - arXiv preprint arXiv …, 2023 - arxiv.org
While deep reinforcement learning (RL) has fueled multiple high-profile successes in
machine learning, it is held back from more widespread adoption by its often poor data …

Forecasting global weather with graph neural networks

R Keisler - arXiv preprint arXiv:2202.07575, 2022 - arxiv.org
We present a data-driven approach for forecasting global weather using graph neural
networks. The system learns to step forward the current 3D atmospheric state by six hours …

Structured state space models for in-context reinforcement learning

C Lu, Y Schroecker, A Gu, E Parisotto… - Advances in …, 2024 - proceedings.neurips.cc
Structured state space sequence (S4) models have recently achieved state-of-the-art
performance on long-range sequence modeling tasks. These models also have fast …

Human-timescale adaptation in an open-ended task space

AA Team, J Bauer, K Baumli, S Baveja… - arXiv preprint arXiv …, 2023 - arxiv.org
Foundation models have shown impressive adaptation and scalability in supervised and self-
supervised learning problems, but so far these successes have not fully translated to …

Discovered policy optimisation

C Lu, J Kuba, A Letcher, L Metz… - Advances in …, 2022 - proceedings.neurips.cc
Tremendous progress has been made in reinforcement learning (RL) over the past decade.
Most of these advancements came through the continual development of new algorithms …

Data science techniques in biomolecular force field development

Y Ding, K Yu, J Huang - Current Opinion in Structural Biology, 2023 - Elsevier
Recent advances in data science are impacting the development of classical force fields.
Here we review some ideas and techniques from data science that have been used in force …

evosax: Jax-based evolution strategies

RT Lange - Proceedings of the Companion Conference on Genetic …, 2023 - dl.acm.org
The deep learning revolution has greatly been accelerated by the'hardware lottery': Recent
advances in modern hardware accelerators, compilers and the availability of open-source …

Tutorial on amortized optimization

B Amos - Foundations and Trends® in Machine Learning, 2023 - nowpublishers.com
Optimization is a ubiquitous modeling tool and is often deployed in settings which
repeatedly solve similar instances of the same problem. Amortized optimization methods …

Learning to learn with generative models of neural network checkpoints

W Peebles, I Radosavovic, T Brooks, AA Efros… - arXiv preprint arXiv …, 2022 - arxiv.org
We explore a data-driven approach for learning to optimize neural networks. We construct a
dataset of neural network checkpoints and train a generative model on the parameters. In …