Optimizing sequential experimental design with deep reinforcement learning

T Blau, EV Bonilla, I Chades… - … conference on machine …, 2022 - proceedings.mlr.press
Bayesian approaches developed to solve the optimal design of sequential experiments are
mathematically elegant but computationally challenging. Recently, techniques using …

Deep adaptive design: Amortizing sequential bayesian experimental design

A Foster, DR Ivanova, I Malik… - … conference on machine …, 2021 - proceedings.mlr.press
Abstract We introduce Deep Adaptive Design (DAD), a method for amortizing the cost of
adaptive Bayesian experimental design that allows experiments to be run in real-time …

Bayesian sequential optimal experimental design for nonlinear models using policy gradient reinforcement learning

W Shen, X Huan - Computer Methods in Applied Mechanics and …, 2023 - Elsevier
We present a mathematical framework and computational methods for optimally designing a
finite sequence of experiments. This sequential optimal experimental design (sOED) …

Implicit deep adaptive design: Policy-based experimental design without likelihoods

DR Ivanova, A Foster, S Kleinegesse… - Advances in neural …, 2021 - proceedings.neurips.cc
Abstract We introduce implicit Deep Adaptive Design (iDAD), a new method for performing
adaptive experiments in real-time with implicit models. iDAD amortizes the cost of Bayesian …

Sequential Bayesian optimal experimental design via approximate dynamic programming

X Huan, YM Marzouk - arXiv preprint arXiv:1604.08320, 2016 - arxiv.org
The design of multiple experiments is commonly undertaken via suboptimal strategies, such
as batch (open-loop) design that omits feedback or greedy (myopic) design that does not …

BINOCULARS for efficient, nonmyopic sequential experimental design

S Jiang, H Chai, J Gonzalez… - … Conference on Machine …, 2020 - proceedings.mlr.press
Finite-horizon sequential experimental design (SED) arises naturally in many contexts,
including hyperparameter tuning in machine learning among more traditional settings …

Adaptive experimental design with temporal interference: A maximum likelihood approach

PW Glynn, R Johari, M Rasouli - Advances in Neural …, 2020 - proceedings.neurips.cc
Suppose an online platform wants to compare a treatment and control policy (eg, two
different matching algorithms in a ridesharing system, or two different inventory management …

Deep reinforcement learning for optimal experimental design in biology

NJ Treloar, N Braniff, B Ingalls… - PLOS Computational …, 2022 - journals.plos.org
The field of optimal experimental design uses mathematical techniques to determine
experiments that are maximally informative from a given experimental setup. Here we apply …

Differentiable multi-target causal bayesian experimental design

P Tigas, Y Annadani, DR Ivanova… - International …, 2023 - proceedings.mlr.press
We introduce a gradient-based approach for the problem of Bayesian optimal experimental
design to learn causal models in a batch setting—a critical component for causal discovery …

Near-optimal design of experiments via regret minimization

Z Allen-Zhu, Y Li, A Singh… - … Conference on Machine …, 2017 - proceedings.mlr.press
We consider computationally tractable methods for the experimental design problem, where
k out of n design points of dimension p are selected so that certain optimality criteria are …