Causal machine learning: A survey and open problems

J Kaddour, A Lynch, Q Liu, MJ Kusner… - arXiv preprint arXiv …, 2022 - arxiv.org
Causal Machine Learning (CausalML) is an umbrella term for machine learning methods
that formalize the data-generation process as a structural causal model (SCM). This …

Semiparametric proximal causal inference

Y Cui, H Pu, X Shi, W Miao… - Journal of the American …, 2024 - Taylor & Francis
Skepticism about the assumption of no unmeasured confounding, also known as
exchangeability, is often warranted in making causal inferences from observational data; …

Provably efficient reinforcement learning in partially observable dynamical systems

M Uehara, A Sekhari, JD Lee… - Advances in Neural …, 2022 - proceedings.neurips.cc
Abstract We study Reinforcement Learning for partially observable systems using function
approximation. We propose a new PO-bilinear framework, that is general enough to include …

Causal inference under unmeasured confounding with negative controls: A minimax learning approach

N Kallus, X Mao, M Uehara - arXiv preprint arXiv:2103.14029, 2021 - arxiv.org
We study the estimation of causal parameters when not all confounders are observed and
instead negative controls are available. Recent work has shown how these can enable …

A minimax learning approach to off-policy evaluation in confounded partially observable markov decision processes

C Shi, M Uehara, J Huang… - … Conference on Machine …, 2022 - proceedings.mlr.press
We consider off-policy evaluation (OPE) in Partially Observable Markov Decision Processes
(POMDPs), where the evaluation policy depends only on observable variables and the …

Causal effect inference for structured treatments

J Kaddour, Y Zhu, Q Liu… - Advances in Neural …, 2021 - proceedings.neurips.cc
We address the estimation of conditional average treatment effects (CATEs) for structured
treatments (eg, graphs, images, texts). Given a weak condition on the effect, we propose the …

Proximal causal inference for complex longitudinal studies

A Ying, W Miao, X Shi… - Journal of the Royal …, 2023 - academic.oup.com
A standard assumption for causal inference about the joint effects of time-varying treatment
is that one has measured sufficient covariates to ensure that within covariate strata, subjects …

Pessimism in the face of confounders: Provably efficient offline reinforcement learning in partially observable markov decision processes

M Lu, Y Min, Z Wang, Z Yang - arXiv preprint arXiv:2205.13589, 2022 - arxiv.org
We study offline reinforcement learning (RL) in partially observable Markov decision
processes. In particular, we aim to learn an optimal policy from a dataset collected by a …

Long-term causal inference under persistent confounding via data combination

G Imbens, N Kallus, X Mao, Y Wang - arXiv preprint arXiv:2202.07234, 2022 - arxiv.org
We study the identification and estimation of long-term treatment effects when both
experimental and observational data are available. Since the long-term outcome is …

Deep proxy causal learning and its application to confounded bandit policy evaluation

L Xu, H Kanagawa, A Gretton - Advances in Neural …, 2021 - proceedings.neurips.cc
Proxy causal learning (PCL) is a method for estimating the causal effect of treatments on
outcomes in the presence of unobserved confounding, using proxies (structured side …