Optimizing an adaptive digital oral health intervention for promoting oral self-care behaviors: Micro-randomized trial protocol

I Nahum-Shani, ZM Greer, AL Trella, KW Zhang… - Contemporary clinical …, 2024 - Elsevier
Dental disease continues to be one of the most prevalent chronic diseases in the United
States. Although oral self-care behaviors (OSCB), involving systematic twice-a-day tooth …

Dyadic Reinforcement Learning

S Li, LS Niell, SW Choi, I Nahum-Shani… - arXiv preprint arXiv …, 2023 - arxiv.org
Mobile health aims to enhance health outcomes by delivering interventions to individuals as
they go about their daily life. The involvement of care partners and social support networks …

Online learning in bandits with predicted context

Y Guo, Z Xu, S Murphy - International Conference on …, 2024 - proceedings.mlr.press
We consider the contextual bandit problem where at each time, the agent only has access to
a noisy version of the context and the error variance (or an estimator of this variance). This …

Statistical inference after adaptive sampling for longitudinal data

KW Zhang, L Janson, SA Murphy - arXiv preprint arXiv:2202.07098, 2022 - arxiv.org
Online reinforcement learning and other adaptive sampling algorithms are increasingly used
in digital intervention experiments to optimize treatment delivery for users over time. In this …

Peeking with PEAK: Sequential, Nonparametric Composite Hypothesis Tests for Means of Multiple Data Streams

B Cho, K Gan, N Kallus - arXiv preprint arXiv:2402.06122, 2024 - arxiv.org
We propose a novel nonparametric sequential test for composite hypotheses for means of
multiple data streams. Our proposed method,\emph {peeking with expectation-based …

Semi-parametric inference based on adaptively collected data

L Lin, K Khamaru, MJ Wainwright - arXiv preprint arXiv:2303.02534, 2023 - arxiv.org
Many standard estimators, when applied to adaptively collected data, fail to be
asymptotically normal, thereby complicating the construction of confidence intervals. We …

Monitoring Fidelity of Online Reinforcement Learning Algorithms in Clinical Trials

AL Trella, KW Zhang, I Nahum-Shani, V Shetty… - arXiv preprint arXiv …, 2024 - arxiv.org
Online reinforcement learning (RL) algorithms offer great potential for personalizing
treatment for participants in clinical trials. However, deploying an online, autonomous …

Oralytics Reinforcement Learning Algorithm

AL Trella, KW Zhang, SM Carpenter, D Elashoff… - arXiv preprint arXiv …, 2024 - arxiv.org
Dental disease is still one of the most common chronic diseases in the United States. While
dental disease is preventable through healthy oral self-care behaviors (OSCB), this basic …

reBandit: Random Effects based Online RL algorithm for Reducing Cannabis Use

S Ghosh, Y Guo, PY Hung, L Coughlin, E Bonar… - arXiv preprint arXiv …, 2024 - arxiv.org
The escalating prevalence of cannabis use, and associated cannabis-use disorder (CUD),
poses a significant public health challenge globally. With a notably wide treatment gap …

Optwin: Drift identification with optimal sub-windows

MDL Tosi, M Theobald - 2024 IEEE 40th International …, 2024 - ieeexplore.ieee.org
Online Learning (OL) is a subfield of Machine Learning (ML) that is increasingly gaining
attention in academia and industry. A long-standing challenge in OL is the presence of …