A review of generalizability and transportability

I Degtiar, S Rose - Annual Review of Statistics and Its …, 2023 - annualreviews.org
When assessing causal effects, determining the target population to which the results are
intended to generalize is a critical decision. Randomized and observational studies each …

Randomized experiments in education, with implications for multilevel causal inference

SW Raudenbush, D Schwartz - Annual review of statistics and its …, 2020 - annualreviews.org
Education research has experienced a methodological renaissance over the past two
decades, with a new focus on large-scale randomized experiments. This wave of …

Diagnosing model performance under distribution shift

TT Cai, H Namkoong, S Yadlowsky - arXiv preprint arXiv:2303.02011, 2023 - arxiv.org
Prediction models can perform poorly when deployed to target distributions different from the
training distribution. To understand these operational failure modes, we develop a method …

Generalizing about public health interventions: a mixed-methods approach to external validity

LC Leviton - Annual review of public health, 2017 - annualreviews.org
Public health researchers and practitioners are calling for greater focus on external validity,
the ability to generalize findings of evidence-based interventions (EBIs) beyond the limited …

Designing probability samples to study treatment effect heterogeneity

E Tipton, DS Yeager, R Iachan… - … methods in survey …, 2019 - Wiley Online Library
This chapter explains a new approach that survey samplers can use when designing
probability samples for survey experiments where there is a possibility of treatment …

Minimax optimal estimation of stability under distribution shift

H Namkoong, Y Ma, PW Glynn - arXiv preprint arXiv:2212.06338, 2022 - arxiv.org
The performance of decision policies and prediction models often deteriorates when applied
to environments different from the ones seen during training. To ensure reliable operation …

The effect of various police enforcement actions on violent crime: Evidence from a saturation foot-patrol intervention

EL Piza - Criminal Justice Policy Review, 2018 - journals.sagepub.com
The current study tests the crime prevention effect of different police actions conducted
during a foot-patrol saturation initiative in Newark, New Jersey. Police actions were …

Who are we missing? a principled approach to characterizing the underrepresented population

H Parikh, R Ross, E Stuart, K Rudolph - arXiv preprint arXiv:2401.14512, 2024 - arxiv.org
Randomized controlled trials (RCTs) serve as the cornerstone for understanding causal
effects, yet extending inferences to target populations presents challenges due to effect …

Interaction of theory and practice to assess external validity

LC Leviton, MD Trujillo - Evaluation Review, 2017 - journals.sagepub.com
Background: Variations in local context bedevil the assessment of external validity: the
ability to generalize about effects of treatments. For evaluation, the challenges of assessing …

Cluster randomized trials designed to support generalizable inferences

SE Robertson, JA Steingrimsson… - Evaluation …, 2024 - journals.sagepub.com
When planning a cluster randomized trial, evaluators often have access to an enumerated
cohort representing the target population of clusters. Practicalities of conducting the trial …