Optimally generate policy-based evidence before scaling

JA List - Nature, 2024 - nature.com
Social scientists have increasingly turned to the experimental method to understand human
behaviour. One critical issue that makes solving social problems difficult is scaling up the …

Heterogeneity in effect size estimates

F Holzmeister, M Johannesson, R Böhm… - Proceedings of the …, 2024 - pnas.org
A typical empirical study involves choosing a sample, a research design, and an analysis
path. Variation in such choices across studies leads to heterogeneity in results that introduce …

Do Preregistration and Preanalysis Plans Reduce p-Hacking and Publication Bias? Evidence from 15,992 Test Statistics and Suggestions for Improvement

A Brodeur, NM Cook, JS Hartley… - Journal of Political …, 2024 - journals.uchicago.edu
Preregistration is regarded as an important contributor to research credibility. We investigate
this by analyzing the pattern of test statistics from the universe of randomized controlled trial …

Generation next: Experimentation with ai

G Charness, B Jabarian, JA List - 2023 - nber.org
We investigate the potential for Large Language Models (LLMs) to enhance scientific
practice within experimentation by identifying key areas, directions, and implications. First …

Do pre-registration and pre-analysis plans reduce p-hacking and publication bias?

A Brodeur, N Cook, J Hartley… - Available at SSRN …, 2022 - papers.ssrn.com
Randomized controlled trials (RCTs) are increasingly prominent in economics, with pre-
registration and pre-analysis plans (PAPs) promoted as important in ensuring the credibility …

Experimental evidence of common pool resource use in the presence of uncertainty

LH Palm-Forster, JF Suter - Journal of Economic Behavior & …, 2022 - Elsevier
Tipping points can occur in many complex environmental systems and often produce abrupt
and irreversible change. Thresholds associated with tipping points are difficult to predict in …

Field testing the transferability of behavioural science knowledge on promoting vaccinations

S Saccardo, H Dai, MA Han, S Vangala, J Hoo… - Nature Human …, 2024 - nature.com
As behavioural science is increasingly adopted by organizations, there is a growing need to
assess the robustness and transferability of empirical findings. Here, we investigate the …

Multiple testing with covariate adjustment in experimental economics

JA List, AM Shaikh, A Vayalinkal - Journal of Applied …, 2023 - Wiley Online Library
This paper provides a framework for testing multiple null hypotheses simultaneously using
experimental data in which simple random sampling is used to assign treatment status to …

How to increase reproducibility and credibility of sociological research

K Auspurg, J Brüderl - Handbook of Sociological Science, 2022 - elgaronline.com
'Sociological Science'highlights that sociology is a science (see the chapter by Raub, De
Graaf & Gërxhani on rigorous sociology in this Handbook). So, the question arises: what are …

The role of open science practices in scaling evidence-based prevention programs

LH Supplee, RT Ammerman, AK Duggan, JA List… - Prevention …, 2022 - Springer
The goal of creating evidence-based programs is to scale them at sufficient breadth to
support population-level improvements in critical outcomes. However, this promise is …