Replicability, robustness, and reproducibility in psychological science

BA Nosek, TE Hardwicke, H Moshontz… - Annual review of …, 2022 - annualreviews.org
Replication—an important, uncommon, and misunderstood practice—is gaining
appreciation in psychology. Achieving replicability is important for making research …

Crisis ahead? Why human-robot interaction user studies may have replicability problems and directions for improvement

B Leichtmann, V Nitsch, M Mara - Frontiers in Robotics and AI, 2022 - frontiersin.org
There is a confidence crisis in many scientific disciplines, in particular disciplines
researching human behavior, as many effects of original experiments have not been …

A discipline-wide investigation of the replicability of Psychology papers over the past two decades

W Youyou, Y Yang, B Uzzi - Proceedings of the National …, 2023 - National Acad Sciences
Conjecture about the weak replicability in social sciences has made scholars eager to
quantify the scale and scope of replication failure for a discipline. Yet small-scale manual …

An excess of positive results: Comparing the standard psychology literature with registered reports

AM Scheel, MRMJ Schijen… - Advances in Methods …, 2021 - journals.sagepub.com
Selectively publishing results that support the tested hypotheses (“positive” results) distorts
the available evidence for scientific claims. For the past decade, psychological scientists …

How many participants do I need to test an interaction? Conducting an appropriate power analysis and achieving sufficient power to detect an interaction

N Sommet, DL Weissman… - Advances in Methods …, 2023 - journals.sagepub.com
Power analysis for first-order interactions poses two challenges:(a) Conducting an
appropriate power analysis is difficult because the typical expected effect size of an …

Correcting for bias in psychology: A comparison of meta-analytic methods

EC Carter, FD Schönbrodt… - … in Methods and …, 2019 - journals.sagepub.com
Publication bias and questionable research practices in primary research can lead to badly
overestimated effects in meta-analysis. Methodologists have proposed a variety of statistical …

The Psychological Science Accelerator: Advancing psychology through a distributed collaborative network

H Moshontz, L Campbell, CR Ebersole… - … in Methods and …, 2018 - journals.sagepub.com
Concerns about the veracity of psychological research have been growing. Many findings in
psychological science are based on studies with insufficient statistical power and …

Research in social psychology changed between 2011 and 2016: Larger sample sizes, more self-report measures, and more online studies

K Sassenberg, L Ditrich - Advances in Methods and …, 2019 - journals.sagepub.com
The debate about false positives in psychological research has led to a demand for higher
statistical power. To meet this demand, researchers need to collect data from larger samples …

When does HARKing hurt? Identifying when different types of undisclosed post hoc hypothesizing harm scientific progress

M Rubin - Review of General Psychology, 2017 - journals.sagepub.com
Hypothesizing after the results are known, or HARKing, occurs when researchers check their
research results and then add or remove hypotheses on the basis of those results without …

Preregistration in practice: A comparison of preregistered and non-preregistered studies in psychology

OR van den Akker, MALM van Assen, M Bakker… - Behavior Research …, 2024 - Springer
Preregistration has gained traction as one of the most promising solutions to improve the
replicability of scientific effects. In this project, we compared 193 psychology studies that …