'Your comments are meaner than your score': Score calibration talk influences intra-and inter-panel variability during scientific grant peer review

EL Pier, J Raclaw, A Kaatz, M Brauer… - Research …, 2017 - academic.oup.com
In scientific grant peer review, groups of expert scientists meet to engage in the collaborative
decision-making task of evaluating and scoring grant applications. Prior research on grant …

Peer review of grant applications in biology and medicine. Reliability, fairness, and validity

M Reinhart - Scientometrics, 2009 - akjournals.com
This paper examines the peer review procedure of a national science funding organization
(Swiss National Science Foundation) by means of the three most frequently studied criteria …

Measuring bias, burden and conservatism in research funding processes

S Guthrie, D Rodriguez Rincon, G McInroy… - …, 2019 - f1000research.com
Background: Grant funding allocation is a complex process that in most cases relies on peer
review. A recent study identified a number of challenges associated with the use of peer …

Low agreement among reviewers evaluating the same NIH grant applications

EL Pier, M Brauer, A Filut, A Kaatz… - Proceedings of the …, 2018 - National Acad Sciences
Obtaining grant funding from the National Institutes of Health (NIH) is increasingly
competitive, as funding success rates have declined over the past decade. To allocate …

Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency

J Shepherd, GK Frampton, K Pickett, JC Wyatt - PLoS One, 2018 - journals.plos.org
Objective To investigate methods and processes for timely, efficient and good quality peer
review of research funding proposals in health. Methods A two-stage evidence synthesis:(1) …

Using simplified peer review processes to fund research: a prospective study

DL Herbert, N Graves, P Clarke, AG Barnett - BMJ open, 2015 - bmjopen.bmj.com
Objective To prospectively test two simplified peer review processes, estimate the
agreement between the simplified and official processes, and compare the costs of peer …

Peer review bias: a critical review

S Haffar, F Bazerbachi, MH Murad - Mayo Clinic Proceedings, 2019 - Elsevier
Various types of bias and confounding have been described in the biomedical literature that
can affect a study before, during, or after the intervention has been delivered. The peer …

Analysis of National Institutes of Health R01 application critiques, impact, and criteria scores: does the sex of the principal investigator make a difference?

A Kaatz, YG Lee, A Potvien, W Magua, A Filut… - Academic …, 2016 - journals.lww.com
Purpose Prior text analysis of R01 critiques suggested that female applicants may be
disadvantaged in National Institutes of Health (NIH) peer review, particularly for renewals …

Sample size and precision in NIH peer review

D Kaplan, N Lacetera, C Kaplan - PLoS One, 2008 - journals.plos.org
The Working Group on Peer Review of the Advisory Committee to the Director of NIH has
recommended that at least 4 reviewers should be used to assess each grant application. A …

Is the future of peer review automated?

R Schulz, A Barnett, R Bernard, NJL Brown… - BMC research …, 2022 - Springer
The rising rate of preprints and publications, combined with persistent inadequate reporting
practices and problems with study design and execution, have strained the traditional peer …