[PDF][PDF] On over-fitting in model selection and subsequent selection bias in performance evaluation

GC Cawley, NLC Talbot - The Journal of Machine Learning Research, 2010 - jmlr.org
… thus cannot be ignored in empirical evaluation. Furthermore, we show that some common
performance evaluation practices are susceptible to a form of selection bias as a result of this …

[PDF][PDF] Discretion and bias in performance evaluation

C Prendergast, R Topel - European Economic Review, 1993 - edisciplinas.usp.br
… the study of subjective performance evaluation in ways that are … performance evaluation
raises issues of systematic bias in organizations. Evidence of potential bias in performance

… of selection bias in evaluating social programs: An interpretation of conventional measures and evidence on the effectiveness of matching as a program evaluation …

JJ Heckman, H Ichimura, J Smith… - Proceedings of the …, 1996 - National Acad Sciences
… due to selection bias, … of selection bias is not due to selection, precisely defined, and we
conjecture that this is a general finding. We find that the conventional measure of selection bias

Site selection bias in program evaluation

H Allcott - The Quarterly journal of economics, 2015 - academic.oup.com
“Site selection bias” can occur when the probability that a program is adopted or evaluated
is correlated with its impacts. I test for site selection bias in the context of the Opower energy …

Hidden selection bias deriving from donor organ characteristics does not affect performance evaluations of kidney transplant centers

JD Schold, TR Srinivas, ED Poggio, BR Stephany… - Medical care, 2010 - journals.lww.com
… These imperfections may lead to a problematic form of selection bias that presents … of
performance evaluations into policy. The potential for the uncertain hidden selection bias also …

Characterizing selection bias using experimental data

JJ Heckman, H Ichimura, JA Smith, PE Todd - 1998 - nber.org
… of selection bias as conveniently measured. We present a rigorous definition of selection
bias and find that in our data it is a small component of conventionally measured bias, but it is …

One algorithm may not fit all: how selection bias affects machine learning performance

AC Yu, J Eng - Radiographics, 2020 - pubs.rsna.org
… A source of confusion when using the term selection bias is the … selection bias as one of
three major categories of study bias, the other two being confounding bias and information bias (…

Measuring teaching quality in higher education: assessing selection bias in course evaluations

M Goos, A Salomons - Research in Higher Education, 2017 - Springer
… the direction and size of selection bias resulting from both … biased, and that correcting for
selection bias has non-negligible effects on the average evaluation score and on the evaluation

Sample selection bias in evaluation of prediction performance of causal models

JP Long, MJ Ha - Statistical Analysis and Data Mining: The ASA …, 2022 - Wiley Online Library
selection bias is likely a key driver of model performance. We propose using a less-biased
evaluation set for assessing prediction performance and … of bias in performance evaluation on …

The determinants and performance effects of managers' performance evaluation biases

JC Bol - The Accounting Review, 2011 - publications.aaahq.org
… Using employees who were employed by FSP in both 2003 and 2004 might lead to selection
bias because employees who left the company in 2003 are excluded from the sample. To …