Improving observational score quality: Challenges in observer thinking

CA Bell, Y Qi, AJ Croft, D Leusner… - … : New guidance from …, 2015 - Wiley Online Library
This chapter commences with a review of research on the nature of rater thinking and
observer training. It describes the studies, observation protocols, data sets, and our analytic …

Assessing the communication and interpersonal skills of graduates of international medical schools as part of the United States Medical Licensing Exam (USMLE) …

M Van Zanten, JR Boulet, DW McKinley… - Academic …, 2007 - journals.lww.com
Background The ability to communicate effectively with patients is an essential element of a
physician's clinical expertise. Method As part of the USMLE Step 2 Clinical Skills exam …

An examination of rater drift within a generalizability theory framework

P Harik, BE Clauser, I Grabovsky… - Journal of …, 2009 - Wiley Online Library
The present study examined the long‐term usefulness of estimated parameters used to
adjust the scores from a performance assessment to account for differences in rater …

Use of the mini-clinical evaluation exercise to rate examinee performance on a multiple-station clinical skills examination: a validity study

MJ Margolis, BE Clauser, MM Cuddy… - Academic …, 2006 - journals.lww.com
Background Multivariate generalizability analysis was used to investigate the performance
of a commonly used clinical evaluation tool. Method Practicing physicians were trained to …

A framework of construct-irrelevant variance for contextualized constructed response assessment

X Zhai, KC Haudek, C Wilson, M Stuhlsatz - Frontiers in Education, 2021 - frontiersin.org
Estimating and monitoring the construct-irrelevant variance (CIV) is of significant importance
to validity, especially for constructed response assessments with rich contextualized …

Evaluating validity evidence for USMLE step 2 clinical skills data gathering and data interpretation scores: does performance predict history-taking and physical …

MM Cuddy, ML Winward, MM Johnston… - Academic …, 2016 - journals.lww.com
Purpose To add to the small body of validity research addressing whether scores from
performance assessments of clinical skills are related to performance in supervised patient …

Using a linear mixed-effect model framework to estimate multivariate generalizability theory parameters in R

Z Jiang, M Raymond, D Shi, C DiStefano - Behavior research methods, 2020 - Springer
Multivariate generalizability theory (mG-theory) is an important framework in many
behavioral and educational studies, as it describes useful psychometric properties of …

A Bayesian approach to estimating variance components within a multivariate generalizability theory framework

Z Jiang, W Skorupski - Behavior Research Methods, 2018 - Springer
In many behavioral research areas, multivariate generalizability theory (mG theory) has
been typically used to investigate the reliability of certain multidimensional assessments …

Neurology objective structured clinical examination reliability using generalizability theory

AD Blood, YS Park, RV Lukas, JR Brorson - Neurology, 2015 - AAN Enterprises
Objectives: This study examines factors affecting reliability, or consistency of assessment
scores, from an objective structured clinical examination (OSCE) in neurology through …

[图书][B] The History of Educational Measurement

B Clauser, MB Bunch - 2021 - api.taylorfrancis.com
This is not a history book in the strictest sense of the term. None of the authors are historians.
We are instead participants in much of the history covered in this book and as such are likely …