Inter-school variations in the standard of examiners' graduation-level OSCE judgements

P Yeates, A Maluf, G McCray, R Kinston, N Cope… - Medical …, 2024 - Taylor & Francis
Introduction Ensuring equivalence in high-stakes performance exams is important for patient
safety and candidate fairness. We compared inter-school examiner differences within a …

[HTML][HTML] Inconsistencies in rater-based assessments mainly affect borderline candidates: but using simple heuristics might improve pass-fail decisions

SK Schauber, AO Olsen, EL Werner… - Advances in Health …, 2024 - Springer
Methods We address two objectives. First, we investigate the dependence of rater-
consistency on performance levels. We recorded videos of mock-exams and had examiners …

[HTML][HTML] Standard setting Very Short Answer Questions (VSAQs) relative to Single Best Answer Questions (SBAQs): does having access to the answers make a …

AH Sam, KR Millar, R Westacott, CR Melville… - BMC Medical …, 2022 - Springer
Background We investigated whether question format and access to the correct answers
affect the pass mark set by standard-setters on written examinations. Methods Trained …

[HTML][HTML] Exploring the use of Rasch modelling in “common content” items for multi-site and multi-year assessment

D Hope, D Kluth, M Homer, A Dewar… - Advances in Health …, 2024 - Springer
Rasch modelling is a powerful tool for evaluating item performance, measuring drift in
difficulty over time, and comparing students who sat assessments at different times or at …

Exploring the Utility and Fairness of a Multi-institutional Situational Judgment Test

KJ Smith, BN Reed, S Neely, MZ Farland… - American Journal of …, 2024 - Elsevier
Objective To pilot an SJT developed to assess empathy, teamwork, and integrity, and to
explore differences in performance between first-year (P1) and fourth-year (P4) student …

[HTML][HTML] Variation in performance on common content items at UK medical schools

D Hope, D Kluth, M Homer, A Dewar, R Fuller… - BMC Medical …, 2021 - Springer
Background Due to differing assessment systems across UK medical schools, making
meaningful cross-school comparisons on undergraduate students' performance in …

VESCA's variable precision: Determining the accuracy of adjustment for examiner differences in distributed OSCEs

P Yeates, G McCray - 2023 - researchsquare.com
Introduction: Ensuring examiner equivalence across assessment locations is a priority within
distributed Objective Structured Clinical Exams (OSCEs) but is challenging due to lack of …

Investigating the accuracy of adjusting for examiner differences in multi-centre Objective Structured Clinical Exams (OSCEs). A simulation study of Video-based …

P Yeates, G McCray - 2024 - researchsquare.com
Introduction: Ensuring examiner equivalence across distributed assessment locations is a
priority within distributed Objective Structured Clinical Exams (OSCEs) but is challenging as …

[HTML][HTML] Measuring the Effect of Using a Borderline Students' Characteristics Model on Reliability of Objective Structured Clinical Examination

RA Abed, SE Elaraby - Cureus, 2022 - ncbi.nlm.nih.gov
Defining borderline group is a crucial step when applying standard setting methods in
objective structured clinical examination (OSCE). However, it is the most challenging and …

Using an Enhancement-Focused Framework Model to Improve the Quality of High-Stakes Assessments

S Shaban, D Regmi, T AlMahmoud… - … of Assessment and …, 2020 - search.proquest.com
Producing a robust multiple-choice question examination (MCQ) for high-stakes assessment
requires significant time and effort to ensure reliability and validity. The enhancement …