A comparison of alternative item weighting strategies on the data gathering component of a clinical skills performance assessment
Academic Medicine, 2008•journals.lww.com
Background Checklist scores used to produce the data gathering score on the Step 2 CS
examination are currently weighted using an algorithm based on expert judgment about the
importance of the item. The present research was designed to compare this approach with
alternative weighting strategies. Method Scores from 21,140 examinees who took the United
States Medical Licensing Examination Step 2 between May 2006 and February 2007 were
subjected to five weighting models:(1) a regression weights model,(2) a factor loading …
examination are currently weighted using an algorithm based on expert judgment about the
importance of the item. The present research was designed to compare this approach with
alternative weighting strategies. Method Scores from 21,140 examinees who took the United
States Medical Licensing Examination Step 2 between May 2006 and February 2007 were
subjected to five weighting models:(1) a regression weights model,(2) a factor loading …
Abstract
Background
Checklist scores used to produce the data gathering score on the Step 2 CS examination are currently weighted using an algorithm based on expert judgment about the importance of the item. The present research was designed to compare this approach with alternative weighting strategies.
Method
Scores from 21,140 examinees who took the United States Medical Licensing Examination Step 2 between May 2006 and February 2007 were subjected to five weighting models:(1) a regression weights model,(2) a factor loading weights model,(3) a standardized response model,(4) an equal weights model, and (5) the operational expert-judgment weights model.
Results
Alternative weighting procedures may have a significant impact on the reliability and validity of checklist scores.
Conclusions
The results suggest that the current weighting procedure is useful, and the regression-based model holds promise for practical application. The regression-based model produces scores that are more reliable than those produced by the current procedure and more strongly related to the external criteria.
Lippincott Williams & Wilkins以上显示的是最相近的搜索结果。 查看全部搜索结果