查看文章

The commonly used form of r_{wg. (J)} can display irregular behavior, so four variants of this index were examined. An alternative index, r*_{wg. J}, is recommended. This index is an inverse linear function of the ratio of the average obtained variance to the variance of uniformly distributed random error. r*_wg.Jis superficially similar to Cronbach’s α, but careful examination confirms that r*_wg.Jis an index of agreement, not reliability. Based on an examination of the small-sample behavior of r_wgand r*_wg.J, sample sizes of 10 or more raters are recommended.