KappaSC: A Measure of Agreement on a Single Rating Category for a Single Item or Object Rated by Multiple Raters
Kappa coefficient of agreement on a single rating category, KSC, with its associated test of statistical significance, is proposed as a measure of the interrater agreement where a single item or object is rated by multiple raters. A goodness-of-fit approach is used to test the statistical significance of all Kappasc beyond chance agreement.