Table 3

Weighted Kappa values for each observer’s agreement between sessions 1 and 2

ObserverIntra-observer
weighted Kappa (95% CI)
Classification
Researcher 10.75 (0.61 to 0.90)Substantial
Researcher 20.78 (0.66 to 0.91)Substantial
Researcher 30.77 (0.66 to 0.88)Substantial
Researcher 40.87 (0.80 to 0.95)Almost perfect
Researcher 50.83 (0.72 to 0.94)Almost perfect
Researcher 60.90 (0.83 to 0.97)Almost perfect
Researcher 70.91 (0.83 to 0.98)Almost perfect
Researcher 80.90 (0.84 to 0.97)Almost perfect
Mean (SD)0.84 (0.07)Almost perfect
Clinician 10.63 (0.46 to 0.80)Substantial
Clinician 20.69 (0.50 to 0.88)Substantial
Clinician 30.83 (0.74 to 0.93)Almost perfect
Clinician 40.80 (0.68 to 0.93)Almost perfect
Clinician 50.85 (0.77 to 0.94)Almost perfect
Clinician 60.88 (0.82 to 0.95)Almost perfect
Clinician 70.88 (0.79 to 0.97)Almost perfect
Clinician 80.90 (0.83 to 0.98)Almost perfect
Mean (SD)0.81 (0.10)Almost perfect
Student 10.83 (0.74 to 0.92)Almost perfect
Student 20.82 (0.74 to 0.91)Almost perfect
Student 30.81 (0.69 to 0.92)Almost perfect
Student 40.83 (0.74 to 0.92)Almost perfect
Student 50.85 (0.77 to 0.93)Almost perfect
Student 60.88 (0.81 to 0.96)Almost perfect
Student 70.86 (0.76 to 0.97)Almost perfect
Student 80.84 (0.71 to 0.96)Almost perfect
Mean (SD)0.84 (0.02)Almost perfect
Difference in group means of weighted Kappa between two groups (95% CI)
 Researcher–clinician0.03 (−0.02 to 0.08)
 Researcher–student−0.00 (−0.04 to 0.004)
 Clinician–student−0.03 (−0.11 to 0.04)
  • Means of each group compared with paired t-tests. Classification based on Landis and Koch.14