Skip to main content

Advertisement

Table 4 Combined estimates of κ w with different weighting schemes

From: Inter-rater reliability of the QuIS as an assessment of the quality of staff-inpatient interactions

Weighting scheme \( {\widehat{\upkappa}}_{w\ collapsed} \) (95% CI) \( {\widehat{\upkappa}}_{w\ fixed} \) (95% CI) χ 2 heterogeneity \( {\widehat{\upkappa}}_{w\ random} \) (95% CI) \( {\widehat{\upkappa}}_{w\ averaged} \) (95% CI)
Unweighted 0.55 (0.49, 0.62) 0.52 (0.45, 0.59) 21.20 0.53 (0.45, 0.60) 0.57 (0.48, 0.65)
Linear 0.58 (0.51, 0.65) 0.52 (0.45, 0.59) 35.67 0.56 (0.46, 0.66) 0.59 (0.51, 0.68)
Quadratic 0.61 (0.50, 0.71) 0.53 (0.44, 0.62) 38.71 0.59 (0.45, 0.74) 0.63 (0.52, 0.73)
A1 0.64 (0.56, 0.73) 0.51 (0.43, 0.59) 47.15 0.62 (0.48, 0.77) 0.66 (0.57, 0.75)
A2 0.62 (0.54, 0.70) 0.50 (0.43, 0.57) 45.75 0.60 (0.47, 0.73) 0.64 (0.54, 0.73)
A3 0.60 (0.53, 0.68) 0.51 (0.44, 0.58) 39.28 0.58 (0.47, 0.69) 0.62 (0.53, 0.71)
A4 0.60 (0.53, 0.67) 0.51 (0.44, 0.58) 36.04 0.57 (0.47, 0.68) 0.61 (0.52, 0.70)
A5 0.59 (0.52, 0.66) 0.52 (0.45, 0.59) 33.22 0.56 (0.46, 0.67) 0.60 (0.52, 0.69)
A6 0.58 (0.51, 0.64) 0.52 (0.45, 0.59) 29.10 0.55 (0.46, 0.64) 0.59 (0.51, 0.67)
B1 0.59 (0.53, 0.66) 0.53 (0.46, 0.59) 30.52 0.56 (0.47, 0.66) 0.60 (0.52, 0.69)
B2 0.58 (0.51, 0.65) 0.53 (0.46, 0.59) 26.01 0.55 (0.46, 0.64) 0.59 (0.51, 0.67)
B3 0.59 (0.53, 0.66) 0.53 (0.47, 0.60) 25.11 0.55 (0.47, 0.64) 0.60 (0.51, 0.68)
C1 0.58 (0.51, 0.65) 0.53 (0.46, 0.59) 26.05 0.55 (0.46, 0.64) 0.59 (0.51, 0.67)
C2 0.58 (0.51, 0.65) 0.52 (0.45, 0.59) 28.82 0.55 (0.46, 0.65) 0.60 (0.51, 0.68)
C3 0.58 (0.51, 0.65) 0.52 (0.45, 0.59) 31.26 0.56 (0.46, 0.66) 0.60 (0.51, 0.68)
min-max \( {\widehat{\upkappa}}_w \) across weighting schemes 0.55–0.64 0.50–0.53 χ 17 2 (0.95) =27.59 0.53–0.62 0.57–0.66