Validity and reliability of a performance evaluation tool based on the modified Barthel Index for stroke patients

Table 4 Inter-rater reliability of video evaluation

Primary outcome (PET-MBI total score)
	Variance σ_s ² of the subject effect	Variance σ_r ² of the rater effect		Variance σ_E ² of the error	Intraclass correlation coefficient (Fleiss’ ICC)		Lower limit of the 95% CI
Session 1	742.81	1.47		8.42	0.99		0.98
Session 2	732.19	3.65		7.67	0.99		0.97
Secondary outcome (PET-MBI, mean κ coefficient, mean agreement rate)
	Session 1				Session 2
	κ_w	κ	P_Ow	P_O	κ_w	κ	P_Ow	P_O
Personal Hygiene	0.77	0.61	0.92	0.71	0.79	0.64	0.93	0.74
Self-bathing	0.80	0.70	0.94	0.81	0.74	0.64	0.92	0.75
Feeding	0.90	0.83	0.97	0.88	0.86	0.80	0.96	0.86
Using the Toilet	0.84	0.74	0.94	0.79	0.82	0.71	0.93	0.77
Stair Climbing	0.89	0.83	0.97	0.90	0.88	0.82	0.97	0.89
Getting dressed	0.87	0.69	0.94	0.75	0.84	0.63	0.93	0.70
Bowel Control	0.93	0.86	0.97	0.90	0.90	0.84	0.96	0.88
Bladder Control	0.94	0.89	0.97	0.92	0.93	0.89	0.97	0.92
Chair/Bed Transfer	0.85	0.77	0.95	0.82	0.86	0.78	0.95	0.84
Ambulation	0.91	0.74	0.97	0.79	0.95	0.79	0.98	0.82

κ _w Weighted κ coefficient (linear weights), κ κ coefficient, P _Ow Weighted agreement rate (linear weights), P _O Agreement rate

ISSN: 1471-2288