Table 4 Pairwise inter-rater reliability of AMSTAR and R-AMSTAR
From: Inter-rater reliability of AMSTAR is dependent on the pair of reviewers
AMSTAR | R-AMSTAR | |||
|---|---|---|---|---|
Pair of reviewers | Cohens κ | Holsti’s r | Cohens κ | Holsti’s r |
1&2 | 0.55 | 0.87 | 0.37 | 0.81 |
1&3 | 0.56 | 0.82 | 0.45 | 0.84 |
1&4 | 0.47 | 0.86 | 0.46 | 0.84 |
1&5 | 0.41 | 0.82 | 0.32 | 0.77 |
2&3 | 0.52 | 0.89 | 0.49 | 0.83 |
2&4 | 0.69 | 0.98 | 0.67 | 0.89 |
2&5 | 0.50 | 0.88 | 0.39 | 0.82 |
3&4 | 0.53 | 0.89 | 0.67 | 0.87 |
3&5 | 0.43 | 0.83 | 0.44 | 0.80 |
4&5 | 0.52 | 0.88 | 0.45 | 0.81 |
min | 0.41 | 0.82 | 0.32 | 0.77 |
max | 0.69 | 0.98 | 0.67 | 0.89 |
mean | 0.52 | 0.87 | 0.47 | 0.83 |
median | 0.52 | 0.88 | 0.45 | 0.82 |