From: Interrater reliability estimators tested against true interrater reliabilities
Across: Distribution & Skew (sk) | 50&50 sk = 0.5 | 25&75, 75&25 sk = 0.75 | 1&99, 99&1 sk = 0.99 | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Across: Category (C) | 2 | 4 | 6 | 8 | 2 | 4 | 6 | 8 | 2 | 4 | 6 | 8 | |
difference in pixels (px) | Difficulty df = (8-px)/7 | ||||||||||||
1 | =1.000 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 |
2 | ≈0.8571 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 |
3 | ≈0.7143 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 |
4 | ≈0.5714 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 |
5 | ≈0.4286 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 |
6 | ≈0.2857 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 |
7 | ≈01429 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 |
8 | =0.0000 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 |