Skip to main content

Table 1 A category (C) by difficulty (df) by skew (sk) - reconstructed experimenta

From: Interrater reliability estimators tested against true interrater reliabilities

Across: Distribution & Skew (sk)

50&50

sk = 0.5

25&75, 75&25

sk = 0.75

1&99, 99&1

sk = 0.99

Across: Category (C)

2

4

6

8

2

4

6

8

2

4

6

8

difference in pixels (px)

Difficulty

df = (8-px)/7

1

=1.000

4

4

4

4

4

4

4

4

4

4

4

4

2

≈0.8571

4

4

4

4

4

4

4

4

4

4

4

4

3

≈0.7143

4

4

4

4

4

4

4

4

4

4

4

4

4

≈0.5714

4

4

4

4

4

4

4

4

4

4

4

4

5

≈0.4286

4

4

4

4

4

4

4

4

4

4

4

4

6

≈0.2857

4

4

4

4

4

4

4

4

4

4

4

4

7

≈01429

4

4

4

4

4

4

4

4

4

4

4

4

8

=0.0000

4

4

4

4

4

4

4

4

4

4

4

4

  1. aMain cell entries are number of reconstructed rating sessions (subjects) in each experimental condition (cell)