From: The impact of grey zones on the accuracy of agreement measures for ordinal tables
Rater A
Rater B
Total
1
2
...
q
m11
m12
m1q
m1+
m21
m22
m2q
m2+
mq1
mq2
mqq
mq+
m+1
m+2
m+q
N=m++