Skip to main content

Table 4 Bias and mean square error of the maximum likelihood estimator for the common AC1 based on 10,000 simulations (K = 2 balanced sample size)

From: Homogeneity score test of AC1 statistics and estimation of common AC1 in multiple or stratified inter-rater agreement studies

Balanced π conditions

Unbalanced π conditions

n1 = n2

γ0

π1 = π2

Bias

MSE

n1 = n2

γ0

π1

π2

Bias

MSE

20

0.1

0.5

0.026

0.025

20

0.1

0.5

0.35

0.019

0.027

0.3

0.023

0.023

0.3

0.018

0.024

0.5

0.017

0.018

0.5

0.013

0.019

0.7

0.009

0.012

0.7

0.007

0.012

0.9

−0.011

0.003

0.9

−0.011

0.003

0.1

0.35

0.009

0.029

0.1

0.65

0.35

0.010

0.028

0.3

0.007

0.025

0.3

0.011

0.025

0.5

0.007

0.019

0.5

0.008

0.019

0.7

0.004

0.012

0.7

0.004

0.012

0.9

−0.011

0.003

0.9

−0.011

0.003

0.7

0.2

−0.007

0.012

0.7

0.5

0.2

0.001

0.012

0.9

−0.010

0.003

0.9

−0.010

0.003

80

0.1

0.5

0.007

0.006

80

0.1

0.5

0.35

0.006

0.007

0.3

0.006

0.006

0.3

0.005

0.006

0.5

0.005

0.005

0.5

0.004

0.005

0.7

0.003

0.003

0.7

0.003

0.003

0.9

0.002

0.001

0.9

0.001

0.001

0.1

0.35

0.004

0.007

0.1

0.65

0.35

0.003

0.008

0.3

0.002

0.006

0.3

0.001

0.006

0.5

0.001

0.005

0.5

0.002

0.005

0.7

0.001

0.003

0.7

0.001

0.003

0.9

0.000

0.001

0.9

0.000

0.001

0.7

0.2

−0.001

0.003

0.7

0.5

0.2

0.001

0.003

0.9

−0.001

0.001

0.9

0.001

0.001