Skip to main content

Table 3 Empirical power of homogeneity tests based on 10,000 simulations (K = 2 balanced sample size)

From: Homogeneity score test of AC1 statistics and estimation of common AC1 in multiple or stratified inter-rater agreement studies

Balanced π conditions

Unbalanced π conditions

n1 = n2

γ1

γ2

π1 = π2

SCORE

GOF

n1 = n2

γ1

γ2

π1

π2

SCORE

GOF

20

0.1

0.5

0.5

0.243

0.290

20

0.1

0.5

0.5

0.35

0.234

0.304

0.3

0.6

0.173

0.202

0.3

0.6

0.168

0.224

0.3

0.7

0.294

0.323

0.3

0.7

0.293

0.351

0.5

0.8

0.212

0.232

0.5

0.8

0.216

0.258

0.5

0.9

0.372

0.396

0.5

0.9

0.389

0.430

0.1

0.5

0.35

0.245

0.357

0.1

0.5

0.65

0.35

0.243

0.355

0.3

0.6

0.185

0.279

0.3

0.6

0.171

0.266

0.3

0.7

0.313

0.408

0.3

0.7

0.296

0.398

0.5

0.8

0.227

0.295

0.5

0.8

0.221

0.291

0.5

0.9

0.396

0.483

0.5

0.9

0.394

0.475

0.5

0.8

0.2

0.270

0.411

0.5

0.8

0.5

0.2

0.230

0.278

0.5

0.9

0.482

0.616

0.5

0.9

0.435

0.473

50

0.1

0.5

0.5

0.538

0.562

50

0.1

0.5

0.5

0.35

0.525

0.595

0.3

0.6

0.377

0.396

0.3

0.6

0.369

0.428

0.3

0.7

0.635

0.651

0.3

0.7

0.630

0.673

0.5

0.8

0.512

0.525

0.5

0.8

0.517

0.548

0.5

0.9

0.835

0.841

0.5

0.9

0.843

0.855

0.1

0.5

0.35

0.509

0.652

0.1

0.5

0.65

0.35

0.503

0.648

0.3

0.6

0.379

0.485

0.3

0.6

0.364

0.470

0.3

0.7

0.633

0.718

0.3

0.7

0.618

0.711

0.5

0.8

0.518

0.585

0.5

0.8

0.516

0.581

0.5

0.9

0.844

0.877

0.5

0.9

0.838

0.874

0.5

0.8

0.2

0.552

0.711

0.5

0.8

0.5

0.2

0.531

0.598

0.5

0.9

0.878

0.915

0.5

0.9

0.861

0.863

80

0.1

0.5

0.5

0.757

0.768

80

0.1

0.5

0.5

0.35

0.732

0.786

0.3

0.6

0.568

0.578

0.3

0.6

0.545

0.596

0.3

0.7

0.841

0.847

0.3

0.7

0.833

0.858

0.5

0.8

0.716

0.722

0.5

0.8

0.717

0.741

0.5

0.9

0.967

0.968

0.5

0.9

0.966

0.970

0.1

0.5

0.35

0.707

0.819

0.1

0.5

0.65

0.35

0.707

0.816

0.3

0.6

0.538

0.645

0.3

0.6

0.541

0.644

0.3

0.7

0.826

0.879

0.3

0.7

0.822

0.884

0.5

0.8

0.717

0.767

0.5

0.8

0.715

0.764

0.5

0.9

0.963

0.973

0.5

0.9

0.965

0.974

0.5

0.8

0.2

0.746

0.872

0.5

0.8

0.5

0.2

0.734

0.787

0.5

0.9

0.976

0.982

0.5

0.9

0.974

0.970