Skip to main content

Table 5 Coverage rates of common γ 95% confidence intervals of the three proposed methods based on 10,000 simulations

From: Homogeneity score test of AC1 statistics and estimation of common AC1 in multiple or stratified inter-rater agreement studies

Balanced π conditionsUnbalanced π conditions
n1 = n2γ0π1 = π2SAFZPVn1 = n2γ0π1π2SAFZPV
200.10.50.9390.9590.958200.10.50.350.9390.9580.958
0.30.9360.9580.9500.30.9330.9580.955
0.50.9310.9620.9620.50.9270.9590.960
0.70.9240.9760.9630.70.9170.9710.961
0.90.9980.9630.9550.90.9970.9660.955
0.10.350.9350.9530.9560.10.650.350.9380.9550.957
0.30.9340.9550.9530.30.9340.9550.956
0.50.9260.9560.9550.50.9270.9590.955
0.70.9180.9650.9580.70.9170.9670.960
0.90.9960.9670.9470.90.9960.9690.950
0.70.20.9290.9590.9500.70.50.20.9310.9650.956
0.90.9700.9660.9110.90.9930.9700.943
500.10.50.9490.9530.952500.10.50.350.9460.9520.953
0.30.9450.9550.9540.30.9430.9520.951
0.50.9450.9540.9530.50.9410.9520.952
0.70.9360.9610.9530.70.9360.9560.953
0.90.9200.9710.9710.90.9230.9680.965
0.10.350.9420.9480.9520.10.650.350.9460.9540.954
0.30.9420.9500.9500.30.9430.9530.952
0.50.9400.9510.9510.50.9410.9540.953
0.70.9370.9540.9520.70.9360.9560.953
0.90.9260.9660.9600.90.9250.9680.960
0.70.20.9380.9490.9480.70.50.20.9370.9540.952
0.90.9270.9650.9540.90.9280.9690.960
800.10.50.9450.9520.952800.10.50.350.9460.9510.951
0.30.9470.9520.9520.30.9460.9520.952
0.50.9430.9530.9520.50.9420.9500.950
0.70.9440.9500.9490.70.9430.9550.953
0.90.9010.9620.9560.90.9220.9630.957
0.10.350.9460.9510.9510.10.650.350.9430.9470.946
0.30.9440.9490.9490.30.9450.9500.950
0.50.9440.9500.9500.50.9440.9530.952
0.70.9410.9500.9490.70.9390.9530.952
0.90.9310.9600.9530.90.9270.9630.954
0.70.20.9440.9500.9490.70.50.20.9420.9550.954
0.90.9290.9560.9510.90.9270.9610.955
  1. SA, FZ, and PV refer to 95% confidence intervals for common AC1 using the simple asymptotic, Fisher’s Z transformation, and profile variance methods, respectively