Table 6 The mean and middle 95% (2.5% quantile, 97.5% quantile) of the accuracy of the test as measured by the proportion of testing dataset observations correctly predicted when targeting a specificity of 0.995. The method(s) with highest accuracy in each scenario or equivalent after rounding are bolded
Scenario A | Scenario B | |||||||
|---|---|---|---|---|---|---|---|---|
n=50 | n=200 | n=50 | n=200 | |||||
Prevalence=0.05 | ||||||||
Empirical | 0.96 | (0.93, 0.97) | 0.96 | (0.95, 0.97) | 0.97 | (0.93, 0.99) | 0.98 | (0.96, 0.99) |
Normal | 0.95 | (0.91, 0.97) | 0.96 | (0.93, 0.97) | 0.97 | (0.90, 0.99) | 0.98 | (0.95, 0.99) |
Log Normal | 0.96 | (0.93, 0.97) | 0.96 | (0.94, 0.97) | 0.97 | (0.93, 0.99) | 0.98 | (0.96, 0.99) |
MAD | 0.90 | (0.84, 0.95) | 0.91 | (0.87, 0.94) | 0.86 | (0.78, 0.93) | 0.86 | (0.81, 0.90) |
Log MAD | 0.94 | (0.89, 0.97) | 0.95 | (0.92, 0.97) | 0.92 | (0.83, 0.98) | 0.93 | (0.87, 0.97) |
Pareto 0.9 | 0.96 | (0.94, 0.97) | 0.96 | (0.95, 0.97) | 0.98 | (0.95, 0.99) | 0.99 | (0.97, 1.00) |
Pareto 0.95 | 0.96 | (0.93, 0.97) | 0.96 | (0.95, 0.97) | 0.98 | (0.94, 0.99) | 0.98 | (0.96, 0.99) |
Hybrid Empirical | 0.96 | (0.93, 0.97) | 0.96 | (0.95, 0.97) | 0.97 | (0.93, 0.99) | 0.98 | (0.96, 0.99) |
Hybrid Pareto 0.9 | 0.96 | (0.93, 0.97) | 0.96 | (0.95, 0.97) | 0.98 | (0.94, 0.99) | 0.99 | (0.97, 1.00) |
Hybrid Pareto 0.95 | 0.96 | (0.93, 0.97) | 0.96 | (0.95, 0.97) | 0.98 | (0.94, 0.99) | 0.98 | (0.96, 0.99) |
Prevalence=0.30 | ||||||||
Empirical | 0.85 | (0.73, 0.95) | 0.81 | (0.73, 0.89) | 0.95 | (0.74, 0.99) | 0.94 | (0.77, 0.99) |
Normal | 0.91 | (0.81, 0.96) | 0.91 | (0.84, 0.96) | 0.96 | (0.90, 0.99) | 0.97 | (0.94, 0.99) |
Log Normal | 0.88 | (0.78, 0.96) | 0.87 | (0.81, 0.94) | 0.97 | (0.94, 0.99) | 0.98 | (0.96, 0.99) |
MAD | 0.93 | (0.88, 0.96) | 0.93 | (0.90, 0.95) | 0.89 | (0.84, 0.95) | 0.90 | (0.86, 0.93) |
Log MAD | 0.92 | (0.82, 0.96) | 0.94 | (0.88, 0.96) | 0.94 | (0.87, 0.98) | 0.94 | (0.90, 0.98) |
Pareto 0.9 | 0.81 | (0.71, 0.95) | 0.79 | (0.73, 0.86) | 0.95 | (0.74, 0.99) | 0.96 | (0.87, 0.99) |
Pareto 0.95 | 0.82 | (0.71, 0.95) | 0.79 | (0.73, 0.86) | 0.94 | (0.72, 0.99) | 0.94 | (0.78, 0.99) |
Hybrid Empirical | 0.85 | (0.73, 0.95) | 0.81 | (0.73, 0.89) | 0.95 | (0.74, 0.99) | 0.94 | (0.77, 0.99) |
Hybrid Pareto 0.9 | 0.82 | (0.71, 0.95) | 0.79 | (0.73, 0.86) | 0.95 | (0.74, 0.99) | 0.96 | (0.87, 0.99) |
Hybrid Pareto 0.95 | 0.83 | (0.71, 0.95) | 0.79 | (0.73, 0.86) | 0.94 | (0.72, 0.99) | 0.94 | (0.78, 0.99) |