Table 5 Comparison of performance of the different criteria with regards the probability and the opportunity cost associated with adopting a treatment that does not have highest true NMB. The values shown in bold represent the most favourable of all criteria for this measure
From: Which interactions matter in economic evaluations? A systematic review and simulation study
Criterion | Proportion of samples in which interactions are included: % (n)a | Sensitivity: proportion of any non-zero interactions taken into account: % (n)b | Specificity: proportion of interactions equal to 0 that are excluded: % (n)c | Mean opportunity cost of adopting a suboptimal treatment | Probability of adopting treatment with highest NMB |
|---|---|---|---|---|---|
1: Always include all interactions | 100.00% (21,600) | 100.00% (14,400) | 0.00% (0) | £472 | 81.70% |
2: Never include any interactions | 0.00% (0) | 0.00% (0) | 100.00% (7200) | £793 | 76.60% |
3: Include interactions where p < 0.05 | 34.44% (7439) | 46.59% (6709) | 89.86% (6470) | £556 | 80.61% |
4: Include interactions where p < 0.10 | 44.86% (9689) | 56.87% (8189) | 79.17% (5700) | £515 | 81.32% |
5: Include interactions where p < 0.25 | 68.45% (14,785) | 77.18% (11,114) | 49.01% (3529) | £491 | 81.58% |
6: Include interactions decreasing AIC | 40.74% (8800) | 52.91% (7619) | 83.60% (6019) | £529 | 81.11% |
7: Include interactions decreasing BIC | 19.79% (4275) | 28.88% (4158) | 98.38% (7083) | £646 | 78.32% |
8: Include qualitative interactions in cost or benefits | 42.02% (9076) | 47.54% (6846) | 69.03% (4970) | £503 | 81.71% |
9: Include interactions for cost or benefits if >simple effect | 56.04% (12,104) | 63.77% (9183) | 59.43% (4279) | £474 | 83.31% |
10: Include interactions for cost or benefits if p < 0.05 or > simple effect | 61.78% (13,344) | 71.42% (10,285) | 57.51% (4141) | £475 | 83.14% |
11: Include qualitative interactions for cost, benefits or NMB | 57.01% (12,314) | 60.76% (8749) | 50.49% (3635) | £480 | 81.21% |
12: Include interactions for cost, benefit or NMB if >simple effect | 67.85% (14,656) | 73.40% (10,569) | 43.24% (3113) | £475 | 81.55% |
13: Include interactions ≥0.25 or ≥ £250 | 31.92% (6894) | 37.02% (5331) | 78.29% (5637) | £472 | 81.22% |
14: Include interactions ≥0.5 or ≥ £500 | 21.73% (4694) | 24.69% (3555) | 84.18% (6061) | £476 | 82.33% |
15: Include interactions ≥1 or ≥ £1000 | 16.65% (3596) | 18.51% (2666) | 87.08% (6270) | £488 | 82.01% |