Table 1 Sensitivity, specificity, and observed prevalence of implementation strength indicators for integrated community case management (iCCM) reported in mobile phone-based survey compared to in-person survey
From: Validity of using mobile phone surveys to evaluate community health worker program in Mali
iCCM indicator | Phone % (n/N) | In-person % (n/N) | Sensitivity % (95% CI) | Specificity % (95% CI) |
|---|---|---|---|---|
Training | ||||
Proportion of ASCs receiving training in the last 2 years | 99.1 (114/115) | 95.7 (110/115) | 100.0 (96.7, 100.0) | 20.0 (0.5, 71.6) |
Proportion of ASCs receiving refresher training | 87.8 (101/115) | 87.0 (100/115) | 92.0 (84.8, 96.5) | 40.0 (16.3, 67.7) |
Supervision | ||||
Proportion of ASCs supervised in the last 3 months | 79.1 (91/115) | 82.6 (95/115) | 91.6 (84.1, 96.3) | 80.0 (56.3, 94.3) |
Proportion of ASCs receiving supervision which included observation of a sick child consultation in the last 3 months | 68.7 (79/115) | 72.2 (83/115) | 72.3 (61.4, 81.6) | 40.6 (23.7, 59.4) |
Treatment supply | ||||
Proportion of ASCs with a supply of unexpired RDT on the day of the assessment | 93.0 (107/115) | 93.9 (108/115) | 97.2 (92.1, 99.4) | 71.4 (29.0, 96.3) |
Proportion of ASCs with a supply of unexpired Amoxicillin tablets/syrup on the day of the assessment | 98.3 (113/115) | 95.7 (110/115) | 100.0 (96.7, 100.0) | 40.0 (5.3, 85.3) |
Proportion of ASCs with a supply of unexpired ACT on the day of the assessment | 98.3 (113/115) | 93.0 (107/115) | 100.0 (96.6, 100.0) | 25.0 (3.2, 65.1) |
Proportion of ASCs with a supply of unexpired ORS on the day of the assessment | 74.8 (86/115) | 53.0 (61/115) | 90.2 (79.8, 96.3) | 42.6 (29.2, 56.8) |
Proportion of ASCs with a supply of unexpired zinc on the day of the assessment | 82.6 (95/115) | 83.5 (96/115) | 93.8 (86.9, 97.7) | 73.7 (48.8, 90.9) |
Proportion of ASCs with a supply of unexpired Plumpy Nut on the day of the assessment | 47.8 (55/115) | 54.8 (63/115) | 81.0 (69.1, 89.8) | 92.3 (81.5, 97.9) |
Treatment stock-outs | ||||
Proportion of ASCs reporting RDT stock-out that lasted more than 1 consecutive week in the past 3 months | 21.7 (25/115) | 17.4 (20/115) | 75.0 (50.9, 91.3) | 89.5 (81.5, 94.8) |
Proportion of ASCs reporting Amoxicillin tablets/syrup stock-out that lasted more than 1 consecutive week in the past 3 months | 7.0 (8/115) | 24.3 (28/115) | 10.7 (2.3, 28.2) | 94.3 (87.1, 98.1) |
Proportion of ASCs reporting ACT stock-out that lasted more than 1 consecutive week in the past 3 months | 10.4 (12/115) | 4.3 (5/115) | 40.0 (5.3, 85.3) | 90.9 (83.9, 95.6) |
Proportion of ASCs reporting ORS stock-out that lasted more than 1 consecutive week in the past 3 months | 16.5 (19/115) | 20.9 (24/115) | 50.0 (29.1, 70.9) | 92.3 (84.8, 96.9) |
Proportion of ASCs reporting zinc stock-out that lasted more than 1 consecutive week in the past 3 months | 17.4 (20/115) | 15.7 (18/115) | 72.2 (46.5, 90.3) | 92.8 (85.7, 97.0) |
Proportion of ASCs reporting Plumpy Nut stock-out that lasted more than 1 consecutive week in the past 3 months | 53.9 (62/115) | 50.4 (58/115) | 86.2 (74.6, 93.9) | 78.9 (66.1, 88.6) |
Reporting | ||||
Proportion of ASCs with complete patient registers for iCCM | 98.3 (113/115) | 88.7 (102/115) | 98.0 (93.1, 99.8) | 0.0 (0.0, 24.7) |