Skip to main content

Table 2 Study results

From: An evaluation of DistillerSR’s machine learning-based prioritization tool for title/abstract screening – impact on reviewer-relevant outcomes

Project

Project details a

Iteration details

# of records needed to screen to achieve true recall @ 95% b

Title/abstract includes not yet identified

Hours saved at title/abstract b c

Final included studies missed

Mean (%) [SD]; Median (range)

Hot flashes

2569; 451 (17.6%); 38 (1.48%)

51 records; 17 or 18 iterations

892.5 (34.7%) [26.9]; 892.5 (867–918)

19.2 (4.3%) [2.04]; 19 (15–22)

27.9 [0.45]; 27.9 (27.5–28.4)

0

Opioid use disorder

16,282; 984 (6.0%); 71 (0.44%)

200 records; 23 or 23 iterations

4480 (27.5%) [103.3]; 4400 (4400–4600)

46.1 (4.7%) [3.38]; 48 (41–49)

196.7 [1.72]; 198.0 (194.7–198.0)

0

Meniere’s disease

2889; 332 (11.5%); 23 (0.80%)

57 records; 19–22 iterations

1168.5 (40.5%) [55.4]; 1140 (1083–1254)

15.0 (4.5%) [1.33]; 15.5 (12–16)

28.7 [0.92]; 29.2 (27.3–30.1)

0

Non-small cell lung cancer

3145; 795 (25.3%); 13 (0.40%)

62 records; 29 or 30 iterations

1829 (58.2%) [0.01]; 1829 (1798–1860)

33.7 (4.2%) [3.53]; 32.5 (29–39)

21.9 [0.54]; 21.9 (21.4–22.5)

0

Prophylaxis for influenza

8278; 395 (4.8%); 104 (1.26%)

165 records; 18 or 19 iterations

3019.5 (36.5%) [79.7]; 2970 (2970–3135)

18.8 (4.8%) [0.42]; 19 (18–19)

87.6 [1.33]; 88.5 (85.7–88.5)

0

Smoking cessation

2250; 881 (39.2%); 14 (0.62%)

45 records; 35 iterations

1575 (70.0%) [0]; 1575 (0)

39.9 (4.5%) [2.60]; 40 (34–44)

11.3 [0]; 11.3 (0)

0

Asthma/ Urticaria

3265; 482 (14.8%); 12 (0.36%)

65 records; 22 or 23 iterations

1488.5 (45.6%) [20.55]; 1495 (1430–1495)

22.5 (4.7%) [1.51]; 23 (20–24)

29.6 [0.34]; 29.5 (29.5–30.6)

0

Depression screening

4174; 126 (3.0%); 1 (0.02%)

83 records; 23–26 iterations

2025 (48.5%) [70]; 1992 (1909–2158)

5.8 (4.6%) [0.42]; 6 (5–6)

35.8 [1.17]; 36.4 (33.6–37.8)

0

Prophylaxis for HIV

4502; 1184 (26.4%); 46 (1.02%)

90 records; 30 iterations

2700 (60.0%) [0]; 2700 (0)

53.7 (4.5%) [1.49]; 53.5 (52–56)

30.0 [0]; 30.0 (0)

0

SSBs

22,309; 4993 (22.4%); 127 (0.57%)

200 records; 64 iterations

12,800 (57.4%) [0]; 12800 (0)

242.7 (4.9%) [2.06]; 243 (238–246)

158.5 [0]; 158.5 (0)

0

  1. HIV Human immunodeficiency virus, SD Standard deviation, SSB Sugar sweetened beverage
  2. a Total number of records; Number of includes at title/abstract (% of all records); Number of included studies in the SR (% of all records)
  3. b Where there was no SD or range, this is identified by a 0
  4. c Hours saved at title/abstract = [(Total records - # of records needed to screen to identify 95% of includes)/60
Back to article page

BMC Medical Research Methodology

ISSN: 1471-2288

Contact us