Skip to main content

Table 3 Proportion missed, workload savings, and estimated time savings for the single reviewer simulations

From: The semi-automation of title and abstract screening: a retrospective exploration of ways to leverage Abstrackr’s relevance predictions in systematic and rapid reviews

Review name

Proportion missed, single reviewer, n (%) a

Single reviewer, fully automated simulation

Single reviewer, semi-automated simulation

Proportion missed, n (%)

Workload savings, n (%)

Time savings, hours (days)

Proportion missed, n (%)

Workload savings, n (%)

Time savings, hours (days)

Systematic reviews

Biomarkers

1 (2)

6 (13)

3424 (94)

29 (4)

20 (44)

2921 (85)

24 (3)

Brain injury

2 (5)

2 (5)

12,324 (98)

103 (13)

11 (28)

10,198 (81)

85 (11)

Activity and pregnancy

11 (11)

12 (12)

5656 (97)

47 (6)

17 (17)

5337 (91)

44 (6)

Concussion

0 (0)

0 (0)

2678 (93)

22 (3)

1 (20)

2040 (71)

17 (2)

Antipsychotics

4 (3)

35 (28)

24,112 (99)

201 (25)

37 (29)

21,995 (90)

183 (23)

Digital technologies for pain

0 (0)

7 (11)

5124 (96)

43 (5)

9 (14)

4803 (90)

40 (5)

Treatments for bronchiolitis

10 (7)

7 (5)

11,522 (98)

96 (12)

7 (5)

10,866 (93)

91 (11)

VBAC

5 (24)

8 (38)

9984 (98)

83 (10)

8 (38)

8494 (83)

71 (9)

Visual acuity

0 (0)

0 (0)

22,258 (99)

185 (23)

0 (0)

18,619 (83)

155 (19)

Experience of bronchiolitis

12 (43)

8 (29)

1102 (85)

9 (1)

9 (32)

991 (76)

8 (1)

Experiences of UTIs

0 (0)

0 (0)

2786 (93)

23 (3)

0 (0)

1940 (65)

16 (2)

Rapid reviews

Preterm delivery

Not applicable

1 (3)

251 (56)

2 (< 1)

1 (3)

161 (36)

1 (< 1)

Community gardening

Not applicable

3 (9)

1336 (87)

11 (1)

3 (9)

1197 (78)

10 (1)

Depression safety

Not applicable

0 (0)

764 (79)

6 (< 1)

0 (0)

315 (41)

3 (< 1)

Depression treatments

Not applicable

25 (14)

1383 (87)

12 (1)

25 (14)

479 (30)

4 (< 1)

Patient education for cancer

Not applicable

0 (0)

2213 (92)

18 (2)

0 (0)

803 (33)

7 (< 1)

Workplace stress

Not applicable

13 (22)

567 (74)

5 (< 1)

13 (22)

357 (47)

3 (< 1)

  1. UTI urinary tract infection; VBAC vaginal birth after caesarean section
  2. aProportion missed (retrospective) had the screening been completed by the second reviewer in isolation