Skip to main content

Table 1 Arm descriptions

From: Automating risk of bias assessment in systematic reviews: a real-time mixed methods comparison of human researchers to a machine learning system

Procedure RR-EPPI arm RR-web arm
Setting up the study Project leader:
- uploaded study files to EPPI-Reviewer
- ran RobotReviewer by clicking a button
Project leader:
- uploaded study files into RobotReviewer’s website
- ran RobotReviewer by clicking a button
- downloaded the resulting documents with automated assessments
- transferred each document (one per study) to a shorter document with instructions
- made the documents available to reviewer pairs
Individual risk of bias assessments (2 reviewers per study) Researchers assessed risk of bias in EPPI Reviewer. Researchers wrote their risk of bias assessments into their own copy of the document.
Coming to a consensus Conducted within the EPPI Reviewer software Researchers produced a new document