Skip to main content

Table 2 Agreement and disagreement in choice of systematic review(s) in replicated Jadad assessments

From: How can clinicians choose between conflicting and discordant systematic reviews? A replication study of the Jadad algorithm

First Author Year

Jadad assessment primary outcome

Jadad assessment primary intervention

# MAs of RCTs

Discordant Review authors’ or our Jadad assessments

Jadad final decision step

SR(s) chosen

Tool used by the Discordant Review authors to assess the quality of SRs (judgment if AMSTAR used)

Cochrane or non-Cochrane SR

ROBIS assessment

Bakdach 2020

Incidence of white spot lesions

Topical fluoride toothpaste, brush on gel and/or foam

3

Discordant Review authors

Step I

Sardana 2018

AMSTAR-2 (Moderate quality)

Non-Cochrane

Low risk

    

Our Choice

Step I

Tasios 2019

(and Sardana 2019)

AMSTAR-2

(Critically low quality)

Non-Cochrane

Low risk

Chalmers 2015

Rate of recurrence

Arthroscopic surgery

2

Discordant Review authors

Step I

Pulavarti 2007

Oxman-Guyatt

Cochrane

Low risk

    

Our Choice

Step H

Lenters 2007

(and Pulavarti 2007)

 

Non-Cochrane

Low risk

Bolland 2014

Hip fracture

Vitamin D +/- calcium versus placebo

4

Discordant Review authors

NR

Avenell 2009

AMSTAR

(High quality)

Cochrane

High risk

    

Our Choice

Step H

Avenell 2009

   

Grassi 2018

Re-operation rate

Patellar resurfacing versus non-resurfacing

5

Discordant Review authors

Step I

He 2011

AMSTAR

(High quality)

Non-Cochrane

Low risk

    

Our Choice

Step H

He 2011

   

Erikson 2015

Patellar instability

Operative versus non-operative treatment

2

Discordant Review authors

NR

Hing 2011

Oxman-Guyatt

Cochrane

Low risk

    

Our Choice

Step H

Hing 2011

   

Chen 2019

Pain using WOMAC total score

PRP injection

4

Discordant Review authors

Step I

Shen 2017

Oxman-Guyatt

Non-Cochrane

Low risk

    

Our Choice

Step H

Dai et al. 2017

 

Non-Cochrane

Low risk

Song 2016

Bile duct injury

Early versus delayed laparoscopic cholecystectomy

6

Discordant Review authors

Step H

Cao 2015

AMSTAR

(High quality)

Non-Cochrane

High risk

    

Discordant Review authors

Step H

Wu 2015

(High quality)

Non-Cochrane

Low risk

    

Our Choice

Step H

Gurusamy 2013

(Highest quality)

Cochrane

Low risk

Chen 2018

Short term VAS

Unilateral PKP versus bilateral PKP

5

Discordant Review authors

Step I

Feng 2015

AMSTAR

(High quality)

Non-Cochrane

High risk

    

Our Choice

Step I

Feng 2015

(High quality)

  

Xu 2017

Non-union

Intramedullary fixation versus plate fixation

5

Discordant Review authors

Step H

Lenza 2015 and Hussain 2016

AMSTAR

(Highest and High quality)

Cochrane and Non-Cochrane

Low and High

    

Our Choice

Step H

Lenza 2015 and Hussain 2016

(Highest and High quality)

 

Low and High risk

Zhao 2015a

Constant score

Surgical versus conservative treatment

3

Discordant Review authors

Step H

Lenza 2013

AMSTAR

(High quality)

Cochrane

Low risk

    

Our Choice

Step H

Lenza 2013

(High quality)

  

Tan 2018

Short-term VAS score

Unilateral versus bilateral percutaneous balloon

6

Discordant Review authors

Step H

Feng 2015

AMSTAR

(High quality)

Non-Cochrane

Low risk

    

Our Choice

Step H

Lin 2013

(High quality)

Non-Cochrane

High risk

Poolman 2007

Stability

Hamstring versus bone-patellar tendon-bone autograft

3

Discordant Review authors

Step F

Biau 2006

Oxman-Guyatt

Non-Cochrane

Low risk

    

Our Choice

Step H

Biau 2006

   

Mascarenhas 2014

Constant score

Single versus double row rotator cuff repair

3

Discordant Review authors

Step I

Millett 2014

Oxman-Guyatt

Non-Cochrane

Low risk

    

Our Choice

Step H

Sheibani-Rad 2013

 

Non-Cochrane

High risk

Xing 2016

Early and late knee pain

Hyaluronic acid versus placebo

10

Discordant Review authors

Step I

Bellamy 2006

AMSTAR

(Highest quality)

Cochrane

High risk

    

Our Choice

Step H

Richette 2015

(and Bellamy 2006)

(High quality)

Non-Cochrane

High risk

Mascarenas 2015

Pivot-shift test score

Single row versus double row rotator cuff repair techniques

6

Discordant Review authors

Step I

Li 2014, van Eck 2012 and Tiamklang 2012

Oxman-Guyatt

Non-Cochrane, Cochrane, and Non-Cochrane

Low, Low and Low risk

    

Our Choice

Step H

Li 2014, van Eck 2012 and Tiamklang 2012

   

Guo 2018

Disease control

Shenyi capsule and chemo versus chemo alone

4

Discordant Review authors

Step I

Xia 2014

AMSTAR

(Moderate quality)

Non-Cochrane

High risk

    

Our Choice

Step H

Hu 2011

(Low quality)

Non-Cochrane

Low risk

Houck 2017

Range of motion

Early versus delayed motion rehabilitation

5

Discordant Review authors

Step I

Riboh 2014

Oxman-Guyatt

Non-Cochrane

Low risk

    

Our Choice

Step H

Chan 2014

 

Non-Cochrane

High risk

Pekala 2019

Inter-vertebral disc degeneration

Fokl polymorphism

7

Discordant Review authors

Step I

Pabalan 2016

AMSTAR

(Moderate quality)

Non-Cochrane

High risk

    

Our Choice

Step I

Nong 2016

(and Pabalan 2016)

(Moderate quality)

Non-Cochrane

Low risk

Zhiyong 2019

Short term VAS scores

Unilateral versus bilateral balloon kyphoplasty

6

Discordant Review authors

Step I

Sun et al. 2016

AMSTAR

(Moderate quality)

Non-Cochrane

Low risk

    

Our Choice

Step I

Feng 2015

(Moderate quality)

Non-Cochrane

Low risk

Fu 2019

Function

Surgical versus non-surgical treatment

4

Discordant Review authors

Step H

Rabi et al. 2015

AMSTAR

(High quality)

Non-Cochrane

High risk

    

Our Choice

Step H

Handoll 2012

(Highest quality)

Cochrane

Low risk

Zhao 2015b

Non-union

Plate fixation

4

Discordant Review authors

Step I

Ouyang 2013

AMSTAR

(Moderate quality)

Non-Cochrane

Low risk

    

Our Choice

Step H

Heineman 2010

(Moderate quality)

Non-Cochrane

Low risk

  1. AMSTAR: A MeaSurement Tool to Assess systematic Reviews; Oxman-Guyatt: Oxman-Guyatt quality assessment questionnaire; PKP: Percutaneous balloon kyphoplasty; PRP: platelet-rich plasma; ROBIS: Risk of Bias Assessment Tool for Systematic Reviews