Skip to main content

Table 5 AGREE II overall assessment of CPGs assessed by at least three appraisals

From: More than one third of clinical practice guidelines on low back pain overlap in AGREE II appraisals. Research wasted?

APPRAISAL AUTHOR

OA1

VARIABILITY OA1

VARIABILITY OA1

OA2

AGREEMENT OA2

QUALITY RATING

AGREEMENT QUALITY RATING

(0-100 scale)

(1-7 scale)

Median (Q1-Q3)

Median (Q1-Q3)

NICE 2016 [63]

 Castellini 2020 [27] 

95,83

88 (83-92.4)

6 (5.5-7)

Yes

Heterogeneity of reporting

 

Perfect agreement

 Corp 2021 [28]

83

Yes

 

 Doniselli 2018 [29]

83

Yes (3 raters); Maybe (1 rater)a

 

 Krenn 2020 [33]

7

 

High

 Lin 2020 [34]

89

 

High

 Meroni 2019 [17]

88

  

 Ng 2021 [35]

6ab

Yes (1 rater); Yes with modifications (1 rater)a

 

 Rathbone 2020 [37]

5,5

Yesa

High

 Stander 2020 [38]

   

ACP 2017 [47]

 Castellini 2020 [27]

75

77 (68.3-82)

5 (5-5.5)

Yes

Heterogeneity of reporting

 

No agreement

 Doniselli 2018 [29]

79

Yes (2 raters); Maybe (1 rater)a

 

 Krenn 2020 [33]

5

 

Moderate

 Lin 2020 [34]

83

 

Low

 Meroni 2019 [17]

66

  

 Ng 2021 [35]

5,5ab

Yes with modificationsa

 

 Rathbone 2020 [37]

5

Yes with modificationsa

Average

 Stander 2020 [38]

   

APS 2009 [65]

 Acevedo 2016 [25]

6

na

5.6 (5.1-6.0)

Yes

No agreement

 

Perfect agreement

 Anderson 2021 [26]

5,9

 

Satisfactory

 Ng 2021 [35]

5ab

Yes with modificationsa

 

 Wong 2016 [39]

  

High

 Hoydonckx 2020 [32]

5,33

  

APTA 2012 [56]

 Doniselli 2018 [29]

67

55 (44-67)

4.8

Yes (2 raters); No (2 raters)a

Heterogeneity of reporting

 

Perfect agreement

 Franz 2015 [31]

   

 Lin 2020 [34]

44

 

Low

 Meroni 2019 [17]

55

  

 Ng 2021 [35]

5ab

Yes with modificationsa

 

 Rathbone 2020 [37]

4,5

Yes with modificationsa

Low

 Wong 2016 [39]

  

Low

 Nordin 2018 [36]

   

KCE 2017 [43]

 Castellini 2020 [27]

83,33

83.3 (61-100)

5 (4.5-6)

Yes

No agreement

 

No agreement

 Corp 2021 [28]

100

Yes

High

 Krenn 2020 [33]

4,5

 

Moderate

 Lin 2020 [34]

61

 

High

 Ng 2021 [35]

5ab

Yes with modificationsa

 

 Rathbone 2020 [37]

6

Yesa

High

CCGPP 2016 [55]

 Castellini 2020 [27]

29,17

44 (29.2-47)

na

No

Heterogeneity of reporting

 

Perfect agreement

 Lin 2020 [34]

44

 

High

 Meroni 2019 [17]

47

  

 Ng 2021 [35]

4,5ab

Yes with modificationsa

 

 Rathbone 2020 [37]

5,5

Yes (1 rater); Yes with modifications (1 rater)a

High

ASIPP 2013 [49]

 Acevedo 2016 [25]

5

 

5.6 (5-5.6)

No

Heterogeneity of reporting

 

No agreement

 Anderson 2021 [27]

5,6

 

Not satisfactory

 Hoydinckx 2020 [33]

5,66

Yes (1 rater); Yes with modifications (1 rater); No (1 rater)

 

 Nordin 2018 [36]

75a

Yesa

High

CAAM 2016 [42]

 Castellini 2020 [27]

45,8

na

na

No

No agreement

 

na

 Ng 2021 [35]

4ab

Yes with modificationsa

 

 Rathbone 2020 [37]

2,5

Yes with modificationsa

Low

CCGI 2018 [60]

 Castellini 2020 [27]

87,5

na

na

Yes

Heterogeneity of reporting

 

Perfect agreement

 Krenn 2020 [33]

6

 

High

 Rathbone 2020 [37]

6

Yes (1 rater); Yes with modifications (1 rater)a

High

Cheng 2012 [59]

 Lin 2020 [34]

17

na

na

 

Perfect agreement

Low

Perfect agreement

 Ng 2021 [35]

4ab

Yes with modificationsa

 

 Rathbone 2020 [37]

4

Yes with modificationsa

Low

DAI 2017 [58]

 Meroni 2019 [17]

80

na

na

 

Perfect agreement

Excellent

No agreement

 Ng 2021 [35]

4ab

Yes with modificationsa

 

 Rathbone 2020 [37]

3

Yes with modificationsa

Low

DHA 2017 [45]

 Doniselli 2018 [30]

92

na

na

Yes (3 raters); Maybe (1 rater)a

Heterogeneity of reporting

 

No agreement

 Lin 2020 [34]

67

 

High

 Rathbone 2020 [37]

4,5

Yes with modificationsa

Average

ICSI 2012 [54]

 Doniselli 2018 [30]

79

na

na

Yes (2 raters); Maybe (2 raters)a

Heterogeneity of reporting

 

na

 Lin 2020 [34]

56

 

Low

 Ng 2021 [35]

4,5ab

Yes with modificationsa

 

ICSI 2018 [44]

 Castellini 2020 [27]

62,5

  

Yes, with modifications

No agreement

 

Perfect agreement

 Krenn 2020 [33]

5,5

na

na

 

Moderate

 Rathbone 2020 [37]

5,5

  

Yesa

Average

KNGF 2013 [46]

 Franz 2015 [31]

 

na

na

 

Perfect agreement

 

na

 Meroni 2019 [17]

43

  

 Ng 2021 [35]

3ab

Noa

 

 Rathbone 2020 [37]

3

Noa

Average

NASS 2013 [50]

 Anderson 2021 [27]

5,5

na

na

 

na

Satisfactory quality

No agreement

 Lin 2020 [34]

39

 

Low

 Rathbone 2020 [37]

4

Yes with modificationsa

Low

NASS 2014 [51]

 Lin 2020 [34]

39

na

na

 

na

Low

No agreement

 Rathbone 2020 [37]

4

Yes with modificationsa

Low

 Wong 2016 [39]

  

High

NICE 2009 [64]

 Acevedo 2016 [25]

6,5

na

na

Yes

No agreement

 

na

 Ng 2021 2021 [35]

4,5ab

Yes with modificationsa

 

 Wong 2016 [39]

  

High

OMG 2012 [61]

 Ng 2021 2021 [35]

4,5ab

na

na

Yes with modificationsa

Perfect agreement

 

Perfect agreement

 Rathbone 2020 [37]

4

Yes with modificationsa

Low

 Wong 2016 [39]

  

Low

PSP 2017 [52]

 Castellini 2020 [27]

4,17

na

na

No

No agreement

 

No agreement

 Corp 2021 [28]

33

No

Low

 Rathbone 2020 [37]

4

Yes with modificationsa

Average

SIGN 2013 [62]

 Ernstzen 2017 [30]

6,5

na

na

 

na

 

Perfect agreement

 Meroni 2019 [17]

81

 

Excellent

 Wong 2016 [39]

  

High

TOP 2017 [53]

 Castellini 2020 [27]

58,33

na

na

No

No agreement

 

No agreement

 Meroni 2019 [17]

89

 

Excellent

 Rathbone 2020 [37]

3,5

Yes with modificationsa

Low

VA/DoD 2017 [48]

 Castellini 2020 [27]

70,83

na

na

Yes, with modifications

Perfect agreement

 

Perfect agreement

 Kreen 2020 [33]

5,5

 

Moderate

 Meroni 2019 [17]

67

  

 Rathbone 2020 [37]

4

Yes with modificationsa

Average

  1. OA1, overall assessment 1; OA2, overall assessment 2. Empty cells indicate judgements not reported
  2. adata sent
  3. bmean judgement between raters. Na, not assessed due to missing data
  4. ACP American College of Physicians, APS American Pain Society, APTA American Physical Therapy Association, ASIPP American Society of Interventional Pain Physicians, CAAM China Association of Acupuncture-Moxibustion, CCGI Canadian Chiropractic Guideline Initiative, CCGPP Council on Chiropractic Guidelines and Practice Parameters, DAI Deutsches Ärzteblatt International, DHA Danish Health Authority, ICSI Institute for Clinical Systems Improvement, KCE Belgian Health Care Knowledge Centre, KNGF Koninklijk Nederlands Genootschap voor Fysiotherapie, na not assessed, NASS North American Spine Society, NICE National Institute for Health and Care Excellence, OMG Ottawa Methods Group, PSP Polish Society of Physiotherapy, SIGN Scottish Intercollegiate Guidelines Network, TOP Toward Optimized Practice Low Back Pain Working Group, VADoD Veterans Affairs/Department of Defense Collaboration Office