APPRAISAL AUTHOR | OA1 | VARIABILITY OA1 | VARIABILITY OA1 | OA2 | AGREEMENT OA2 | QUALITY RATING | AGREEMENT QUALITY RATING |
---|---|---|---|---|---|---|---|
(0-100 scale) | (1-7 scale) | ||||||
Median (Q1-Q3) | Median (Q1-Q3) | ||||||
NICE 2016 [63] | |||||||
 Castellini 2020 [27] | 95,83 | 88 (83-92.4) | 6 (5.5-7) | Yes | Heterogeneity of reporting |  | Perfect agreement |
 Corp 2021 [28] | 83 | Yes |  | ||||
 Doniselli 2018 [29] | 83 | Yes (3 raters); Maybe (1 rater)a |  | ||||
 Krenn 2020 [33] | 7 |  | High | ||||
 Lin 2020 [34] | 89 |  | High | ||||
 Meroni 2019 [17] | 88 |  |  | ||||
 Ng 2021 [35] | 6ab | Yes (1 rater); Yes with modifications (1 rater)a |  | ||||
 Rathbone 2020 [37] | 5,5 | Yesa | High | ||||
 Stander 2020 [38] |  |  |  | ||||
ACP 2017 [47] | |||||||
 Castellini 2020 [27] | 75 | 77 (68.3-82) | 5 (5-5.5) | Yes | Heterogeneity of reporting |  | No agreement |
 Doniselli 2018 [29] | 79 | Yes (2 raters); Maybe (1 rater)a |  | ||||
 Krenn 2020 [33] | 5 |  | Moderate | ||||
 Lin 2020 [34] | 83 |  | Low | ||||
 Meroni 2019 [17] | 66 |  |  | ||||
 Ng 2021 [35] | 5,5ab | Yes with modificationsa |  | ||||
 Rathbone 2020 [37] | 5 | Yes with modificationsa | Average | ||||
 Stander 2020 [38] |  |  |  | ||||
APS 2009 [65] | |||||||
 Acevedo 2016 [25] | 6 | na | 5.6 (5.1-6.0) | Yes | No agreement |  | Perfect agreement |
 Anderson 2021 [26] | 5,9 |  | Satisfactory | ||||
 Ng 2021 [35] | 5ab | Yes with modificationsa |  | ||||
 Wong 2016 [39] |  |  | High | ||||
 Hoydonckx 2020 [32] | 5,33 |  |  | ||||
APTA 2012 [56] | |||||||
 Doniselli 2018 [29] | 67 | 55 (44-67) | 4.8 | Yes (2 raters); No (2 raters)a | Heterogeneity of reporting |  | Perfect agreement |
 Franz 2015 [31] |  |  |  | ||||
 Lin 2020 [34] | 44 |  | Low | ||||
 Meroni 2019 [17] | 55 |  |  | ||||
 Ng 2021 [35] | 5ab | Yes with modificationsa |  | ||||
 Rathbone 2020 [37] | 4,5 | Yes with modificationsa | Low | ||||
 Wong 2016 [39] |  |  | Low | ||||
 Nordin 2018 [36] |  |  |  | ||||
KCE 2017 [43] | |||||||
 Castellini 2020 [27] | 83,33 | 83.3 (61-100) | 5 (4.5-6) | Yes | No agreement |  | No agreement |
 Corp 2021 [28] | 100 | Yes | High | ||||
 Krenn 2020 [33] | 4,5 |  | Moderate | ||||
 Lin 2020 [34] | 61 |  | High | ||||
 Ng 2021 [35] | 5ab | Yes with modificationsa |  | ||||
 Rathbone 2020 [37] | 6 | Yesa | High | ||||
CCGPP 2016 [55] | |||||||
 Castellini 2020 [27] | 29,17 | 44 (29.2-47) | na | No | Heterogeneity of reporting |  | Perfect agreement |
 Lin 2020 [34] | 44 |  | High | ||||
 Meroni 2019 [17] | 47 |  |  | ||||
 Ng 2021 [35] | 4,5ab | Yes with modificationsa |  | ||||
 Rathbone 2020 [37] | 5,5 | Yes (1 rater); Yes with modifications (1 rater)a | High | ||||
ASIPP 2013 [49] | |||||||
 Acevedo 2016 [25] | 5 |  | 5.6 (5-5.6) | No | Heterogeneity of reporting |  | No agreement |
 Anderson 2021 [27] | 5,6 |  | Not satisfactory | ||||
 Hoydinckx 2020 [33] | 5,66 | Yes (1 rater); Yes with modifications (1 rater); No (1 rater) |  | ||||
 Nordin 2018 [36] | 75a | Yesa | High | ||||
CAAM 2016 [42] | |||||||
 Castellini 2020 [27] | 45,8 | na | na | No | No agreement |  | na |
 Ng 2021 [35] | 4ab | Yes with modificationsa |  | ||||
 Rathbone 2020 [37] | 2,5 | Yes with modificationsa | Low | ||||
CCGI 2018 [60] | |||||||
 Castellini 2020 [27] | 87,5 | na | na | Yes | Heterogeneity of reporting |  | Perfect agreement |
 Krenn 2020 [33] | 6 |  | High | ||||
 Rathbone 2020 [37] | 6 | Yes (1 rater); Yes with modifications (1 rater)a | High | ||||
Cheng 2012 [59] | |||||||
 Lin 2020 [34] | 17 | na | na |  | Perfect agreement | Low | Perfect agreement |
 Ng 2021 [35] | 4ab | Yes with modificationsa |  | ||||
 Rathbone 2020 [37] | 4 | Yes with modificationsa | Low | ||||
DAI 2017 [58] | |||||||
 Meroni 2019 [17] | 80 | na | na |  | Perfect agreement | Excellent | No agreement |
 Ng 2021 [35] | 4ab | Yes with modificationsa |  | ||||
 Rathbone 2020 [37] | 3 | Yes with modificationsa | Low | ||||
DHA 2017 [45] | |||||||
 Doniselli 2018 [30] | 92 | na | na | Yes (3 raters); Maybe (1 rater)a | Heterogeneity of reporting |  | No agreement |
 Lin 2020 [34] | 67 |  | High | ||||
 Rathbone 2020 [37] | 4,5 | Yes with modificationsa | Average | ||||
ICSI 2012 [54] | |||||||
 Doniselli 2018 [30] | 79 | na | na | Yes (2 raters); Maybe (2 raters)a | Heterogeneity of reporting |  | na |
 Lin 2020 [34] | 56 |  | Low | ||||
 Ng 2021 [35] | 4,5ab | Yes with modificationsa |  | ||||
ICSI 2018 [44] | |||||||
 Castellini 2020 [27] | 62,5 |  |  | Yes, with modifications | No agreement |  | Perfect agreement |
 Krenn 2020 [33] | 5,5 | na | na |  | Moderate | ||
 Rathbone 2020 [37] | 5,5 |  |  | Yesa | Average | ||
KNGF 2013 [46] | |||||||
 Franz 2015 [31] |  | na | na |  | Perfect agreement |  | na |
 Meroni 2019 [17] | 43 |  |  | ||||
 Ng 2021 [35] | 3ab | Noa |  | ||||
 Rathbone 2020 [37] | 3 | Noa | Average | ||||
NASS 2013 [50] | |||||||
 Anderson 2021 [27] | 5,5 | na | na |  | na | Satisfactory quality | No agreement |
 Lin 2020 [34] | 39 |  | Low | ||||
 Rathbone 2020 [37] | 4 | Yes with modificationsa | Low | ||||
NASS 2014 [51] | |||||||
 Lin 2020 [34] | 39 | na | na |  | na | Low | No agreement |
 Rathbone 2020 [37] | 4 | Yes with modificationsa | Low | ||||
 Wong 2016 [39] |  |  | High | ||||
NICE 2009 [64] | |||||||
 Acevedo 2016 [25] | 6,5 | na | na | Yes | No agreement |  | na |
 Ng 2021 2021 [35] | 4,5ab | Yes with modificationsa |  | ||||
 Wong 2016 [39] |  |  | High | ||||
OMG 2012 [61] | |||||||
 Ng 2021 2021 [35] | 4,5ab | na | na | Yes with modificationsa | Perfect agreement |  | Perfect agreement |
 Rathbone 2020 [37] | 4 | Yes with modificationsa | Low | ||||
 Wong 2016 [39] |  |  | Low | ||||
PSP 2017 [52] | |||||||
 Castellini 2020 [27] | 4,17 | na | na | No | No agreement |  | No agreement |
 Corp 2021 [28] | 33 | No | Low | ||||
 Rathbone 2020 [37] | 4 | Yes with modificationsa | Average | ||||
SIGN 2013 [62] | |||||||
 Ernstzen 2017 [30] | 6,5 | na | na |  | na |  | Perfect agreement |
 Meroni 2019 [17] | 81 |  | Excellent | ||||
 Wong 2016 [39] |  |  | High | ||||
TOP 2017 [53] | |||||||
 Castellini 2020 [27] | 58,33 | na | na | No | No agreement |  | No agreement |
 Meroni 2019 [17] | 89 |  | Excellent | ||||
 Rathbone 2020 [37] | 3,5 | Yes with modificationsa | Low | ||||
VA/DoD 2017 [48] | |||||||
 Castellini 2020 [27] | 70,83 | na | na | Yes, with modifications | Perfect agreement |  | Perfect agreement |
 Kreen 2020 [33] | 5,5 |  | Moderate | ||||
 Meroni 2019 [17] | 67 |  |  | ||||
 Rathbone 2020 [37] | 4 | Yes with modificationsa | Average |