From: Inter-rater reliability of AMSTAR is dependent on the pair of reviewers
Rev1 | Rev2 | Rev3 | Rev4 | Rev5 | |
---|---|---|---|---|---|
I1: Was an ‘a priori’ design provided? | 0 | 5 | 0 | 0 | 0 |
I2: Was there duplicate study selection and data extraction? | 5 | 1 | 4 | 0 | 7 |
I3: Was a comprehensive literature search performed? | 2 | 1 | 3 | 1 | 2 |
I4: Was the status of publication (i.e. grey literature) used as an inclusion criterion? | 7 | 3 | 6 | 1 | 5 |
I5: Was a list of studies (included and excluded) provided? | 2 | 0 | 2 | 1 | 3 |
I6: Were the characteristics of the included studies provided? | 0 | 0 | 0 | 0 | 3 |
I7: Was the scientific quality of the included studies assessed and documented? | 1 | 1 | 3 | 1 | 0 |
I8: Was the scientific quality of the included studies used appropriately in formulating conclusions? | 1 | 1 | 1 | 1 | 4 |
I9: Were the methods used to combine the findings of studies appropriate? | 4 | 4 | 7 | 4 | 3 |
I10: Was the likelihood of publication bias assessed? | 5 | 3 | 11 | 1 | 2 |
I11: Was the conflict of interest included? | 7 | 2 | 1 | 0 | 2 |
Total | 34 | 21 | 38 | 10 | 29 |