Skip to main content

Table 6 Number of overruled assessments for each reviewer at item-level for AMSTAR

From: Inter-rater reliability of AMSTAR is dependent on the pair of reviewers

 

Rev1

Rev2

Rev3

Rev4

Rev5

I1: Was an ‘a priori’ design provided?

0

5

0

0

0

I2: Was there duplicate study selection and data extraction?

5

1

4

0

7

I3: Was a comprehensive literature search performed?

2

1

3

1

2

I4: Was the status of publication (i.e. grey literature) used as an inclusion criterion?

7

3

6

1

5

I5: Was a list of studies (included and excluded) provided?

2

0

2

1

3

I6: Were the characteristics of the included studies provided?

0

0

0

0

3

I7: Was the scientific quality of the included studies assessed and documented?

1

1

3

1

0

I8: Was the scientific quality of the included studies used appropriately in formulating conclusions?

1

1

1

1

4

I9: Were the methods used to combine the findings of studies appropriate?

4

4

7

4

3

I10: Was the likelihood of publication bias assessed?

5

3

11

1

2

I11: Was the conflict of interest included?

7

2

1

0

2

Total

34

21

38

10

29

  1. I Item, Rev Reviewer