Skip to main content

Table 3 Verdicts for domains I-VI, indicating number of assessors rating 'Yes', 'Unclear', or 'No' per paper, and the kappa statistic (κ) per domain

From: Method for appraising model validity of randomised controlled trials of homeopathic treatment: multi-rater concordance study

Domain I (Rationale)

κ = 0.50

   

Paper

Yes

Unclear

No

Lewith

3

1

4

Kainz

6

2

0

McCutcheon

2

4

2

Bell

8

0

0

Robertson

6

1

1

Adler

8

0

0

Domain II (Principles)

κ = 0.68

   

Paper

Yes

Unclear

No

Lewith

7

1

0

Kainz

7

1

0

McCutcheon

2

5

1

Bell

8

0

0

Robertson

6

0

2

Adler

8

0

0

Domain III (Practitioner)

κ = 0.42

   

Paper

Yes

Unclear

No

Lewith

6

1

1

Kainz

5

3

0

McCutcheon

1

4

3

Bell

8

0

0

Robertson

4

2

2

Adler

7

1

0

Domain IV (Outcome measure)

κ = 0.92

   

Paper

Yes

Unclear

No

Lewith

6

2

0

Kainz

8

0

0

McCutcheon

7

1

0

Bell

8

0

0

Robertson

7

0

1

Adler

8

0

0

Domain V (Sensitivity)

κ = 0.94

   

Paper

Yes

Unclear

No

Lewith

8

0

0

Kainz

8

0

0

McCutcheon

4

3

1

Bell

8

0

0

Robertson

7

1

0

Adler

8

0

0

Domain VI (Follow-up)

κ = 0.43

   

Paper

Yes

Unclear

No

Lewith

5

1

2

Kainz

4

4

0

McCutcheon

3

3

2

Bell

8

0

0

Robertson

8

0

0

Adler

6

1

1