Table 5 Agreement per question per figure expressed as number of same answers as part of the total number of given answers

1a.

Is the publication in which the figure is reported a primary publication?

7/8

8/8

8/8

8/8

1b.

Is the primary publication known?

7/7

7/8

7/8

5/7^a

1c.

Is the primary publication verifiable?

7/7

8/8

7/8

4/7^a

3a.

Is the figure expressed in absolute terms?

4/8^a

6/8^a

5/8^a

6/8^a

3b.

Is the figure expressed in relative terms?

6/8^a

6/6

5/5

5/6

3c.

Does the figure you are assessing match the figure in the primary publication?

5/7^a

6/8^a

5/8^a

8/8

4b.

Does the definition of the subject of the figure you are assessing match the definition of the subject in the primary publication?

5/7^a

6/8^a

5/8^a

5/8^a

5b.

Does the definition of the population of the figure you are assessing match the definition in the primary publication?

6/7

5/8^a

6/8^a

5/8^a

6b.

Does the geographical area of the figure you are assessing match the geographical area in the primary publication?

6/7

5/8^a

8/8

8/8

7a

Is the time period in which the units are counted described in the primary publication?

8/8

6/8^a

7/8

5/8^a

7b.

Does the time period to which the figure applies match the time period in the primary publication?

6/7

4/8^a

7/8

6/8^a

8a.

Are the data on which the figure is based collected periodically?

8/8

5/8^a

6/8^a

7/8

8b.

Are the data on which the figure is based collected only once?

N.A.

5/5

2/2

1/1

9a.

Is the figure based on a sample?

8/8

5/8^a

7/8

7/8

9b.

Is the sample size known?

7/8

3/3

1/1

1/1

9c.

Is the response known?

8/8

2/3

1/1

1/1

9d.

Were important groups disregarded in the calculation of the figure?

7/8

2/3

1/1

N.A.

10a.

Were the data collected through an existing registration?

7/8

7/8

5/8^a

5/8^a

10b.

Is it known which registration was used?

1/1

7/7

2/3

3/3

11a.

Were the data collected through survey research?

8/8

6/8^a

7/8

7/8

11b.

Are the questions on which the figure is based described precisely?

7/8

5/6

1/1

1/1

11c.

Are the answer categories of the questions described?

7/8

6/6

1/1

1/1

12a.

Are the data collected through direct observations?

8/8

8/8

8/8

6/8^a

12b.

Is it known how the direct observations took place?

N.A.

N.A.

N.A.

2/2

13a.

Was the figure constructed through modelling?

7/8

5/8^a

8/8

6/8^a

13b.

Are the assumptions which were made in the model known?

1/1

2/3

8/8

3/6^a