Advertisement
Table 5 Agreement per question per figure expressed as number of same answers as part of the total number of given answers
| Nr. | Question | Figure 1 | Figure 2 | Figure 3 | Figure 4 |
|---|---|---|---|---|---|
| 1a. | Is the publication in which the figure is reported a primary publication? | 7/8 | 8/8 | 8/8 | 8/8 |
| 1b. | Is the primary publication known? | 7/7 | 7/8 | 7/8 | 5/7a |
| 1c. | Is the primary publication verifiable? | 7/7 | 8/8 | 7/8 | 4/7a |
| 3a. | Is the figure expressed in absolute terms? | 4/8a | 6/8a | 5/8a | 6/8a |
| 3b. | Is the figure expressed in relative terms? | 6/8a | 6/6 | 5/5 | 5/6 |
| 3c. | Does the figure you are assessing match the figure in the primary publication? | 5/7a | 6/8a | 5/8a | 8/8 |
| 4b. | Does the definition of the subject of the figure you are assessing match the definition of the subject in the primary publication? | 5/7a | 6/8a | 5/8a | 5/8a |
| 5b. | Does the definition of the population of the figure you are assessing match the definition in the primary publication? | 6/7 | 5/8a | 6/8a | 5/8a |
| 6b. | Does the geographical area of the figure you are assessing match the geographical area in the primary publication? | 6/7 | 5/8a | 8/8 | 8/8 |
| 7a | Is the time period in which the units are counted described in the primary publication? | 8/8 | 6/8a | 7/8 | 5/8a |
| 7b. | Does the time period to which the figure applies match the time period in the primary publication? | 6/7 | 4/8a | 7/8 | 6/8a |
| 8a. | Are the data on which the figure is based collected periodically? | 8/8 | 5/8a | 6/8a | 7/8 |
| 8b. | Are the data on which the figure is based collected only once? | N.A. | 5/5 | 2/2 | 1/1 |
| 9a. | Is the figure based on a sample? | 8/8 | 5/8a | 7/8 | 7/8 |
| 9b. | Is the sample size known? | 7/8 | 3/3 | 1/1 | 1/1 |
| 9c. | Is the response known? | 8/8 | 2/3 | 1/1 | 1/1 |
| 9d. | Were important groups disregarded in the calculation of the figure? | 7/8 | 2/3 | 1/1 | N.A. |
| 10a. | Were the data collected through an existing registration? | 7/8 | 7/8 | 5/8a | 5/8a |
| 10b. | Is it known which registration was used? | 1/1 | 7/7 | 2/3 | 3/3 |
| 11a. | Were the data collected through survey research? | 8/8 | 6/8a | 7/8 | 7/8 |
| 11b. | Are the questions on which the figure is based described precisely? | 7/8 | 5/6 | 1/1 | 1/1 |
| 11c. | Are the answer categories of the questions described? | 7/8 | 6/6 | 1/1 | 1/1 |
| 12a. | Are the data collected through direct observations? | 8/8 | 8/8 | 8/8 | 6/8a |
| 12b. | Is it known how the direct observations took place? | N.A. | N.A. | N.A. | 2/2 |
| 13a. | Was the figure constructed through modelling? | 7/8 | 5/8a | 8/8 | 6/8a |
| 13b. | Are the assumptions which were made in the model known? | 1/1 | 2/3 | 8/8 | 3/6a |
