Skip to main content

Table 5 Agreement per question per figure expressed as number of same answers as part of the total number of given answers

From: Figure Interpretation Assessment Tool-Health (FIAT-health) 2.0: from a scoring instrument to a critical appraisal tool

Nr. Question Figure 1 Figure 2 Figure 3 Figure 4
1a. Is the publication in which the figure is reported a primary publication? 7/8 8/8 8/8 8/8
1b. Is the primary publication known? 7/7 7/8 7/8 5/7a
1c. Is the primary publication verifiable? 7/7 8/8 7/8 4/7a
3a. Is the figure expressed in absolute terms? 4/8a 6/8a 5/8a 6/8a
3b. Is the figure expressed in relative terms? 6/8a 6/6 5/5 5/6
3c. Does the figure you are assessing match the figure in the primary publication? 5/7a 6/8a 5/8a 8/8
4b. Does the definition of the subject of the figure you are assessing match the definition of the subject in the primary publication? 5/7a 6/8a 5/8a 5/8a
5b. Does the definition of the population of the figure you are assessing match the definition in the primary publication? 6/7 5/8a 6/8a 5/8a
6b. Does the geographical area of the figure you are assessing match the geographical area in the primary publication? 6/7 5/8a 8/8 8/8
7a Is the time period in which the units are counted described in the primary publication? 8/8 6/8a 7/8 5/8a
7b. Does the time period to which the figure applies match the time period in the primary publication? 6/7 4/8a 7/8 6/8a
8a. Are the data on which the figure is based collected periodically? 8/8 5/8a 6/8a 7/8
8b. Are the data on which the figure is based collected only once? N.A. 5/5 2/2 1/1
9a. Is the figure based on a sample? 8/8 5/8a 7/8 7/8
9b. Is the sample size known? 7/8 3/3 1/1 1/1
9c. Is the response known? 8/8 2/3 1/1 1/1
9d. Were important groups disregarded in the calculation of the figure? 7/8 2/3 1/1 N.A.
10a. Were the data collected through an existing registration? 7/8 7/8 5/8a 5/8a
10b. Is it known which registration was used? 1/1 7/7 2/3 3/3
11a. Were the data collected through survey research? 8/8 6/8a 7/8 7/8
11b. Are the questions on which the figure is based described precisely? 7/8 5/6 1/1 1/1
11c. Are the answer categories of the questions described? 7/8 6/6 1/1 1/1
12a. Are the data collected through direct observations? 8/8 8/8 8/8 6/8a
12b. Is it known how the direct observations took place? N.A. N.A. N.A. 2/2
13a. Was the figure constructed through modelling? 7/8 5/8a 8/8 6/8a
13b. Are the assumptions which were made in the model known? 1/1 2/3 8/8 3/6a
  1. aanswers are inconsistent (if only one participant answered the question, the consistency rule does not apply)
  2. N.A. not applicable as no answers were given