Skip to main content

Table 2 Frequency of outcome reporting classifications for each reporting itemfor the primary outcome in 18 included RCTs

From: Primary outcome reporting in adolescent depression clinical trials needs standardization

Reporting Item Thematic Item Category and Number

Fully reported

N (%)

Partially reported N (%)a

Not reported

N (%)

What: Description of the outcome

1. Described the outcome domainb

6 (33)

N/A

12 (67)

2. Stated the outcome

18 (100)

N/A

0 (0)

3. Specified the outcome as primary

17 (94)

N/A

1 (6)

4. Provided a rationale for classifying the outcome as primary, instead of secondary

3 (17)

N/A

15 (83)

5. Defined clinical significance on the outcome (e.g., minimal important difference, responder definition), including what would constitute a good or poor outcome

11 (61)

N/A

7 (39)

6. Justified the criteria used for defining meaningful change (e.g., the minimal important difference, responder definition), including what would constitute a good or poor outcome, such as from an outcome measurement interpretation guideline

3 (17)

N/A

15 (83)

Why: Rationale for selecting the outcome

7. Explained how the outcome addresses/relates to the hypothesis of the study

8 (44)

N/A

10 (56)

8. Explained how the outcome addresses the objective/research question of the study (i.e., to compare the effect of intervention A versus intervention B on outcome X)

10 (56)

N/A

8 (44)

9. Described why the outcome is relevant to each stakeholder group involved in this trial (e.g., patients, decision makers, policy makers, clinicians, funders, etc.)

11 (61)

N/A

7 (39)

10. Reported which stakeholders (e.g., patients, decision makers, policy makers, clinicians, funders, etc.) were actively involved in outcome selection

2 (11)

N/A

16 (89)

11. Explained the mechanism (e.g., pathophysiological, pharmacological, etc.) or theoretical framework/model by which the experimental intervention is expected to cause change in the outcome in the target population

7 (39)

N/A

11 (61)

12. Provided rationale for the choice of the specific type of outcome (e.g.,., why a patient-reported outcome instead of a clinician reported outcome)

4 (22)

N/A

14 (78)

How: The way the outcome is measured

13. Described the outcome measurement instrument used. This should include instrument scaling and scoring details (e.g., range and direction of scores)c

9 (50)

8 (44)

1 (6)

14. Specified whether the outcome measurement instrument will be used in accordance with any user manual and specify and justify deviations if planned

0 (0)d

N/A

16 (100)

15. Specified a recall period for outcome measurement instrument

1 (6)

N/A

17 (94)

16. Described mode of outcome assessment (e.g., face to face, telephone, electronically)

9 (53)d

N/A

8 (47)

17. Justified the mode of outcome assessment (e.g., justification for equivalence between different modes of administration, if applicable)

1 (6)d

N/A

16 (94)

18. Described any additional resources/materials or processes when performing outcome assessment, when relevant (e.g.,, a stethoscope, language interpreter, fasting prior to colonoscopy, etc.)

5 (28)

N/A

13 (72)

19. Described or provided reference to an empirical study that established validity of the outcome measurement instrument in individuals similar to the study sample (i.e., measures what it is supposed to measure)c

1 (6)d

3 (19)

12 (75)

20. Described or provided reference to an empirical study that established validity of the outcome measurement instrument in the study setting (i.e., measures what it is supposed to measure)c

1 (6)d

3 (19)

12 (75)

21. Specified whether more than one language version of the outcome measurement instrument was used and state whether translated versions have been developed using currently recommended methods, if applicable

0 (0)

0 (0)

15 (83)d

22. Described or provided reference to an empirical study that established reliability of the outcome measurement instrument in individuals similar to the study sample (i.e., ability to produce consistent results)c

3 (17)

6 (33)

9 (50)

23. Described or provided reference to an empirical study that established reliability of the outcome measurement instrument in the study setting (i.e., ability to produce consistent results)c

0 (0)

7 (39)

11 (61)

24. Described or provided reference to an empirical study that established the responsiveness of the outcome measurement instrument in the study sample (i.e., ability to detect change over time given a change in disease activity or status)

2 (13)d

0 (0)

14 (87)

25. Described the feasibility of the outcome measurement instrument in the study sample (i.e., the practical considerations of using an instrument, including its ease of use, time to complete, monetary costs, and interpretability of the question(s) included in the instrument)

5 (28)

0 (0)

13 (72)

26. Described the acceptability and burden of the outcome measurement instrument in the study samplec

2 (11)

1 (6)

15 (83)

27. Specified whether order of administration of outcome measurement instrument was standardized, if assessing multiple outcomes

2 (12)d

N/A

15 (88)

28. Specified whether outcome data will be monitored during the study to inform the clinical care of individual trial participants, and if so, how this will be managed in a standardized way

2 (11)

0 (0)

16 (89)

Who: Source of information of the outcome

29. Described who (e.g., nurse, occupational therapist, technician, parent, outcome adjudicators), and if applicable, how many, assessed the outcome in each study group

9 (50)

0 (0)

9 (50)

30. Justified the choice of outcome assessor(s) (e.g., proxy versus healthcare provider)

3 (17)

N/A

15 (83)

31. Described whether the outcome assessor(s) were blinded/masked to intervention assignment

14 (78)

N/A

4 (22)

32. Described any study-specific training required for outcome assessors to apply the outcome measurement instrument

6 (33)

N/A

12 (67)

33. Described how outcome data quality was maximized (e.g., duplicate measurements)

9 (50)

N/A

9 (50)

Where: Assessment location and setting of the outcome

34. Specified geographic location of outcome assessment for each study group (e.g., list of countries where outcome data was collected)

5 (28)

N/A

13 (72)

35. Described setting of outcome assessment for each study group (e.g., clinic, home, other)

4 (22)

N/A

14 (78)

36. Justified suitability of the outcome assessment setting(s) for the study sample (e.g., family doctor office vs. home when measuring blood pressure)

0 (0)

N/A

18 (100)

When: Timing of measurement of the outcome

37. Specified timing and frequency of outcome assessment(s) for outcomes (e.g., time point for each outcome, time schedule of assessments)c

16 (89)

2 (11)

0 (0)

38. Provided justification of timing and frequency of outcome assessment(s) (such as pathophysiological or epidemiological evidence for disease processes and complications to occur and/or pragmatic justification)

1 (6)

0 (0)

17 (94)

Outcome data management and analyses

39. Provided definition of outcome analysis population

16 (89)

N/A

2 (11)

40. Described unit of analysis of the outcome (i.e., cluster or individual)

18 (100)

N/A

0 (0)

41. Described outcome analysis metric (e.g., change from baseline, final value, time to event)

18 (100)

N/A

0 (0)

42. Described method of aggregation for outcome data (e.g., mean, median, proportion)

18 (100)

N/A

0 (0)

43. Described statistical methods and/or significance test(s) (name or type) used for analyzing outcome data. This should include any analyses undertaken to address multiplicity/type I (α) error, particularly for trials with multiple domains and time pointsc

11 (61)

7 (39)

0 (0)

44. Described the covariates and factors in the statistical model (e.g., adjusted analyses) used for analyzing outcome data, if applicable

14 (82)d

N/A

3 (18)

45. Provided justification for covariates and factors and why they were selected, if applicable

2 (12)d

N/A

15 (88)

46. Described results for each group, including estimated effect size and its precision (such as 95% confidence interval). For binary outcomes, presentation of both absolute and relative effect sizes is recommendedc

14 (78)

4 (22)

0 (0)

47. Described time period (i.e., chronological time since randomization) for which the outcome was analyzed

18 (100)

N/A

0 (0)

48. Described outcome data, assessment process, and analysis for participants who discontinued or deviated from the assigned intervention protocolc

1 (6)

15 (83)

2 (11)

49. Described outcome data entry, coding, security and storage, including any related processes to promote outcome data quality (e.g., double entry, range checks from outcome data values)

0 (0)

1 (6)

17 (94)

50. Described blinding procedure(s) applied to data entry personnel and/or data analysts

3 (17)

0 (0)

15 (83)

51. Described methods for additional analyses (e.g., subgroup analyses), if applicable

8 (62)d

N/A

5 (38)

Missing outcome data

52. Described how much outcome data was missing

16 (89)

N/A

2 (11)

53. Described any reasons for missing outcome data in each arm (e.g.,, reasons for withdrawal or reasons for lack of follow-up), with enough detail that the reported reason can be used to reduce the uncertainty about the potential underlying mechanism of missing outcome data

11 (65)d

0 (0)

6 (35)

54. Explained statistical methods to handle missing outcome items or entire assessments (e.g., multiple imputation)

13 (72)

N/A

5 (28)

55. Provided justification for methods used to handle missing outcome data. This should include: (1) assumptions underlying the missing outcome data mechanism with justification (including analyses performed to support assumptions about the missingness mechanism); and (2) how the assumed missingness mechanism and any relevant features of the outcome data would influence the choice of statistical method(s) to handle missing outcome data including sensitivity analysesc

3 (17)

1 (6)

14 (77)

56. Described any outcome analyses conducted to assess the risk of bias posed by missing outcome data (e.g., comparison of baseline characteristics of participants with and without missing outcome data)

3 (18)d

N/A

14 (82)

Interpretation

57. Interpreted outcome data in relation to clinical outcomes, where relevant

12 (67)

N/A

6 (33)

58. Discussed impact of missing outcome data on the interpretation of findings, if applicable

4 (22)

N/A

14 (78)

  1. aN/A not applicable, refers to instances where “partially reported” was not a valid scoring option. Items scored as “Not applicable” were excluded from the overall assessment calculations because they were deemed not relevant to the assessment of outcome reporting by the research team (AM, EM, SP, NJB) by consensus
  2. bOutcome domain defined as: “A relatively broad aspect of the effect of illness on a child, within which an improvement may occur in response to an intervention. In general these domains may not be directly measurable themselves, so outcomes are selected to assess change within them.” [36]
  3. cItem was considered “fully reported” only when all components (e.g., timing AND frequency, item 37) within each checklist item were “fully reported”
  4. dSeveral items do not total to adenominator of N = 18 trials, for the following reasons: Items 16 and 17 (denominator = 17): item was not applied to articles where the primary outcome was a biomarker. Items 14, 19–20, 24 (denominator = 16): item was not applied to articles where the outcome was assessed using clinician judgement. Item 21 (denominator = 15): item not applied to articles with biomarkers or time to event as the primary outcome. Item 27 (denominator = 17): item was not applied to articles where only one outcome measurement instrument was reported. Item 44 and 45 (denominator = 17): items were only applicable to articles with statistical methods that include covariates/factors. Item 51 (denominator = 13): item was only applied to articles that included additional/subgroup analyses. Item 53 and 56 (denominator = 17): items were only applied to articles that reported having missing data