Skip to main content
Download PDF

An approach to exploring patterns of imbalance and potential missingness in reports of the randomized baseline values for primary outcomes measurable at baseline in randomized controlled trials for meta-analyses

BMC Medical Research Methodology volume 22, Article number: 154 (2022) Cite this article

Abstract

Background

This study evaluated the adequacy of randomization in randomized controlled trials by investigating baseline differences in the primary outcome when a meta-analysis employed an outcome whose baseline level was measurable.

Methods

We retrieved Cochrane reviews published during one year. We calculated the proportion of studies that reported randomized baseline values for the primary outcome. The standardized mean difference (SMD) was used to assess baseline imbalance and heterogeneity. We explored ranking-ordered forest plots using a normal cumulative probability curve as a guideline representing well-performed randomized trials. When skewness was suggested, a funnel plot was drawn to assess whether there was a significant linear trend.

Results

In 10 of 18 meta-analyses, more than 25% of trials did not report randomized baseline values of the primary outcomes. Three meta-analyses indicated baseline imbalance (P < 0.1) and three showed substantial heterogeneity (I2 > 60%). Four meta-analyses with forest plots suggesting a skewed SMD distribution also showed a linear trend on their standard errors on the funnel plot.

Conclusions

If the primary outcome is measured at baseline, it is essential to explore the full scope of baseline imbalance among the trials. This could help understand patterns of bias, including missingness, for designing adjustment.

Peer Review reports

Background

Randomized controlled trials (RCTs) use random allocation to minimize the baseline difference between arms. Randomization ensures the comparability of each arm by balancing unmeasured prognostic factors and confounding variables. Therefore, when randomization is properly conducted, differences in baseline characteristics between arms should occur only by chance. If there exist chance imbalances, we should adjust for the baseline covariates by using a statistical approach such as analysis of covariance (ANCOVA) [1]. The Consolidated Standards of Reporting Trials (CONSORT) guidelines require RCTs to report baseline demographic and clinical characteristics in each arm [2].

Under the condition that comparison groups are well balanced after random assignment in RCTs, systematic reviews and meta-analyses can infer unbiased pooled estimates. According to the Preferred Reporting Items of Systematic reviews and Meta-Analyses (PRISMA) guidelines [3, 4], it is a norm that the risk of bias [5] of RCTs is assessed as part of the systematic review process, which primarily includes an evaluation of the methods used for random sequence generation and allocation concealment. The recently revised Cochrane tool for assessing the risk of bias in randomized trials (RoB 2.0) recommends assessing baseline differences between intervention groups along with the potential for bias arising from the randomization process [6, 7].

When we conduct a meta-analysis of RCTs, although we expect a good balance in values of the primary outcomes to be achieved after randomization between intervention groups, it is not always very plausible that this condition holds true. When evaluating an outcome that is an event such as mortality, there is only the ‘endpoint’ to account for, and no baseline status of the outcome itself can be measured. In such a case, it may be especially important to assess the baseline status of important covariates among the randomized patients in a meta-analysis [8]. If we evaluate an outcome whose baseline values are measurable and of concern, such as pain or symptom scores that are measured on a continuous scale, it is essential to assess the primary outcome’s baseline balance between groups. Thus, it is also critical for the primary RCT authors to report these values so that they can be evaluated by the meta-analyst and be taken into account if any considerable imbalance is noted.

As an example of the importance of this issue, a meta-analysis of the effects of calcium supplementation on body weight showed that the baseline body weight was significantly lower in the treatment group than in the control group [9]. The authors proposed using an ANCOVA-type meta-regression method to adjust for the baseline imbalance and demonstrated that the apparent treatment effect was, in fact, due to the baseline difference [10]. Another meta-analysis of pain after epidural steroid injections in low back pain patients reported a significantly lower mean baseline pain score in the intervention group [11]. The authors also adjusted for the baseline pain scores and emphasized the need to adjust for baseline imbalances, which might change the conclusion of meta-analyses. The presence of a systematic imbalance in baseline values after randomization poses questions regarding how well the randomization process in clinical trials functions in reality and whether imbalanced allocation may be related to specific factors, such as the type of intervention or outcome.

In addition to the overall imbalance of baseline values, the extent of heterogeneity has also been suggested as a sign of bias against randomization [12]. A Cochrane review of spinal manipulative therapy for chronic low back pain showed that there was no significant pooled difference between groups, but significant heterogeneity was present in baseline back pain scores, as some trials with a baseline imbalance between groups were included in the meta-analysis [8].

In this study, we first attempted to investigate the proportion of trials that reported the randomized baseline values for the primary outcome, when their meta-analysis employed an outcome for which the baseline level was measurable, together with the characteristics of the meta-analysis. The balance between groups after random assignment was examined for the reported values. Finally, we aimed to devise an exploratory approach based on graphical presentations to explore the potential for selection bias in the RCTs included in a meta-analysis.

Methods

Study selection

We retrieved Cochrane reviews published in 2018 from the Cochrane Library. The inclusion criteria were systematic reviews that contained a meta-analysis of more than 10 RCTs and clearly defined the primary outcome. We selected meta-analyses that used primary outcomes of quantitative measures, the baseline level of which should be assessed. One meta-analysis with the largest number of RCTs per systematic review was chosen if multiple meta-analyses of primary outcomes were eligible within a study.

Data extraction

One author extracted data and the second author cross-checked the data, and a discussion was held to resolve any questions by consensus. For each meta-analysis, we extracted the definitions of PICO (patients, intervention, comparator, and the primary outcome), the type of effect measures, and the number of RCTs included. For each trial, we extracted the number of participants in each arm and the mean and standard deviation (SD) of the baseline values for the primary outcome. If the mean and SD were not reported, we collected other forms of summary statistics, such as the median and interquartile range.

Statistical analysis

We first identified RCTs that reported baseline values for the primary outcomes and confirmed that the reported values could be considered as results from a randomized sample. For studies that reported baseline values only for the analyzed patients (not for all the randomized patients), we considered the results as arising from a randomized patient sample if the dropout rate was less than 10%.

We calculated the baseline difference for each trial using the standardized mean difference (SMD) to evaluate the balance on a common scale across meta-analyses considering different outcomes with different ranges of magnitude. Baseline values reported as the median with interquartile range were not included in the calculation of SMD measures. The baseline mean differences were coded so that an SMD < 0 indicated that the patients in the intervention group of interest were in a better condition at baseline (e.g., having lower symptom scores or higher activity scores). When it was difficult to judge which direction would indicate a better condition based on the outcome alone, the characteristics of the disease and the intervention of interest were considered in the context of the study objective; for example, a lower preoperative glucose level implies a better condition when investigating the perioperative hyperglycemic response to surgical stress.

We calculated the pooled SMD, using the weight of inverse variance of the baseline mean difference from each trial, with the 95% confidence interval (CI). Statistical heterogeneity across trials within a meta-analysis was evaluated using the I2 statistic [13]. We regarded I2 values of 0–40%, 30–60%, 50–90%, and 75–100% as indicating insignificant, moderate, substantial, and considerable heterogeneity, respectively [14]. We also examined the proportion of trials with negative SMD values in each meta-analysis.

For each meta-analysis, the SMD and its 95% CI for the included trials were presented in descending order in a forest plot. A cumulative normal distribution function was overlaid, assuming that the distribution would have a mean of zero and the same variability as that of the pooled SMD, representing the curve that one would expect with only sampling error when the observed baseline differences were obtained from well-performed randomized trials. We visually explored the location and the shape of the observed values using the cumulative probability curve as a guideline. Symmetry was confirmed first with the location of the median value being zero, and a pattern of deviation of interval estimates for the SMD from the curve was identified. We considered there to be a sign of skewness when the location of the median value disaccorded with zero and the trial estimates deviated from the imposed guideline in one direction. When some skewness was suggested, we further drew funnel plots of SMDs with their standard errors (SEs). We assessed whether there was any notable trend in SMDs [15].

Statistical analyses were performed using R version 3.6.1 (R Foundation for Statistical Computing, Vienna, Austria).

Results

Study characteristics of meta-analyses

The flow diagram of the study selection process is reported in Fig. 1. From 641 Cochrane reviews, 18 meta-analyses on 372 trials met our selection criteria. The characteristics of each meta-analysis are summarized in Table 1. Fifteen meta-analyses used subjective primary outcomes such as pain or symptom scores (#3-#7, #9-#18). Five of the eight meta-analyses using active controls mainly targeted patients receiving surgical care (#1, #2, #16-#18). Eight of the other 10 meta-analyses using placebo or standard of care were studies of patients receiving medical care (#3, #4, #6-#8, #11-#13). Nine of the 13 meta-analyses on pharmacological interventions used mean differences (#1, #2, #4, #7, #10, #14, #16-#18), and all five meta-analyses on non-pharmacological interventions used SMDs (#3, #5, #9, #11, #13). Those five studies evaluated their outcome measures primarily at the end of follow-up. Five of the other six studies with evaluations at the end of follow-up used pain as the primary outcome (#14-#18).

Fig. 1
figure 1

Flow diagram of the selection process. RCT, randomized controlled trial

Full size image
Table 1 Characteristics of the meta-analyses included in this study
Full size table

Reporting of baseline values for the primary outcome

Baseline values for the primary outcome were not reported in 171 of the 372 trials (46%). Among 201 trials that reported baseline values, 22 only reported the baseline values for analyzed patients with a dropout rate greater than 10%. Therefore, we identified 179 trials (48%) that reported baseline values for the randomized patients. Six out of the 179 trials reported baseline values as the median with interquartile range. In eight of the 18 meta-analyses, fewer than 20% of trials did not report randomized baseline values, whereas in two studies, 100% of trials reported the values. In five other meta-analyses, the baseline values were not reported in 29–55% of trials. Only a small proportion (0–12%) of trials reported baseline values in the other five meta-analyses (#14-#18) that assessed postoperative pain in surgical patients, for whom the baseline pain score before surgery was not of concern (Fig. 2). The 10 meta-analyses (#9-#18), in which relatively few trials reported baseline values, evaluated the outcome measures mainly based on follow-up scores.

Fig. 2
figure 2

The proportion of RCTs that reported baseline values for the primary outcome in each meta-analysis

Full size image

Baseline imbalance and heterogeneity

In terms of the weighted pooled SMD, two meta-analyses indicated significant baseline mean differences, with a p-value < 0.05 (#8: SMD = − 0.214 [95% CI = − 0.344, − 0.085]; #10: SMD = − 0.174 [95% CI = − 0.321, − 0.028]). Another meta-analysis showed significance with a p-value < 0.1 (#5: SMD = − 0.136 [95% CI = − 0.280, 0.008]), and two meta-analyses showed p-values between 0.1 and 0.2 (#3: SMD = 0.071 [95% CI = − 0.030, 0.171]; #13: SMD = − 0.087 [95% CI = − 0.204, 0.030]). There was substantial heterogeneity in the observed baseline differences of primary outcomes across the trials in three meta-analyses (#5: I2 = 62.4%; #8: I2 = 68.9%; #13: I2 = 71.7%), and moderate heterogeneity was found in two meta-analyses (#4: I2 = 35.8%; #10: I2 = 34.2%) (Fig. 3). The four meta-analyses (#5, #8, #10, #13) that showed both imbalance and heterogeneity in the baseline values assessed their outcomes primarily based on follow-up scores. In 10 of the 13 meta-analyses reported in Fig. 3, a large proportion of trials (63–83%) showed baseline imbalance either in a negative or a positive direction. Two of them showed significant proportional differences, at the 0.05 level (#8) and at the 0.1 level (#3). Another three showed p-values between 0.1 and 0.2 (#1, #7, #12).

Fig. 3
figure 3

Results of baseline differences after randomization for the primary outcome in each meta-analysis. The median baseline values obtained from 6 trials were not included in the analysis. P-value was produced by one-proportion z-test. RCT, randomized controlled trial; SMD, standardized mean difference; CI, confidence interval

Full size image

Graphical representations of baseline differences

Figure 4A presents a forest plot for randomized baseline mean differences, where the median value was observed to be zero and the interval estimates for the SMD were in line with the cumulative normal distribution function. In five meta-analyses (#7, #6, #2, #1, #3), while the interval estimates followed the cumulative probability curve closely, the median value disaccorded with zero. In three other meta-analyses (#9, #4, #5), the deviation of the SMD estimates from the curve was wider, indicating greater variance than what was assumed, and some intervals were found to be out of line (Fig. 4B). Some skewness was suggested in the distribution of the baseline SMDs for the other four meta-analyses; three were skewed to the right (#8, #10, #13) and one to the left (#12). The funnel plots for those four meta-analyses exhibited asymmetry, with a linear trend of SMDs according to their SEs; larger differences in SMDs were found as the SEs became greater in three studies (#8, #13, #12), whereas in one study, larger differences in SMDs tended to be found when the SEs were smaller (#10) (Fig. 5).

Fig. 4
figure 4

Forest plots for a meta-analysis without skewness of the distribution. A Standard forest plot for baseline mean differences. B Forest plots for other studies. The vertical axis represents a probability from 0 to 1. The horizontal axis represents a baseline standardized mean difference (SMD), and a negative SMD value indicates that the treatment group is better at baseline. The size of the square shows the weight of trials. A black square represents a negative direction, and a white square represents a positive direction. The polygon indicates a pooled estimate \((\widehat b)\). The red line follows the cumulative normal distribution function with a mean of zero and variance \(\mathit{\operatorname{var}}(\hat{b})\). The red circle indicates the median and mean value of the distribution, which is SMD = 0

Full size image
Fig. 5
figure 5

Forest plots and funnel plots for a meta-analysis with skewness of the distribution. In the funnel plot, the x-axis is the standardized mean difference (SMD) at baseline and the y-axis is the standard error (SE). The pseudo 95% confidence interval line around the SMD equaling zero and the pooled SMD are presented

Full size image

Discussion

Our finding suggests that randomized baseline values for the primary outcome were not reported in about half of trials (52%). The majority of them (72%) were studies of postoperative pain management in surgical patients, for whom baseline pain scores would be irrelevant. Therefore, we excluded those trials from our evaluation of the randomized baseline status of the primary outcome. After excluding these trials, the actual proportion of trials that did not report randomized baseline values for the primary outcome was 25%. One other meta-analysis on the effectiveness of distracting children during needle-related medical procedures reported baseline pain scores in 45% of trials, although the primary outcome’s baseline value may also have been irrelevant. In this case, the reported baseline pain might be considered as an important prognostic factor that could influence the outcome, rather than a baseline value of the primary outcome itself, but 55% of trials still did not report values for this variable. A prior study of baseline variables that are predictive of outcomes in a meta-analysis found that 40% of trials did not report some of the baseline demographic data [34].

All the studies with significant baseline imbalances (3/13) or heterogeneity (3/13) were found to use a final value measured at the end of follow-up instead of changes in scores from baseline. We also found that all meta-analyses with a large proportion of missing baseline values (more than 30%) evaluated their outcome measures at the end of follow-up, which would be natural considering the unavailability of baseline values. If the baseline scores for the randomized patients are unbalanced in a clinical trial, ANCOVA is the optimal statistical method for adjustment [35]. When conducting a meta-analysis, we may also need to adjust for baseline differences when a significant imbalance occurs [10, 36]. However, when the randomized baseline values for the outcome are not reported in trials, and thus are not available for such an analysis, any existing method of statistical analysis would not be practical to apply.

In the forest plot, the SMDs of baseline outcome values for trials were positioned in descending order according to the value of k/(n + 1), where k is the rank of the trial given a total of n trials. In this way, each observed SMD could be considered as the crude k/(n + 1) × 100th percentile in the forest plot as an empirical version of a cumulative probability plot. The overlaid cumulative normal distribution curve can be interpreted as a guideline that would theoretically appear if the true mean baseline difference is zero. The interval estimates of baseline differences for the included trials are, therefore, expected to be approximately in line with the guideline if they were obtained from well-performed randomized trials. In this context, we aimed to identify how the observed baseline differences after randomization deviated from what would be obtained in the ideal situation where randomization was well-performed. In the ideal world, the true mean baseline difference should be fixed as a value of zero for all trials if the randomization was conducted well, with a certain extent of variation that we obtained from a fixed-effect model. A notable observed departure from the guideline curve might then be interpreted as a phenomenon caused by heterogeneity, possibly resulting from variation in the quality of randomization from study to study, or potential missingness in reports of baseline values, as suggested by the presence of a certain pattern, which may also be related to systematic bias in randomization.

Detecting a deviation in the forest plot from the guideline suggests a possibility of selection bias in randomization. Evaluating the pattern of deviation can help us to understand the characteristics of the bias. We found skewness of baseline differences in four meta-analyses; three were skewed to the right and one to the left. The direction of skewness primarily suggests the direction of selection bias that should be examined through characteristics of the disease and the intervention in the context of the study objective. A skewed distribution of baseline differences may additionally suggest a pattern of missingness in the values that could be identified through further investigation of its funnel plot. In those four meta-analyses, a large proportion of included trials did not report the randomized baseline values (20–55%), and therefore, the observed trend may be associated with the missingness. Three of those four meta-analyses showed a trend for the SMDs to increase as the SEs became greater, implying that a majority of the unreported values would likely be large SMD values missing in the opposite direction. Therefore, if the baseline values were fully reported, their observed distribution would more likely have a mean value closer to zero. In contrast, one meta-analysis showed a different pattern, suggesting that the missing values would be found in the same direction where the majority of observed values lay. This means that the distribution of baseline differences after randomization would still have a shifted mean from zero even if the missing values were filled, implying that some systematic subversion in randomization might have occurred in those trials.

We limited our study sample to Cochrane reviews published in 1 specific year. Our study had some limitations in interpreting the randomized baseline differences in the primary outcome and their reporting status in relation to study characteristics. For example, most of the pain outcomes included in our study did not have measurements of baseline status (postoperative pain management in surgical patients) and there was no study on controlling pain by a procedure in patients with pain in our study set, which would have been of interest since baseline pain measurements would be relevant in such a study. Therefore, future research with a broader range of characteristics, involving not only Cochrane reviews but also studies published in other major medical journals, will enable further elaboration of our results.

Our investigation was carried out using SMD measurements to compare the resulting balance in baseline values of the primary outcomes after randomization on a common scale across meta-analyses, the primary outcomes of which could have different magnitudes by their nature. However, if any future meta-analysts wish to use our approach for meta-analyses where the MD would be a more appropriate measure, there would be no need to choose the SMD over the MD unless they intend to compare their results to those of other studies that used a different outcome.

Our suggested approach is a visual exploratory analysis by nature. Since we did not apply any formal test, there might be some concerns about the subjectivity of interpretation, particularly in the determination of skewness. Although limited statistical power would still be a problem, it would be useful to devise a formal meta-analytic test method for skewness that could appropriately be considered in the given context. Furthermore, additional research on how the baseline imbalanced and missed baseline values affect pooled results in meta-analyses should be conducted in more detail as future work.

Conclusions

In our study, significant baseline imbalances or substantial baseline heterogeneity for the primary outcome commonly occurred after randomization. The Cochrane RoB 2.0 tool [7] recommends assessing imbalance in major key prognostic factors or baseline measures of outcome variables that are unlikely to occur by chance alone. We suggest that if a meta-analysis employs a primary outcome with a measurable baseline level, it is particularly essential to explore the full scope of its baseline imbalance among the trials by using graphical methods that could provide a sense of the likelihood of systematic selection bias and potential patterns of missing reports. These methods could help in determining whether and/or how to effectively adjust for the bias. If the primary studies do not report the relevant data, using any modeling technique for adjustment is of very limited applicability. It is particularly important to make sure that the included trials report those data.

Availability of data and materials

The data that support the findings of this study are secondary data drawn from already published literature as referenced within the article. The R scripts for the proposed graphical approach are provided in Appendix 1.

Abbreviations

RCT:

Randomized controlled trial

ANCOVA:

Analysis of covariance

CONSORT:

Consolidated Standards of Reporting Trials

PRISMA:

Preferred Reporting Items of Systematic reviews and Meta-Analyses

ROB:

Risk of bias

SD:

Standard deviation

SMD:

Standardized mean difference

CI:

Confidence interval

SE:

Standard error

References

  1. Vickers AJ, Altman DG. Statistics notes - Analysing controlled trials with baseline and follow up measurements. Bmj-Brit Med J. 2001;323(7321):1123–4.

    CAS  Article  Google Scholar 

  2. Schulz KF, Altman DG, Moher D, Grp C. CONSORT. Statement: updated guidelines for reporting parallel group randomised trials. Trials. 2010;2010:11.

    Google Scholar 

  3. Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.

    Article  Google Scholar 

  4. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Bmj-Brit Med J. 2021;372:n71.

    Article  Google Scholar 

  5. Higgins JPT, Altman DG, Gotzsche PC, Juni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. Bmj-Brit Med J. 2011;343:d5928.

    Article  Google Scholar 

  6. Corbett MS, Higgins JPT, Woolacott NF. Assessing baseline imbalance in randomised trials: implications for the Cochrane risk of bias tool. Res Synth Methods. 2014;5(1):79–85.

    Article  Google Scholar 

  7. Sterne JAC, Savovic J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019;366:l4898.

    Article  Google Scholar 

  8. Clark L, Fairhurst C, Cook E, TorgersOn DJ. Important outcome predictors showed greater baseline heterogeneity than age in two systematic reviews. J Clin Epidemiol. 2015;68(2):175–81.

    Article  Google Scholar 

  9. Trowman R, Dumville JC, Hahn S, Torgerson DJ. A systematic review of the effects of calcium supplementation on body weight. Br J Nutr. 2006;95(6):1033–8.

    CAS  Article  Google Scholar 

  10. Trowman R, Dumville JC, Torgerson DJ, Cranny G. The impact of trial baseline imbalances should be considered in systematic reviews: a methodological case study. J Clin Epidemiol. 2007;60(12):1229–33.

    Article  Google Scholar 

  11. Choi HJ, Hahn S, Kim CH, Jang BH, Park S, Lee SM, et al. Epidural steroid injection therapy for low back pain: a meta-analysis. Int J Technol Assess Health Care. 2013;29(3):244–53.

    Article  Google Scholar 

  12. Clark L, Fairhurst C, Hewitt CE, Birks Y, Braby S, Cockayne S, et al. A methodological review of recent meta-analyses has found significant heterogeneity in age between randomized groups. J Clin Epidemiol. 2014;67(9):1016–24.

    Article  Google Scholar 

  13. Higgins JPT, Green S. Cochrane Collaboration. Cochrane handbook for systematic reviews of interventions. Chichester, England; Hoboken, NJ: Wiley-Blackwell; 2008.

    Book  Google Scholar 

  14. Deeks JJ, Higgins J, Altman DG. Chapter 9: analysing data and undertaking meta-analyses. In: JPT H, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. The Cochrane Collaboration; 2011.

    Google Scholar 

  15. Egger M, Smith GD, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. Bmj-Brit Med J. 1997;315(7109):629–34.

    CAS  Article  Google Scholar 

  16. Del Fabbro M, et al. Autologous platelet concentrates for treating periodontal infrabony defects. Cochrane Database Syst Rev. 2018;11:CD011423.

    PubMed  Google Scholar 

  17. Polderman JAW, et al. Adverse side effects of dexamethasone in surgical patients. Cochrane Database Syst Rev. 2018;11:CD011940.

    PubMed  Google Scholar 

  18. Purgato M, et al. Psychological therapies for the treatment of mental disorders in low- and middle-income countries affected by humanitarian crises. Cochrane Database Syst Rev. 2018;7:CD011849.

    PubMed  Google Scholar 

  19. Makrgeorgou A, et al. Probiotics for treating eczema. Cochrane Database Syst Rev. 2018;11:CD006135.

    PubMed  Google Scholar 

  20. Mehrholz J, et al. Electromechanical and robot-assisted arm training for improving activities of daily living, arm function, and arm muscle strength after stroke. Cochrane Database Syst Rev. 2018;9:CD006876.

    PubMed  Google Scholar 

  21. Pittayanon R, et al. Prokinetics for functional dyspepsia. Cochrane Database Syst Rev. 2018;10:CD009431.

    PubMed  Google Scholar 

  22. Pattanaik S, et al. Phosphodiesterase inhibitors for lower urinary tract symptoms consistent with benign prostatic hyperplasia. Cochrane Database Syst Rev. 2018;11:CD010060.

    PubMed  Google Scholar 

  23. Htay H, et al. Biocompatible dialysis fluids for peritoneal dialysis. Cochrane Database Syst Rev. 2018;10:CD007554.

    PubMed  Google Scholar 

  24. Thieme H, et al. Mirror therapy for improving motor function after stroke. Cochrane Database Syst Rev. 2018;7:CD008449.

    PubMed  Google Scholar 

  25. Hwang EC, et al. Naftopidil for the treatment of lower urinary tract symptoms compatible with benign prostatic hyperplasia. Cochrane Database Syst Rev. 2018;10:CD007360.

    PubMed  Google Scholar 

  26. van der Steen JT, et al. Music-based therapeutic interventions for people with dementia. Cochrane Database Syst Rev. 2018;7:CD003477.

    PubMed  Google Scholar 

  27. Castells X, Blanco-Silvente L, Cunill R. Amphetamines for attention deficit hyperactivity disorder (ADHD) in adults. Cochrane Database Syst Rev. 2018;8:CD007813.

    PubMed  Google Scholar 

  28. Birnie KA, et al. Psychological interventions for needle-related procedural pain and distress in children and adolescents. Cochrane Database Syst Rev. 2018;10:CD005179.

    PubMed  Google Scholar 

  29. Brinck ECV, et al. Perioperative intravenous ketamine for acute postoperative pain in adults. Cochrane Database Syst Rev. 2018;12:CD012033.

    PubMed  Google Scholar 

  30. Weibel S, et al. Continuous intravenous perioperative lidocaine infusion for postoperative pain and recovery in adults. Cochrane Database Syst Rev. 2018;6:CD009642.

    PubMed  Google Scholar 

  31. Salicath JH, Yeoh ECY, Bennett MH. Epidural analgesia versus patient-controlled intravenous analgesia for pain following intra-abdominal surgery in adults. Cochrane Database Syst Rev. 2018;8:CD010434.

    PubMed  Google Scholar 

  32. Jaschinski T, et al. Laparoscopic versus open surgery for suspected appendicitis. Cochrane Database Syst Rev. 2018;11:CD001546.

    PubMed  Google Scholar 

  33. Doleman B, et al. Pre-emptive and preventive opioids for postoperative pain in adults undergoing all types of surgery. Cochrane Database Syst Rev. 2018;12:CD012624.

    PubMed  Google Scholar 

  34. Hicks A, Fairhurst C, Torgerson DJ. A simple technique investigating baseline heterogeneity helped to eliminate potential bias in meta-analyses. J Clin Epidemiol. 2018;95:55–62.

    Article  Google Scholar 

  35. Egbewale BE, Lewis M, Sim J. Bias, precision and statistical power of analysis of covariance in the analysis of randomized trials with baseline imbalance: a simulation study. BMC Med Res Methodol. 2014;14:49.

    Article  Google Scholar 

  36. Riley RD, Kauser I, Bland M, Thijs L, Staessen JA, Wang JG, et al. Meta-analysis of randomised trials with a continuous outcome according to baseline imbalance and availability of individual participant data. Stat Med. 2013;32(16):2747–66.

    Article  Google Scholar 

Download references

Funding

This research was supported by a grant of the Korea Health Technology R&D Project through the Korea Health Industry Development Institute, funded by the Ministry of Health & Welfare, Republic of Korea (grant number: HI19C1178) and also by the National Research Foundation of Korea (NRF) grant funded by the Ministry of Science and ICT of the Republic of Korea (grant number: 2022R1A2C101043711).

Author information

Authors and Affiliations

  1. Interdisciplinary Program in Medical Informatics, Seoul National University College of Medicine, Seoul, South Korea

    Eun-Gee Park

  2. Department of Human Systems Medicine, Seoul National University College of Medicine, Seoul, South Korea

    Seokyung Hahn

  3. Division of Medical Statistics, Medical Research Collaborating Center, Seoul National University Hospital, Seoul, South Korea

    Seokyung Hahn

  4. Institute of Health Policy and Management, Medical Research Center, Seoul National University, Seoul, South Korea

    Seokyung Hahn

Authors
  1. Eun-Gee Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Seokyung Hahn
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

SH conceived the original idea and was the guarantor of the study. E-GP and SH contributed to the conception and design of the study. E-GP contributed to the acquisition and analysis of data. E-GP and SH contributed to the interpretation of results. E-GP and SH drafted and critically revised the manuscript. All authors approved the final manuscript.

Corresponding author

Correspondence to Seokyung Hahn.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors of this study have nothing to disclose.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Appendix 1.

R scripts for generating graphical representations of baseline differences.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Park, EG., Hahn, S. An approach to exploring patterns of imbalance and potential missingness in reports of the randomized baseline values for primary outcomes measurable at baseline in randomized controlled trials for meta-analyses. BMC Med Res Methodol 22, 154 (2022). https://doi.org/10.1186/s12874-022-01620-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12874-022-01620-x

Keywords

  • Meta-analysis
  • Randomized controlled trials
  • Baseline imbalance
  • Baseline heterogeneity
  • Primary outcome

BMC Medical Research Methodology

ISSN: 1471-2288

Contact us