Skip to main content
Download PDF

Is it possible to estimate the minimal clinically important treatment effect needed to change practice in preterm birth prevention? Results of an obstetrician survey used to support the design of a trial

BMC Medical Research Methodology volume 12, Article number: 31 (2012) Cite this article

Abstract

Background

Sample sizes for obstetrical trials are often based on the opinion of investigators about clinically important effect size. We surveyed Canadian obstetricians to investigate clinically important effect sizes required before introducing new treatments into practice to prevent preterm birth.

Methods

Questionnaires were mailed to practicing obstetricians, asking the magnitude of pregnancy prolongation required to introduce treatments into practice. The three prophylactic treatments were of increasing invasiveness: vaginal progesterone, intramuscular progesterone, and cervical cerclage. We also asked about the perceived most relevant outcome measures for obstetrical trials and current obstetrical practice in preterm birth prevention.

Results

544/1293(42.1%) completed questionnaires were received. The majority of respondents required one or two weeks' increase in length of gestation before introducing vaginal (372,77.1%), and intramuscular progesterone(354,67.9%). At least three weeks increase was required before introducing prophylactic cervical cerclage(326,62.8%). Clinicians who already used a treatment required a smaller difference before introducing it into practice. Decreasing neonatal morbidity was cited as the most important outcome for obstetrical trials (349,72.2%).

Conclusion

Obstetricians would require a larger increase in treatment effect before introducing more invasive treatments into practice. Although infant morbidity was perceived as a more important outcome, clinicians appeared willing to change practice on the basis of prolongation of pregnancy, a surrogate outcome. We found that there is not a single minimum clinically important treatment effect that will influence all practising clinicians: rather the effect size that will influence physicians is affected by the nature of the treatment, the reported outcome measure and the clinician's own current clinical practice.

Peer Review reports

Background

Clinical practice should be guided by evidence from well designed clinical trials [1–3]. Unfortunately, the transfer of knowledge from research into practice is often challenging, with a concomitant delay in the uptake of new evidence [3, 4]. Many reasons for the delay have been proposed, including the inadequate dissemination of research findings [5, 6], and barriers caused by entrenched physician beliefs [6–8].

Factors associated with research design also play an important role. Randomised controlled trials are generally accepted as the "gold standard" for health research, however studies that report statistically significant findings can lack relevance for major stakeholders such as clinicians, patients, and policy makers [9, 10] and therefore fail to influence practice. Large sample sizes may lead to findings that are statistically significant but clinically irrelevant in their reflection of minor change [11–13]. Small sample sizes lead to studies that are underpowered to detect meaningful differences [12]. Additionally, sample size calculations may be based on estimates of effect size that are not relevant to the study being designed, or based on expert opinion [14]. Clinical relevance is important for fixed and other more efficient study designs (such as group-sequential designs [15]).

Concerns about clinical relevance of trials led to the concept of "minimal clinically important difference" (MCID) [16]. Originally applied to quality of life scales that are difficult for clinicians to interpret directly, MCID is defined as the lowest threshold of change believed to be important by patients and clinicians [13, 16–19]. Other definitions have been suggested, including "minimal important difference" [14] and "really important difference" [20]. In treatment trials, important differences are termed "clinically important treatment effects" [21], however trial designers continue to struggle with determining the appropriate size of effect that would be sufficient to influence clinical practice. Many trialists choose to use an "opinion-based" method to estimate clinically important treatment effects, as opposed to "distribution approaches" which use statistical methods based on the distributions of scores of the measure of interest in control populations, or "anchor approaches" that compare scores of measures of interest with reference measures of known meaning [22]. The "opinion approach" gathers opinions of patients or experts [23], the investigators or their collaborators [24], however the effect size required to change practice is known to be affected by a number of additional factors including clinical context [17], physician background [25], and individual decision making patterns [26]. For this reason, reliance on expert opinion to determine clinically important effect size is unlikely to reflect the generality of clinicians who will ultimately be the recipients of the research findings.

In addition to other important factors such as the mean and variance of the primary outcome, a plausible estimate of effect size was a critical consideration in our estimation of sample size for a randomised trial of vaginal progesterone versus placebo to prevent preterm birth in multiple pregnancy [27]. We wished our trial to be as small as it could be to find the clinically important treatment effect, and to ensure our trial was feasible [26]. We knew that designing a large trial that resulted in a change in pregnancy prolongation of only one or two days (even if found statistically different) would be unlikely to change clinical practice, but we did not know the minimum difference that would influence obstetrical practice. We therefore undertook a survey of practicing obstetricians in Canada to examine the minimum prolongation of pregnancy necessary to change practice in hypothetical randomised controlled trials of treatments to prevent preterm birth. Our study also examined the relative importance of different outcome measures in clinical trials.

Methods

This study, approved by the University of Calgary Conjoint Health Research Ethics Board (Ethics ID 18809), was a mailed questionnaire survey of all practicing obstetricians in Canada conducted between March 2006 and June 2006. Current lists of registered obstetricians and gynaecologists were obtained from the Colleges of Physicians and Surgeons in each Canadian province (n = 10) and territory (n = 3). The Ontario file excluded physicians who had not consented to have contact information released. The lists did not distinguish between obstetricians and gynaecologists, and therefore questionnaires were sent to all those listed (n = 1531).

Each identified physician was mailed a structured questionnaire. Two reminders were mailed at five week intervals to non-responders. Recipients were first asked to indicate if they did not provide care for pregnant women and return the questionnaire without further completion to avoid being sent further questionnaires.

The questionnaire was developed through discussion among the research team, and piloted with obstetrical residents (who were not therefore involved in the actual survey). The questionnaire consisted of four sections (Additional file 1). The first section contained three vignettes describing clinical settings in which treatments might be used for women at risk of preterm birth, and asked about the minimum prolongation of pregnancy that would be necessary for the respondent to introduce preventative treatments into their practice:

Treatment 1: prophylactic daily progesterone supplementation, administered vaginally after 16 weeks gestational age. Progesterone is a hormone treatment that may theoretically reduce the likelihood of preterm birth. Risk factor: multiple gestation.

Treatment 2: prophylactic weekly progesterone supplementation, administered intramuscularly after 16 weeks gestational age. Risk factors: history of preterm birth or shortened cervix on ultrasound or positive fetal fibronectin.

Treatment 3: prophylactic cervical cerclage placed between 16-23 6/7 weeks gestational age. Cerclage is a surgical procedure in which a stitch is placed in the cervix to prevent it from opening in pregnancy. Risk factor: shortened cervix on ultrasound.

The questionnaire provided three options for prolongation of pregnancy: one, two or three weeks. Respondents were asked to select the minimum prolongation they felt would be necessary to introduce that treatment into their clinical practice.

The next section asked about the most important clinical outcome for justifying a change to clinical practice, and whether the respondent would be willing to join randomised trials that would investigate the same three new prophylactic treatments. Respondents were also asked about their current practice in relation to the three treatments. Finally respondents were asked about their age, length of time in practice, gender and practice setting.

Statistical analyses were carried out using SAS 9.2 (SAS Institute Inc., Cary, NC), and were mainly descriptive. Analyses were carried out on only complete responses for each question, because there were several question funnels which meant that some questions were not relevant to all respondents. For example, in the sections about current clinical practice, it would have been inappropriate to impute data for subjects who did not respond because that section was not relevant to them. Friedman test, a non-parametric test comparing matched multiple groups, was used to test whether within subjects the responses (prolongation of pregnancy needed to change practice) differed significantly between the three interventions. Pearson Chi Squared tests were used to examine differences between groups (for example clinicians practicing in different settings) in the proportion of respondents giving different choices of gestational prolongation required to change practice.

Results

Response rate

Of 1531 questionnaires mailed out, 269 respondents did not provide care to pregnant women or the questionnaires were returned because the addressees had moved away. Thus questionnaires were presumed delivered to 1292 appropriate recipients, of whom 544 (42.1%) returned completed questionnaires. The characteristics of respondents are shown in Table 1.

Table 1 Characteristics of respondents
Full size table

Prolongation of pregnancy necessary to change practice

Respondents were asked to select the minimum prolongation of pregnancy they believed was necessary to introduce a preventative treatment into their clinical practice for patients with risk factors for preterm birth (Table 2). The majority of respondents would accept a minimum increase in gestation of one week or two weeks to introduce vaginal progesterone for women with multiple gestations (372, 77.1%), and intramuscular progesterone for women with singleton pregnancies and a history of preterm birth or shortened cervix on ultrasound or positive fetal fibronectin (354, 67.9%). Prolongation of pregnancy by at least 3 weeks was required by the majority of respondents (326, 62.8%) before introducing prophylactic cervical cerclage for women with a short cervix.

Table 2 Prolongation of pregnancy required to introduce new treatment into practice
Full size table

A Friedman test was carried out to compare, within subjects, the responses for the three interventions. This test found that responses for the three interventions differed significantly (×2 = 291, df = 2, p < 0.001). The mean ranks for the three treatments were: vaginal progesterone 1.75, intramuscular progesterone 1.85, cerclage 2.39. This suggests that there was a tendency to need a larger effect size to introduce intramuscular progesterone than vaginal progesterone, and there was a need for a larger effect size to introduce cerclage.

Pearson Chi Squared tests were carried out to estimate if there was a difference between respondents from teaching hospitals versus those in community hospitals in the level of evidence required to change their practice for each of the three treatments. These tests did not demonstrate differences between groups.

Current practice

Respondents were asked to describe their current obstetrical practice relevant to the treatments in the scenarios (Table 3).

Table 3 Current clinical practice - treatments for women at risk of preterm birth
Full size table

Only 17 (3.2%) currently prescribed prophylactic progesterone for women with multiple pregnancies, all of whom would consider a history of previous preterm delivery in their decision to treat. Among the 17 who would use progesterone, vaginal treatment was prescribed by 11 (64.7%), with the earliest start at a mean of 12 weeks' gestation and the latest stopping date at mean 27 weeks.

Fifty-one respondents (9.7%) would prescribe progesterone for women with risk factors with singleton pregnancies, the majority of whom (49, 96.1%) would consider a history of previous preterm delivery in their decision to treat. Similarly, vaginal treatment was favored by the majority (37 (72.5%), with the earliest start at a mean of 13 weeks gestation and the latest stopping at mean of 29 weeks.

Cerclage was a more widely used treatment, with 317 (62.8%) responding that they currently perform prophylactic cervical cerclage. A number of risk factors influenced the decision to place a cerclage: the most common were short cervix (190, 59.9%), previous preterm delivery (176, 55.5%) and a diagnosis of incompetent cervix (139, 43.8%). Cerclage would be performed at the earliest at mean 13 weeks of gestation, and at the latest at 22 weeks.

Pearson Chi Squared tests were carried out to estimate if there was a difference between respondents who currently used a treatment versus those who did not, in the level of evidence required to change their practice. The test for cerclage appeared to indicate that more who currently used prophylactic cerclage would be willing to accept a smaller effect size to introduce prophylactic cerclage into practice (Table 4, ×2 = 8.17, p = 0.017). For progesterone treatments, current use was not associated with effect size.

Table 4 Current use of cerclage and minimum prolongation of pregnancy required to introduce prophylactic cerclage into practice
Full size table

Feasibility of a trial

The majority of respondents stated that decreased fetal morbidity (379, 72.2%) was the single most important outcome measure that would justify introducing a new treatment into their practice, rather than prolongation of pregnancy (95, 18.1%) (Table 5).

Table 5 Feasibility of trials
Full size table

The majority of respondents would be willing to take part in a placebo controlled trial of vaginal progesterone for women with multiple pregnancies (450, 84.1%), and a trial of intramuscular progesterone for women with singleton pregnancies (410, 77.5%) (Table 6). The most commonly cited reason for not joining the multiple gestation trial was having too few such patients in their practice (26/85, (30.6%) (Table 6). The main concern about the intramuscular progesterone trial was patient discomfort associated with weekly intramuscular injections (32/119, 26.9%) (Table 6). By contrast, only a minority of respondents would consider taking part in the proposed cerclage trial (239, 45.5%) (Table 5): the main reason for not wishing to join such a trial was concerns about the invasive nature of the cerclage itself (110/288, 38.2%) (Table 6).

Table 6 Reasons given for not taking part in a trial
Full size table

Discussion

The determination of a suitable estimate of effect size is notoriously difficult [26]. Our mailed survey of all Canadian obstetricians attempted to estimate the clinically important treatment effect required to change practice in the prevention of preterm birth, in order to increase the likelihood that our research would be relevant, with the potential to influence clinical practice. Our study found that responding clinicians were willing to identify an increase in duration of pregnancy that they believed would change their practice. The small amount of missing data indicated that respondents found the clinical scenarios plausible.

Our study found that minimal clinically important treatment effect was associated with the invasiveness of the treatment, and current clinical practice of the respondents. A one or two week prolongation of pregnancy was the minimum effect size required by around 70% of obstetricians to introduce new progesterone treatments into their practice for treating women at risk of preterm birth. Cerclage, a more invasive treatment, required a larger minimum effect size: a three week increase was needed to introduce this treatment. Availability of the treatment also influenced the minimum important treatment effect: clinicians who already had access to cerclage were willing to accept a smaller effect size to utilize this treatment.

The impact of the choice of effect size may best be illustrated using the parameters we employed when calculating the sample size for our progesterone trial [27]. For that study, we used local data from a two year period to estimate the usual (untreated) mean and standard deviation gestational age of delivery for multiple pregnancies. Sample size calculations using a power of 80% and two-sided significance level of 0.05, would estimate sample sizes as follows: to detect a three week difference, a sample of 36 (18 per randomised group) would be required; for two weeks, the sample size would be 78 (39 per group); for one week, the sample size would be 156 (78 per group). If the three week effect size was chosen, and therefore the smaller sample size was used, a real difference between treated and control groups of one or two weeks would not be identified as a significant difference. These examples clearly show that the choice of clinically important treatment effect has a practical effect on the design, conduct and clinical relevance of the study. Applying these examples to our hypothetical scenarios, it is clear that a trial of cerclage versus no cerclage would be smaller in size than a trial of a progesterone treatment versus placebo.

The principal goal of prophylactic treatment for women at risk of preterm labour is to improve the outcome for the neonate by reducing morbidity and mortality. The consequences of even late preterm birth are considerable, with worse developmental outcomes and academic difficulties up to seven years of age compared to term infants [28]. In our questionnaire study, the majority of respondents (72.2%) clearly recognised this by stating that decreased fetal morbidity was the most important outcome to justify changing clinical practice. Despite this, in our hypothetical scenarios where clinicians were asked to consider changing their clinical practice on the basis of prolongation of pregnancy, all but 4% were willing to make a choice based on that outcome. It therefore appears that clinicians would be willing to accept a surrogate outcome on which to base a change in clinical practice. This is an important point: a trial that measures impact of a treatment on fetal or neonatal morbidity, even in a trial examining preterm birth where adverse neonatal events would be expected, will need to be far larger than one that measures impact on pregnancy duration, where every pregnancy will have an outcome [29]. In addition, the definition of a 'neonatal morbidity' composite outcome is fraught with difficulty, and is open to misinterpretation by clinicians and patients [29]. Thus the choice of effect size and choice of outcome will impact on the size and expense of a clinical trial. Both of these choices will also impact on the adoption of trial findings into clinical practice.

We were interested about the feasibility of trials of treatments to prevent preterm birth. Concern for the patient and increasing invasiveness of the intervention impacted on respondents' decisions about taking part in a trial. The majority of respondents would be willing to take part in both hypothetical progesterone trials. The most frequently cited reason for declining to take part in the multiple trial was feasibility (lack of suitable cases), while concern about the intervention (for example patient discomfort) was most commonly cited for the intramuscular progesterone trial. Concern about cerclage itself was a common reason for not wishing to take part in a trial, although 13.2% believed that there was already sufficient evidence to use prophylactic cerclage in women with a short cervix. We did not lead clinicians in their reason for not wishing to take part in each trial, rather leaving them to provide text answers to open-ended questions. Therefore we believe the responses were those that mattered most to the clinicians.

The design of our questionnaire could be criticised for a number of reasons. Firstly, the questionnaire described three hypothetical scenarios, including different risk factors for preterm birth. Although designed to represent clinical experience, we do not know whether the responses would reflect actual practice. Secondly, in the clinical scenarios, we used a forced choice method that asked clinicians to choose a one, two or three week prolongation of pregnancy as the outcome for the hypothetical treatments. It is possible that clinicians would be willing to accept a shorter increase or would prefer a longer increase in gestation before changing their practice. We set the earliest gestational age for treatment at 16 weeks, and the longest duration of pregnancy as 33 weeks and 4 days [30, 31], for each hypothetical prolongation of pregnancy. Thus it is possible that the choice of clinically important increase in duration of pregnancy may have been affected by our descriptions. These scenarios and choices were necessarily complex, reflecting situations commonly encountered by obstetricians who manage high risk pregnancies.

Much research relevant to the prevention of preterm birth has been published since our survey was carried out, reflecting the ongoing interest and importance of this topic. Recent publications conclude that, in appropriately selected women with high-risk singleton pregnancies, progesterone can reduce preterm birth before 33 weeks' gestation [32], and cerclage can reduce preterm birth and improve neonatal outcome [33]. Trials of progesterone in multiple pregnancies have failed to prevent preterm birth [34], most likely because of a difference in aetiology, perhaps involving larger fetal and placental mass, and greater stretching of uterine muscle [35]. Nonetheless, preterm birth remains the most concerning perinatal problem for obstetricians, and therefore new progesterone trials continue to be undertaken [36], and the search for new effective treatments continues.

Our survey of all obstetricians was challenging and would not be feasible for all trials, partly because such surveys are costly and time consuming, and partly because clinicians would be plagued by many similar questionnaires, leading to declining response rates and possible bias in the results. In the future, we believe that a more limited survey of a random sample of practicing clinicians would be more appropriate. In our study, however, obstetricians were willing to respond to our fairly complex questionnaire: we achieved a response rate of 42.1% after only two reminders, similar to response rates from other surveys of clinical practice [25, 37, 38]. Our respondents came from a range of clinical settings and had a range of experience. Our large number of responses (n = 544) leads us to believe that our findings are more representative of clinician beliefs than the more usual practice of identifying the minimum clinically important treatment effect by discussion with trial collaborators [25] or experts [23].

Conclusion

The importance of our study lies in the continuing need to undertake meaningful and efficient randomized trials that are designed to support clinical practice [2, 3]. Such trials must provide clinically important differences rather than merely statistically significant differences, and the results should be available in a timely way [7, 13]. To be timely, trials should be designed to be as small as realistically possible to obtain clinically relevant results. Our study developed a method that was able to estimate the clinically important difference needed to design our randomised trial [27]. Clinical trialists must make the additional effort to estimate the minimum clinically important treatment effect that is relevant to practicing clinicians. Without this effort, trials will continue to fail to influence clinical practice.

Authors' information

SR is a health services researcher and Professor in the Departments of Obstetrics and Gynaecology, Family Medicine, Community Health Sciences and Family Medicine, and Director of Research in the Department of Obstetrics and Gynaecology, University of Calgary. JM was a research associate in the Department of Obstetrics and Gynaecology, University of Calgary. SD was involved in this study during her residency in obstetrics and gynaecology in Calgary, and is now a perinatologist in the Department of Obstetrics and Gynaecology at the University of Calgary. ST is data analyst in the Department of Obstetrics and Gynaecology, University of Calgary. SW is an obstetrician/gynaecologist and Associate Professor in the Departments of Obstetrics and Gynaecology and Community Health Sciences, University of Calgary.

References

  1. Sackett D, Rosenberg WM, Gray JA, Haynes RB, Richardson WS: Evidence based medicine: What it is and what it isn't. BMJ. 1996, 312: 71-72. 10.1136/bmj.312.7023.71.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  2. Lorenz K, Ryan G, Morton S, Chan K, Wang S, Shekelle P: A qualitative examination of primary care providers' and physicians managers' uses and views of research evidence. International Journal for Quality in Health Care. 2005, 17: 409-414. 10.1093/intqhc/mzi054.

    Article  PubMed  Google Scholar 

  3. Guyatt G, Cook D, Haynes B: Evidence based medicine has come a long way. BMJ. 2004, 329: 900-901.

    Article  Google Scholar 

  4. Claridge J, Fabian T: History and Development of evidence-based medicine. World Journal of Surgery. 2005, 29: 547-553. 10.1007/s00268-005-7910-1.

    Article  PubMed  Google Scholar 

  5. McAlister F, O'Connor A, Wells G, Grover S, Laupacis A: When should hypertension be treated? The different perspectives of Canadian family physicians and patients. CMAJ. 2000, 163: 403-408.

    CAS  PubMed  PubMed Central  Google Scholar 

  6. Cabana M, Rand C, Powe N, Wu A, Wilson M, Abboud PA, Rubin H: Why don't physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999, 282: 1458-1465. 10.1001/jama.282.15.1458.

    CAS  Article  PubMed  Google Scholar 

  7. Grol R, Grimshaw J: From best evidence to best practice: effective implementation of changes in patients' care. Lancet. 2003, 362: 1225-1230. 10.1016/S0140-6736(03)14546-1.

    Article  PubMed  Google Scholar 

  8. Houghton A, Cowley A: Why are angiotension converting enzyme inhibitors underutilized in the treatment of heart failure by general practitioners?. Int J Cardiol. 1997, 59: 7-10. 10.1016/S0167-5273(96)02904-X.

    CAS  Article  PubMed  Google Scholar 

  9. Jacobson N, Berns S, McGilinchey J: Methods for defining and interpreting the cinical significance of treatment effects: Description, application, and alternatives. J Consult Clin Psychol. 1999, 67: 300-307.

    CAS  Article  PubMed  Google Scholar 

  10. Tunis S, Stryer D, Clancy C: Practical clinical trials. Increasing the value of clinical research for decision making in clinical and health policy. JAMA. 2003, 290: 1624-1632. 10.1001/jama.290.12.1624.

    CAS  Article  PubMed  Google Scholar 

  11. Crosby R, Kolotkin R, Williams R: Defining clinically meaningful change in health-related quality of life. Journal of Clinical Epidemiology. 2003, 56: 395-407. 10.1016/S0895-4356(03)00044-1.

    Article  PubMed  Google Scholar 

  12. Scales DC, Rubenfeld GD: Estimating sample size in critical care clinical trials. J Crit Care. 2005, 20 (1): 6-11. 10.1016/j.jcrc.2005.02.002.

    Article  PubMed  Google Scholar 

  13. Copay AG, Subach BR, Glassman SD, Polly DW, Schuler TC: Understanding the minimum clinically important difference: a review of concepts and methods. Spine J. 2007, 7 (5): 541-546. 10.1016/j.spinee.2007.01.008.

    Article  PubMed  Google Scholar 

  14. Barrett B, Brown D, Mundt M, Brown R: Sufficiently important difference: expanding the framework of clinical significance. Med Decis Making. 2005, 25: 250-261. 10.1177/0272989X05276863.

    Article  PubMed  Google Scholar 

  15. Morgan C: Sample size re-estimation in group-sequential response-adaptive clinical trials. Stat Med. 2003, 22: 3843-3857. 10.1002/sim.1677.

    Article  PubMed  Google Scholar 

  16. Jaeschke R, Singer J, Guyatt G: Measurement of health status: ascertaining the minimal clinically important difference. Control Clin Trials. 1989, 10: 407-415. 10.1016/0197-2456(89)90005-6.

    CAS  Article  PubMed  Google Scholar 

  17. Hays R, Woolley J: The concept of clinically important differences in health-related quality of life research. Pharmoeconomics. 2000, 18: 419-423. 10.2165/00019053-200018050-00001.

    CAS  Article  Google Scholar 

  18. Beaton D, Boers M, Wells G: Many faces of the minimal clinically important difference (MCID): A literature review and directions for future research. Curr Opin Rheumatol. 2002, 14: 109-114. 10.1097/00002281-200203000-00006.

    Article  PubMed  Google Scholar 

  19. Kashani I, Hall JL, Hall JC: Reporting of minimum clinically important differences in surgical trials. ANZ J Surg. 2009, 79 (4): 301-304. 10.1111/j.1445-2197.2009.04865.x.

    Article  PubMed  Google Scholar 

  20. Wolfe F, Michaud K, Strand V: Expanding the definition of clinical differences: from minimally clinically important differences to really important differences. Analyses in 8931 patients with rheumatoid arthritis. J Rheumatol. 2005, 32 (4): 583-589.

    PubMed  Google Scholar 

  21. Naylor CD, Llewellyn-Thomas HA: Can there be a more patient-centred approach to determining clinically important effect sizes for randomized treatment trials?. J Clin Epidemiol. 1994, 47 (7): 787-795. 10.1016/0895-4356(94)90176-7.

    CAS  Article  PubMed  Google Scholar 

  22. Make B: How can we assess outcomes of clinical trials: the MCID approach. COPD: Journal of Chronic Obstructive Pulmonary Disease. 2007, 4: 191-194. 10.1080/15412550701471231.

    Article  PubMed  Google Scholar 

  23. Kirkby HM, Wilson S, Calvert M, Draper H: Using e-mail recruitment and an online questionnaire to establish effect size: A worked example. BMC Med Res Methodol. 2011, 11 (1): 89-10.1186/1471-2288-11-89.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Brasher PM, Brant RF: Sample size calculations in randomized trials: common pitfalls. Can J Anaesth. 2007, 54 (2): 103-106. 10.1007/BF03022005.

    Article  PubMed  Google Scholar 

  25. van Walraven C, Mahon J, Moher D, Bohm C, Laupacis A: Surveying physicians to determine the minimally important difference: Implications for sample-size calculation. J Clin Epidemiol. 1999, 52: 717-723. 10.1016/S0895-4356(99)00050-5.

    CAS  Article  PubMed  Google Scholar 

  26. Kirwan JR: Minimum clinically important difference: the crock of gold at the end of the rainbow?. J Rheumatol. 2001, 28: 439-444.

    CAS  PubMed  Google Scholar 

  27. Wood S, Ross S, Sauve R, Brant R: Vaginal progesterone versus placebo in multiple pregnancy. ClinicalTrials.gov http://clinicaltrials.gov/ct2/show/NCT00343265 (accessed 13 June 2011)

  28. McGowan J, Alderdice F, Holmes V, Johnston L: Early childhood development of late-preterm infants: a systematic review. Pediatrics. 2011, 127: 1111-1124. 10.1542/peds.2010-2257.

    Article  PubMed  Google Scholar 

  29. Ross S: Composite outcomes in randomized clinical trials: arguments for and against. Am J Obstet Gynecol. 2007, 196 (2): 119-e1-6

    Article  PubMed  Google Scholar 

  30. Kramer MS, Demissie K, Yang H, Platt RW, Sauve R, Liston R: The contribution of mild and moderate preterm birth to infant mortality. Fetal and Infant Health Study Group of the Canadian Perinatal Surveillance System. JAMA. 2000, 284 (7): 843-849. 10.1001/jama.284.7.843.

    CAS  Article  PubMed  Google Scholar 

  31. Clements KM, Barfield WD, Ayadi MF, Wilber N: Preterm birth-associated cost of early intervention services: an analysis by gestational age. Pediatrics. 2007, 119 (4): e866-10.1542/peds.2006-1729. 74.32

    Article  PubMed  Google Scholar 

  32. Hassan S, Romero R, Vidyadhari D, Fusey S, Baxter J, Khandelwal M, Vijayaraghavan J, Trivedi Y, Soma-Pillay P, Sambarey P, Dayal A, Potapov V, O'Brien J, Astakhov V, Yuzko O, Kinzler W, Dattel B, Sehdev H, Mazheika L, Manchulenko D, Gervasi MT, Sullivan L, Conde-Agudelo A, Phillips JA, Creasy GW: PREGNANT Trial. Vaginal progesterone reduces the rate of preterm birth in women with a sonographic short cervix: a multicenter, randomized, double-blind, placebo-controlled trial. Ultrasound Obstet Gynecol. 2011, 38: 18-31.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  33. Berghella V, Rafael T, Szychowski J, Rust O, Owen J: Cerclage for short cervix on ultrasonography in women with singleton gestations and previous preterm birth: a meta-analysis. Obstet Gynecol. 2011, 117: 663-671. 10.1097/AOG.0b013e31820ca847.

    Article  PubMed  Google Scholar 

  34. Rode L, Klein K, Nicolaides KH, Krampl-Bettelheim E, Tabor A: PREDICT Group. Prevention of preterm delivery in twin gestations (PREDICT): a multicenter, randomized, placebo-controlled trial on the effect of vaginal micronized progesterone. Ultrasound Obstet Gynecol. 2011, 38: 272-280.

    CAS  Article  PubMed  Google Scholar 

  35. Stock S, Norman J: Preterm and term labour in multiple pregnancies. Semin Fetal Neonatal Med. 2010, 15: 336-341. 10.1016/j.siny.2010.06.006.

    Article  PubMed  Google Scholar 

  36. van Os M, van der Ven J, Kleinrouweler E, Pajkrt E, de Miranda E, van Wassenaer A, Porath M, Bossuyt PM, Bloemenkamp KW, Willekes C, Woiski M, Oudijk MA, Bilardo KM, Sikkema MJ, Duvekot JJ, Veersema D, Laudy J, Kuiper P, de Groot CJ, Mol BW, Haak MC: Preventing preterm birth with progesterone: costs and effects of screening low risk women with a singleton pregnancy for short cervical length, the Triple P study. BMC Pregnancy Childbirth. 2011, 11: 77-10.1186/1471-2393-11-77.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  37. Pramod R, Okun N, McKay D, Kiehn L, Hewson S, Ross S, Hannah ME: Cerclage for the short cervix demonstrated by transvaginal ultrasound: current practice and opinion. J Obstet Gynaecol Can. 2004, 26 (6): 564-570.

    Article  PubMed  Google Scholar 

  38. Arunkalaivanan AS, Barrington JW: Questionnaire-based survey on obstetricians and gynaecologists' attitudes towards the surgical management of urinary incontinence in women during their childbearing years. Eur J Obstet Gynecol Reprod Biol. 2003, 108 (1): 85-93. 10.1016/S0301-2115(02)00431-1.

    CAS  Article  PubMed  Google Scholar 

Pre-publication history

Download references

Acknowledgements

The authors acknowledge the contribution of Cheryl Swaby RN to data collection.

This study was internally funded as part of the Partnership for Research and Education for Mothers and Infants (PREMI) program of research. Funding for PREMI was provided by the Ross Division of Abbott Laboratories.

Author information

Authors and Affiliations

  1. Department of Obstetrics and Gynaecology, University of Calgary, Calgary, T2N 2T9, Canada

    Sue Ross, Jill Milne, Shannon Dwinnell, Selphee Tang & Stephen Wood

  2. Department of Community Health Sciences, University of Calgary, Calgary, T2N 4Z6, Canada

    Sue Ross, Selphee Tang & Stephen Wood

  3. Department of Family Medicine, University of Calgary, Calgary, T2N 4N1, Canada

    Sue Ross

  4. Department of Surgery, University of Calgary, Calgary, T2N 2T9, Canada

    Sue Ross

Authors
  1. Sue Ross
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jill Milne
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shannon Dwinnell
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Selphee Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Stephen Wood
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sue Ross.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

All authors contributed equally to the design of the follow-up study, participated in writing the manuscript and have read and approved the final version.

Electronic supplementary material

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Ross, S., Milne, J., Dwinnell, S. et al. Is it possible to estimate the minimal clinically important treatment effect needed to change practice in preterm birth prevention? Results of an obstetrician survey used to support the design of a trial. BMC Med Res Methodol 12, 31 (2012). https://doi.org/10.1186/1471-2288-12-31

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2288-12-31

Keywords

  • Research design
  • Cross-sectional survey
  • Premature birth
  • Clinical trials as topic

BMC Medical Research Methodology

ISSN: 1471-2288

Contact us