Is it possible to estimate the minimal clinically important treatment effect needed to change practice in preterm birth prevention? Results of an obstetrician survey used to support the design of a trial
© Ross et al; licensee BioMed Central Ltd. 2012
Received: 7 July 2011
Accepted: 19 March 2012
Published: 19 March 2012
Sample sizes for obstetrical trials are often based on the opinion of investigators about clinically important effect size. We surveyed Canadian obstetricians to investigate clinically important effect sizes required before introducing new treatments into practice to prevent preterm birth.
Questionnaires were mailed to practicing obstetricians, asking the magnitude of pregnancy prolongation required to introduce treatments into practice. The three prophylactic treatments were of increasing invasiveness: vaginal progesterone, intramuscular progesterone, and cervical cerclage. We also asked about the perceived most relevant outcome measures for obstetrical trials and current obstetrical practice in preterm birth prevention.
544/1293(42.1%) completed questionnaires were received. The majority of respondents required one or two weeks' increase in length of gestation before introducing vaginal (372,77.1%), and intramuscular progesterone(354,67.9%). At least three weeks increase was required before introducing prophylactic cervical cerclage(326,62.8%). Clinicians who already used a treatment required a smaller difference before introducing it into practice. Decreasing neonatal morbidity was cited as the most important outcome for obstetrical trials (349,72.2%).
Obstetricians would require a larger increase in treatment effect before introducing more invasive treatments into practice. Although infant morbidity was perceived as a more important outcome, clinicians appeared willing to change practice on the basis of prolongation of pregnancy, a surrogate outcome. We found that there is not a single minimum clinically important treatment effect that will influence all practising clinicians: rather the effect size that will influence physicians is affected by the nature of the treatment, the reported outcome measure and the clinician's own current clinical practice.
KeywordsResearch design Cross-sectional survey Premature birth Clinical trials as topic
Clinical practice should be guided by evidence from well designed clinical trials [1–3]. Unfortunately, the transfer of knowledge from research into practice is often challenging, with a concomitant delay in the uptake of new evidence [3, 4]. Many reasons for the delay have been proposed, including the inadequate dissemination of research findings [5, 6], and barriers caused by entrenched physician beliefs [6–8].
Factors associated with research design also play an important role. Randomised controlled trials are generally accepted as the "gold standard" for health research, however studies that report statistically significant findings can lack relevance for major stakeholders such as clinicians, patients, and policy makers [9, 10] and therefore fail to influence practice. Large sample sizes may lead to findings that are statistically significant but clinically irrelevant in their reflection of minor change [11–13]. Small sample sizes lead to studies that are underpowered to detect meaningful differences . Additionally, sample size calculations may be based on estimates of effect size that are not relevant to the study being designed, or based on expert opinion . Clinical relevance is important for fixed and other more efficient study designs (such as group-sequential designs ).
Concerns about clinical relevance of trials led to the concept of "minimal clinically important difference" (MCID) . Originally applied to quality of life scales that are difficult for clinicians to interpret directly, MCID is defined as the lowest threshold of change believed to be important by patients and clinicians [13, 16–19]. Other definitions have been suggested, including "minimal important difference"  and "really important difference" . In treatment trials, important differences are termed "clinically important treatment effects" , however trial designers continue to struggle with determining the appropriate size of effect that would be sufficient to influence clinical practice. Many trialists choose to use an "opinion-based" method to estimate clinically important treatment effects, as opposed to "distribution approaches" which use statistical methods based on the distributions of scores of the measure of interest in control populations, or "anchor approaches" that compare scores of measures of interest with reference measures of known meaning . The "opinion approach" gathers opinions of patients or experts , the investigators or their collaborators , however the effect size required to change practice is known to be affected by a number of additional factors including clinical context , physician background , and individual decision making patterns . For this reason, reliance on expert opinion to determine clinically important effect size is unlikely to reflect the generality of clinicians who will ultimately be the recipients of the research findings.
In addition to other important factors such as the mean and variance of the primary outcome, a plausible estimate of effect size was a critical consideration in our estimation of sample size for a randomised trial of vaginal progesterone versus placebo to prevent preterm birth in multiple pregnancy . We wished our trial to be as small as it could be to find the clinically important treatment effect, and to ensure our trial was feasible . We knew that designing a large trial that resulted in a change in pregnancy prolongation of only one or two days (even if found statistically different) would be unlikely to change clinical practice, but we did not know the minimum difference that would influence obstetrical practice. We therefore undertook a survey of practicing obstetricians in Canada to examine the minimum prolongation of pregnancy necessary to change practice in hypothetical randomised controlled trials of treatments to prevent preterm birth. Our study also examined the relative importance of different outcome measures in clinical trials.
This study, approved by the University of Calgary Conjoint Health Research Ethics Board (Ethics ID 18809), was a mailed questionnaire survey of all practicing obstetricians in Canada conducted between March 2006 and June 2006. Current lists of registered obstetricians and gynaecologists were obtained from the Colleges of Physicians and Surgeons in each Canadian province (n = 10) and territory (n = 3). The Ontario file excluded physicians who had not consented to have contact information released. The lists did not distinguish between obstetricians and gynaecologists, and therefore questionnaires were sent to all those listed (n = 1531).
Each identified physician was mailed a structured questionnaire. Two reminders were mailed at five week intervals to non-responders. Recipients were first asked to indicate if they did not provide care for pregnant women and return the questionnaire without further completion to avoid being sent further questionnaires.
The questionnaire was developed through discussion among the research team, and piloted with obstetrical residents (who were not therefore involved in the actual survey). The questionnaire consisted of four sections (Additional file 1). The first section contained three vignettes describing clinical settings in which treatments might be used for women at risk of preterm birth, and asked about the minimum prolongation of pregnancy that would be necessary for the respondent to introduce preventative treatments into their practice:
Treatment 1: prophylactic daily progesterone supplementation, administered vaginally after 16 weeks gestational age. Progesterone is a hormone treatment that may theoretically reduce the likelihood of preterm birth. Risk factor: multiple gestation.
Treatment 2: prophylactic weekly progesterone supplementation, administered intramuscularly after 16 weeks gestational age. Risk factors: history of preterm birth or shortened cervix on ultrasound or positive fetal fibronectin.
Treatment 3: prophylactic cervical cerclage placed between 16-23 6/7 weeks gestational age. Cerclage is a surgical procedure in which a stitch is placed in the cervix to prevent it from opening in pregnancy. Risk factor: shortened cervix on ultrasound.
The questionnaire provided three options for prolongation of pregnancy: one, two or three weeks. Respondents were asked to select the minimum prolongation they felt would be necessary to introduce that treatment into their clinical practice.
The next section asked about the most important clinical outcome for justifying a change to clinical practice, and whether the respondent would be willing to join randomised trials that would investigate the same three new prophylactic treatments. Respondents were also asked about their current practice in relation to the three treatments. Finally respondents were asked about their age, length of time in practice, gender and practice setting.
Statistical analyses were carried out using SAS 9.2 (SAS Institute Inc., Cary, NC), and were mainly descriptive. Analyses were carried out on only complete responses for each question, because there were several question funnels which meant that some questions were not relevant to all respondents. For example, in the sections about current clinical practice, it would have been inappropriate to impute data for subjects who did not respond because that section was not relevant to them. Friedman test, a non-parametric test comparing matched multiple groups, was used to test whether within subjects the responses (prolongation of pregnancy needed to change practice) differed significantly between the three interventions. Pearson Chi Squared tests were used to examine differences between groups (for example clinicians practicing in different settings) in the proportion of respondents giving different choices of gestational prolongation required to change practice.
Characteristics of respondents
(n = 544)
46 (SD 10)
Time in practice
15 (SD 10)
Prolongation of pregnancy necessary to change practice
Prolongation of pregnancy required to introduce new treatment into practice
Treatment used in clinical practice
Progesterone PV in
(n = 544)
Progesterone IM in
(n = 544)
(n = 544)
A Friedman test was carried out to compare, within subjects, the responses for the three interventions. This test found that responses for the three interventions differed significantly (×2 = 291, df = 2, p < 0.001). The mean ranks for the three treatments were: vaginal progesterone 1.75, intramuscular progesterone 1.85, cerclage 2.39. This suggests that there was a tendency to need a larger effect size to introduce intramuscular progesterone than vaginal progesterone, and there was a need for a larger effect size to introduce cerclage.
Pearson Chi Squared tests were carried out to estimate if there was a difference between respondents from teaching hospitals versus those in community hospitals in the level of evidence required to change their practice for each of the three treatments. These tests did not demonstrate differences between groups.
Current clinical practice - treatments for women at risk of preterm birth
Treatment used in clinical practice
Current clinical practice
in multiple pregnancies
(n = 544)
in singleton pregnancies
(n = 544)
(n = 544)
use this treatment
do not use this treatment
For 'YES' ONLY
n = 17
n = 51
n = 317
Risk factors influencing decision *
previous preterm delivery
positive FFN test
Route of administration favoured *
Earliest gestational age treatment
12 (SD 8)
range 2 to 30
13 (SD 5)
range 4 to 24
surgery not before:
13 (SD 2)
range 7 to 18
age treatment stops
27 (SD 10)
range 12 to 36
29 (SD 8)
range 12 to 36
surgery not after: 22 (SD 4)
range 12 to 34
Only 17 (3.2%) currently prescribed prophylactic progesterone for women with multiple pregnancies, all of whom would consider a history of previous preterm delivery in their decision to treat. Among the 17 who would use progesterone, vaginal treatment was prescribed by 11 (64.7%), with the earliest start at a mean of 12 weeks' gestation and the latest stopping date at mean 27 weeks.
Fifty-one respondents (9.7%) would prescribe progesterone for women with risk factors with singleton pregnancies, the majority of whom (49, 96.1%) would consider a history of previous preterm delivery in their decision to treat. Similarly, vaginal treatment was favored by the majority (37 (72.5%), with the earliest start at a mean of 13 weeks gestation and the latest stopping at mean of 29 weeks.
Cerclage was a more widely used treatment, with 317 (62.8%) responding that they currently perform prophylactic cervical cerclage. A number of risk factors influenced the decision to place a cerclage: the most common were short cervix (190, 59.9%), previous preterm delivery (176, 55.5%) and a diagnosis of incompetent cervix (139, 43.8%). Cerclage would be performed at the earliest at mean 13 weeks of gestation, and at the latest at 22 weeks.
Current use of cerclage and minimum prolongation of pregnancy required to introduce prophylactic cerclage into practice
Current use of cerclage
Prolongation of pregnancy
required to change practice
(n = 308)
Do not use cerclage
(n = 174)
Feasibility of a trial
Feasibility of trials
What would be the best outcome measure for a trial? (n = 544)
prolongation of gestation
decreased fetal morbidity
decreased fetal mortality
decreased maternal morbidity
Would you take part in a trial?
(n = 544)
Progesterone IM in
(n = 544)
(n = 544)
Reasons given for not taking part in a trial
Reasons for not joining
Vaginal progesterone in
women with multiple
n = 85
Concerns re intervention
Concerns re trial design
Lack of resources
Do not do research
IM progesterone in women
with singleton pregnancies with
risk factors for preterm birth
n = 119
Concerns re intervention
Lack of resources
Concerns re trial design
Do not do research
Cerclage in women with risk
factors for preterm birth
n = 288
Concerns re intervention
Do not do cerclage
Concerns re trial design
Lack of resources
Do not do research
The determination of a suitable estimate of effect size is notoriously difficult . Our mailed survey of all Canadian obstetricians attempted to estimate the clinically important treatment effect required to change practice in the prevention of preterm birth, in order to increase the likelihood that our research would be relevant, with the potential to influence clinical practice. Our study found that responding clinicians were willing to identify an increase in duration of pregnancy that they believed would change their practice. The small amount of missing data indicated that respondents found the clinical scenarios plausible.
Our study found that minimal clinically important treatment effect was associated with the invasiveness of the treatment, and current clinical practice of the respondents. A one or two week prolongation of pregnancy was the minimum effect size required by around 70% of obstetricians to introduce new progesterone treatments into their practice for treating women at risk of preterm birth. Cerclage, a more invasive treatment, required a larger minimum effect size: a three week increase was needed to introduce this treatment. Availability of the treatment also influenced the minimum important treatment effect: clinicians who already had access to cerclage were willing to accept a smaller effect size to utilize this treatment.
The impact of the choice of effect size may best be illustrated using the parameters we employed when calculating the sample size for our progesterone trial . For that study, we used local data from a two year period to estimate the usual (untreated) mean and standard deviation gestational age of delivery for multiple pregnancies. Sample size calculations using a power of 80% and two-sided significance level of 0.05, would estimate sample sizes as follows: to detect a three week difference, a sample of 36 (18 per randomised group) would be required; for two weeks, the sample size would be 78 (39 per group); for one week, the sample size would be 156 (78 per group). If the three week effect size was chosen, and therefore the smaller sample size was used, a real difference between treated and control groups of one or two weeks would not be identified as a significant difference. These examples clearly show that the choice of clinically important treatment effect has a practical effect on the design, conduct and clinical relevance of the study. Applying these examples to our hypothetical scenarios, it is clear that a trial of cerclage versus no cerclage would be smaller in size than a trial of a progesterone treatment versus placebo.
The principal goal of prophylactic treatment for women at risk of preterm labour is to improve the outcome for the neonate by reducing morbidity and mortality. The consequences of even late preterm birth are considerable, with worse developmental outcomes and academic difficulties up to seven years of age compared to term infants . In our questionnaire study, the majority of respondents (72.2%) clearly recognised this by stating that decreased fetal morbidity was the most important outcome to justify changing clinical practice. Despite this, in our hypothetical scenarios where clinicians were asked to consider changing their clinical practice on the basis of prolongation of pregnancy, all but 4% were willing to make a choice based on that outcome. It therefore appears that clinicians would be willing to accept a surrogate outcome on which to base a change in clinical practice. This is an important point: a trial that measures impact of a treatment on fetal or neonatal morbidity, even in a trial examining preterm birth where adverse neonatal events would be expected, will need to be far larger than one that measures impact on pregnancy duration, where every pregnancy will have an outcome . In addition, the definition of a 'neonatal morbidity' composite outcome is fraught with difficulty, and is open to misinterpretation by clinicians and patients . Thus the choice of effect size and choice of outcome will impact on the size and expense of a clinical trial. Both of these choices will also impact on the adoption of trial findings into clinical practice.
We were interested about the feasibility of trials of treatments to prevent preterm birth. Concern for the patient and increasing invasiveness of the intervention impacted on respondents' decisions about taking part in a trial. The majority of respondents would be willing to take part in both hypothetical progesterone trials. The most frequently cited reason for declining to take part in the multiple trial was feasibility (lack of suitable cases), while concern about the intervention (for example patient discomfort) was most commonly cited for the intramuscular progesterone trial. Concern about cerclage itself was a common reason for not wishing to take part in a trial, although 13.2% believed that there was already sufficient evidence to use prophylactic cerclage in women with a short cervix. We did not lead clinicians in their reason for not wishing to take part in each trial, rather leaving them to provide text answers to open-ended questions. Therefore we believe the responses were those that mattered most to the clinicians.
The design of our questionnaire could be criticised for a number of reasons. Firstly, the questionnaire described three hypothetical scenarios, including different risk factors for preterm birth. Although designed to represent clinical experience, we do not know whether the responses would reflect actual practice. Secondly, in the clinical scenarios, we used a forced choice method that asked clinicians to choose a one, two or three week prolongation of pregnancy as the outcome for the hypothetical treatments. It is possible that clinicians would be willing to accept a shorter increase or would prefer a longer increase in gestation before changing their practice. We set the earliest gestational age for treatment at 16 weeks, and the longest duration of pregnancy as 33 weeks and 4 days [30, 31], for each hypothetical prolongation of pregnancy. Thus it is possible that the choice of clinically important increase in duration of pregnancy may have been affected by our descriptions. These scenarios and choices were necessarily complex, reflecting situations commonly encountered by obstetricians who manage high risk pregnancies.
Much research relevant to the prevention of preterm birth has been published since our survey was carried out, reflecting the ongoing interest and importance of this topic. Recent publications conclude that, in appropriately selected women with high-risk singleton pregnancies, progesterone can reduce preterm birth before 33 weeks' gestation , and cerclage can reduce preterm birth and improve neonatal outcome . Trials of progesterone in multiple pregnancies have failed to prevent preterm birth , most likely because of a difference in aetiology, perhaps involving larger fetal and placental mass, and greater stretching of uterine muscle . Nonetheless, preterm birth remains the most concerning perinatal problem for obstetricians, and therefore new progesterone trials continue to be undertaken , and the search for new effective treatments continues.
Our survey of all obstetricians was challenging and would not be feasible for all trials, partly because such surveys are costly and time consuming, and partly because clinicians would be plagued by many similar questionnaires, leading to declining response rates and possible bias in the results. In the future, we believe that a more limited survey of a random sample of practicing clinicians would be more appropriate. In our study, however, obstetricians were willing to respond to our fairly complex questionnaire: we achieved a response rate of 42.1% after only two reminders, similar to response rates from other surveys of clinical practice [25, 37, 38]. Our respondents came from a range of clinical settings and had a range of experience. Our large number of responses (n = 544) leads us to believe that our findings are more representative of clinician beliefs than the more usual practice of identifying the minimum clinically important treatment effect by discussion with trial collaborators  or experts .
The importance of our study lies in the continuing need to undertake meaningful and efficient randomized trials that are designed to support clinical practice [2, 3]. Such trials must provide clinically important differences rather than merely statistically significant differences, and the results should be available in a timely way [7, 13]. To be timely, trials should be designed to be as small as realistically possible to obtain clinically relevant results. Our study developed a method that was able to estimate the clinically important difference needed to design our randomised trial . Clinical trialists must make the additional effort to estimate the minimum clinically important treatment effect that is relevant to practicing clinicians. Without this effort, trials will continue to fail to influence clinical practice.
SR is a health services researcher and Professor in the Departments of Obstetrics and Gynaecology, Family Medicine, Community Health Sciences and Family Medicine, and Director of Research in the Department of Obstetrics and Gynaecology, University of Calgary. JM was a research associate in the Department of Obstetrics and Gynaecology, University of Calgary. SD was involved in this study during her residency in obstetrics and gynaecology in Calgary, and is now a perinatologist in the Department of Obstetrics and Gynaecology at the University of Calgary. ST is data analyst in the Department of Obstetrics and Gynaecology, University of Calgary. SW is an obstetrician/gynaecologist and Associate Professor in the Departments of Obstetrics and Gynaecology and Community Health Sciences, University of Calgary.
The authors acknowledge the contribution of Cheryl Swaby RN to data collection.
This study was internally funded as part of the Partnership for Research and Education for Mothers and Infants (PREMI) program of research. Funding for PREMI was provided by the Ross Division of Abbott Laboratories.
- Sackett D, Rosenberg WM, Gray JA, Haynes RB, Richardson WS: Evidence based medicine: What it is and what it isn't. BMJ. 1996, 312: 71-72. 10.1136/bmj.312.7023.71.View ArticlePubMedPubMed CentralGoogle Scholar
- Lorenz K, Ryan G, Morton S, Chan K, Wang S, Shekelle P: A qualitative examination of primary care providers' and physicians managers' uses and views of research evidence. International Journal for Quality in Health Care. 2005, 17: 409-414. 10.1093/intqhc/mzi054.View ArticlePubMedGoogle Scholar
- Guyatt G, Cook D, Haynes B: Evidence based medicine has come a long way. BMJ. 2004, 329: 900-901.View ArticleGoogle Scholar
- Claridge J, Fabian T: History and Development of evidence-based medicine. World Journal of Surgery. 2005, 29: 547-553. 10.1007/s00268-005-7910-1.View ArticlePubMedGoogle Scholar
- McAlister F, O'Connor A, Wells G, Grover S, Laupacis A: When should hypertension be treated? The different perspectives of Canadian family physicians and patients. CMAJ. 2000, 163: 403-408.PubMedPubMed CentralGoogle Scholar
- Cabana M, Rand C, Powe N, Wu A, Wilson M, Abboud PA, Rubin H: Why don't physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999, 282: 1458-1465. 10.1001/jama.282.15.1458.View ArticlePubMedGoogle Scholar
- Grol R, Grimshaw J: From best evidence to best practice: effective implementation of changes in patients' care. Lancet. 2003, 362: 1225-1230. 10.1016/S0140-6736(03)14546-1.View ArticlePubMedGoogle Scholar
- Houghton A, Cowley A: Why are angiotension converting enzyme inhibitors underutilized in the treatment of heart failure by general practitioners?. Int J Cardiol. 1997, 59: 7-10. 10.1016/S0167-5273(96)02904-X.View ArticlePubMedGoogle Scholar
- Jacobson N, Berns S, McGilinchey J: Methods for defining and interpreting the cinical significance of treatment effects: Description, application, and alternatives. J Consult Clin Psychol. 1999, 67: 300-307.View ArticlePubMedGoogle Scholar
- Tunis S, Stryer D, Clancy C: Practical clinical trials. Increasing the value of clinical research for decision making in clinical and health policy. JAMA. 2003, 290: 1624-1632. 10.1001/jama.290.12.1624.View ArticlePubMedGoogle Scholar
- Crosby R, Kolotkin R, Williams R: Defining clinically meaningful change in health-related quality of life. Journal of Clinical Epidemiology. 2003, 56: 395-407. 10.1016/S0895-4356(03)00044-1.View ArticlePubMedGoogle Scholar
- Scales DC, Rubenfeld GD: Estimating sample size in critical care clinical trials. J Crit Care. 2005, 20 (1): 6-11. 10.1016/j.jcrc.2005.02.002.View ArticlePubMedGoogle Scholar
- Copay AG, Subach BR, Glassman SD, Polly DW, Schuler TC: Understanding the minimum clinically important difference: a review of concepts and methods. Spine J. 2007, 7 (5): 541-546. 10.1016/j.spinee.2007.01.008.View ArticlePubMedGoogle Scholar
- Barrett B, Brown D, Mundt M, Brown R: Sufficiently important difference: expanding the framework of clinical significance. Med Decis Making. 2005, 25: 250-261. 10.1177/0272989X05276863.View ArticlePubMedGoogle Scholar
- Morgan C: Sample size re-estimation in group-sequential response-adaptive clinical trials. Stat Med. 2003, 22: 3843-3857. 10.1002/sim.1677.View ArticlePubMedGoogle Scholar
- Jaeschke R, Singer J, Guyatt G: Measurement of health status: ascertaining the minimal clinically important difference. Control Clin Trials. 1989, 10: 407-415. 10.1016/0197-2456(89)90005-6.View ArticlePubMedGoogle Scholar
- Hays R, Woolley J: The concept of clinically important differences in health-related quality of life research. Pharmoeconomics. 2000, 18: 419-423. 10.2165/00019053-200018050-00001.View ArticleGoogle Scholar
- Beaton D, Boers M, Wells G: Many faces of the minimal clinically important difference (MCID): A literature review and directions for future research. Curr Opin Rheumatol. 2002, 14: 109-114. 10.1097/00002281-200203000-00006.View ArticlePubMedGoogle Scholar
- Kashani I, Hall JL, Hall JC: Reporting of minimum clinically important differences in surgical trials. ANZ J Surg. 2009, 79 (4): 301-304. 10.1111/j.1445-2197.2009.04865.x.View ArticlePubMedGoogle Scholar
- Wolfe F, Michaud K, Strand V: Expanding the definition of clinical differences: from minimally clinically important differences to really important differences. Analyses in 8931 patients with rheumatoid arthritis. J Rheumatol. 2005, 32 (4): 583-589.PubMedGoogle Scholar
- Naylor CD, Llewellyn-Thomas HA: Can there be a more patient-centred approach to determining clinically important effect sizes for randomized treatment trials?. J Clin Epidemiol. 1994, 47 (7): 787-795. 10.1016/0895-4356(94)90176-7.View ArticlePubMedGoogle Scholar
- Make B: How can we assess outcomes of clinical trials: the MCID approach. COPD: Journal of Chronic Obstructive Pulmonary Disease. 2007, 4: 191-194. 10.1080/15412550701471231.View ArticlePubMedGoogle Scholar
- Kirkby HM, Wilson S, Calvert M, Draper H: Using e-mail recruitment and an online questionnaire to establish effect size: A worked example. BMC Med Res Methodol. 2011, 11 (1): 89-10.1186/1471-2288-11-89.View ArticlePubMedPubMed CentralGoogle Scholar
- Brasher PM, Brant RF: Sample size calculations in randomized trials: common pitfalls. Can J Anaesth. 2007, 54 (2): 103-106. 10.1007/BF03022005.View ArticlePubMedGoogle Scholar
- van Walraven C, Mahon J, Moher D, Bohm C, Laupacis A: Surveying physicians to determine the minimally important difference: Implications for sample-size calculation. J Clin Epidemiol. 1999, 52: 717-723. 10.1016/S0895-4356(99)00050-5.View ArticlePubMedGoogle Scholar
- Kirwan JR: Minimum clinically important difference: the crock of gold at the end of the rainbow?. J Rheumatol. 2001, 28: 439-444.PubMedGoogle Scholar
- Wood S, Ross S, Sauve R, Brant R: Vaginal progesterone versus placebo in multiple pregnancy. ClinicalTrials.gov http://clinicaltrials.gov/ct2/show/NCT00343265 (accessed 13 June 2011)
- McGowan J, Alderdice F, Holmes V, Johnston L: Early childhood development of late-preterm infants: a systematic review. Pediatrics. 2011, 127: 1111-1124. 10.1542/peds.2010-2257.View ArticlePubMedGoogle Scholar
- Ross S: Composite outcomes in randomized clinical trials: arguments for and against. Am J Obstet Gynecol. 2007, 196 (2): 119-e1-6View ArticlePubMedGoogle Scholar
- Kramer MS, Demissie K, Yang H, Platt RW, Sauve R, Liston R: The contribution of mild and moderate preterm birth to infant mortality. Fetal and Infant Health Study Group of the Canadian Perinatal Surveillance System. JAMA. 2000, 284 (7): 843-849. 10.1001/jama.284.7.843.View ArticlePubMedGoogle Scholar
- Clements KM, Barfield WD, Ayadi MF, Wilber N: Preterm birth-associated cost of early intervention services: an analysis by gestational age. Pediatrics. 2007, 119 (4): e866-10.1542/peds.2006-1729. 74.32View ArticlePubMedGoogle Scholar
- Hassan S, Romero R, Vidyadhari D, Fusey S, Baxter J, Khandelwal M, Vijayaraghavan J, Trivedi Y, Soma-Pillay P, Sambarey P, Dayal A, Potapov V, O'Brien J, Astakhov V, Yuzko O, Kinzler W, Dattel B, Sehdev H, Mazheika L, Manchulenko D, Gervasi MT, Sullivan L, Conde-Agudelo A, Phillips JA, Creasy GW: PREGNANT Trial. Vaginal progesterone reduces the rate of preterm birth in women with a sonographic short cervix: a multicenter, randomized, double-blind, placebo-controlled trial. Ultrasound Obstet Gynecol. 2011, 38: 18-31.View ArticlePubMedPubMed CentralGoogle Scholar
- Berghella V, Rafael T, Szychowski J, Rust O, Owen J: Cerclage for short cervix on ultrasonography in women with singleton gestations and previous preterm birth: a meta-analysis. Obstet Gynecol. 2011, 117: 663-671. 10.1097/AOG.0b013e31820ca847.View ArticlePubMedGoogle Scholar
- Rode L, Klein K, Nicolaides KH, Krampl-Bettelheim E, Tabor A: PREDICT Group. Prevention of preterm delivery in twin gestations (PREDICT): a multicenter, randomized, placebo-controlled trial on the effect of vaginal micronized progesterone. Ultrasound Obstet Gynecol. 2011, 38: 272-280.View ArticlePubMedGoogle Scholar
- Stock S, Norman J: Preterm and term labour in multiple pregnancies. Semin Fetal Neonatal Med. 2010, 15: 336-341. 10.1016/j.siny.2010.06.006.View ArticlePubMedGoogle Scholar
- van Os M, van der Ven J, Kleinrouweler E, Pajkrt E, de Miranda E, van Wassenaer A, Porath M, Bossuyt PM, Bloemenkamp KW, Willekes C, Woiski M, Oudijk MA, Bilardo KM, Sikkema MJ, Duvekot JJ, Veersema D, Laudy J, Kuiper P, de Groot CJ, Mol BW, Haak MC: Preventing preterm birth with progesterone: costs and effects of screening low risk women with a singleton pregnancy for short cervical length, the Triple P study. BMC Pregnancy Childbirth. 2011, 11: 77-10.1186/1471-2393-11-77.View ArticlePubMedPubMed CentralGoogle Scholar
- Pramod R, Okun N, McKay D, Kiehn L, Hewson S, Ross S, Hannah ME: Cerclage for the short cervix demonstrated by transvaginal ultrasound: current practice and opinion. J Obstet Gynaecol Can. 2004, 26 (6): 564-570.View ArticlePubMedGoogle Scholar
- Arunkalaivanan AS, Barrington JW: Questionnaire-based survey on obstetricians and gynaecologists' attitudes towards the surgical management of urinary incontinence in women during their childbearing years. Eur J Obstet Gynecol Reprod Biol. 2003, 108 (1): 85-93. 10.1016/S0301-2115(02)00431-1.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/12/31/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.