Intracluster correlation coefficients for the Brazilian Multicenter Study on Preterm Birth (EMIP): methodological and practical implications
BMC Medical Research Methodology volume 14, Article number: 54 (2014)
Cluster-based studies in health research are increasing. An important characteristic of such studies is the presence of intracluster correlation, typically quantified by the intracluster correlation coefficient (ICC), that indicate the proportion of data variability that is explained by the way of clustering. The purpose of this manuscript was to evaluate ICC of variables studied in the Brazilian Multicenter Study on Preterm Birth.
This was a multicenter cross-sectional study on preterm births involving 20 referral hospitals in different regions of Brazil plus a nested case–control study to assess associated factors with spontaneous preterm births. Estimated prevalence rates or means, ICC with 95% confidence intervals, design effects and mean cluster sizes were presented for more than 250 maternal and newborn variables.
Overall, 5296 cases were included in the study (4,150 preterm births and 1,146 term births). ICC ranged from <0.001 to 0.965, with a median of 0.028. For descriptive characteristics (socio-demographic, obstetric history and perinatal outcomes) the median ICC was 0.014, for newborn outcomes the median ICC was 0.041 and for process variables (clinical management and delivery), it was 0.102. ICC was <0.1 in 78.4% of the variables and <0.3 for approximately 95% of them. Most of ICC >0.3 was found in some clinical management aspects well defined in literature such as use of corticosteroids, indicating there was homogeneity in clusters for these variables.
Clusters selected for Brazilian Multicenter Study on Preterm Birth had mainly heterogeneous findings and these results can help researchers estimate the required sample size for future studies on maternal and perinatal health.
Cluster-based studies involving aggregated units such as hospitals, health centers, schools or medical practices are increasingly being used in healthcare evaluation, especially in cluster randomized trials, which are perhaps the most high impact form of public health research/evaluation study design that can benefit from good extent estimates of ICC. In such situations, population groups (specific geographical areas), healthcare units (hospitals) or healthcare sectors are considered primary sampling units and generally all subjects belonging to each group are included to obtain data of interest [1, 2].
However, depending on the method of selection, data obtained from clusters may not be sufficiently representative to allow for generalization. Population observed in clusters can present a large degree of similarity in some characteristics (homogeneity), unlike when there is a simple random sampling (SRS), in which each individual has the same probability of being selected in the general population, with more heterogeneity .
Therefore, an important characteristic of cluster-based studies is to evaluate the proportion of data variability that is explained by means of clustering, and this reliability may be analyzed by measuring inter and intracluster variance .
Intracluster correlation coefficient (ICC), denoted by ρ, is defined as the ratio of the between-cluster variance to the total variance (both between and within clusters), and therefore has a value between 0 and 1 [4, 5]. Its value depends on the type of variable, cluster size and the prevalence of the condition . Coefficients close to zero indicate that individuals within clusters are no more similar to each other than individuals from different clusters (the variable is randomly distributed among clusters); otherwise the values close to 1 reflect the homogeneity in a sample . In other words, for cluster based population studies this heterogeneity (ICC close to zero) is desired as a proxy to the subjects being randomly selected.
The increase in variance due to clustering, compared to what would be obtained if sampling had been carried out by the SRS method, is calculated by design effect (Deff) . It is given by 1 + (m-1) ICC, where m is the average cluster size . Deff value is directly proportional to ICC and to the size of a cluster .
The ICC estimate in cluster studies is very useful for the development of new studies in the same field, because values obtained could be used as a correction factor for the calculation of sample size needed, thus avoiding underestimates, since in studies in which SRS is used, the sample size required to achieve sufficient statistical power is usually smaller .
The purpose of this manuscript is to evaluate the ICC of variables studied in the Brazilian Multicenter Study on Preterm Birth, a multicenter cross-sectional study on preterm births involving 20 referral hospitals in different regions of Brazil plus a nested case–control study. Estimated prevalence rates or means, ICC with 95% confidence intervals, design effects and average cluster sizes were also objectives for this study and they are presented for more than 250 maternal and neonatal variables.
The Brazilian Multicenter Study on Preterm Birth consisted of a multicenter cross-sectional study plus a nested case–control study to assess their associated factors implemented in referral obstetrical units (clusters) from several states of the country. The full research proposal has already been published elsewhere .
A single-stage cluster sampling was used. Clusters were selected by an invitation to 27 healthcare institutions that build a national network called Brazilian Network for Studies on Reproductive and Perinatal Health. They are located in the five geographical regions of the country, almost all of them are public institutions, and all of them receive both low and high risk pregnant women. Initially 26 centers accepted to participate, but 20 selected institutions were able to fully take part in the study.
The sample size was calculated using the official prevalence of preterm births in Brazil of around 6.5% . Considering an acceptable absolute difference of about 0.25% between the sample and the population prevalence, and a type I error of 5%, initial surveillance of a sample size of 37,000 deliveries was necessary. For the case–control study component, the estimated sample size was 1,055 women in each group (cases and controls). The total number of preterm births estimated to be followed in both components of the study was around 3,600.
The participating centers performed a prospective surveillance of all patients admitted to give birth in order to identify preterm births. For this purpose and according to standard international definitions, preterm birth was considered that occurring before 37 completed weeks of gestational age evaluated by an ultrasound scan performed early in pregnancy, by a known date of the last menstrual period, or alternatively by the evaluation of the somatic age of the newborn. During the first months of the study, in order to complete the sample for the appropriate analysis of the factors associated with spontaneous preterm birth, a random sample of women who had full-term birth was also selected.
Data was collected during six to twelve months for each center, from April 2011 to March 2012, in a detailed form called “Questionnaire” including 306 variables from four sources: interview with women in the postpartum period, medical records and prenatal chart of the mother (before hospital discharge), and newborn medical records (within sixty days after birth, even if it remained in hospital for longer period). An electronic system of data entry called OpenClinica® was selected and a proper clinical research form (CRF) was designed for the input of data after the questionnaire of each case was completed and reviewed.
High quality data and reliable information was guaranteed by several steps: preparatory meetings, development of detailed manuals of operation, monitoring technical site visits to the centers, close monitoring of data collection and data entry, concurrent query management, checking for logical inconsistencies, and correction of database. The research proposal was firstly approved by the Institutional Review Board of the coordinating center and then confirmed by IRB of each other participating center.
In this study, each of the 20 participating centers (hospital) was considered a primary sampling unit (PSU) and there was no stratification of the PSU or weighting of the data. The subject (unit of analysis) was woman who delivered preterm (case) or at term (control).
Estimated prevalence (categorical variables) or means (continuous numeric variables), intracluster correlation coefficients (ICC), their respective 95% confidence intervals (CI), design effects (Deff) and mean cluster size of each variable were calculated. Software programs used for analysis were SPSS® version 20.0  and Stata version 7.0 , taking into consideration the cluster sampling plan (centers) for data analysis.
According to Kish , ICC (Roh) is: ρ = (s 2 a − s 2 b /b)/sˆ2, where s 2 a is the variance between clusters; s 2 b is the variance within clusters, b is the size of clusters and sˆ2 is the estimate of S 2 (variance in individual level). The estimate sˆ2 is obtained by: sˆ2 = s 2 a + [(b − 1)/b]s 2 b . Stata’s equivalent computing formula for ICC  is: ICC = [(F − 1)a/n]/1 + (F − 1)a/n, where ‘F’ is the Snedecor’s F-value from the ANOVA table and ‘a’ is the number of groups. The variance estimate for ICC is obtained by an extensive asymptotic formula and because this it was not showed.
For this study, the Design effect - DEFF  is Deff = varactual(r)/varSRS(r) = s 2 a/a/s 2/n) where varactual(r) is the estimated variance according to the complex design being studied and varSRS(r) is the variance in the estimator considering the design as if it were calculated using a SRS of the same size, n.
During fifteen months, 5,296 births were included in the study, 4,150 of them being preterm births (1,491 due to spontaneous preterm labor, 1,191 due to a prelabor premature rupture of membranes and 1,468 due to a therapeutic interruption of pregnancy either for a maternal or fetal condition) and a sample of 1,146 term births to be used as controls for the case–control component.
Clustering was not stratified by region. Proportionally more centers were located in the Southeast of the country and consequently over half of births were from this region (11/20 – 53.5%). The other centers were from Northeast region (7/20 – 35%), contributing with 34.8% of births studied, South region (2/20 – 10%), with 11.7% of births. The mean size of each cluster was 265 cases.
Estimated ICCs are presented in Tables 1, 2, 3, 4, 5, 6, 7, 8, 9 and 10 for each of 261 variables. Tables 2 and 8 show results for continuous numeric variables, while other tables present results for categorical variables or were categorized for analysis. In addition to ICC, the 95% confidence interval (CI), the design effect (Deff) and the mean cluster size (na), as well as the estimated prevalence (or mean) are presented. ICC ranged from <0.001 to 0.965, with a median of 0.028. ICC was < 0.1 in 78.5% of the variables and < 0.3 for 95% of them.
Tables 1 and 2 presents some variables related to maternal characteristics, including clinical and obstetrical history. ICCs ranged from <0.001 to 0.145 (median 0.011). Table 3 shows the socio-demographic variables studied, and ICC ranged from 0.017 to 0.191 (median 0.041). Tables 4 and 5 presents variables related to pregnancy characteristics with ICC ranging from 0.001 to 0.386 (median 0.015). The variables related to labor conditions were presented in Table 6. It can be observed that ICC ranged from 0.002 to 0.384, with a median of 0.022. Tables 7 and 8 shows variables related to perinatal outcomes and ICC were < 0.1 in 81% of them. The most important outcome variable, newborn morbidities, is presented in Table 7. Tables 9 and 10 present some variables analyzed specifically for preterm births and are related to management. Most variables in Table 9 showed ICC greater than 0.3 and the greatest ICC of this study (0.965) was relative to the variable “corticosteroids use”, a management aspect well defined and well-established in all obstetric protocols, so there were high degree of homogeneity in clusters in these variables. The median of ICCs was 0.274. The median ICC in Table 10 was 0.079.
Deff were under 5.0 in 74% of variables in Tables 1 and 2, ranging from 1.2 to 42.2 (median 3.65). Table 3 presents Deff values ranging from 2.8 to 60 (median 13.0). In variables related to gestational process (Tables 4 and 5), Deff values ranged from 0.6 to 101.5 (median 4.9). The variables related to labor conditions (Table 6) showed Deff ranging from 1.1 to 148 (median 6.6), with 60% of them under 8.0. In Tables 7 and 8, related to perinatal outcomes, Deff values ranged from 1.1 to 84.8 (median 7.8). Tables 9 and 10 presented Deff median of 16.35 and 7.0, respectively.
We can observe that greater Deff median is present in process variables (Table 9), and greater ICCs.
This study presents a large number of intracluster correlation coefficients whose values can be considered low (close to zero) in most variables, showing intracluster heterogeneity.
The greater ICC values were found in process variables, especially management in spontaneous preterm labor conditions, as corticosteroids use, Group B streptococcus screening, use of tocolytic agents and use of antibiotic. Indeed, the mean ICC value for these variables was 10 times higher than the mean ICC of the study. The variable with the highest ICC was “corticosteroids – betamethasone”, with a value of 0.965. The prevalence of this variable was 85%, showing a high degree of homogeneity in this management for preterm labor. These findings are in accordance with the literature that describes ICC values generally higher for variables related to process compared to those variables related to outcome [15, 16].
In the field of maternal and perinatal healthcare, Taljaard et al. calculated ICC values based on data obtained from secondary/tertiary services . Comparing with our study, they found an overall median ICC of 0.067 versus 0.028. For maternal and newborn outcome variables, their median ICCs was 0.011 (versus 0.014), and 0.054 (versus 0.041), respectively. The findings of those investigators showed that, for variables associated to process, ICC values tend to be > 0.07. The present findings are in agreement with this observation.
Pagel et al. estimated ICC for a range of outcomes using data from five community-based clusters randomized controlled trials in three low-income countries. Estimated ICC values for mortality outcomes were lower than those for process outcomes, with narrower confidence intervals throughout for trials with larger number of clusters.
All comparisons show that the smaller the cluster size, the higher the ICC and the opposite occurs regarding the prevalence of the condition. Estimates of intracluster correlation are much less reliable for rare outcomes and the size of the cluster had a greater impact than the number of clusters on the reliability of estimates for rare outcomes .
Furthermore, higher healthcare levels tend to increase the degree of homogeneity [18, 19]. The size of ICC increases if the ICC represents data from secondary rather than primary care. This may be a reflection of the underlying heterogeneity of the datasets under consideration as the conditions represented across the different datasets were diverse. Although numerically small (average 0.01), such differences can have a substantial effect on sample size, even when the average of cluster is small . The clusters in this study are secondary and tertiary hospitals, most of them are teaching hospitals, with the majority of procedures performed in conformity with evidence-based healthcare protocols.
Stratified randomization had the effect of reducing estimates of cluster correlation . However, in the same way that in Brazilian Network for Surveillance of Severe Maternal Morbidity Study , which found ICC values close to zero, the selection of clusters did not performed stratification by region. The distribution of centers in this study, with almost half located in southeast region, is in accordance with the actual distribution of healthcare institutions and the proportionality of births per region in the country [21, 22].
The large number of intracluster correlation coefficients presented in this study, considered low (close to zero) in most of variables, can probably be seen as a good parameter of variance for calculating sample size in new studies in the field of perinatal and maternal health .
We can, however, to identify some possible limitations of the study, including the fact that we used a non-probabilistic sample from the centers (hospitals). Therefore, strictly speaking, the findings cannot be generalized to other populations. However, the majority of hospitals included in the study was third level referral hospitals taking care of high risk pregnancies and preterm babies. Probably the results would be applicable to other centers with such characteristics, irrespective of being private or public, especially in middle income countries like Brazil.
The Brazilian Multicenter Study on Preterm Birth, developed as part of the Brazilian Network for Studies on Reproductive and Perinatal Health, to the best of our knowledge is the first cross sectional multicenter study on this topic in the country. It represents a planned comprehensive assessment of preterm birth in Brazil and ICC values calculation and analysis of more than 250 maternal and newborn variables, showed heterogeneity of data in selected clusters. These findings increase reliability of study estimates and allow the use of these results to calculate the required sample size for future research studies in maternal and perinatal health.
Clinical research form
Intraclass correlation coefficient
Simple random sampling.
Ukoumunne OC, Gulliford MC, Chinn S, Sterne JA, Burney PG: Methods for evaluating area-wide and organisation-based interventions in health and health care: a systematic review. Health Technol Assess. 1999, 3 (5): iii-92-
Kish L: Survey sampling. 1965, New York: John Wiley & Sons
Donner A, Koval JJ: Design considerations in the estimation of the intraclass correlation. Ann Hum Genet. 1982, 46: 271-277. 10.1111/j.1469-1809.1982.tb00718.x.
Campbell MK, Grimshaw JM, Elbourne DR: Intracluster correlation coefficients in cluster randomised trials: empirical insights into how should they be reported. BMC Med Res Methodol. 2009, 4: 9-
Killip S, Mahfoud Z, Pearce K: What is an intracluster correlation coefficient? Crucial concepts for primary care researchers. Ann Fam Med. 2004, 2: 204-208. 10.1370/afm.141.
Adams G, Gulliford MC, Ukoumunne OC, Eldridge S, Chinn S, Campbell MJ: Patterns of intra-cluster correlation from primary care research to inform study design and analysis. J Clin Epidemiol. 2004, 57: 785-794. 10.1016/j.jclinepi.2003.12.013.
Hayes R, Moulton LH: Cluster Randomised Controlled Trials. 2009, New York: Chapman &Hall/CRC Press
US Census Bureau: Technical paper 63RV: current population survey - design and methodology. TP63RV 2002, 14–18. Available at http://www.census.gov/prod/2002pubs/tp63rv.pdf. Accessed on October 02, 2013
Hayes RJ, Benett S: Simple size calculation for cluster-randomised trials. Int J Epidemiol. 1999, 28 (2): 319-326. 10.1093/ije/28.2.319.
Eldridge SM, Ukoumunne OC, Carlin JB: The intra-cluster correlation coefficient in cluster randomized trials: a review of definitions. Int Stat Rev. 2009, 77 (3): 378-394. 10.1111/j.1751-5823.2009.00092.x.
Passini R, Tedesco RP, Marba ST, Cecatti JG, Guinsburg R, Martinez FE, Nomura ML, Brazilian Network of Studies on Reproductive and Perinatal Health: Brazilian multicenter study on prevalence of preterm birth and associated factors. BMC Pregnancy Childbirth. 2010, 10: 22-10.1186/1471-2393-10-22.
Tedesco RP, Passini R, Cecatti JG, Camargo RS, Pacagnella RC, Sousa MH: Estimation of preterm birth rate, associated factors and maternal morbidity from a Demographic and Health Survey in Brazil. Matern Child Health J. 2013, 17 (9): 1638-1647. 10.1007/s10995-012-1177-6.
SPSS for Windows: Release 20.0. 2011, New York: SPSS Inc
StataCorp: College Station. Stata Statistical Software: Release 7. 2001, College Station, TX: StataCorp LP
Campbell MK, Fayers PM, Grimshaw JM: Determinants of the intracluster correlation coefficient in cluster randomised trials: the case of implementation research. Clin Trials. 2005, 2: 99-107. 10.1191/1740774505cn071oa.
Taljaard M, Donner A, Villar J, Wojdyla D, Velazco A, Bataglia V, Bataglia V, Faundes A, Langer A, Narváez A, Valladares E, Carroli G, Zavaleta N, Shah A, Campodónico L, Romero M, Reynoso S, de Pádua KS, Giordano D, Kublickas M, Acosta A, World Health Organization 2005 Global Survey on Maternal and Perinatal Health Research Group: Intracluster correlation coefficients from the WHO Global Survey on Maternal and Perinatal Health: implications for implementation research. Paediat Perinatal Epidemiol. 2005, 2008 (22): 117-125.
Pagel C, Prost A, Lewycka S, Das S, Colbourn T, Mahapatra R, Azad K, Costello A, Osrin D: Intracluster correlation coefficients and coefficients of variation for perinatal outcomes from five cluster-randomised controlled trials in low and middle-income countries: results and methodological implications. Trials. 2011, 12: 151-10.1186/1745-6215-12-151.
Piaggio G, Carroli G, Villar J, Pinol A, Bakketeig L, Lumbiganon P, Bergsjø P, Al-Mazrou Y, Ba'aqeel H, Belizán JM, Farnot U, Berendes H, WHO Antenatal Care Trial Research Group: Methodological considerations on the design and analysis of an equivalence stratified cluster randomization trial. Stat Med. 2001, 20: 401-416. 10.1002/1097-0258(20010215)20:3<401::AID-SIM801>3.0.CO;2-1.
Campbell SM, Braspenning J, Hutchinson A, Marshall M: Research methods used in developing and applying quality indicators in primary care. Qual Safe Health Care. 2002, 11: 358-364. 10.1136/qhc.11.4.358.
Haddad SM, Sousa MH, Cecatti JG, Parpinelli MA, Costa ML, Souza JP, and for the Brazilian Network for Surveillance of Severe Maternal Morbidity Group: Intraclass correlation coefficients in the Brazilian network for surveillance of severe maternal morbidity study. BMC Pregnancy Childbirth. 2012, 12: 101-10.1186/1471-2393-12-101.
Brazilian Ministry of Health: National Registry of Health Facilities. 2013, Available at http://cnes.datasus.gov.br/Lista_Tot_Es_Estado.asp. Accessed on November 27th, 2013
Brazilian Ministry of Health: SINASC – National Information System on Live Births. 2011, Available at http://tabnet.datasus.gov.br/cgi/tabcgi.exe?sinasc/cnv/nvuf.def. Accessed on November 27th, 2013
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/14/54/prepub
The authors thank the CNPq (Brazilian National Research Council) and Fapesp (Foundation for Support to Research of the State of Sao Paulo) for the financial sponsorship of this study, Process Fapesp 2009/53245-5 (Call AP.PPSUS-1). This publication was also sponsored by Fapesp (Processo 2014/08183-0)
The Brazilian Multicenter Study on Preterm Birth study group: Sergio T Marba, Ruth Guinsburg, Francisco E Martinez, Vilma Zotarelli, Lucio T Gurgel, Francisco E Feitosa, George N Chaves, Ana M Porto, Isabela C Coutinho, Antonio C Barbosa Lima, Elias F Melo Jr, Débora F Leite, Melania M Amorim, Adriana SO Melo, Fabiana O Melo, Marília G Martins, Marynea V Nunes, Cláudio S Paiva, Moises D Lima, Djacyr M Freire, Edson G Tristão, Denis J Nascimento, Renato T Souza, Carlos A Menezes, Marcelo Aquino, Janete Vettorazzi, Cintia E Senger, Augusta MB Assumpção, Marcela AF Guedes, Maria EL Moreira, Vera T Borges, Nelson L Maia Filho, Jacinta P Mathias, Eduardo Souza, Ana CP Zamarian, Silvana M Quintana, Patrícia PS Melli, Fátima A Lotufo, Kaliane Uzilin, Elvira A Zanette, Carla B Andreucci, Tenilson A Oliveira, Laércio R Oliveira, Nelson Sass, Mirian RF Silveira, Pedro R Coutinho, Luciana Siqueira.
The authors declare that they have no competing interests.
The idea for the study first arose in a discussion among RPJ, JGC and RPT and then was developed and implemented by the whole research team. The first version of the manuscript was drafted by GJL and SMH, and then complemented with the suggestions of the others. RPJ and JGC supervised the entire process. All authors contributed to the development of the study protocol and approved the final version of manuscript.
About this article
Cite this article
Lajos, G.J., Haddad, S.M., Tedesco, R.P. et al. Intracluster correlation coefficients for the Brazilian Multicenter Study on Preterm Birth (EMIP): methodological and practical implications. BMC Med Res Methodol 14, 54 (2014). https://doi.org/10.1186/1471-2288-14-54
- Intracluster correlation coefficient
- Preterm birth
- Spontaneous preterm labor
- Premature rupture of membranes
- Indicated preterm delivery
- Neonatal morbidity