Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Comparison of participants and non-participants to the ORISCAV-LUX population-based study on cardiovascular risk factors in Luxembourg

BMC Medical Research Methodology volume 10, Article number: 80 (2010) Cite this article

Abstract

Background

Poor response is a major concern in public health surveys. In a population-based ORISCAV-LUX study carried out in Grand-Duchy of Luxembourg to assess the cardiovascular risk factors, the non-response rate was not negligible. The aims of the present work were: 1) to investigate the representativeness of study sample to the general population, and 2) to compare the known demographic and cardiovascular health-related profiles of participants and non-participants.

Methods

For sample representativeness, the participants were compared to the source population according to stratification criteria (age, sex and district of residence). Based on complementary information from the "medical administrative database", further analysis was carried out to assess whether the health status affected the response rate. Several demographic and morbidity indicators were used in the univariate comparison between participants and non-participants.

Results

Among the 4452 potentially eligible subjects contacted for the study, there were finally 1432 (32.2%) participants. Compared to the source population, no differences were found for gender and district distribution. By contrast, the youngest age group was under-represented while adults and elderly were over-represented in the sample, for both genders. Globally, the investigated clinical profile of the non-participants was similar to that of participants. Hospital admission and cardiovascular health-related medical measures were comparable in both groups even after controlling for age. The participation rate was lower in Portuguese residents as compared to Luxembourgish (OR = 0.58, 95% CI: 0.48-0.69). It was also significantly associated with the professional status (P < 0.0001). Subjects from the working class were less receptive to the study than those from other professional categories.

Conclusion

The 32.2% participation rate obtained in the ORISCAV-LUX survey represents the realistic achievable rate for this type of multiple-stage, nationwide, population-based surveys. It corresponds to the expected rate upon which the sample size was calculated. Given the absence of discriminating health profiles between participants and non-participants, it can be concluded that the response rate does not invalidate the results and allows generalizing the findings for the population.

Peer Review reports

Background

Poor response rate and sample representativeness are major concerns in prevalence public health surveys[1–5]. Nevertheless such studies are based on voluntary participation which depends basically on the subjects' willingness to take part. The literature shows that response rates vary tremendously among surveys and are decreasing in most industrialized countries[6]. In addition, the participation to health surveys requiring physical, anthropometric and blood examination of subjects tends to be even lower in comparison to only-questionnaire surveys[7–9]. Several factors affect the collaboration and participation of subjects, such as population characteristics, cultural attitudes, way of initial contact, length of time needed for full participation, follow-up procedure, legitimacy of the research from the subject's viewpoint, and subject's interest by the research topic[7–9]. Noteworthy, only few published studies drew attention to the real denominator (total eligible sample) to calculate the true participation rate. This makes a comparison of response rates across similar studies quite difficult.

Traditionally, a high response rate is dictated as a rule of thumb of good survey practice. It is considered as an indicator of quality survey estimates, by presuming that a high response rate is associated with a more representative sample and hence with lower bias[10]. Though several studies showed that non-response can yield information with large potential bias[11, 12], recent empirical findings, based on relevant methodological studies by Groves and colleagues, suggest however that changes in non-response rates do not necessarily alter survey estimates. The link between non-response rate and bias is indirect and more complex[6]. More and more, there is less support for the hypothesis that low response rate produces systematically high non-response bias estimates[6, 13, 10, 14–16]. Moreover, the same group of experts in the field advised to anticipate the coverage error by applying a prior well-defined sampling frame so as to retain the value of unbiased sample despite low response rates[6, 14, 13]. In short, non-response bias is a much more complex phenomenon than mere non-response rates, which needs to be investigated consistently in epidemiological surveys[17]. The literature shows that non response is generally managed in two ways. The first is by using response-enhancement strategies during survey development and data collection. This approach is to influence positively the response rate[14, 18], particularly among those initially reluctant, as for example incentives for participation and reminders to non-responders[19–22]. The second approach is the post-survey adjustment of data using weighting techniques to correct for non-response errors[18].

Observation of Cardiovascular Risk Factors in Luxembourg (ORISCAV-LUX) is a nationwide cross-sectional cardiovascular monitoring survey, conducted between November 2007 and January 2009, under the auspices of Luxembourg's Ministry of Health and co-financed by the Ministry of Research. Its major public health objective was to establish baseline information on the prevalence of various potentially modifiable cardiovascular risk factors among the non-institutionalized general adult population, aged 18-69 years. Luxembourg is a small country surrounded by Belgium, France and Germany, with a total population of 493,500 inhabitants (STATEC official estimate, 2009) over an area of about 2,600 km2. Luxembourgish people constitute approximately 56.3% of the population, while the well-integrated foreign residents, constituting more than 150 nationalities, are mostly Portuguese (16.2%), French (5.8%), Italians (3.9%) and Belgians (3.4%).

The response rate attained 30% in the ORISCAV-LUX survey. However, the low participation rate does not necessarily result in a selection bias[23, 24]. Ideally, a separate investigation on non-participants is recommended to reveal potential outcome differences that might indicate reasons for non-participation and subsequent potential non-participation bias[5, 23]. To address this concern, the present paper aimed to 1) investigate the representativeness of the ORISCAV-LUX sample with respect to the general population, and 2) compare the known demographic and cardiovascular health-related characteristics of participants and non participants.

Methods

Overview of the survey

The ORISCAV-LUX survey was primarily designed to collect baseline cardiovascular health data from adult subjects aged 18-69 years residing in Luxembourg. Such an epidemiological survey was never undertaken before in this country. Its methodology is described in detail elsewhere[25]. Basically, a representative random sample was drawn from the national health insurance registry, stratified by gender (male and female), age (5-year categories) and geographic districts of residence (Luxembourg, Diekirch and Grevenmacher). With a 98% social coverage rate, the registry is considered as the most complete list of inhabitants available in Luxembourg. The minimal representative sample size was calculated to 1285 subjects to ensure statistical power[26]. However, based on literature review and previous evidence with such multiple-stage population-based studies, a high non-participation rate was expected, including refusal, invalid addresses and non-response. Assuming a response rate of 30% and a proportion of 5% of institutionalized subjects in each stratum, the sample size was augmented to 4496 subjects. The distribution of selected subjects in each stratum was proportional to their distribution in the source population (adult population of 18 to 69 years residents in Luxembourg). Pregnant women, people living in institutions, subjects outside the age range 18-69 years and those deceased before recruitment were excluded. Briefly, full participation included three major stages: (i) self completion questionnaire on demographic and socio-economic status, personal and family history of cardiovascular diseases and relevant cardiovascular risk factors including tobacco and alcohol consumption, physical activity, dietary habits and medication intake; (ii) physical and anthropometric measurements; and (iii) blood, urine and hair tests.

Measures to increase participation

Intensive efforts were made to increase the response rate, not only during survey preparation but also during the participants' recruitment phase. At kick-off phase, survey publicity, including flyers and media articles, were diffused to provide the selected individuals ample information about the study objectives, relevance to public health policies, ways of participation and participant's rights. A telephone number for inquiries was supplied and the ORISCAV-LUX website was set up. A detailed personal invitation letter with a prepaid reply envelope addressed to the research centre was enclosed with each mailing. The selected subjects were asked to send their approval and phone number for follow-up contact and appointment; otherwise, they were requested to mention the reason of refusal with the purpose of obtaining a prior idea on the reasons of non-participation.

Up to three written invitations (first letter and 2 reminders) were sent at monthly intervals to those who did not respond spontaneously. They were followed by several telephone contacts by skilled personnel, in order to recruit the remaining non-respondents. Those who refused were not contacted again. The field-nurses and phone interviewers were all trained and supplied with detailed manuals. Reluctant cases were followed up by the project manager by means of personal phone contact, to discuss the potential reasons and give them the opportunity to ask further questions about the study. To ensure smooth and well organized data collection, several investigation centers dispatched all over the national territory were prepared to welcome the participants, every morning and occasionally on Saturdays. Home visits were also proposed to those who had transport difficulties related to their health status.

Due to the cultural diversity in Luxembourg, all documents (invitation letter, coupon-answer, consent and questionnaires) were translated into the three most spoken languages: German, Portuguese and English. The translated questionnaires, originally established in French, were independently back-ward translated into French to ensure the validity[27]. Multi-lingual field-nurses and phone interviewers were employed. These measures were taken to increase the potential participation of the minorities. Another method of increasing response rate was providing anonymity to the subject, by using only research identification number and code-bar for each participant's file. A clear sentence was written over the communicated documents, pointing out the approval of the national ethical committee and the national council for private data protection. In addition, mutual benefit theory was applied, aiming to maximize the participation, by supplying the participants with their biological results complemented by the cardiologist notes. In case of abnormal findings, they were advised to consult their family doctor.

Complementary information

The General Inspectorate of Social Security (IGSS) of Luxembourg manages the national health insurance registry, also called the "medical administrative database", from which the ORISCAV-LUX sample of 4496 subjects was selected. Interestingly, besides information about the name, gender, age group, nationality, professional status and address of every resident in Luxembourg, the register contains hospital discharge and medications consumption data. Therefore, complementary anonymous information from the "medical administrative database" was obtained by means of subsequent official request to the IGSS for both participants (1432 subjects) and non-participants (3018 subjects). The requested data concerned cardiovascular health-related conditions, such as medications intake, hospital admissions and medical measures recorded in year 2006 prior to recruitment. Specifically, the requested information comprised (i) prescribed medications, including anti-diabetics, anti-thrombotics, cardiac therapy, antihypertensive drugs, diuretics, peripheral vasodilatators, vasoprotective agents, beta-blocking agents, calcium channel blockers, agents acting on the renin-angiotensin system and serum lipid reducing agents; (ii) hospitalizations due to chronic conditions, such as malignant neoplasm of the colon, bronchus, lung, prostate, breast, thyroid; mental and behavioral disorders due to use of tobacco, alcohol and nutritional disorders, severe mental retardation, hypertensive diseases, ischemic heart disease, cardiac arrest, cardiac failure, cerebro-vascular disease, atherosclerosis, chronic liver cirrhosis, acute and chronic renal failure, and (iii) other cardiovascular-related medical measures, such as hemodialysis for renal failure, cardiac pacemaker, thyroid gland scintigraphy, cardiac catheterization and coronary angioplasty. These data are indicators of morbidity covering a time period of 12 months prior to the study launch. Information concerning the distribution of the resident population of Luxembourg was available freely from the National Statistics and Economic Studies Service (STATEC).

Ethical aspects

As long as the additional requested data were anonymous, the participant's consent was not necessary to make the link between data collected through the ORISCAV-LUX survey and the medical administrative database.

Statistical methods

All statistical analyses were carried out using the SAS 9.2 (© SAS Institute Inc., Cary, NC, USA). Results were presented as numbers and percentages. To study the ORISCAV-LUX sample representativeness, the sample distributions were compared to the source population distributions according to the stratification criteria (sex, age and district of residence) by classical chi-squared tests. To test whether demographics characteristics and health status affected the participation rate, participants and non-participants were compared by univariate logistic regression analysis. The dependent variable was the participation to the ORISCAV-LUX study while the independent variables were, respectively, prescribed medication, hospitalization (yes or no), cardiovascular health-related medical measures (yes or no), nationality and professional status. Associations were expressed as odds ratios (OR) together with their 95% confidence interval (CI). Age-adjusted ORs were also computed by logistic regression analysis to account for the effect of age. All tests were two-sided, with a P-value of 0.05 or less considered statistically significant.

Results

Recruitment process

The ORISCAV-LUX subjects' recruitment process is depicted in Figure 1. Among the 4496 subjects constituting the random stratified sample drawn from the Luxembourg population, 12 were institutionalised and therefore excluded (primary exclusion before sending the invitation letter). After invitation, other 32 cases, including pregnant women (N = 21), severe mentally ill individuals (N = 5), one prisoner and 5 deceased subjects were also excluded before recruitment (secondary exclusion). Thus, a total of 4452 subjects were potentially eligible to take part in the study.

Figure 1
figure 1

The ORISCAV-LUX subject's recruitment flowchart. Primary exclusion before invitation includes 12 addresses of institutionalized subjects. Secondary exclusion after sending the invitation letter includes 32 subjects (pregnant women, mentally ill and deceased cases). Tertiary exclusion from the database after recruitment (> 69 years old).

Full size image

Nearly 5% (213 subjects) were no longer residing at their home address, identified by the post office as "return to sender", were classified as invalid addresses. Further, 502 subjects (11.3%) absolutely refused to participate and were labeled as negative answers; 1545 (34.7%) subjects replied positively and were classified as positive answers; the 2192 (49.2%) individuals who never returned the response-coupon despite 3 invitation letters were considered as "non-respondents". Among initially positive answers, 80 persons refused to continue, were listed as "withdrawal cases", in addition to 31 subjects couldn't come to repeated appointments because of unavailability. The "invalid addresses", "negative answers", "non-respondents", "withdrawal cases" and those how couldn't participate were grouped in a single category called "non-participation", constituting 67.8% of the eligible sample. Finally, a total of 1434 (32.2%) was successfully recruited, hence achieving the prior calculated sample size and the expected response rate. Two participants reached 70 years of age at the time of recruitment were excluded later from the analysis (tertiary exclusion).

Table 1 shows the impact of response-enhancement measures on participation rate. The two postal reminders and the repeated phone contacts enabled further recruitment of 323 (7.3%) and 37 subjects (0.8%), respectively. Thus the participation rate was increased from 24% (1072/4452), then to 31.3% (1395/4452) and finally up to 32.2 (1432/4452) until the end of the study.

Table 1 The impact of response-enhancement measures on participation rate (Eligible participants = 4452 subjects)
Full size table

A majority of subjects who refused to participate ("negative answers", n = 392; 78.1%) did not indicate the reason. For those who did, the reasons were: lack of time to participate (33 cases), prolonged absence in particular for university students abroad (44 cases), permanent medical control (23 cases), personal reasons (5 cases) and absence of interest in the topic (3 cases).

Sample representativeness

To assess the representativeness, the recruited sample (1432 participants) was compared to the source population (298,521 individuals) according to the stratification criteria: gender, age category and district of residence. As seen in Table 2, the ORISCAV-LUX sample was representative of the population for gender and district of residence, but not for age categories. This age difference was significant for both men (P = 0.0004) and women (P = 0.0003). Compared to the source population, the younger age group of 18-29 years was under-represented, whereas adults and elderly were over-represented in the sample.

Table 2 Comparison of ORISCAV-LUX participants to the source population by gender, age category and district of residence
Full size table

Comparison of participants and non-participants

The purpose of the non-response analysis was to compare the known demographic and cardiovascular health-related characteristics of participants and non-participants, to reveal potential outcome differences that might indicate a non-response bias. The distribution between participants and non-participants was comparable in terms of the cardiovascular morbidity indicators, including prescribed medications, hospital admission and medical measures (Table 3). Globally, the clinical profile was not dissimilar to that of participants. Concerning prescribed medications, the OR was 1.4 (95%CI: 1.13 - 1.73) for serum lipid reducing agents medication, showing a significant difference between participants and non-participants (10.7% versus 7.89%, P = 0.002), but this association disappeared after age adjustment (P = 0.12). All prescribed medications in participants were generally similar to those in non participants after age adjustment, except for calcium channel blockers (P = 0.04) and for anti-diabetic medications (P = 0.049). The odds ratios for hospital admission (OR = 0.54, 95%CI: 0.26 - 1.13) and for cardiovascular health-related medical measures (OR = 1.16, 95%CI: 0.69 - 1.93) did not reveal any significant association with participation, even after age-adjustment, although it was borderline for hospital admission (P = 0.05).

Table 3 Characteristics of participants and non-participants to the ORISCAV-LUX survey
Full size table

The recruited sample was representative of the source population with respect to nationality (P = 0.40) (data not shown). However, as seen in Table 3, the participation was significantly associated with the nationality (P < 0.0001). The participation rate was lower in Portuguese residents as compared to Luxembourgish (OR = 0.58, 95% CI, 0.48-0.69).

Similarly, the participation was significantly associated with the professional status (P < 0.0001). There were 1.12% farmers, 31.56% employees, 10.82% state employees, 2.37% independent intellectual workers, 21.51% from working class among participants against 0.7%, 26.24%, 7.12%, 1.76% and 28.79%, respectively, among non-participants. All ORs were statistically significant, except for the "independent intellectual" category. After age-adjustment, the OR for "farmer" category was no longer significant. Overall, only subjects from the "working class" category were less receptive to the study as compared to the other professional categories.

Discussion

As non-participation can affect the validity of epidemiological studies, assessment of non-respondents characteristics is important in the critical appraisal of health research. For the same reason, the application of effective strategies to increase response could improve the quality of health surveys and may reduce selection bias. The key objectives of this paper were to analyze the sample representativeness, and to test the null hypothesis that response rate is not influenced by known demographic or health-related characteristics. In addition, it purposed to assess the impact of pro-active measures to increase participation to the national ORISCAV-LUX survey.

In spite of all the forethought and persistence efforts, there are almost always some uncooperative individuals who fail to respond[5]. The two postal reminders enabled further recruitment of 323 subjects, leading to 7.3% increase in response rate. Further, 37 subjects accepted to participate following repeated phone contacts, hence raising the participation rate from 24% up to 32.2% at the end of the study. Whatever the cause, non-respondents may not be a random subgroup and the respondents may not be representative of the parent population. A recent systematic review[28] has examined ways to enhance the response rate, including personalized letters of invitation originating from universities or public authorities, careful layout and user-friendly questionnaires, stamped return envelopes, follow up contacts. Indeed, in the ORISCAV-LUX survey, almost all these measures were applied. Likewise, from our experience, we could suggest that multilingual personnel and documents translations, particularly the questionnaire, to another non-official language(s), augmented considerably the participation of those who prefer answering in their mother language. Moreover, sending by posted mail the cardiologist's feedback regarding clinical and biological results proved to be attractive to the participants. Interestingly, asking the sampled subjects to mention otherwise the reason of refusal was helpful as a prior exploration of non-participation. Though the majority of those who refused (negative answers) did not indicate the cause, several reasons were nonetheless expressed by the subjects, such as: lack of time to participate, prolonged absence of young 18-29 years adults doing their university studies abroad, which was confirmed by the under-participation level in this age group. The recent research developments in the field of population surveys in such small country made the population more solicited and hence keen to participate only to interesting topics. Individuals under permanent medical control seemed to be less disposed and less convinced by the necessity to participate to such surveys. Other personal reasons and absence of interest to the topic were also pointed out.

The main goal of obtaining higher response rates in epidemiological studies is to increase the likelihood of sample representativeness and to decrease "selection bias" [26, 29], also denoted "non-response bias" in the text. The sample representativeness analysis have shown that there was no significant difference of the recruited ORISCAV-LUX sample by gender and district of residence as compared with the source population, but the study sample contained a slightly higher proportion of older population and less young adults. This finding was expected as most of the young adults were not available due to their prolonged absence for studying abroad. In addition, the cardiovascular focus of the ORISCAV-LUX study might not be a priority for young age groups who usually enjoy a good health. Conversely, the over-representativeness of the older people might be reasonably due to their perception for the need to clinical check-up, especially when counseling by a cardiologist was provided freely. Therefore, in the ORISCAV-LUX survey, the potential consequence of age-related non-response bias was handled by adjusting the sample for age, by using the most recent available distribution of the Luxembourg's population (STATEC database). According to the research questions, future analyses will be performed after sample weighting to take into account the complex sampling design.

Empirically, a low response rate does not necessarily result in a biased sample or, conversely, a high response rate may yield a biased sample[6, 30]. In practice, an "acceptable" or "tolerable" level of non-participation cannot be generalized, because it depends on the study nature, population characteristics and the event under investigation[5]. Although in certain studies a small amount of bias may distort the results, the extent of bias should not necessarily be proportional to the non-response rate[5, 6]. In order to address this issue properly, it is necessary to obtain information about the characteristics of non-participants[31].

The literature provides insights regarding the characteristics associated with lower participation, including younger[32] or older age[33, 34], female sex[33, 34], lower socio-economic status[4, 35], lower occupational status[36], non-Western origin[37], comorbidity[38, 39], and less favorable lifestyle[40, 41]. These findings vary markedly according to the setting, study topic, method and number of contacts, characteristics of the target population and the available data for participants-non participants profile comparison.

It was reported that those who participate in clinical trials and respond to public health surveys are generally healthier and at less risk than those who refuse participation, also called the "healthy participant effect"[1, 8, 38, 42–44], though an example of opposite findings was noticed[45]. To this end, it was important to investigate the morbidity profile of non-participants in the ORISCAV-LUX population. Globally, the morbidity profile-related difference between the participants and non-participants was not significant. Though the participants under lipid-reducing agents were proportionally more numerous than the non-participants, this divergence (dissimilarities of the fractions of the exposed and non-exposed)[35] disappeared after age adjustment. Our results suggest that non-participation in the ORISCAV-LUX survey was not related to the morbidity profile.

Compared to non-participants, participants tended to be older people of Luxembourgish nationality, working as employees or state employees. Across the literature, age seems to have a varying effect[46]; participation either increased with age[37, 47, 48] or, in the contrary, was higher among the young groups[19, 49]. The age difference was probably related to different awareness of the cardiovascular disease problems between young and old people. Such aspects appear to be less attractive to younger age group. In addition, Luxembourg is a small country with limited local higher education possibilities; most young adults of 18-29 years were not available during the study period. Our intensive efforts to fix appointments during the holiday periods increased moderately their participation, but could not surmount their under-representativeness in the sample.

Job grade showed that the probability of participation among state employees was 2.03 times higher than that of those coming from working-classes and 1.94 times after age-adjustment. This finding is close to that observed in most other similar studies in France[46], Great Britain[5, 50, 51] and United States[52]. The difficulty to get temporary free leave from work may hence limit the attendance of working-class group.

Strengths and limitations

The present comparative study has major strong points. First, we analyzed non-participation not only according to traditional demographic background but also according to cardiovascular health characteristics. Second, the comparison study was based on reliable data obtained by means of a request to official authorities, without the need of prior research authorization or subject's consent. Third, the national health insurance authorities keep a reasonably complete "medical administrative database" of the general resident population of the country. For health care reimbursement purposes, this database is subject to regular updates, which was confirmed by the relatively low number of invalid addresses. This enabled us to select a national representative sample and to obtain further information on the main cardiovascular health-related conditions. In view of high cost and low or even possibly decreasing participation rates in population surveys, data collected from ongoing routine databanks may represent a good alternative option for health monitoring in the future.

In ORISCAV-LUX, it was not possible to apply a short version of the original self-reported health behaviors questionnaire as an alternative approach to obtain information about the salient outcome indicators (smoking, alcohol consumption, dietary habits and physical activity). For the reason that, after all enhanced efforts to contact and recruit the non-respondents and reluctant cases, it was irrational to re-contact them for an otherwise shorter questionnaire. According to the best of our knowledge, no previous cardiovascular population-based study has reported a similar methodology, based on survey data and national "medical administrative database".

The IGSS data could not supply information about some relevant socioeconomic features, such as the education level, income and marital status, which can be seen as a limitation. Such information would allow investigating the impact of socio-economic differences and its potential bias on the non-participation rate[35]. Therefore, in future analyses, this issue should be interpreted prudently.

Conclusion

In conclusion, the present article provides an insight regarding the strategies applied to increase response rate, sample representativeness and the characteristics of non participants. The 32.2% participation rate obtained represents the realistic achievable for this type of survey, corresponding to the expected rate, upon which the sample size was calculated. The potential non-response bias of the ORISCAV-LUX data was determined by the degree of similarities between the characteristics of participants and non-participants. Given the absence of divergent cardiovascular health-related profiles, we concluded that the response rate did not invalidate our data and allows generalizing the results for the population. Collectively, these results suggest that pro-active strategies to increase response rate in health surveys may yield unbiased estimates of entire population characteristics.

References

  1. Hoeymans N, Feskens EJ, Van Den Bos GA, Kromhout D: Non-response bias in a study of cardiovascular diseases, functional status and self-rated health among elderly men. Age and ageing. 1998, 27 (1): 35-40. 10.1093/ageing/27.1.35.

    Article  CAS  PubMed  Google Scholar 

  2. Jackson R, Chambless LE, Yang K, Byrne T, Watson R, Folsom A, Shahar E, Kalsbeek W: Differences between respondents and nonrespondents in a multicenter community-based study vary by gender ethnicity. The Atherosclerosis Risk in Communities (ARIC) Study Investigators. Journal of clinical epidemiology. 1996, 49 (12): 1441-1446. 10.1016/0895-4356(95)00047-X.

    Article  CAS  PubMed  Google Scholar 

  3. Tolonen H, Dobson A, Kulathinal S: Effect on trend estimates of the difference between survey respondents and non-respondents: results from 27 populations in the WHO MONICA Project. European journal of epidemiology. 2005, 20 (11): 887-898. 10.1007/s10654-005-2672-5.

    Article  PubMed  Google Scholar 

  4. Boshuizen HC, Viet AL, Picavet HS, Botterweck A, van Loon AJ: Non-response in a survey of cardiovascular risk factors in the Dutch population: determinants and resulting biases. Public health. 2006, 120 (4): 297-308. 10.1016/j.puhe.2005.09.008.

    Article  CAS  PubMed  Google Scholar 

  5. Sheikh K, Mattingly S: Investigating non-response bias in mail surveys. Journal of epidemiology and community health. 1981, 35 (4): 293-296. 10.1136/jech.35.4.293.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Groves RM: Nonresponse rates and nonresponse bias in houshold surveys. Public Opinion Quarterly. 2006, 70 (No.5, Special): 646-675. 10.1093/poq/nfl033.

    Article  Google Scholar 

  7. Pirie PL, Elias WS, Wackman DB, Jacobs DR, Murray DM, Mittelmark MB, Luepker RV, Blackburn H: Characteristics of participants and nonparticipants in a community cardiovascular disease risk factor screening: the Minnesota Heart Health Program. American journal of preventive medicine. 1986, 2 (1): 20-25.

    CAS  PubMed  Google Scholar 

  8. Pullen E, Nutbeam D, Moore L: Demographic characteristics and health behaviours of consenters to medical examination. Results from the Welsh Heart Health Survey. Journal of epidemiology and community health. 1992, 46 (4): 455-459. 10.1136/jech.46.4.455.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Pill R, Stott N: Invitation to attend a health check in a general practice setting: the views of a cohort of non-attenders. The Journal of the Royal College of General Practitioners. 1988, 38 (307): 57-60.

    CAS  PubMed  PubMed Central  Google Scholar 

  10. Tate AR, Jones M, Hull L, Fear NT, Rona R, Wessely S, Hotopf M: How many mailouts? Could attempts to increase the response rate in the Iraq war cohort study be counterproductive?. BMC medical research methodology. 2007, 7: 51-10.1186/1471-2288-7-51.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Brogan DR: Nonresponse in sample surveys: the problem and some solutions. Physical therapy. 1980, 60 (8): 1026-1032.

    CAS  PubMed  Google Scholar 

  12. Hill A, Roberts J, Ewings P, Gunnell D: Non-response bias in a lifestyle survey. Journal of public health medicine. 1997, 19 (2): 203-207.

    Article  CAS  PubMed  Google Scholar 

  13. Groves RM, Couper MP, S P, E S, R T, G PA, Nelson L: Experiments in producing nonresponse bias. Public Opinion Quarterly. 2006, 70 (5, special): 720-736. 10.1093/poq/nfl036.

    Article  Google Scholar 

  14. Lahaut VM, Jansen HA, van de Mheen D, Garretsen HF, Verdurmen JE, van Dijk A: Estimating non-response bias in a survey on alcohol consumption: comparison of response waves. Alcohol and alcoholism (Oxford, Oxfordshire). 2003, 38 (2): 128-134. 10.1093/alcalc/agg044.

    Article  Google Scholar 

  15. Curtin R, Presser S, Singer E: The effects of response rate changes on the index of consumer sentiment. Public Opin Q. 2000, 64 (4): 413-428. 10.1086/318638.

    Article  CAS  PubMed  Google Scholar 

  16. Keeter S, Miller C, Kohut A, Groves RM, Presser S: Consequences of reducing nonresponse in a national telephone survey. Public Opin Q. 2000, 64 (2): 125-148. 10.1086/317759.

    Article  CAS  PubMed  Google Scholar 

  17. Morton LM, Cahill J, Hartge P: Reporting participation in epidemiologic studies: a survey of practice. Am J Epidemiol. 2006, 163 (3): 197-203. 10.1093/aje/kwj036.

    Article  PubMed  Google Scholar 

  18. Locker D: Response and nonresponse bias in oral health surveys. Journal of public health dentistry. 2000, 60 (2): 72-81. 10.1111/j.1752-7325.2000.tb03298.x.

    Article  CAS  PubMed  Google Scholar 

  19. O'Neill TW, Marsden D, Matthis C, Raspe H, Silman AJ: Survey response rates: national and regional differences in a European multicentre study of vertebral osteoporosis. Journal of epidemiology and community health. 1995, 49 (1): 87-93. 10.1136/jech.49.1.87.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Vestbo J, Rasmussen FV: Baseline characteristics are not sufficient indicators of non-response bias follow up studies. Journal of epidemiology and community health. 1992, 46 (6): 617-619. 10.1136/jech.46.6.617.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. O'Neill TW, Marsden D, Silman AJ: Differences in the characteristics of responders and non-responders in a prevalence survey of vertebral osteoporosis. European Vertebral Osteoporosis Study Group. Osteoporos Int. 1995, 5 (5): 327-334. 10.1007/BF01622254.

    Article  PubMed  Google Scholar 

  22. Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, Kwan I: Increasing response rates to postal questionnaires: systematic review. BMJ (Clinical research ed). 2002, 324 (7347): 1183.-10.1136/bmj.324.7347.1183.

    Article  PubMed Central  Google Scholar 

  23. Korkeila K, Suominen S, Ahvenainen J, Ojanlatva A, Rautava P, Helenius H, Koskenvuo M: Non-response and related factors in a nation-wide health survey. European journal of epidemiology. 2001, 17 (11): 991-999. 10.1023/A:1020016922473.

    Article  CAS  PubMed  Google Scholar 

  24. Stang A, Jockel KH: Studies with low response proportions may be less biased than studies with high response proportions. American journal of epidemiology. 2004, 159 (2): 204-210. 10.1093/aje/kwh009.

    Article  PubMed  Google Scholar 

  25. Alkerwi A, Sauvageot N, Donneau A-F, Lair M-L, Couffignal S, Beissel J, Delagardelle C, Wagener Y, Albert A, Guillaume M: First nationwide survey on cardiovascular risk factors in Grand-Duchy of Luxembourg (ORISCAV-LUX). BMC Public Health. 2010, 10 (468):

  26. Lwanga SK, Lemeshow S: Sample Size Determination in Health Studies: A Practical Manual. 1991

    Google Scholar 

  27. Anand SS, Yusuf S, Vuksan V, Devanesen S, Montague P, Kelemen L, Bosch J, Sigouin C, Teo KK, Lonn E, et al: The Study of Health Assessment and Risk in Ethnic groups (SHARE): rationale and design. The SHARE Investigators. Can J Cardiol. 1998, 14 (11): 1349-1357.

    CAS  PubMed  Google Scholar 

  28. Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, Kwan I, Cooper R: Methods to increase response rates to postal questionnaires. Cochrane Database Syst Rev. 2007, MR000008-2

  29. Rothman KJGS: Precision and validity in epidemiological studies. Modern Epidemiology. 1998, 115-134. 2

    Google Scholar 

  30. Kjoller M, Thoning H: Characteristics of non-response in the Danish Health Interview Surveys, 1987-1994. Eur J Public Health. 2005, 15 (5): 528-535. 10.1093/eurpub/cki023.

    Article  PubMed  Google Scholar 

  31. de Marco R, Verlato G, Zanolin E, Bugiani M, Drane JW: Nonresponse bias in EC Respiratory Health Survey in Italy. Eur Respir J. 1994, 7 (12): 2139-2145. 10.1183/09031936.94.07122139.

    Article  CAS  PubMed  Google Scholar 

  32. Jacobsen SJ, Mahoney DW, Redfield MM, Bailey KR, Burnett JC, Rodeheffer RJ: Participation bias in a population-based echocardiography study. Ann Epidemiol. 2004, 14 (8): 579-584. 10.1016/j.annepidem.2003.11.001.

    Article  PubMed  Google Scholar 

  33. Ramos E, Lopes C, Barros H: Investigating the effect of nonparticipation using a population-based case-control study on myocardial infarction. Ann Epidemiol. 2004, 14 (6): 437-441. 10.1016/j.annepidem.2003.09.013.

    Article  PubMed  Google Scholar 

  34. Benfante R, Reed D, MacLean C, Kagan A: Response bias in the Honolulu Heart Program. American journal of epidemiology. 1989, 130 (6): 1088-1100.

    CAS  PubMed  Google Scholar 

  35. Strandhagen E, Berg C, Lissner L, Nunez L, Rosengren A, Toren K, Thelle DS: Selection bias in a population survey with registry linkage: potential effect on socioeconomic gradient in cardiovascular risk. Eur J Epidemiol. 2010, 25 (3): 163-172. 10.1007/s10654-010-9427-7.

    Article  PubMed  Google Scholar 

  36. Gerber Y, Jacobsen SJ, Killian JM, Weston SA, Roger VL: Participation bias assessment in a community-based study of myocardial infarction, 2002-2005. Mayo Clin Proc. 2007, 82 (8): 933-938. 10.4065/82.8.933.

    Article  PubMed  Google Scholar 

  37. Sogaard AJ, Selmer R, Bjertness E, Thelle D: The Oslo Health Study: The impact of self-selection in a large, population-based survey. Int J Equity Health. 2004, 3 (1): 3-10.1186/1475-9276-3-3.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Criqui MH, Barrett-Connor E, Austin M: Differences between respondents and non-respondents in a population-based cardiovascular disease study. American journal of epidemiology. 1978, 108 (5): 367-372.

    CAS  PubMed  Google Scholar 

  39. Pirzada A, Yan LL, Garside DB, Schiffer L, Dyer AR, Daviglus ML: Response rates to a questionnaire 26 years after baseline examination with minimal interim participant contact and baseline differences between respondents and nonrespondents. American journal of epidemiology. 2004, 159 (1): 94-101. 10.1093/aje/kwh012.

    Article  PubMed  Google Scholar 

  40. de Winter AF, Oldehinkel AJ, Veenstra R, Brunnekreef JA, Verhulst FC, Ormel J: Evaluation of non-response bias in mental health determinants and outcomes in a large sample of pre-adolescents. European journal of epidemiology. 2005, 20 (2): 173-181. 10.1007/s10654-004-4948-6.

    Article  PubMed  Google Scholar 

  41. Madigan MP, Troisi R, Potischman N, Brogan D, Gammon MD, Malone KE, Brinton LA: Characteristics of respondents and non-respondents from a case-control study of breast cancer in younger women. Int J Epidemiol. 2000, 29 (5): 793-798. 10.1093/ije/29.5.793.

    Article  CAS  PubMed  Google Scholar 

  42. Klesges RC, Williamson JE, Somes GW, Talcott GW, Lando HA, Haddock CK: A population comparison of participants and nonparticipants in a health survey. American journal of public health. 1999, 89 (8): 1228-1231. 10.2105/AJPH.89.8.1228.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  43. Lynch WD, Golaszewski TJ, Clearie A, Vickery DM: Characteristics of self-selected responders to a health risk appraisal: generalizability of corporate health assessments. American journal of public health. 1989, 79 (7): 887-888. 10.2105/AJPH.79.7.887.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  44. Foster K, Campbell D, Crum J, Stove M: Non-response in a population study after an environmental disaster. Public health. 1995, 109 (4): 267-273. 10.1016/S0033-3506(95)80204-5.

    Article  CAS  PubMed  Google Scholar 

  45. Tennant A, Badley EM: Investigating non-response bias in a survey of disablement in the community: implications for survey methodology. Journal of epidemiology and community health. 1991, 45 (3): 247-250. 10.1136/jech.45.3.247.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  46. Goldberg M, Chastang JF, Leclerc A, Zins M, Bonenfant S, Bugel I, Kaniewski N, Schmaus A, Niedhammer I, Piciotti M, et al: Socioeconomic, demographic, occupational, and health factors associated with participation in a long-term epidemiologic survey: a prospective study of the French GAZEL cohort and its target population. American journal of epidemiology. 2001, 154 (4): 373-384. 10.1093/aje/154.4.373.

    Article  CAS  PubMed  Google Scholar 

  47. Jacobsen BK, Thelle DS: The Tromso Heart Study: responders and non-responders to a health questionnaire, do they differ?. Scandinavian journal of social medicine. 1988, 16 (2): 101-104.

    CAS  PubMed  Google Scholar 

  48. Bakke P, Gulsvik A, Lilleng P, Overa O, Hanoa R, Eide GE: Postal survey on airborne occupational exposure and respiratory disorders in Norway: causes and consequences of non-response. Journal of epidemiology and community health. 1990, 44 (4): 316-320. 10.1136/jech.44.4.316.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  49. Tell GS, Fried LP, Hermanson B, Manolio TA, Newman AB, Borhani NO: Recruitment of adults 65 years and older as participants in the Cardiovascular Health Study. Ann Epidemiol. 1993, 3 (4): 358-366. 10.1016/1047-2797(93)90062-9.

    Article  CAS  PubMed  Google Scholar 

  50. Walker M, Shaper AG, Cook DG: Non-participation and mortality in a prospective study of cardiovascular disease. Journal of epidemiology and community health. 1987, 41 (4): 295-299. 10.1136/jech.41.4.295.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  51. Marmot M, Feeney A, Shipley M, North F, Syme SL: Sickness absence as a measure of health status and functioning: from the UK Whitehall II study. Journal of epidemiology and community health. 1995, 49 (2): 124-130. 10.1136/jech.49.2.124.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  52. Friedman GD, Cutter GR, Donahue RP, Hughes GH, Hulley SB, Jacobs DR, Liu K, Savage PJ: CARDIA: study design, recruitment, and some characteristics of the examined subjects. Journal of clinical epidemiology. 1988, 41 (11): 1105-1116. 10.1016/0895-4356(88)90080-7.

    Article  CAS  PubMed  Google Scholar 

Pre-publication history

Download references

Acknowledgements

The Ministry of Social Security, in particular the General Inspectorate of Social Security selected the first sample and supplied the additional data about the non respondents. The authors thank Astrid Breyer, Carlo Haller and Laurence Weber for collaboration to sample selection and for preparing and compiling the social insurance data.

The authors acknowledge the financial support of the Luxembourg Research Funds (Fonds National de la Recherche) for the article processing charge.

Author information

Authors and Affiliations

  1. Centre de Recherche Public de la Santé, Centre d'Etudes en Santé, Luxembourg

    Ala'a Alkerwi, Nicolas Sauvageot, Sophie Couffignal & Marie-Lise Lair

  2. School of Public Health, University of Liège, Belgium

    Adelin Albert & Michèle Guillaume

Authors
  1. Ala'a Alkerwi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nicolas Sauvageot
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sophie Couffignal
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Adelin Albert
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Marie-Lise Lair
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Michèle Guillaume
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ala'a Alkerwi.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

AA(1) coordinated the ORISCAV-LUX survey, involved in the study design, collaborated to get the health insurance data, contributed to statistical analysis and results interpretation and drafted the manuscript. NS performed the statistical analysis and contributed to results interpretation. SC gave methodological advice on the present study design and statistical analysis. M-LL participated in the present study design, coordinated between the authorities to get the health insurance data, supervised all the study process and discussed the statistical results. AA(2) contributed to the critical revision of the manuscript and intellectual content. MG provided expertise and oversight throughout the process. All authors read and approved the final version.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Alkerwi, A., Sauvageot, N., Couffignal, S. et al. Comparison of participants and non-participants to the ORISCAV-LUX population-based study on cardiovascular risk factors in Luxembourg. BMC Med Res Methodol 10, 80 (2010). https://doi.org/10.1186/1471-2288-10-80

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2288-10-80

Keywords

BMC Medical Research Methodology

ISSN: 1471-2288

Contact us