Skip to main content
Download PDF

The effect of home visits as an additional recruitment step on the composition of the final sample: a cross-sectional analysis in two study centers of the German National Cohort (NAKO)

BMC Medical Research Methodology volume 21, Article number: 176 (2021) Cite this article

Abstract

Background

Participation in epidemiologic studies has been declining over the last decades. In addition to postal invitations and phone calls, home visits can be conducted to increase participation. The aim of this study was therefore to evaluate the effects of home visits in terms of response increase and composition of the additionally recruited and final sample.

Methods

In the framework of the German National Cohort (NAKO) recruitment process, two of 18 study centers, Halle (Saale) and Berlin-Center, performed home visits as additional recruitment step after postal invitation and reminders. Response increase was calculated and differences between participants recruited via home visits and standard recruitment were examined. Proportions are presented as percentages with 95%-confidence intervals.

Results

In the general population in Halle, 21.3-22.8% participated after postal invitation and two reminders in the five assessed recruitment waves. The increase of the overall response was 2.8 percentage points (95%confidence interval: 1.9-4.0) for home visits compared to 2.4 percentage points (95%CI: 1.7-3.3) for alternatively sent third postal reminder. Participants recruited via home visits had similar characteristics to those recruited via standard recruitment. Among persons of Turkish descent in Berlin-Center site of the NAKO, home visits conducted by native speakers increased the participation of women, persons living together with their partner, were born in Turkey, had lower German language skills, lower-income, lower education, were more often smokers and reported more often diabetes and depression to a degree which changed overall estimates for this subsample.

Conclusions

As an additional recruitment measure in the general population, home visits increased response only marginally, and the through home visits recruited participants did not differ from those already recruited. Among persons with migration background, home visits by a native speaker increased participation of persons not reached by the standard recruitment, but the effects of using a native speaker approach could not be separated from the effect of home visits.

Peer Review reports

Background

Participation in studies has been steadily declining over the past few decades [1,2,3]. While the Framingham Heart Study (first wave 1948-1950) as one of the first epidemiological cohort studies reported a response proportion of 68.6% [4, 5], a much lower response is reported for more recent large cohort studies, e.g. “UK Biobank”, started in 2006 in the UK, or “NAKO”, started in 2014 in Germany [6,7,8,9,10].

Various reasons are likely to contribute to this decline (e.g. lower social engagement in general, higher workload, more relocations) [1, 11]. In any study type, a low response can result in nonresponse bias, a form of selection bias, caused by a non-random participation, with differences between those who participate and those who do not [12, 13]. When the response is high, a small group of non-participants is unlikely to change the overall estimates. When the overall response decreases, it still can be useful to increase participation of less represented groups of the population to be able to calculate weighted estimates. Since it is unlikely that we will be able to reach the participation level of the older studies in the future, the practical question is about the incremental value of additional efforts to increase response. This can vary among populations studied, for example, the mechanisms of response can be different in the general population, patient samples, or among migrant groups due to the additional difficulty of language barriers [2, 14, 15]. Different strategies to increase participation were proposed by several authors, including additional reminders or using various ways of approaching participants, for example, phone calls or home visits in addition to invitations via regular mail [16,17,18].

The aim of this study was therefore to investigate the effect of home visits as an additional step in the recruitment process a) on the response proportion and b) on the characteristics of the study population among a general population and migrants.

Methods

Study design and participants

We used data from two study centers of the German National Cohort (NAKO). The study design of the NAKO has been described in detail elsewhere [7, 19, 20]. Briefly, NAKO is a population-based prospective study that included more than 205.000 participants between 20 and 69 years of age at baseline from 18 study centers all over Germany. The overarching aim of the NAKO is to identify risk factors for common diseases such as cardiovascular diseases, diabetes, cancer, and neuropsychiatric, infectious, and musculoskeletal diseases including socio-economic, lifestyle-related, psychosocial, occupational, and environmental factors. The study was approved by the ethical review committees of all participating study centers including the Charité-Universitätsmedizin Berlin and the Martin Luther University Halle-Wittenberg. Written informed consent was obtained from all participants.

Recruitment

Recruitment of the participants took place between 2014 and 2019 and was organized locally by the 18 study centers. Potential participants were randomly selected from local registration offices and invited in waves (à 500-1000 persons stratified for 10-year age groups: 10% of 20-29 and 30-39 years, respectively, 26,6% of 40-49, 50-59, and 60-69 years, respectively) to the study centers through a multistep invitation procedure. First, an invitation was sent by regular mail. This mail included an invitation letter, a flyer with a short description of the study objectives, a reference to the vote of the Data Protection Officer and the Ethics Committee, a letter of support from regional authorities, and a reply card. Potential participants could mark on the card if they were willing to participate as well as a phone number to be contacted to make an appointment. Participants could also call directly, write an e-mail or fax their reply card to the study center. If no contact could be established, after 14 and 28 days, a first and a second reminder letter were sent out, respectively. If there was no response after 2-3 months, in the study center Halle, a third reminder letter was sent out. In the study center Berlin, no third reminders were sent out. If the phone number of the potential participant was identified (e.g. via phone book or a phone number search service), they were directly contacted via phone by the study center following the invitation letter. After five unsuccessful attempts to reach the participant by phone, reminder letters were sent out, analogously to the potential participants without a known phone number. As an additional recruitment step, study centers could conduct face-to-face recruitment via home visits. However, as this type of recruitment is very time-consuming, this additional step was only carried out in two study centers of the NAKO: Berlin-Center and Halle (Saale), and just for a short time. A flowchart of the NAKO recruitment process is provided as a supplementary figure (Supplementary Fig. 1).

In the study center Halle, data from five recruitment waves were used. In each of the waves, new individuals were contacted. The recruitment waves 1-3 took place between July and October 2014, waves 4 and 5 took place between November 2014 and January 2015. During waves 4 and 5, home visits were performed instead of the third postal reminder. Home visits were usually conducted during the afternoon or during the weekend to increase the likelihood of reaching subjects who work during the day. The team of NAKO staff members consisted of two trained recruiters. Only one home visit per non-responder was attempted.

At the NAKO study center Berlin-Center, home visits were conducted from June 2016 to July 2017 among persons of assumed Turkish descent who had not answered the second reminder letter. We focused on persons with a Turkish background since they represent the largest migrant group (currently 2.8 million) in Germany and especially in Berlin since Germany invited so-called “guest workers” from predominantly Southern Europe and the Mediterranean region in the 1960s and 1970s [21]. The person’s Turkish background was not only based on their nationality (which is provided by the registration office) but additionally on his or her name since many persons with a migration background have German citizenship. One member of the study staff with a Turkish background and Turkish as a native language performed the home visits on one to 2 days per week for 1 year. The postal invitations sent before were only in the German language.

In both study centers, the procedure for home visits was almost identical. If nobody was met, an information card with contact details together with a study flyer (including a Turkish version in Berlin) was deposed in the mailbox. If a family member was encountered at home, this was documented, and the information card was handed out to this person. If the potential participant was at home, the study content was explained to rule out misunderstandings and fears in the hope to promote study participation. Since the study language was German, the participants should have a sufficient understanding of German to provide informed consent and responses in questionnaires. However, during the home visits, individual support was also offered and the possibility to have for example a family member with command of German to attend the participant in the study center. The aim of the home visits was to make directly an appointment for the examination in the study center or to receive at least the phone number of the potential participant to contact him/her later and arrange an appointment then. If a person declined study participation actively during the home visit, a non-responder questionnaire was provided, following the standard NAKO recruitment strategy.

Variables and measures

Residents’ age (categorized into 5 age groups; 20-29, 30-39, 40-49, 50-59, 60-69), sex, and nationality were obtained from the city register beforehand and were therefore available for both participants and non-participants to report stratified response proportions. They were also assessed during baseline assessment via self-report.

Various socio-economic and health-related characteristics were assessed during the NAKO interview and included in the current analysis: marital status (dichotomized into living with a partner (being married or living together with a partner) or without a partner (separated, divorced, single, or widowed), education (dropped out of school, low (< 10 years), medium (10-12 years), and high (> 12 years)), employment status (categorized into employed (including fulltime, part-time/parental leave), retired, unemployed, and permanently disabled), and average income per household member. Health-related variables included lifetime prevalence of cardiovascular diseases (heart attack, angina pectoris, heart failure, cardiac arrhythmia, intermittent claudication, and stroke), chronic back pain, arthritis, osteoporosis, diabetes, cancer, and depression. These variables were recorded dichotomously (ever diagnosed by a physician (yes/no)).

For the sample recruited in Berlin-Center, additional variables were included: the place of birth (Germany or Turkey), native language (German yes or no), level of German language (dichotomized into good (including the answers very good and good), and weak (including the answers medium, bad, and very bad)), years since immigration (categorizes into 0-10 years, > 10 to 20 years, and > 20 years).

Health behaviors included smoking status and the body mass index (BMI). Smoking was assessed via a touchscreen-based self-administrated questionnaire and categorized into smokers, ex-smokers, and non-smokers. Body height and weight were measured at baseline using a calibrated integrated measurement station (SECA model 764, Seca®, Hamburg, Germany). Body mass index (BMI) was calculated from these measurements as weight over height squared in kg/m2, and categorized into normal weight (BMI 18.5 to < 25.0 kg/m2), overweight (BMI 25.0 to < 30.0 kg/m2), and obesity (BMI ≥30.0 kg/m2).

Statistical analysis

Response proportion was calculated using the formula

$$ \frac{\mathrm{Participants}\ \mathrm{that}\ \mathrm{join}\mathrm{ed}\ \mathrm{the}\ \mathrm{study}}{\left(\mathrm{Participants}\ \mathrm{that}\ \mathrm{join}\mathrm{ed}\ \mathrm{the}\ \mathrm{study}+\mathrm{Subjects}\ \mathrm{that}\ \mathrm{refused}\ \mathrm{to}\ \mathrm{join}+\mathrm{Non}-\mathrm{responders}\right)}\ast 100\% $$

The response proportion includes as non-responders all eligible subjects in the denominator, even subjects that died or moved away before contact could be made, as we could not distinguish these possibilities. The participants’ demographic, socioeconomic, and medical characteristics were reported using common descriptive statistics. Continuous variables were reported as means with the standard deviation (SD), categorical variables were reported as absolute and relative frequencies. Relative frequencies were presented alongside their respective 95% confidence interval (CI). Sample characteristics were stratified according to recruitment efforts. All analyses were performed using the R statistical software version 3.2.3. Due to different sample characteristics and recruitment strategies, results from Halle (Saale) and Berlin-Center are reported separately.

To assess the effect of additional home visits on the composition of the final sample, we compared the educational levels of subjects with local respective census data of the so-called Mikrozensus 2011 [22]. For the census conducted in 2011 in Germany, the following data sources were used: a) register data from the Federal Employment Agency on all employees covered by social insurance for about 28.2 million persons, b) register data from public employers on civil servants, judges, and soldiers for around 1.97 million persons and c) data from the household survey (additional employment statistics) on a sample basis with about 7.9 million respondents including data from the survey at addresses with non-sensitive dormitories and shared accommodations with about 122,000 respondents. Because of stratified sampling in the NAKO (oversampling of persons > 40 years), we compare the proportion of persons with high school diplomas in the waves with and without home visits to census data in 10-year age strata.

Results

Home visits in the general population (NAKO study center Halle)

Recruitment process

In total, among 358 non-responders of the Halle study center from waves 4 and 5, a home visit was performed. In 142 visits (40%), the target person or a household member was encountered, in the remaining 60%, only information was left. In total, 28 (7.8%) new participants were recruited through this strategy, 27 of them resulted from the 142 cases when a person was encountered and only 1 of those 216 when nobody was encountered (Fig. 1).

Fig. 1
figure 1

Recruitment flow-chart – NAKO study center Halle

Full size image

Response

The response in waves 1-3 was increased from 21.3 to 23.6% by the third reminder letter. The overall response for waves 4-5 was increased from 22.8 to 25.6% by conducting the home visits (Fig. 2). The mean increase was thus 2.4 percentage points (95% CI: 1.7-3.3) for the third reminder letter and 2.8 percentage points (95% CI: 1.9-4.0) for home visits. Some gender and age differences in recruitment were observed: response was generally higher among women than among men in waves 1-5: 14.4% vs. 10.4% (first invitation), 7.8% vs. 6.7% (first reminder), 2.4% vs. 2.0% (second reminder), 1.2% vs. 1.7% (third reminder (waves 1-3)), and 1.1% vs. 1.1% (home visits (waves 4 and 5)), respectively. Concerning the different age groups, both the third reminder letter and home visits increased the response the most among the age group 20-29 (4.8 and 6.6% increase, respectively). The same age group had the highest response before the third reminder or home visit, indicating that at the overall low response additional recruitment efforts provide more participants in the same groups as already recruited.

Fig. 2
figure 2

Response after different recruitment steps for waves 1-5 and summarized for waves 1-3 (third reminder letter) and waves 4-5 (home visits)

Full size image

Composition of the additionally recruited and final sample

Persons who were recruited during home visits were not different from those who were recruited in one of the precedent postal invitations (in the same wave) nor from those who participated after the third reminder letter (in previous waves). Minor differences were observed for some age groups, gender, marital status, smoking, and chronic diseases, but all of them were within the variation expected for the sample size (Supplementary Table 1).

Consistently, when comparing all participants recruited during waves 1-3 (invitation letter, 1st and 2nd reminder letter (standard recruitment), and additional 3rd reminder letter) with all participants recruited during waves 4-5 (standard recruitment and additional home visit), only small differences could be observed, which were within the expected variation for the sample size. For more details see Table 1.

Table 1 Characteristics of participants recruited in waves with postal mail only (wave 1-3) and waves including home visits (wave 4-5) in the Halle (Saale) NAKO study center
Full size table

Home visits among persons of Turkish descent (NAKO study center Berlin-center)

Recruitment process

Among all non-responders (after two reminders), 613 were classified as of Turkish descent and visited at home in the Berlin-Center region. 40 additional participants of Turkish descent were recruited through this strategy reflecting a response of 6.5% (Fig. 3). In comparison, 229 participants considered Turkish were recruited through postal invitation with up to two reminder letters in the corresponding recruitment waves. Since no onomastic characterization of all potential participants was performed before recruitment, no response increase due to home visits can be calculated for persons of Turkish descent.

Fig. 3
figure 3

Recruitment flow-chart – NAKO study center Berlin-Center

Full size image

Composition of the additionally recruited and final sample

In contrast to the home visits in the general population, in the population of Turkish descent, there were differences between those recruited via home visits and those recruited in preceding recruitment steps: those who were recruited via home visits were more often women, were more often born in Turkey, lived more often with a partner, and had more often a low educational level, less often reported German as their native language, and rated their German language skills as good. In addition, among the participants recruited via home visits, more were smokers, more had a low income, and fewer were employed. They were more often obese and reported more often having diabetes or depression. When comparing those recruited via home visits with those recruited in preceding postal invitations among the sample of Turkish descent, the effect of the home visits was small but remained visible. While the overall estimates for this subgroup were affected, the sample of those recruited via home visits was rather small and some of the observed differences might become more or less nuanced with a bigger sample.

For more details see Table 2.

Table 2 Characteristics of participants of Turkish descent recruited at various steps in the NAKO study center Berlin-Center
Full size table

Comparison of the NAKO participants with the general population

The comparison with the census data showed that the participants recruited in the NAKO are much higher educated than the persons of the respective age group in the underlying populations (Tables 3 and 4). This is the case for both recruitment steps postal invitation with reminders and additional home visits, respectively. The complete tables including all education levels are presented in the supplement as Supplementary Tables 2 and 3. While the recruitment procedure included also a short assessment of non-respondents, the number of persons who decline participation but are willing to provide further information was very low (data not shown).

Table 3 Proportion of highly educated subjects (more than 12 years of education) among NAKO participants (Halle/Saale) and the respective census data [22]
Full size table
Table 4 Proportion of highly educated subjects (more than 12 years of education) among NAKO participants of Turkish descent (Berlin-Center) and the respective census data [22]
Full size table

Discussion

This study aimed to compare participants recruited via postal invitation and reminders with those recruited via additional home visits. Using data from two centers of NAKO, we demonstrated that there was little value in additional home visits as a part of the recruitment strategy among the general population. Response increased only marginally and those recruited via home visits were similar to those recruited either in earlier steps or by additional postal invitation. Overall, home visits did not improve the representativeness of the recruited sample. In contrast, there were some effects of home visits conducted among a population of Turkish descent. However, since the preceding recruitment steps did not use materials in the Turkish language, it is not clear how much of the effect can be attributed to home visits.

In the last decades, a decline in participation in epidemiological studies was observed; various possible explanations were proposed such as less social engagement in general, an increasing mistrust in research, and the fact that studies are more demanding than they used to be (e.g. taking several blood samples, long follow-up, multiple examinations) [1]. Also in our study, the overall response was low compared to earlier studies with about 26% in Halle and 17% in Berlin-Center (whole study sample, no specific data for persons of Turkish descent available) [7]. The effect of the additional home visits in a general population was only small and comparable to a third reminder letter, which is much less demanding in terms of efforts. Additional recruitments steps did not reduce the difference to the general population nor improve the basis for generating weighted estimates.

Home visits as an additional recruitment step have been investigated in several studies with heterogeneous results [16,17,18]. Effects regarding response increase seem to depend on sex, ethnicity, or if the population is generally healthy or a sample of patients. Non-participation of patients is often associated with disease severity resulting in higher participation of “healthier” patients and consequently in an underestimation of disease severity or an overestimation of effects of a certain treatment [23]. Among general population samples, evidence is less clear: a Cochrane review reported no increase of participation after performing home visits among a sample of women who were invited for a breast cancer screening [24]. Results of a recent meta-analysis investigating response in biobank studies showed, in contrast, that face-to-face contact as a recruitment measure could increase response notably [16].

Among persons with a migration background, home visits were described as useful by several authors. Ford et al. reported face-to-face recruitment at church as effective among African Americans, however, without reporting a comparison, since the face-to-face recruitment was conducted as an individual recruitment measure and not as an additional step after mailing or telephone contact [25]. In the pre-test phase of the NAKO, Reiss et al. showed that a 10% response could be reached among persons of Turkish descent using additional home visits and bilingual study staff and study material, however, the authors provide no information about response increase due to home visits or comparability with census data among this population group [26]. Similarly, Bonevski et al. propose bilingual study staff and material, adapted wording, and personal contact via face-to-face contact as recruitment strategies for vulnerable population groups or minorities [27], but they do not quantify the effect.

Home visits among the sample of the general population of Halle did not lead to a substantial increase in participation of other population groups than already recruited via postal invitations and reminders. This is in line with a recent study from the US conducted by the National Health Institute that did not find any differences regarding health status between early and late respondents in a population-based survey [28]. Several other studies, however, showed that early respondents were different from late respondents, who were rather young, had a lower educational level [29, 30], and showed a higher prevalence of unfavorable substance use such as smoking and drinking [30,31,32,33,34]. All above-mentioned studies, conducted between 2002 and 2013, had higher response proportions than the NAKO ranging from 35 to 52%, which could be one reason for larger differences between early and late respondents. An important result of the studies was that late respondents were different from early/intermediate respondents and active refusers as well, but could be considered as similar to non-respondents (if the information could be assessed using a non-responder questionnaire). Several studies showed that non-respondents had as well lower educational levels and more often unhealthy lifestyle behaviors than participants [33, 35,36,37,38]. We could not confirm these observations.

In contrast to the general sample, we found that in the subsample among persons of Turkish descent, home visits could reach persons who were different from those who had agreed to participate after one of the postal invitations. Home visits recruited persons were more often women, living together with their partner, were more often born in Turkey, had lower German language skills, lower-income, and lower education. This corresponds with results from Hernando et al. who showed that common reasons for non-participation are language barriers and cultural differences between study staff and participants (Hernando et al., 2018). Hughson et al. proposed home visits especially for recruitment of population groups with a “high likelihood of socioeconomic hardship” [39]. Unfavorable health behavior, as well as a higher prevalence of chronic diseases, are also factors that are generally found more frequently in non-participants as among our sample of Turkish migrants [38]. Those factors seem to be similar for baseline and follow-up participation. A recent study showed that re-participation at 6-year follow-up could be increased via home visits by 9.5% (from 40.6% after postal invitation and two reminders to 50.1%). Participants recruited via home visits were more often women, had more often their own migration experience, lower education, or were unemployed compared to the participants recruited via mailing and telephone contact [40]. However, when comparing our data with census data assessed in 2011 via the German “Mikrozensus 2011”, even if home visits among the Turkish sample led to the participation of less-educated persons, participants were still different from the underlying migrant population in Berlin. This is in line with other studies showing higher participation of persons with higher education and socio-economic status [2, 36, 38].

Implications

Our results do not support a recommendation of home visits for the general population at current recruitment levels in Germany. Differences in participants recruited with and without home visits were so small that an effect on associations with exposures of interest would be very unlikely. While among persons with migration background, personal contact including native speaker seemed to promote the willingness of participation among those who were not recruited in preceding steps. However, it is not clear how much of this effect could be achieved by adding recruitment materials in the native language in postal invitations. It was not our aim to assess the representativeness of the NAKO sample in general, just to address the question of whether home visits have additional value for the final sample. Distortion of the distribution of some characteristics does not necessarily implicate bias, therefore, definitive judgment is not possible, but as far as we can infer from the studied characteristics, leaving out home visits did not introduce negative effects and the effort of home visits is not required.

Strengths and limitations

One strength of our study is that it is embedded in a strongly standardized environment of the NAKO using recruitment via registration offices, implementing the same recruitment procedures in all study centers including training for study staff. This leads to good comparability between the two study centers Halle and Berlin-Center. Another strength is the inclusion of two different population samples in our analyses (general population and a subsample of Turkish descent) to compare the effect of home visits among those samples using the same methodology. A third strength is the wide spectrum of characteristics across which the differences could be assessed.

Some limitations have to be mentioned as well. First, our sample sizes of persons recruited via home visits were rather small, resulting in the low statistical power of our study. There is thus a probability that differences between groups or associations have not been detected. Second, no response increase caused by the home visits could be provided for the Turkish subsample, since the onomastic classification was not conducted for the standard recruitment responders. Furthermore, despite recommendations based on a NAKO pre-test, no bilingual study information was provided for persons with (a possible) migration background. We could therefore not separate the effects of home visits from the effects of providing information about the study in the native language. Also, the study materials were still in German, therefore the participation of persons without knowledge of German required additional support. This can be different when participation in a native language is offered. In addition, since the recruitment was performed in two urban settings without including more rural regions, the generalizability may be reduced.

Conclusions

In the sample of the general population, home visits as an additional recruitment measure increased response only to a very limited degree and in a comparable dimension as a third reminder letter. Participants recruited via home visit did not differ from these recruited via regular mail. In a migrant sample, we show positive effects of home visits, but could not separate those from the effects of providing study materials with bilingual study information.

Availability of data and materials

The datasets used and/or analyzed during the current study are not yet publicly available due to the ongoing data management process but are available from the corresponding author on reasonable request.

Abbreviations

BMI:

Body mass index

CI:

Confidence interval

NAKO:

Nationale Kohorte

SD:

Standard deviation

References

  1. Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17:643–53.

    Article  Google Scholar 

  2. Reinikainen J, Tolonen H, Borodulin K, Härkänen T, Jousilahti P, Karvanen J, et al. Participation rates by educational levels have diverged during 25 years in Finnish health examination surveys. Eur J Pub Health. 2018;28:237–43.

    Article  Google Scholar 

  3. Latza U, Stang A, Bergmann M, Kroke A, Sauer S, Holle R, et al. The Problem of Response in Epidemiological Studies in Germany (Part I) [Zum Problem der Response in epidemiologischen Studien in Deutschland (Teil I)]. Gesundheitswesen. 2004;66:326–36.

    Article  CAS  Google Scholar 

  4. Dawber TR, Meadors GF, Moore FE. Epidemiological approaches to heart disease: the Framingham study. Am J Public Health. 1951;41:279–81.

    Article  CAS  Google Scholar 

  5. Dawber TR, Kannel WB. An epidemiologic study of heart disease: the Framingham study. Nutr Rev. 1958;16:1–4.

  6. Steell L, Ho FK, Sillars A, Petermann-Rocha F, Li H, Lyall DM, et al. Dose-response associations of cardiorespiratory fitness with all-cause mortality and incidence and mortality of cancer and cardiovascular and respiratory diseases: the UK Biobank cohort study. Br J Sports Med. 2019;53:1371–8.

    Article  Google Scholar 

  7. Schipf S, Schöne G, Günther K, Greiser KH, Meinke-Franze C, Stübs G, et al. The baseline assessment of the German National Cohort (NAKO Gesundheitsstudie): participation in the examination modules, quality assurance, and the use of secondary data [die Basiserhebung der NAKO Gesundheitsstudie: Teilnahme an den Untersuchungsmodulen]. Bundesgesundheitsblatt. 2020;63:254–66.

    Article  Google Scholar 

  8. UK Biobank. Study web site. 2021. https://www.ukbiobank.ac.uk/. Accessed 9 Apr 2021.

  9. Ollier W, Sprosen T, Peakman T. UK Biobank: from concept to reality. Pharmacogenomics. 2005;6:639–46.

    Article  Google Scholar 

  10. Ahrens W, Hoffmann W, Jöckel KH, Kaaks R, Gromer B, Greiser KH, et al. The German National Cohort: aims, study design and organization. Eur J Epidemiol. 2014;29:371–82.

    Article  Google Scholar 

  11. Brick JM, Williams D. Explaining rising nonresponse rates in cross-sectional surveys. Ann Am Acad Pol Soc Sci. 2013;645:36–59.

    Article  Google Scholar 

  12. Strandhagen E, Berg C, Lissner L, Nunez L, Rosengren A, Torén K, et al. Selection bias in a population survey with registry linkage: potential effect on socioeconomic gradient in cardiovascular risk. Eur J Epidemiol. 2010;25:163–72.

    Article  Google Scholar 

  13. Infante-Rivard C, Cusson A. Reflection on modern methods: selection bias—a review of recent developments. Int J Epidemiol. 2018;47:1714–22.

    Article  Google Scholar 

  14. Hernando C, Sabidó M, Casabona J. Facilitators and barriers of participation in a longitudinal research on migrant families in Badalona (Spain): a qualitative approach. Heal Soc Care Community. 2018;26:e64–74.

    Article  Google Scholar 

  15. Hernando C, Sabidó M, Ronda E, Ortiz-Barreda G, Casabona J. A systematic review of longitudinal cohort studies on the health of migrant populations. Soc Med. 2015;9:73–85.

    Google Scholar 

  16. van Zon SKR, Scholtens S, Reijneveld SA, Smidt N, Bültmann U. Active recruitment and limited participant-load related to high participation in large population-based biobank studies. J Clin Epidemiol. 2016;78:52–62.

    Article  Google Scholar 

  17. Booker CL, Harding S, Benzeval M. A systematic review of the effect of retention methods in population-based cohort studies. BMC Public Health. 2011;11:249.

  18. Edwards PJ, Clarke MJ, Roberts I, DiGuiseppi C, Wentz R, Kwan I, et al. Methods to increase response to postal and electronic questionnaires (review). Cochrane Libr. 2009;3:1–527.

  19. Ahrens W, Hoffmann W, Jöckel KH, Kaaks R, Gromer B, Greiser KH, et al. The German National Cohort: aims, study des. Eur J Epidemiol. 2014;29:371–82.

    Article  Google Scholar 

  20. Dragano N, Reuter M, Greiser KH, Becher H, Zeeb H, Mikolajczyk R, et al. Socio-demographic and employment-related factors in the German National Cohort (GNC; NAKO Gesundheitsstudie) [Soziodemografische und erwerbsbezogene Merkmale in der NAKO Gesundheitsstudie]. Bundesgesundheitsblatt. 2020;63:267–78.

    Article  Google Scholar 

  21. Statistisches Bundesamt (Destatis). Bevölkerung und Erwerbstätigkeit: Bevölkerung mit Migrationshintergrund – Ergebnisse des Mikrozensus 2019. 2020.

    Google Scholar 

  22. Statistisches Bundesamt (Destatis). Zensus 2011. Methoden und Verfahren. Hrsg. Statistische Ämter des Bundes und der Länder. 2015.

  23. de Beurs E, Warmerdam L, Twisk J. Bias through selective inclusion and attrition: representativeness when comparing provider performance with routine outcome monitoring data. Clin Psychol Psychother. 2019;26:430–9.

    Article  Google Scholar 

  24. Bonfill Cosp X, Marzo Castillejo M, Pladevall Vila M, Marti J, Emparanza JI. Strategies for increasing the participation of women in community breast cancer screening (review). Cochrane Database Syst Rev. 2001;(1):CD002943:1–32.

  25. Ford ME, Havstad SL, Davis SD. A randomized trial of recruitment methods for older African American men in the Prostat, lung, colorectal and ovarian (PLCO) cancer screening trial. Clin Trials. 2004;1:343–51.

    Article  Google Scholar 

  26. Reiss K, Dragano N, Ellert U, Fricke J, Greiser KH, Keil T, et al. Comparing sampling strategies to recruit migrants for an epidemiological study. Results from a German feasibility study. Eur J Pub Health. 2014;24:721–6.

    Article  Google Scholar 

  27. Bonevski B, Randell M, Paul C, Chapman K, Twyman L, Bryant J, et al. Reaching the hard-to-reach: a systematic review of strategies for improving health and medical research with socially disadvantaged groups. BMC Med Res Methodol. 2014;14:42.

  28. Maitland A, Lin A, Cantor D, Jones M, Moser RP, Hesse BW, et al. A nonresponse Bias analysis of the health information National Trends Survey (HINTS). J Health Commun. 2017;22:545–53.

    Article  Google Scholar 

  29. Helasoja V, Prättälä R, Dregval L, Pudule I, Kasmel ANU. Late response and item nonresponse in the Finbalt Health Monitor Survey. Eur J Pub Health. 2002:117–123.

  30. Chen R, Wei L, Syme PD. Comparison of early and delayed respondents to a postal health survey: a questionnaire study of personality traits and neuropsychological symptoms. Eur J Epidemiol. 2003;18:195–202.

    Article  Google Scholar 

  31. Korkeila K, Suominen S, Ahvenainen J, Ojanlatva A, Rautava P, Helenius H, et al. Non-response and related factors in a nation-wide health survey. Eur J Epidemiol. 2001;17:991–9.

    Article  CAS  Google Scholar 

  32. Meiklejohn J, Connor J, Kypri K. The effect of low survey response rates on estimates of alcohol consumption in a general population survey. PLoS One. 2012;7:1–6.

    Article  Google Scholar 

  33. Hoffmann W, Terschüren C, Holle R, Kamtsiuris P, Bergmann M, Kroke A, et al. The Problem of Response in Epidemiologic Studies in Germany (Part II) [Zum Problem der Response in epidemiologischen Studien in Deutschland (Teil II)]. Gesundheitswesen. 2004;66:482–91.

    Article  CAS  Google Scholar 

  34. Studer J, Baggio S, Mohler-Kuo M, Dermota P, Gaume J, Bertholet N, et al. Examining non-response bias in substance use research-are late respondents proxies for non-respondents? Drug Alcohol Depend. 2013;132:316–23.

    Article  Google Scholar 

  35. Karvanen J, Härkänen T, Reinikainen J, Tolonen H. Recommendations for design and analysis of health examination surveys under selective non-participation. Eur J Pub Health. 2019;29:8–12.

    Article  Google Scholar 

  36. Demarest S, Van Der Heyden J, Charafeddine R, Tafforeau J, Van Oyen H, Van Hal G. Socio-economic differences in participation of households in a Belgian national health survey. Eur J Pub Health. 2013;23:981–5.

    Article  Google Scholar 

  37. Yamaguchi M, Yoshida T, Yamada Y, Watanabe Y, Nanri H, Yokoyama K, et al. Sociodemographic and physical predictors of non-participation in community based physical checkup among older neighbors: a case-control study from the Kyoto-Kameoka longitudinal study, Japan. BMC Public Health. 2018;18:1–15.

    Article  Google Scholar 

  38. Enzenbach C, Wicklein B, Wirkner K, Loeffler M. Evaluating selection bias in a population-based cohort study with low baseline participation: the LIFE-adult-study. BMC Med Res Methodol. 2019;19:1–14.

    Article  Google Scholar 

  39. Hughson J, Woodward-Kron R, Parker A, Hajek J, Bresin A, Knoch U, et al. A review of approaches to improve participation of culturally and linguistically diverse populations in clinical trials. Trials. 2016;17:1–10.

    Article  Google Scholar 

  40. Krist L, Dornquast C, Reinhold T, Solak S, Durak M, Keil T. Strategies to enhance follow-up response in a cohort study with Berliners of Turkish descent. Eur J Pub Health. 2019;29(Supplement 4):400–1.

    Google Scholar 

Download references

Acknowledgments

We thank all participants who took part in the NAKO and the staff in the NAKO centers Halle and Berlin-Center.

Funding

This project was conducted with data from the German National Cohort (NAKO) (www.nako.de). The NAKO is funded by the Federal Ministry of Education and Research [BMBF, project funding reference numbers: 01ER1301A/B/C and 01ER1511D]; federal states; the Helmholtz Association and additional financial support by the participating universities and the institutes of the Leibniz Association. The funding bodies had no role in the design of the study, in the collection, analysis, and interpretation of data, and in writing the manuscript. Open Access funding enabled and organized by Projekt DEAL.

Author information

Author notes

  1. Lilian Krist and Ahmed Bedir contributed equally to this work.

Authors and Affiliations

  1. Institute of Social Medicine, Epidemiology and Health Economics, Charité-Universitätsmedizin, Berlin, Germany

    Lilian Krist & Julia Fricke

  2. Department of Radiation Oncology, Health Services Research Group, University Hospital Halle (Saale), Halle (Saale), Germany

    Ahmed Bedir

  3. Institute of Medical Epidemiology, Biometry, and Informatics, Martin Luther University Halle-Wittenberg, Halle (Saale), Germany

    Alexander Kluttig & Rafael Mikolajczyk

Authors
  1. Lilian Krist
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ahmed Bedir
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Julia Fricke
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Alexander Kluttig
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rafael Mikolajczyk
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

LK, JF, AK, and RM designed and/or conducted the study; AB and LK managed and retrieved the data; AB analyzed the data and performed the statistical analysis; LK and AB drafted the manuscript. All authors provided input for the manuscript draft and have read and approved the final version.

Corresponding author

Correspondence to Lilian Krist.

Ethics declarations

Ethics approval and consent to participate

The NAKO was approved by the ethical review committees of all participating NAKO study centers including the Charité-Universitätsmedizin Berlin and the Martin Luther University Halle-Wittenberg. Written informed consent was obtained from all participants. All methods were performed in accordance with the relevant guidelines and regulations.

Consent for publication

All participants gave written, informed consent.

Competing interests

The authors declare that they have no conflict of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Supplementary Figure 1.

Recruitment process of the German National Cohort (NAKO)

Additional file 2: Supplementary Table 1.

Characteristics of participants recruited in waves 1-3 (invitation, 1st, and 2nd reminder vs. 3rd reminder) and participants recruited in waves 4-5 (invitation, 1st, and 2nd reminder vs. home visits)

Additional file 3: Supplementary Table 2.

Comparison of educational levels between NAKO participants (Halle/Saale) and respective census data (all numbers are divided by within-group total)

Additional file 4: Supplementary Table 3.

Comparison of educational levels between NAKO participants of Turkish descent (Berlin-Center) and respective census data (all numbers are divided by within-group total)

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Krist, L., Bedir, A., Fricke, J. et al. The effect of home visits as an additional recruitment step on the composition of the final sample: a cross-sectional analysis in two study centers of the German National Cohort (NAKO). BMC Med Res Methodol 21, 176 (2021). https://doi.org/10.1186/s12874-021-01357-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12874-021-01357-z

Keywords

BMC Medical Research Methodology

ISSN: 1471-2288

Contact us