- Research article
- Open Access
Program design features that can improve participation in health education interventions
BMC Medical Research Methodology volume 7, Article number: 47 (2007)
Although there have been reported benefits of health education interventions across various health issues, the key to program effectiveness is participation and retention. Unfortunately, not everyone is willing to participate in health interventions upon invitation. In fact, health education interventions are vulnerable to low participation rates. The objective of this study was to identify design features that may increase participation in health education interventions and evaluation surveys, and to maximize recruitment and retention efforts in a general ambulatory population.
A cross-sectional questionnaire was administered to 175 individuals in waiting rooms of two hospitals diagnostic centres in Toronto, Canada. Subjects were asked about their willingness to participate, in principle, and the extent of their participation (frequency and duration) in health education interventions under various settings and in intervention evaluation surveys using various survey methods.
The majority of respondents preferred to participate in one 30–60 minutes education intervention session a year, in hospital either with a group or one-on-one with an educator. Also, the majority of respondents preferred to spend 20–30 minutes each time, completing one to two evaluation surveys per year in hospital or by mail.
When designing interventions and their evaluation surveys, it is important to consider the preferences for setting, length of participation and survey method of your target population, in order to maximize recruitment and retention efforts. Study respondents preferred short and convenient health education interventions and surveys. Therefore, brevity, convenience and choice appear to be important when designing education interventions and evaluation surveys from the perspective of our target population.
Due to the growing availability of medical and health information through various sources and forms of mass media , more and more people are becoming consumers of health information . However, this accumulation of knowledge does not necessarily result in adequate information about one's health or illness. In fact, the public health literature suggests that a large percentage of individuals are unaware of the symptoms, mechanism and management of their illness, and many feel that their level of knowledge is unsatisfactory . Therefore, delivering systematic, comprehensive and reliable information about the nature, prevention, detection and self-management of illnesses is imperative.
Governments and health professionals are recognizing this gap in knowledge, and increasing amounts of money and time have consequently been spent on designing and developing health education interventions. Health education interventions usually provide individuals with the necessary knowledge and/or skills regarding the nature of an illness; its mechanism, signs or symptoms; consequences of the illness; prevention, detection techniques or self-monitoring practices; and appropriate self-care, management and treatment methods. For instance, self-management education for chronic illnesses have been developed to empower participants, teach them skills and techniques, and improve their interaction with the healthcare systems to enhance the management of their chronic condition . Interventions can either target specific groups of individuals such as individuals with specific illnesses; caregivers, family, and friends of those with illnesses; healthcare professionals; or the general public.
Interventions are usually evaluated by surveying or interviewing participants. Information such as their experiences, acceptability of the program, and relevant information about individuals before and after the completion of the education sessions are usually collected and analyzed. Evaluation or follow-up surveys provide important data regarding the effectiveness and limitations of the interventions.
In addition to the reported benefits of health education interventions across various health issues [5–10], the key to program effectiveness is participation and retention [11–15]. Unfortunately, not everyone is willing to participate in health interventions and its evaluation upon invitation. In fact, health education interventions are vulnerable to low participation rates [12, 16–18]. Low participation not only limits these interventions from being effective and reaching their target population and goals, but also impedes the gathering of information necessary to further improve these programs. The amount of research on this issue is limited, and even fewer investigations look at the factors that could increase participation. We believe that intervention factors such as convenience and accessibility , length and frequency, and the characteristics of the setting or organization offering the intervention  can offset the perceived benefits and decrease participation of health education interventions .
The purpose of this study was to identify the preferred design features of health education interventions and intervention evaluation surveys in a general ambulatory population. By determining the extent to which people are willing to participate in education interventions based on various design features, program managers, educators and researchers can develop education initiatives that are more appealing, convenient and accessible to their population of interest, while at the same time increase program participation.
Hospital outpatients were recruited during the spring of 2002 to complete a cross-sectional questionnaire while waiting for general diagnostic testing at the University Health Network, a consortium of three hospitals, in Toronto, Ontario, Canada. All participants were able to read and write in English and were willing to provide written informed consent. The institution's research ethics board approved the study.
A questionnaire regarding the participation in health education interventions and intervention evaluation surveys was developed. A health education session was defined as an intervention that provides individuals with information about preventative health practices and/or disease self-management care. An evaluation survey was defined as a tool to assess issues related to the program and to one's health, such as physical, emotional or social well-being. The survey instrument was tested with ten outpatients and their family members for clarity and ease of completion prior to the commencement of the study. All individuals waiting in the diagnostic laboratory testing centres were approached by a research assistant and asked to participate in the study. After signing an informed consent, a questionnaire was given to participants to complete on their own.
The survey took 10–15 minutes to complete. Participants responded to a set of options concerning their participation in health education interventions and intervention evaluation surveys, in principle (See Figure 1 for an extract of the questionnaire). For each of the three settings (i.e., in hospital within a group, in hospital one-on-one with an educator and in the home with an educator), participants were asked to circle the number of health education intervention sessions (0, 1, 2, 4, 6, 8 sessions) they were willing to attend in a year if offered at a frequency of once per week, and the amount of time (0, 30, 60, 90, 120 minutes) they were willing to spend in an education session assuming they would have completed at least one education session. For each of the five survey methods (i.e., in hospital, in home with an interviewer, by mail, via phone and over the Internet), participants were asked to circle the number of evaluation surveys (0, 1, 2, 4, 6, 12 surveys) they were willing to complete in a year, assuming that they attend at least one intervention session, and the amount of time (0, 5, 10, 20, 30, 40, 50, 60 minutes) they were willing to spend completing a survey assuming they would have completed at least one evaluation survey.
Column bar graphs were used to summarize respondents' willingness to participate in health education interventions and evaluation surveys, based on their choices for the participation length and frequency under various settings and survey methods. While the education setting or survey method categories were represented by different shadings, the length and frequency choice categories were also collapsed to make interpretations of graphs easier. The two-way Chi-square tests were used to assess the significant difference in the distribution of the frequency and length the participants willing to spend in an intervention session or an evaluation survey, according to setting or survey methods, respectively. For all analyses, results were considered statistically significant where p-value <0.05. The data was analyzed using the Statistical Package for Social Sciences (version 11.5, SPSS Inc.) and/or Microsoft Excel (versions 2002, SP3, Microsoft Corp.)
Two hundred and three eligible people were approached to participate in the study, of which 175 (response rate 86%) completed the survey. The common reasons for declining to participate in the study were: not feeling well (3%); not having their eye glasses (2%); worry that participating would interfere with their appointment (3%); and refusing to sign the consent form (4%), despite reassurance that their signature would not be linked with their responses (See Figure 2).
Our sample population had an equitable proportion of males (51.5%) and females, and the mean age was 44.5 (SD 13.8) with a range from 13 to 80 years of age. The majority of participants was born in Canada (66.9%), lived in the Greater Toronto Region (70.1%), primary language was English (92.2%), had some or a college/university degree (57.7%), was employed (67.7%) and had an annual income of or more than $40,000 (73.2%). Overall, 57.4% of our study participants had previously participated in health research, and 77.5% of participants indicated that their self-reported health status to be good to excellent. The characteristics of the study population are presented in Table 1.
Health Education Interventions
In-hospital setting with a group was preferred by most participants, followed by one-on-one with an educator in-hospital, while about half of the respondents (50.7%, CI: 42.8, 58.7) disliked the idea of having an educator coming to their home. If health education intervention sessions were offered once per week over a one-year period, most respondents were willing to participate in only one education session regardless of the setting: 46.1% (CI: 38.2, 54.0) for in-hospital with a group, 40.8% (CI: 33.0, 48.6) for one-on-one in hospital with an educator, and 25% (CI: 18.1, 31.9) for in-home education sessions. As the number of sessions increased in a year, fewer respondents were willing to participate and smaller differences were observed among the three settings (Figure 3). Chi-square test indicated that the distribution of the preferred number of intervention sessions is significantly different between the settings (χ2 = 24.882, p = 0.002, df = 8).
Of the respondents who were willing to participate in education sessions, most people found 30 to 60 minutes per education session acceptable in-hospital setting, where 68.2% (CI: 60.7, 75.7) of respondents were willing to spend the noted amount of time in hospital with a group, and two-thirds of respondents (66.2%, CI: 58.7, 73.7) were open to one-on-one with an educator in hospital. Although nearly half of the participants (47.4%, CI: 39.5, 55.3) were reluctant to spend any time in an education session with an educator coming to their home, 39.0% were willing to participate for 30–60 minutes by this format. A small, yet similar proportion of respondents (14%) were willing to spend between 90 and 120 minutes in an education session across all three settings (see Figure 4 and additional file 1). Again, Chi-square tests showed that the distribution of the preferred length of each intervention sessions to be statistically different among the three setting (χ2 = 43.274, p < 0.001, df = 4).
Intervention Evaluation Surveys
The two most popular survey methods for evaluating the intervention were by participating in the hospital and by mail, while many were unwilling to complete any surveys at their home with the interviewer (46.7%, CI: 38.8, 54.6), by telephone (43.4%, CI: 35.5, 51.3), or over the Internet (33%, CI: 25, 40) (Figure 5). Of those willing to participate, the preference for the number of evaluation surveys willing to complete in a year was between one and two, with the leading response of 45.5% (CI: 37.6, 53.4) for the in-hospital method and 35.5% (CI 27.9, 43.1) by mail. As the number of surveys per year increased, a preference for mail and Internet responses was observed; yet the willingness to participate decreased overall. Chi-square test revealed significantly different distributions in the number of surveys participants are willing to take part in among survey formats (χ2 = 61.475, p < 0.001, df = 12).
For the two most popular survey methods, by mail and in hospital, 43.2% (CI: 35.4, 51.0) and 39.9% (CI: 32.3, 47.5) of respondents, respectively, were willing to spend 20 to 30 minutes filling out an evaluation survey (Figure 6). Although completing surveys by telephone was shunned overall, more than one third of the respondents (35.7%, CI: 28.1, 43.3) were willing to spend 5 to 10 minutes for a survey by this method. However, as the length of time increased, less people were willing to participate overall. Chi-square distributions of the preferred number of minutes willing to participate in evaluation surveys were significantly different across survey methods (χ2 = 65.280, p < 0.001, df = 12).
Given that many health education interventions are provided in ambulatory settings, the goal of this study was to inquire about preferences regarding settings, survey methods, duration and frequency for interventions and evaluation survey from an ambulatory-based population. Our study findings suggest that research settings do influence people's willingness to participate in a health education intervention. Most individuals are willing to participate in only one education session per year for 30 to 60 minutes, preferably in hospitals, either in a group or one-on-one format. In addition to already being at the hospital for other reasons, hospital settings may be more comforting to individuals due to the presence of other people, or they may feel that hospital settings legitimize the proposed intervention or survey . In fact, individuals may expect to receive some education about their illness while they are in the hospital. Also, individuals with chronic illnesses often feel isolated in their management of the disease , and family members may feel powerless in their support due to shortage of knowledge regarding the experience. In such cases, a group environment may provide participants with an opportunity to interact with others who have similar illnesses or concerns, resulting in a slightly higher popularity for group sessions over the one-on-one in-hospital format. However, some participants may dislike a group format for various reasons  and may want more interaction with knowledgeable health professionals , thus preferring a one-on-one setting. Providing individuals with a choice between individual and group education is ideal, but not always feasible, particularly when working with limited resources.
The majority of respondents are not willing to participate in education sessions in their home, which showed a different pattern from the responses towards in-hospital settings, possibly because this format may represent an invasion of their privacy and security. Certain individuals may also be discouraged from participating in home interviews due to fear of strangers, violence or abuse . However, people who are financially or physically unable to travel to the location where a health education intervention is being offered [13, 25–27], or who simply dislikes hospital settings , may prefer in-home education sessions or sessions in local community settings.
The type of survey methods used also influence how often and how long respondents are willing to spend completing an evaluation survey. In general, most people are willing to spend 20 to 30 minutes completing one to two surveys in hospital or by mail, but lower enthusiasm was observed for in-home or telephone methods. Surveys at hospitals can be completed while waiting for a medical appointment or immediately after the intervention, and mail surveys may be more popular because they allow participants to complete the survey at their convenience. Reasons for lower willingness to complete in-home surveys may be similar to those previously noted for in-home education sessions. Since telephone surveys usually require immediate completion, devoting a continuous period of time may be tiresome to some unless one is very motivated.
The preference to participate in studies by mail, as opposed to at home with an interviewer or by telephone, is problematic for program managers and researchers because mail surveys tend to have low response rates . In addition, individuals with less education tend to be underrepresented in mail surveys, which may introduce a non-response bias . Furthermore, people may forget or may feel less obliged to fill out mail surveys compared to other, more interactive modalities. However, mail surveys may provide greater and more accurate data when sensitive information is being sought, given the lack of an interviewer [24, 30]. They are also more practical and inexpensive, costing much less per person than telephone or in-person interviews [30–32]. Several combined approaches can be used to enhance response rates from mail surveys, such as sending a reminder to participants within a month , re-mailing the survey [33, 34], or including small monetary incentives [33–37]. In any case, using both mail and a subsequent telephone follow-up, with the option of completing the survey by telephone, may be most effective .
Currently, the Internet is not universally accessible and not all users are proficient at it , which may explain its unpopularity relative to hospital and mail surveys. Younger age and higher level of education is identified as the strongest predictors of Internet access and use . Although most respondents had an education level of more than high school, the mean age of our sample population was 44.5, with 83.2% of respondents being over 30 years of age. This middle-aged population may be less receptive to computer technology and less likely to be Internet-orientated compared to a younger 18–29 age group , and thus might also account for the relative low preference for surveys via the Internet. However, as people become more Internet-orientated, this method may become more popular and practical . Moreover, recent studies have shown an increasing preference for computer-based surveys because they offer more privacy and are easy to use [39, 41]. One study showed that although e-surveys resulted in a lower response rate than postal surveys, the data quality was equivalent and was obtained in a shorter average response time, indicating that e-surveys could be a more feasible evaluation method in the future . There is also exploration into the development of electronic and Internet-based health education intervention or support programs, which are getting favorable responses among participants in other research studies .
Due to the overall shortage of information regarding whether questionnaire length affects the response rate, this factor is still being debated among the academic literature. Some studies show that the response rate and the number of missing responses in a questionnaire are not related to questionnaire length, provided the questionnaire is well designed and easy to complete [28, 31, 44]. Other studies show that increasing the length of a questionnaire results in an increased burden on completion and a decreased response rate [45–48]. In our study, the number of respondents who were willing to participate in education intervention or evaluation surveys differed greatly between settings, especially at a lower frequency or for a shorter time-duration. Nevertheless, the majority of the respondents were agreeable to spend 30–60 minutes participating in an education session and 20–30 minutes completing a survey; however, as the number and length of education sessions and evaluation surveys increased, less people were willing to participate and less of a preference for any particular setting or survey method was observed. This inverse relationship demonstrates that most respondents are only willing to allocate up to a limited time when participating in education sessions and surveys. Individuals who are willing to participate in many education sessions or surveys, and for longer durations, may be motivated by different factors, and thus the location or method of the intervention or evaluation surveys may not be an issue. Consequently, designing short and convenient education programs and evaluation surveys appears to be important. For instance, an inverse relationship was found between program intensity and retention in health promotion work-site programs ; suggesting that intensive programs that demand more time, effort, and commitment may generate substantially lower participation and retention rates . Furthermore, overly structured or inflexible interventions may not be optimal  and providing participants with options to choose from various settings or delivery methods that can easily fit into their schedules are likely more effective in retaining patients. Short and convenient scheduling of intervention sessions may be a key element in increasing participation, especially among full-time working individuals .
There are a few limitations associated with this study. Firstly, our study participants were recruited from hospital diagnostic testing centres and may not represent the general population. Our study participants may frequent the hospital more often than the general population, particularly since the majority of participants favoured a hospital-based setting for both the intervention and the evaluation survey. These findings may also imply a potential selection bias given the study population and setting were ambulatory-based. Nevertheless, this was our targeted population and the goal of this study was to identify their preferences. Furthermore, a normal distribution was observed among participants' self-reported health status, where 77 percent reported being in good to excellent condition, which is similar to the self-reported health status distribution observed among the general populations of Canadians, where 66 percent reported being in very good to excellent condition . Our sample may not represent the non-English speaking population, who may adhere to different cultural beliefs that could influence one's motivation and decision to participate in education programs . Yet, 33 percent of our study sample was born outside of Canada, and represented various non-western ethnic minority backgrounds including African, Asian, South American and East Europeans, thereby representing the opinions of a diverse and multicultural population. Lastly, this survey measured respondents' intentions to participate in a health education intervention and an evaluation survey based on various research design features; these intentions may not translate into actual participation if respondents were presented with the opportunity to take part in an education intervention or survey [53, 54]. Nevertheless, our study findings capture a legitimate perspective (i.e., potential participants) on how to design better health education interventions and evaluation surveys to meet a population's preference.
Our findings have important implications for the design and evaluation of education interventions. Our participants strongly preferred to receive educational interventions in a hospital setting either within a group or one-on-one with an educator. This was somewhat of a surprise at a time where the emphasis of healthcare is shifting towards a more home-based environment. This lack of interest in home-based interventions is also apparent in home-based survey evaluations. A small percentage of participants were interested in telephone or internet-based surveys and even fewer wanted interviewers coming into their homes.
In terms of duration and frequency for both health interventions and their evaluation, participants preferred short and convenient education sessions and evaluation surveys. Education interventions should not be too time intensive that people cannot fit them into their daily schedules. Therefore, balance is needed between the length of time necessary to deliver essential information and/or facilitation of new skills and the convenience and brevity participants desire to better design effective health education interventions. Furthermore, providing individuals with choice in regard to location and modalities may maximize recruitment and retention efforts. By considering potential participants' preferences in the design and implementation of health education interventions, it may be possible to improve recruitment efforts and increase participation rates.
Neuberger J: The educated patient: new challenges for the medical profession. J Intern Med. 2000, 247: 6-10. 10.1046/j.1365-2796.2000.00624.x.
Cline RJ, Haynes KM: Consumer health information seeking on the Internet: the state of the art. Health Educ Res. 2001, 16: 671-692. 10.1093/her/16.6.671.
Latalski M, Skorzynska H, Pacian A: The demand for health education among patients with diabetes. Ann Univ Mariae Curie Sklodowska [Med ]. 2002, 57: 579-588.
Lorig KR, Sobel DS, Stewart AL, Brown BW, Bandura A, Ritter P, Gonzalez VM, Laurent DD, Holman HR: Evidence suggesting that a chronic disease self-management program can improve health status while reducing hospitalization: a randomized trial. Med Care. 1999, 37: 5-14. 10.1097/00005650-199901000-00003.
Bankhead C, Richards SH, Peters TJ, Sharp DJ, Hobbs FD, Brown J, Roberts L, Tydeman C, Redman V, Formby J, Wilson S, Austoker J: Improving attendance for breast screening among recent non-attenders: a randomised controlled trial of two interventions in primary care. J Med Screen. 2001, 8: 99-105. 10.1136/jms.8.2.99.
Brechner RJ, Cowie CC, Howie LJ, Herman WH, Will JC, Harris MI: Ophthalmic examination among adults with diagnosed diabetes mellitus. JAMA. 1993, 270: 1714-1718. 10.1001/jama.270.14.1714.
Dhein Y, Munks-Lederer C, Worth H: [Evaluation of a structured education programme for patients with COPD under outpatient conditions-- a pilot study]. Pneumologie. 2003, 57: 591-597. 10.1055/s-2003-43019.
Keller HH, Hedley MR, Wong SS, Vanderkooy P, Tindale J, Norris J: Community organized food and nutrition education: participation, attitudes and nutritional risk in seniors. J Nutr Health Aging. 2006, 10: 15-20.
Lowe JM, Bowen K: Evaluation of a diabetes education program in Newcastle, NSW. Diabetes Res Clin Pract. 1997, 38: 91-99. 10.1016/S0168-8227(97)00089-2.
Padgett D, Mumford E, Hynes M, Carter R: Meta-analysis of the effects of educational and psychosocial interventions on management of diabetes mellitus. J Clin Epidemiol. 1988, 41: 1007-1030. 10.1016/0895-4356(88)90040-6.
Glasgow RE, McCaul KD, Fisher KJ: Participation in worksite health promotion: a critique of the literature and recommendations for future practice. Health Educ Q. 1993, 20: 391-408.
Glasgow RE, Eakin EG, Toobert DJ: How generalizable are the results of diabetes self-management research? The impact of participation and attrition. Diabetes Educ. 1996, 22: 573-2, 584. 10.1177/014572179602200605.
Halm M, Penque S, Doll N, Beahrs M: Women and cardiac rehabilitation: referral and compliance patterns. J Cardiovasc Nurs. 1999, 13: 83-92.
Marcus BH, Nigg CR, Riebe D, Forsyth LH: Interactive communication strategies: implications for population-based physical-activity promotion. Am J Prev Med. 2000, 19: 121-126. 10.1016/S0749-3797(00)00186-0.
Nigg CR, Allegrante JP, Ory M: Theory-comparison and multiple-behavior research: common themes advancing health behavior research. Health Educ Res. 2002, 17: 670-679. 10.1093/her/17.5.670.
Coonrod BA, Betschart J, Harris MI: Frequency and determinants of diabetes patient education among adults in the U.S. population. Diabetes Care. 1994, 17: 852-858. 10.2337/diacare.17.8.852.
Toobert DJ, Strycker LA, Glasgow RE, Bagdade JD: If you build it, will they come?. Reach and Adoption associated with a comprehensive lifestyle management program for women with type 2 diabetes. Patient Educ Couns. 2002, 48: 99-105. 10.1016/S0738-3991(02)00120-9.
Glasgow RE, Toobert DJ, Hampson SE: Participation in outpatient diabetes education programs: how many patients take part and how representative are they?. Diabetes Educ. 1991, 17: 376-380. 10.1177/014572179101700509.
Engebretson J, Mahoney JS, Walker G: Participation in community health screenings: a qualitative evaluation. J Community Health Nurs. 2005, 22: 77-92. 10.1207/s15327655jchn2202_2.
Andersson CM, Bjaras G, Tillgren P, Ostenson CG: A longitudinal assessment of inter-sectoral participation in a community-based diabetes prevention programme. Soc Sci Med. 2005, 61: 2407-2422. 10.1016/j.socscimed.2005.04.032.
Farley RL, Wade TD, Birchmore L: Factors influencing attendance at cardiac rehabilitation among coronary heart disease patients. Eur J Cardiovasc Nurs. 2003, 2: 205-212. 10.1016/S1474-5151(03)00060-4.
Ohman M, Soderberg S, Lundman B: Hovering between suffering and enduring: the meaning of living with serious chronic illness. Qual Health Res. 2003, 13: 528-542. 10.1177/1049732302250720.
van Dam HA, van der HF, van den BB, Ryckman R, Crebolder H: Provider-patient interaction in diabetes care: effects on patient self-care and outcomes. A systematic review. Patient Educ Couns. 2003, 51: 17-28. 10.1016/S0738-3991(02)00122-2.
Hebert R, Bravo G, KornerBitensky N, Voyer L: Refusal and information bias associated with postal questionnaires and face-to-face interviews in very elderly subjects. Journal of Clinical Epidemiology. 1996, 49: 373-381. 10.1016/0895-4356(95)00527-7.
Brown JV, Demi AS, Celano MP, Bakeman R, Kobrynski L, Wilson SR: A home visiting asthma education program: challenges to program implementation. Health Educ Behav. 2005, 32: 42-56. 10.1177/1090198104266895.
Ramm C, Robinson S, Sharpe N: Factors determining non-attendance at a cardiac rehabilitation programme following myocardial infarction. N Z Med J. 2001, 114: 227-229.
Tercyak KP, Johnson SB, Kirkpatrick KA, Silverstein JH: Offering a randomized trial of intensive therapy for IDDM to adolescents. Reasons for refusal, patient characteristics, and recruiter effects. Diabetes Care. 1998, 21: 213-215. 10.2337/diacare.21.2.213.
Sitzia J, Wood N: Response rate in patient satisfaction research: an analysis of 210 published studies. International Journal for Quality in Health Care. 1998, 10: 311-317. 10.1093/intqhc/10.4.311.
Picavet HJ: National health surveys by mail or home interview: effects on response. J Epidemiol Community Health. 2001, 55: 408-413. 10.1136/jech.55.6.408.
Beebe TJ, McRae JA, Harrison PA, Davern ME, Quinlan KB: Mail surveys resulted in more reports of substance use than telephone surveys. J Clin Epidemiol. 2005, 58: 421-424. 10.1016/j.jclinepi.2004.10.007.
Subar AF, Ziegler RG, Thompson FE, Johnson CC, Weissfeld JL, Reding D, Kavounis KH, Hayes RB, Prostate L: Is shorter always better? Relative importance of questionnaire length and cognitive ease on response rates and data quality for two dietary questionnaires. American Journal of Epidemiology. 2001, 153: 404-409. 10.1093/aje/153.4.404.
O'Toole BI, Battistutta D, Long A, Crouch K: A comparison of costs and data quality of three health survey methods: mail, telephone and personal home interview. American Journal of Epidemiology. 1986, 124: 317-328.
Woodruff SI, Conway TL, Edwards CC: Increasing response rates to a smoking survey for U.S. Navy enlisted women. Evaluation & the Health Professions. 2000, 23: 172-181. 10.1177/016327870002300203.
Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, Kwan I: Increasing response rates to postal questionnaires: systematic review. BMJ. 2002, 324: 1183-10.1136/bmj.324.7347.1183.
Halpern SD, Ubel PA, Berlin JA, Asch DA: Randomized trial of 5 dollars versus 10 dollars monetary incentives, envelope size, and candy to increase physician response rates to mailed questionnaires. Medical Care. 2002, 40: 834-839. 10.1097/00005650-200209000-00012.
Roberts PJ, Roberts C, Sibbald B, Torgerson DJ: The effect of a direct payment or a lottery on questionnaire response rates: a randomised controlled trial. J Epidemiol Community Health. 2000, 54: 71-72. 10.1136/jech.54.1.71.
Collins RL, Ellickson PL, Hays RD, McCaffrey DF: Effects of incentive size and timing on response rates to a follow-up wave of a longitudinal mailed survey. Evaluation Review. 2000, 24: 347-363.
Beebe TJ, Davern ME, McAlpine DD, Call KT, Rockwood TH: Increasing response rates in a survey of Medicaid enrollees: the effect of a prepaid monetary incentive and mixed modes (mail and telephone). Med Care. 2005, 43: 411-414. 10.1097/01.mlr.0000156858.81146.0e.
Truell AD, Bartlett JE, Alexander MW: Response rate, speed, and completeness: a comparison of Internet-based and mail surveys. Behav Res Methods Instrum Comput. 2002, 34: 46-49.
Nie NH, Erbring L: 2000, Stanford Institutes for the Quantitative Study of Society, [http://www.stanford.edu/group/siqss/Press_Release/internetStudy.html] Internet and Society: A preliminary report, SIQSS (The Stanford Institute for the Quantitative Study of Society)
Hanscom B, Lurie JD, Homa K, Weinstein JN: Computerized questionnaires and the quality of survey data. Spine. 2002, 27: 1797-1801. 10.1097/00007632-200208150-00020.
Akl EA, Maroun N, Klocke RA, Montori V, Schunemann HJ: Electronic mail was not better than postal mail for surveying residents and faculty. J Clin Epidemiol. 2005, 58: 425-429. 10.1016/j.jclinepi.2004.10.006.
Hill WG, Weinert C: An evaluation of an online intervention to provide social support and health education. Comput Inform Nurs. 2004, 22: 282-288. 10.1097/00024665-200409000-00008.
Mond JM, Rodgers B, Hay PJ, Owen C, Beumont PJ: Mode of delivery, but not questionnaire length, affected response in an epidemiological study of eating-disordered behavior. J Clin Epidemiol. 2004, 57: 1167-1171. 10.1016/j.jclinepi.2004.02.017.
Sharp LM, Frankel J: Respondent Burden: A Test of Some Common Assumptions. Public Opin Q. 1983, 47: 36-53. 10.1086/268765.
Eaker S, Bergstrom R, Bergstrom A, Adami HO, Nyren O: Response rate to mailed epidemiologic questionnaires: a population-based randomized trial of variations in design and mailing routines. American Journal of Epidemiology. 1998, 147: 74-82.
Edwards P, Roberts I, Sandercock P, Frost C: Follow-up by mail in clinical trials: does questionnaire length matter?. Control Clin Trials. 2004, 25: 31-52. 10.1016/j.cct.2003.08.013.
Ronckers C, Land C, Hayes R, Verduijn P, van LF: Factors impacting questionnaire response in a Dutch retrospective cohort study. Ann Epidemiol. 2004, 14: 66-72. 10.1016/S1047-2797(03)00123-6.
Glasgow RE: Outcomes of and for diabetes education research. Diabetes Educ. 1999, 25: 74-88. 10.1177/014572179902500508.
Funnell MM, Anderson RM: Putting Humpty Dumpty back together again: Reintegrating the Clinical and Behavioral Components in Diabetes Care and Education. Diabetes Spectrum. 1999, 12: 19-23.
Canada H: Healthy Canadians: A Federal Report on Comparable Health Indicators 2006. 2006, Health Canada, [http://hc-sc.gc.ca/hcs-sss/pubs/system-regime/2006-fed-comp-indicat/2006-fed-comp-indicat-3_e.html#1]
Wong BC, Chan AO, Wong KW, Ching CK, Wong WM, Tam S, Lai KC, Chan CK, Yuen MF, Lam SK: A pilot study of participation in faecal occult blood testing and screening colonoscopy after health education in Hong Kong. Eur J Cancer Prev. 2005, 14: 181-184. 10.1097/00008469-200504000-00015.
Cooper A, Lloyd G, Weinman J, Jackson G: Why patients do not attend cardiac rehabilitation: role of intentions and illness beliefs. Heart. 1999, 82: 234-236.
Woodside AG, Wilson EJ: Respondent inaccuracy. J A R. 2002, 42: 7-19.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/7/47/prepub
We like to thank Rima Kharonsky for assisting with the submission process and the reviewers' comments for improving the quality of our research manuscript.
The author(s) declare that they have no competing interests.
EG was involved in the conception and design of the research idea, coordinated the acquisition of the data, analyzed and interpreted the data, and drafted, reviewed and revised the manuscript. CDL analyzed and interpreted the data, draft, reviewed and revised the manuscript. AP was involved with the conception and design of the research idea, acquisition of the data, analyzed and interpreted the data, and drafted and reviewed the final manuscript. JC was involved with the conception and design of the research idea, coordinated the acquisition of the data, provided guidance with the analyses and interpretation of the data, and reviewed the manuscript. All authors read and approved the final manuscript.
Jill I Cameron, Chen Di Liao, Alison Palmer and Donna E Stewart contributed equally to this work.
Electronic supplementary material
Additional file 1: Frequency table for the number of minutes respondents are willing to spend in a health education session by setting. The data provided present the frequency of respondents' choice of the 5 number of minutes they are willing to spend in a health education session by setting. (DOC 28 KB)
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Gucciardi, E., Cameron, J.I., Liao, C.D. et al. Program design features that can improve participation in health education interventions. BMC Med Res Methodol 7, 47 (2007). https://doi.org/10.1186/1471-2288-7-47
- Intervention Session
- Survey Method
- Education Session
- Education Intervention
- Mail Survey