Recruitment methods in Alzheimer's disease research: general practice versus population based screening by mail
BMC Medical Research Methodology volume 10, Article number: 35 (2010)
In Alzheimer's disease (AD) research patients are usually recruited from clinical practice, memory clinics or nursing homes. Lack of standardised inclusion and diagnostic criteria is a major concern in current AD studies. The aim of the study was to explore whether patient characteristics differ between study samples recruited from general practice and from a population based screening by mail within the same geographic areas in rural Northern Norway.
An interventional study in nine municipalities with 70000 inhabitants was designed. Patients were recruited from general practice or by population based screening of cognitive function by mail. We sent a questionnaire to 11807 individuals ≥ 65 years of age of whom 3767 responded. Among these, 438 individuals whose answers raised a suspicion of cognitive impairment were invited to an extended cognitive and clinical examination. Descriptive statistics, chi-square, independent sample t-test and analyses of covariance adjusted for possible confounders were used.
The final study samples included 100 patients recruited by screening and 87 from general practice. Screening through mail recruited younger and more self-reliant male patients with a higher MMSE sum score, whereas older women with more severe cognitive impairment were recruited from general practice. Adjustment for age did not alter the statistically significant differences of cognitive function, self-reliance and gender distribution between patients recruited by screening and from general practice.
Different recruitment procedures of individuals with cognitive impairment provided study samples with different demographic characteristics. Initial cognitive screening by mail, preceding extended cognitive testing and clinical examination may be a suitable recruitment strategy in studies of early stage AD.
ClinicalTrial.gov Identifier: NCT00443014
Alzheimer's disease (AD) constitutes 65 - 70% of all dementia subtypes. The prevalence is 10% for individuals 65 years and older, encompassing 90% of all AD. The incidence increases from <1% among people 65-69 years of age to nearly 9% above 85, making AD a major cause of disability in the elderly [1, 2].
Due to the increasing lifespan and the decreasing ratio of working to retired populations, the social and economic burden of neurodegenerative diseases are growing  and may be threatening future welfare and health care. As a consequence, the European Science and Research Commission has declared that prevention, early identification, and postponement of AD onset should have high priority. In order to remove or reduce modifiable AD risk factors, increasing attention to cognitive impairment is needed within the medical communities, including more reliable early AD screening tools.
Characteristics of AD study participants depend on study design, inclusion and diagnostic criteria, recruitment method and age distribution [4, 5]. In clinical trials AD patients are usually recruited from memory clinics, hospitals and nursing homes, which makes the studies prone to selection bias . The heterogeneity of diagnostic criteria and diagnostic tools reinforce these methodological challenges [7–10]. As a consequence few validated screening questionnaires are available and study comparisons may be hampered due to lack of standardization [11–13]. In a recent population based study Palmer et al showed that mild cognitive impairment criteria failed to identify individuals with global cognitive deficits at high risk of AD progression .
The impact of different recruitment methods on sample characteristics is insufficiently examined , whereas studies comparing sample characteristics of individuals recruited by different methods from the same population are lacking.
The aim of this paper is to compare clinical and demographic characteristics in AD individuals recruited from general practice or by population based screening questionnaires in the same geographical area.
The Dementia Study in Rural Northern Norway planned to recruit 200 patients with recently diagnosed AD in primary health care in nine rural municipalities, from January 2006 to December 2007. AD patients were recruited from general practice (n = 87) and through population based screening (n = 100) based on the same diagnostic criteria. Both groups underwent similar cognitive, physical and laboratory examinations. Inclusion criteria were individuals aged ≥ 65 years with a MMSE sum score ≥ 10 and ≤ 30 points. Exclusion criteria were delirium and behavioral disturbances interfering with cognitive and clinical testing, reluctance to participate, and inability to understand the purpose of the study, or relatives/caregivers disapproving participation.
Recruitment by population based screening
Due to a low inclusion rate by general practitioners (GPs) during the first year, the recruitment method was extended to comprise a population based screening of cognitive impairment. An invitation letter enclosing a questionnaire modified from the Cambridge Examination for Mental Disorders of the Elderly and Strawbridge et al [11, 12] was sent to 11807 individuals ≥ 65 years of age in the participating municipalities. The first question was on participation (Do you want to participate in the Dementia study?). Four questions covered memory impairment (Have your memory deteriorated?), visuo-spatial skills (Do you forget where objects were left?), speech difficulties (Do you have difficulties to find the appropriate words?) and activities of daily living (Do you have difficulties in managing daily activities, which earlier represented no problem?). An algorithm was designed to identify individuals at increased risk of having cognitive impairment (Appendix 1). Based on this, 438 individuals were invited to an extended cognitive and clinical examination. A physician with background in geriatric medicine examined the invited individuals, and supervised and completed the interdisciplinary diagnostic procedures. Among the respondents without self reported cognitive impairment, a randomly selected reference group, undergoing cognitive testing, was established.
Examination of individuals with memory problems
Prior to study start, GPs and co-workers were trained to identify and diagnose AD based on the Norwegian guidelines . A semi-structured interview of the participants focused on the onset and the course of cognitive impairment emphasising memory and visuo-spatial disturbances, word-finding difficulties, and changes in executive functions including activities of daily living (ADL). A family member or a caregiver was encouraged to add medical data according to the Informant Questionnaire-Cognitive Decline in the Elderly (IQ-CODE) . Cognitive function was tested with The Mini Mental Status Examination (MMSE)  and Clock drawing test , and depression was examined with Montgomery and Aasberg Depression Rating Scale (MADRS) . Neurological examination, blood tests and cerebral computed tomography (CT) were performed to exclude other causes of dementia but AD.
The diagnosis of dementia was set by GPs and discussed with at least one specialist in geriatric medicine according to the ICD-10 criteria , AD according to the Statistical Manual of Mental Disorders fourth edition (DSM-IV-TR) and probable AD according to National Institute of Neurological Disorders and Stroke-Alzheimer Disease and Related Disorders' (NINCDS-ADRDA) criteria . Disagreement or uncertainty about the diagnostic subtypes regarding 12 patients was solved by consulting a third specialist in geriatric medicine (MV).
The present study is registered as an International Standard Randomised Controlled Trial within ClinicalTrials.gov and approved by the following bodies; The Regional Committee for Medical Research Ethics in Northern Norway, The Privacy Ombudsman for Research, The Directory of Health and Social Welfare and The Norwegian Medicine Agency including the EudraCT database (no 2004-002613-37). The Norwegian Medicine Agency concluded that the study was conducted according to the principles of Good Clinical Practice. Each participant gave a written informed consent co-signed by a spouse, a close relative or a guardian. The national authorities listed above have approved the consent formula.
This manuscript intends to comply with The CONSORT statements and The Uniform Requirements for Manuscripts Submitted to Biomedical Journals.
Descriptive statistics, chi-square, independent sample t-test, analyses of covariance adjusted for possible confounders and multivariable analysis were used with a two-sided significance level of 5%. SPSS version 15 was applied for both data management and analysis.
At the end of the inclusion period 87 patients were recruited from GPs and 100 from population based postal screening.
Figure 1 describes in detail the outcome of the screening method. 3767 (31.3%) individuals responded to the questionnaire, of which 438 persons met the criteria of self reported cognitive impairment. The cognitive impairment (CI) group consisted of 292 individuals, but only 229 individuals underwent cognitive and clinical examinations due to withdrawals.
Seventy of these had no dementia, 31 had mild cognitive impairment  and 15 had cognitive impairment not due to AD. One hundred and thirteen individuals had probable AD constituting 49% of the clinically examined group (n = 229). Thirteen patients with probable AD withdrew before inclusion. Of those examined, but not included, 53% were women.
Among 791 individuals who answered "Yes" to question one (participation) and "No" to the remaining five screening questions, 500 individuals were randomly selected as references for the cases. The final reference group (Ref-group) comprised 199 individuals who underwent cognitive testing. A highly significant difference (p < .001, age adjusted) was found for MMSE sum score between individuals with and without self-reported cognitive impairment (CI-group versus Ref-group, Figure 1).
A comparison between the two recruitment methods (screening versus general practice) (Table 1) revealed that AD patients recruited by screening more often were male (p < .001), younger (p = .006), needed less community support (p < .001), and had a significantly higher MMSE sum score (p < .001) as compared to those recruited in general practice, also when adjusting for education and co-morbidity (p < .001). In a multivariable model, the estimates remained unchanged. Overall, men were younger than women (p = .001). Compared to men, women more frequently lived alone (p < .001, age adjusted) and more frequently needed support from community care (p = .04, age adjusted).
The main finding of this comparative study was that AD patient characteristics differed according to recruitment method. Younger and more often male patients with a higher MMSE score were recruited by mail as compared to those recruited in general practice. The estimate of baseline characteristics remained significantly different when adjusting for education, coronary heart disease, hypertension, stroke and diabetes. However, the overall gender difference in MMSE score turned non-significant when adjusting for age.
54% of those recruited by population based screening were men in contrast to only 23% from general practice. This is in accordance with the findings of Fitzpatrick et al who reported that men younger than 85 years were more willing to attend clinical trials dealing with cognitive function. According to Norwegian Statistics 2008, the male proportion of the general population above 70 and 80 years were 42% and 35%, respectively .
Men recruited by screening were more frequently living in a relationship in their own home without community support as compared to men recruited from general practice. In contrast, female participants were older, less self-reliant and more likely to live alone. All these factors are probably highly inter-correlated, partly as a result of different life expectancies for men and women. Living alone may promote inactivity, isolation and stimulus deprivation, all contributing to dementia progression .
Our study confirms that different recruitment methods in AD research provide samples with different baseline characteristics. Similar findings have been reported by Izal et al who emphasises that this could influence the results significantly . A possible explanation is that a mailed questionnaire may alert those with a concern of own memory problems or early stage dementia whereas routine practice usually diagnoses patients with more obvious cognitive impairment and loss of compliance and self-care. According to the algorithm of the screening program 438 persons were invited to a subsequent cognitive and clinical examination, of which 113 (26%) were diagnosed with probable AD. In a large population based screening program conducted by Crews et al, 44.3% of the participants were recommended a follow-up. Of these, 24% were referred for objective memory impairment. A number of the patients reported that their GPs had never adequately assessed their memory complaints .
As for the present screening program, we found that a selection based on the answers to the postal questionnaire resulted in samples with highly significant differences in cognitive abilities (p < .001 age adjusted). Among 229 individuals undergoing clinical examination 70 (30%) had no dementia but had a family member or close relative with such a diagnosis, which probably contributed to a higher level of concern regarding cognitive symptoms. This group (n = 70) had similar MMSE sum score as the Ref-group.
Study limitations include the relative low number of participants in both groups. If screening questions are imprecise, information bias may threaten the internal validity of a study like this. We used questions based on the Cambridge Cognitive Examination, a widely accepted and reliable screening tool . Our results indicate that the questions are capable of identifying individuals with MMSE scores corresponding to early AD. In our opinion, it is likely that the results are valid for western populations with similar demographics and co-morbidities.
It is known that GPs hesitate to diagnose mild cognitive impairment or early stage of dementia . Mild to moderate cognitive impairment in the elderly, including early stage AD, seems to be disregarded by both relatives and health professionals, even though this stage of cognitive impairment has the best response to intervention. In this study, only one of five GPs in the nine municipalities joined the pre-study educational program aimed to improve AD diagnostics. Our findings are in accordance with those of Vernooij-Dassen et al who reported that GPs tend to postpone a comprehensive examination of patients who complain of memory problems . Lack of therapeutic and diagnostic skills may contribute to this attitude . Carters et al described such insufficient examination as a consequence of time constraints , whereas Wilcock et al reported that a number of GPs considered studies aiming to diagnose and manage AD irrelevant to their practice .
According to Norwegian recommendations, early stage dementia and MCI should be diagnosed in memory clinics and not in primary health care . However, due to shortage of memory clinics, this strategy will not benefit the majority of elderly with early stage dementia. Under these circumstances GPs have to be supported and trained to detect and diagnose cognitive impairment.
Few AD studies have compared patient characteristics of different recruitment methods. In our study patients recruited by screening were younger, more frequently men and had a higher MMSE sum score as compared to those recruited from general practice. Screening of cognitive function by questionnaires enables recruitment of early stage AD, whereas general practice recruits patients with more advanced disease. Future dementia studies on prevention and treatment should take recruitment methods into consideration, in particular when focusing on early stage AD. According to our experience, the applied screening questionnaire, preceding a clinical examination, would be a suitable strategy to identify and diagnose AD in primary health care.
Berr C, Wancata J, Ritchie K: Prevalence of dementia in the elderly in Europe. Eur Neuropsychopharmacol. 2005, 15 (4): 463-471. 10.1016/j.euroneuro.2005.04.003.
Evans DA, Funkenstein HH, Albert MS, Scherr PA, Cook NR, Chown MJ, Hebert LE, Hennekens CH, Taylor JO: Prevalence of Alzheimer's disease in a community population of older persons. Higher than previously reported. JAMA. 1989, 262 (18): 2551-2556. 10.1001/jama.262.18.2551.
EU Commission. News Alert: Commission steps up action on Alzheimer's disease and other neurodegenerative conditions. 2009
Fitzpatrick AL, Fried LP, Williamson J, Crowley P, Posey D, Kwong L, Bonk J, Moyer R, Chabot J, Kidoguchi L, Furberg CD, Dekosky ST: Recruitment of the elderly into a pharmacologic prevention trial: the Ginkgo Evaluation of Memory Study experience. Contemp Clin Trials. 2006, 27 (6): 541-553. 10.1016/j.cct.2006.06.007.
Izal M, Nuevo R, Montorio I, Perez-Rojo G: Method of recruitment and the scores of self-report measures: the example of worry in the elderly. Arch Gerontol Geriatr. 2009, 48 (1): 45-49. 10.1016/j.archger.2007.09.009.
Hully SB, Cummings SR, Browner WS, Grady DG, Newman TB: Designing Clinical Research. 2007, Chap 3:
Stephan BC, Matthews FE, McKeith IG, Bond J, Brayne C: Early cognitive change in the general population: how do different definitions work?. J Am Geriatr Soc. 2007, 55 (10): 1534-1540. 10.1111/j.1532-5415.2007.01386.x.
Erkinjuntti T, Ostbye T, Steenhuis R, Hachinski V: The effect of different diagnostic criteria on the prevalence of dementia. N Engl J Med. 1997, 337 (23): 1667-1674. 10.1056/NEJM199712043372306.
Mahieux F, Onen F, Berr C, Volteau M, Habert MO, Legrain S, Dubois B: Early detection of patients in the pre demented stage of Alzheimer's disease: the Pre-Al Study. J Nutr Health Aging. 2009, 13 (1): 21-26. 10.1007/s12603-009-0004-2.
Dubois B, Feldman HH, Jacova C, Dekosky ST, Barberger-Gateau P, Cummings J, Delacourte A, Galasko D, Gauthier S, Jicha G, Meguro K, O'brien J, Pasquier F, Robert P, Rossor M, Salloway S, Stern Y, Visser PJ, Scheltens P: Research criteria for the diagnosis of Alzheimer's disease: revising the NINCDS-ADRDA criteria. Lancet Neurol. 2007, 6 (8): 734-746. 10.1016/S1474-4422(07)70178-3.
Lolk A, Nielsen H, Andersen K, Andersen J, Kragh-Sorensen P: CAMCOG as a screening instrument for dementia: the Odense study. Cambridge Cognitive Examination. Acta Psychiatr Scand. 2000, 102 (5): 331-335. 10.1034/j.1600-0447.2000.102005331.x.
Strawbridge WJ, Shema SJ, Balfour JL, Higby HR, Kaplan GA: Antecedents of frailty over three decades in an older cohort. J Gerontol B Psychol Sci Soc Sci. 1998, 53 (1): S9-16.
van Uffelen JG, Chin APM, Klein M, van Mechelen MW, Hopman-Rock M: Detection of memory impairment in the general population: screening by questionnaire and telephone compared to subsequent face-to-face assessment. Int J Geriatr Psychiatry. 2007, 22 (3): 203-210. 10.1002/gps.1661.
Palmer K, Bäckman L, Winblad B, Fratiglioni L: Early symptoms and signs of cognitive deficits might not always be detectable in persons who develop Alzheimer's disease. Int Psychogeriatr. 2008, 20 (2): 252-258. 10.1017/S1041610207006564.
Palmer K, Bäckman L, Winblad B, Fratiglioni L: Detection of Alzheimer's disease and dementia in the preclinical phase: population based cohort study. BMJ. 2003, 326 (7383): 245-10.1136/bmj.326.7383.245.
The Norwegian Competence Centre Aging and Health inventor: Dementia diagnosing tools. 2009
Jorm AF, Jacomb PA: The Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE): socio-demographic correlates, reliability, validity and some norms. Psychol Med. 1989, 19 (4): 1015-1022. 10.1017/S0033291700005742.
Folstein MF, Folstein SE, McHugh PR: "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975, 12 (3): 189-198. 10.1016/0022-3956(75)90026-6.
Sunderland T, Hill JL, Mellow AM, Lawlor BA, Gundersheimer J, Newhouse PA, Grafman JH: Clock drawing in Alzheimer's disease. A novel measure of dementia severity. J Am Geriatr Soc. 1989, 37 (8): 725-729.
Dratcu L, da Costa RL, Calil HM: Depression assessment in Brazil. The first application of the Montgomery-Asberg Depression Rating Scale. Br J Psychiatry. 1987, 150: 797-800. 10.1192/bjp.150.6.797.
Bebbington P: Welcome to ICD-10. Soc Psychiatry Psychiatr Epidemiol. 1992, 27 (6): 255-257.
McKhann G, Drachman D, Folstein M, Katzman R, Price D, Stadlan EM: Clinical diagnosis of Alzheimer's disease: report of the NINCDS-ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer's Disease. Neurology. 1984, 34 (7): 939-944.
Winblad B, Palmer K, Kivipelto M, Jelic V, Fratiglioni L, Wahlund LO, Nordberg A, Bäckman L, Albert M, Almkvist O, Arai H, Basun H, Blennow K, de Leon M, DeCarli C, Erkinjuntti T, Giacobini E, Graff C, Hardy J, Jack C, Jorm A, Ritchie K, van Duijn C, Visser P, Petersen RC: Mild cognitive impairment-- beyond controversies, towards a consensus: report of the International Working Group on Mild Cognitive Impairment. J Intern Med. 2004, 256 (3): 240-246. 10.1111/j.1365-2796.2004.01380.x.
SSB: Norwegian Statistics. 2008
Bernhardt T, Seidler A, Frölich L: The effect of psychosocial factors on risk of dementia. Fortschr Neurol Psychiatr. 2002, 70 (6): 283-288. 10.1055/s-2002-32023.
Crews WD, Harrison DW, Keiser AM, Kunze CM: The memory screening outreach program: findings from a large community-based sample of middle-aged and older adults. J Am Geriatr Soc. 2009, 57 (9): 1697-1703. 10.1111/j.1532-5415.2009.02404.x.
Woods RT, Moniz-Cook E, Iliffe S, Campion P, Vernooij-Dassen M, Zanetti O, Franco M: Dementia: issues in early recognition and intervention in primary care. J R Soc Med. 2003, 96 (7): 320-324. 10.1258/jrsm.96.7.320.
Vernooij-Dassen MJ, Moniz-Cook ED, Woods RT, De LJ, Leuschner A, Zanetti O, de Rotrou J, Kenny G, Franco M, Peters V, Iliffe S: Factors affecting timely recognition and diagnosis of dementia across Europe: from awareness to stigma. Int J Geriatr Psychiatry. 2005, 20 (4): 377-386. 10.1002/gps.1302.
Carter RE, Rose DA, Palesch YY, Mintzer JE: Alzheimer's Disease in the Family Practice Setting: Assessment of a Screening Tool. Prim Care Companion J Clin Psychiatry. 2004, 6 (6): 234-238. 10.4088/PCC.v06n0603.
Wilcock J, Bryans M, Turner S, O'Carroll R, Keady J, Levin E: Methodological problems in dementia research in primary care: a case study of a randomized controlled trial. Primary Health Care Research and Development. 2006, 7: 1-10. 10.1191/1463423606pc262ed.
Engedal K: Diagnosis and treatment of dementia. Tidsskr Nor Laegeforen. 2002, 122 (5): 520-524.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/10/35/prepub
1. Do you want to participate in the Dementia study?
2. Have your memory deteriorated?
3. Do you forget where objects were left?
4. Do you have difficulties to find the appropriate words?
5. Do you have difficulties in managing daily activities, which earlier represented no problem?
6. Have you been examined for memory impairment earlier?
Patients invited to clinical examination
1. "Yes" on question 1, 2, 3, 4, 5. "No" on question 6
2. "Yes" on question 1, 2, 5 and 3 or 4. "No" on question 6
Persons randomised and invited to participate in reference group
3. "Yes" on question 1 (participation) "No" on question 2, 3, 4, 5 and 6
We want to express our gratitude to the patients, nurses and general practitioners who participated and contributed to this study. We are grateful to the staff at the study centre in Steigen, Kristin Tverback, Merete Hjertø and Herdis Svendsen for daily administration, testing and monitoring. We want to thank Egil Arnesen †, The Institute of Community Medicine, University of Tromsø, for support with baseline analyses, Ivar Aaraas, The Institute of Community Medicine, University of Tromsø, and Rolf Salvesen, Neurological Department, Nordland Central Hospital, Bodø, for kind pre-review of the article, Inger Sperstad and the Clinical Research Centre, University of Tromsø for randomizing patients and data support, Per Baadnes at the Institute of Community Medicine, University of Tromsø, for support with the screening procedure, and the staff at the pharmacy in Nordland Central Hospital for medical distribution. Finally we would like to thank our sponsors (See Funding) for necessary economic support and at last, but not least, the Scientific Advisory Board for their important methodological and clinical guidance. Permission to the acknowledgement is obtained from all the persons named above.
The Northern Norway Regional Health Authority, The National Centre of Rural Health at The University of Tromsø, Health and Rehabilitation, The Directory of Health and Social Welfare in Norway, The County Officer of Nordland and The Municipality of Steigen constituted the funding group. Pfizer delivered donepezil and placebo, but had otherwise no influence on the study design, data collection, analysis and publication.
The authors declare that they have no competing interests.
FA has initiated, coordinated and conducted this study in close co-operation with the scientific advisory board at The University of Tromsø. He has examined and diagnosed patients recruited both in general practice and by postal cognitive screening. He is also responsible for analysing baseline data. TE has been the main supervisor and member of the scientific advisory board, participating in all stages of this study; - planning, lecturing, collecting data, discussing results and writing. BS participated in the planning of the study, supervising implementation and analysis and has revised the manuscript. He is a member of the scientific advisory board. MV is a member of the scientific advisory board and has participated in diagnosing 12 patients, and in revising this manuscript. DH has participated in the data analysis, and has contributed in drafting and writing of the paper. SH has participated in the development of the data-recording file and supervised the training of the test technicians. He also has examined and diagnosed a number of patients in the study. KS has examined and diagnosed a number of patients recruited both in general practice and by postal cognitive screening.
All authors have approved the final version of the paper.
Fred Andersen, Torgeir A Engstad contributed equally to this work.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Andersen, F., Engstad, T.A., Straume, B. et al. Recruitment methods in Alzheimer's disease research: general practice versus population based screening by mail. BMC Med Res Methodol 10, 35 (2010). https://doi.org/10.1186/1471-2288-10-35
- Mild Cognitive Impairment
- Recruitment Method
- Mini Mental Status Examination Score
- Memory Clinic
- Population Base Screening