This article has Open Peer Review reports available.
Magnitude of discordance between registry data and death certificate when evaluating leading causes of death in dialysis patients
© Lafrance et al.; licensee BioMed Central Ltd. 2013
Received: 13 September 2012
Accepted: 22 March 2013
Published: 27 March 2013
Discordance between dialysis registry and death certificate reported death has been demonstrated. Since cause of death is measured using registry data in dialysis patients and death certificate data in the general population, comparisons of cause of death proportions between dialysis patients and the general population may be biased. Our aim was to compare the proportion of deaths attributed to cardiovascular disease (CVD), malignancy, and infections between patients receiving dialysis and the general population using death certificates for both, and to quantify the magnitude of discrepancy between registry and death certificate estimates in dialysis patients.
A retrospective cohort study of 5858 patients initiating maintenance dialysis between 2001 and 2007 was conducted. Cause of death was obtained from both registry and death certificate data for dialysis patients, and from death certificate data for the general population.
Compared to the general population, use of death certificate data in dialysis patients resulted in smaller differences in the proportion of deaths attributed to CVD or infection than that from the registry. In the general population, the proportion of deaths due to CVD is 29.3% for men and 28.2% for women, and the proportion of deaths due to infection is 3.3% for men and 3.6% for women. For men, the proportion of deaths in dialysis patients due to CVD using registry data is 41.5%, compared with a proportion of 32.1% using death certificate data. Similarly for women, the proportion of deaths due to CVD using registry data is 35.2% and that using death certificate data 24.3%. The proportion of deaths due to infection in dialysis patients follows the same pattern: for men, the proportion of deaths due to infection using registry data is 9.9% and that from death certificate data at 5.0%; while for women the proportions are 11.6% and 4.8%, respectively.
While absolute cause-specific mortality rates did differ, evaluation of causes of death using death certificate in dialysis patients in Quebec revealed that they do not have substantially different proportion of death due to CVD or infections than the general population. Infections appeared to be a frequent complication leading to death, suggesting that infections are an important target to consider for reducing mortality in dialysis populations.
In Canada, more than 22 000 patients were receiving chronic dialysis in 2009, increasing by nearly 20% in five years . Cardiovascular disease (CVD) is the leading cause of mortality among dialysis patients, followed by infections . It is well-established that dialysis patients have a higher mortality rate than the general population (GP) [1–3], and some data suggest that they have a higher proportion of death due to CVD than the GP [4, 5].
Understanding causes of death in a given population is important, as this data may guide prevention efforts, patient management, and clinical or research resources allocation. Many countries, including Canada, rely on registry data to produce estimates of causes of death for their dialysis population. In the GP, death certificates are considered the best practical source of truth at a population level. Since cause of death is measured using registry data in dialysis patients and death certificates in the GP, comparisons of cause of death proportions between dialysis patients and the GP may be biased. Reports comparing death certificates with dialysis registry data have demonstrated poor cause of death concordance [6, 7]. However, the quantification of the difference relative to GP estimates has not been undertaken. Using a single source of truth, such as death certificates, through linkage of databases may produce more reliable estimates and may drive better clinical, research and administrative decisions.
Interestingly, while many CVD-oriented interventions such as use of statins [8, 9] or angiotensin converting enzyme inhibitors  have resulted in some improvement in outcomes (such as reduction in atherosclerotic events), none have been demonstrated to lower mortality in the dialysis population. While pathogenic processes for CVD are probably different in the dialysis population compared to the GP, the inability of large studies to demonstrate improved survival, may suggest that attention to CVD deaths alone is insufficient to reduce mortality. Attention to other important contributors, such as infections, may be important . In order to inform decision-making more accurately concerning intervention targets, assessment of causes of death proportions among dialysis patients should be ascertained using the same source of truth as in the GP. Our aim was to compare the proportion of deaths attributed to CVD, malignancy, and infections between patients receiving dialysis and the GP using death certificates for both, and to quantify the magnitude of discrepancy between registry and death certificate estimates in dialysis patients.
Data sources and study population
Data were obtained from the national Canadian dialysis registry, the Canadian Organ Replacement Register (CORR), and the provincial health services administrative databases of the province of Québec, Canada. CORR provides descriptive statistics on dialysis incidence, prevalence and patients’ characteristics, and its data have been used successfully in numerous scientific publications [11–15].
Canadian organ replacement register (CORR)
Institut de la statistique du Québec(ISQ)
Régie de l’assurance maladie du Québec(RAMQ)
Provincial vital statistics
Medical claims and hospital discharge summaries database
All chronic dialysis patients in Canada
All residents in Québec (general population)
All residents in Québec (general population)
Filling of cause of death field
Registered nurse responsible for the unit, helped with treating physician
Cause of death coding scheme
Internal coding scheme (code entered directly on the reporting form)
ICD-10 by trained archivists centrally
From CORR, RAMQ and ISQ, data were obtained for all patients initiating chronic dialysis (without a prior kidney transplant) between January 1st, 2001 and December 31st, 2007 in the province of Québec. Patients with less than 90 days of dialysis were excluded. The study cohort consisted of all patients who were present in both the CORR and RAMQ databases as incident dialysis patients. An incident cohort was used, since comorbidities and causes of death may highly depend on dialysis vintage. Patients were followed from day 90 after dialysis initiation until date of death or end of the study period.
Mortality rates in the GP of Québec were obtained from the ISQ website for the years 2001 to 2007 .
Measurement of dates and causes of death
CORR data provided a date of death (month and year) and a cause of death using an internal classification (78 elements). The cause of death is usually coded by the registered nurse responsible in each dialysis unit.
ISQ also provided a date of death (month and year) and a cause of death coded using the International Classification of Diseases, 10th Revision (ICD-10). Death certificates are filled by physicians and then coded by trained archivists at ISQ. For the evaluation of dates of death concordance, the date of death provided by RAMQ-ISQ was considered the source of truth.
The cause of death is mandatory on the death certificate (ISQ) and includes different fields: 1) underlying disease that eventually led to death; 2) diseases in the pathway to death (“secondary causes”); and 3) the disease or complication that directly led to death (“direct cause”). For example, a patient may have the following pathway: had an acute myocardial infarction (underlying cause), followed by a cardiogenic shock (secondary cause), and dies after a ventilator-associated pneumonia in the intensive care unit (direct cause).
Causes of death were classified in four mutually exclusive categories: CVD (ICD-10: I00-I99), infection (A00-B99, J10-J18), malignancy (C00-D48), and other. Among the “other” category, kidney failure (N17-N19) and diabetes (E10-E14) were identified using death certificate, but those categories had no code using CORR internal scheme.
Dates of death from CORR and ISQ were considered concordant if they occurred in the same month, or in a contiguous month. Concordance was measured using kappa statistics.
Mortality rates were calculated by dividing the number of deaths by the total patient-years of follow-up. 95% confidence intervals (CI) for rates were calculated using a Poisson distribution. Mortality rates for the GP were indirectly standardized using the study cohort age and sex structure. Cumulative survival function was calculated using Kaplan-Meier method.
Causes of death were considered concordant if they fell within the same category. Two concordance analyses were done for causes of death: 1) CORR versus ISQ underlying cause and 2) CORR versus ISQ direct cause. Concordance was measured by non-weighted kappa statistics for categorical variables , and by a Chi-square test for proportions.
Some codes in CORR classification system are broad and may include various categories: Cardiac Arrest, Cause Unknown; Patient Refused Further Treatment; Multi System Failure; or Other Identified Cause of Death. In the main classification, theses codes were classified as “Other” except Cardiac Arrest, Cause Unknown that was classified as CVD. To test the impact of this decision on the results, a sensitivity analysis was conducted by excluding patients who had one of these codes. Also, because a large proportion of causes of death were missing in CORR, two sensitivity analyses were conducted where all missing causes were attributed to 1) CVD or 2) other causes.
Permission was obtained to conduct this study by the Government of Québec ethics committee (Commission d’accès à l’information), CORR internal review committee, and Maisonneuve-Rosemont Hospital ethics committee. Informed consent was waived.
Among study patients, 1907 deaths were identified using CORR data, while 2074 were identified using ISQ data. In total, 96.4% of patients had a concordant death status: 3778 were still alive at the end of the study according to both data sources and 1872 had a concordant date of death (same or contiguous month). The remaining patients with non-concordant death status were distributed as follow: 6 were still alive in ISQ but deceased in CORR, 29 had a non-concordant date of death (by a median absolute difference of 120 days), and 173 patients were still alive in CORR but deceased in ISQ. Kappa statistics for concordance between dates of death was excellent: 0.92 (95% CI: 0.91, 0.93).
All-cause and CVD mortality rates
Causes of death distribution and concordance
Distribution of causes of death according to CORR and ISQ for patients receiving dialysis and for the general population
Causes of death
ISQ – Underlying cause
ISQ – Direct cause
Causes of death for patients with a cause of death in both CORR and ISQ using the underlying cause of death in ISQ
ISQ -- Underlying cause
Causes of death for patients with a cause of death in both CORR and ISQ using the direct cause of death in ISQ
ISQ -- Direct cause
Among the 173 patients who were considered still alive in CORR but deceased in ISQ, 17.3% of deaths were attributed to CVD (underlying cause in ISQ database), 2.3% to infection, 22.0% to malignancy, 56.6% to other causes, and 1.7% were missing.
Removing codes possibly overlapping multiple categories (see Methods) did not improve concordance (kappa: 0.31 with underlying and 0.35 with direct cause). Reclassifying missing cause of death in CORR as CVD (kappa: 0.20 with underlying and 0.26 with direct cause) or other causes (kappa: 0.22 with underlying and 0.30 with direct cause) led to slightly worse results.
This study reports on the comparison of cause of death proportions between dialysis patients and the GP. It demonstrated poor concordance between registry data and death certificates. This discrepancy between registry data and death certificates led to different conclusions when proportions of death attributed to CVD were compared between the dialysis population and the GP. While CORR showed a higher CVD death proportion among dialysis patients, ISQ showed almost no difference compared to the GP. While the proportion of deaths due to infection was also higher among dialysis patients using CORR data than when compared to underlying cause of death, proportions estimated from direct cause of death in the death certificate showed that they remained an important complication of disease (biological mechanism) leading to death. Finally, cause of death was missing in more than a quarter of deaths in CORR, greatly diminishing its usefulness.
Many countries and regions collect and report mortality data from renal dialysis programs using registries. Examples include the United States Renal Data System (USRDS), United Kingdom Renal Registry (UKRR), European Dialysis and Transplant Association/European Renal Association (EDTA/ERA), and Australia and New Zealand Dialysis and Transplant Registry (ANZDATA) . Most dialysis registries use an internal coding system to classify cause of death instead of ICD-10 [2, 19]. Reports of distribution of causes of death for patients on dialysis vary between countries, influenced in part by different age distributions and case-mix among populations. CVD remains the most frequent cause in all (31 to 55% of deaths), followed in most countries by infections (11 to 18%), and malignancies (4 to 13%) [19–21]. Of note, distribution of causes of death reported for the GP are age and sex adjusted to the dialysis cohort. Therefore, causes of death associated with older age have a higher weight, explaining why malignancies are the leading cause of death at 36.1% in the GP.
Our finding of only fair concordance of cause of death between ISQ and CORR is consistent with results from previous reports using USRDS and ANZDATA (overall kappa from 0.22 to 0.24) [6, 7]. One may hypothesize that, in most of those dialysis populations, reported CVD death proportions are likely higher than what would have been reported using DC. To our knowledge, no study has quantitatively evaluated the proportion of deaths attributable to different causes in comparison to GP, using the same source of information (DC) for both populations.
In the UKRR, part of their data (England and Wales) is linked with national vital statistics [18, 22]. In USRDS, only 1% of deaths are ascertained through national vital statistics . However, reporting death to USRDS is mandatory. CORR is a voluntary registry with no linkage to vital statistic registries. This may account for some of the discrepancies observed in our analysis. Given that information from registries (such as cause of death) is precious to guide policy, planning and resources we insist that better identification of true causes of death in dialysis populations is important, and that we do have an opportunity to remedy to the current situation in Canada.
While validity of death occurrence and its date is fairly high in vital statistic registries such as ISQ , misclassification of the cause of death is known to occur [7, 24, 25]. Of note, neither CORR nor ISQ is a true gold standard for cause of death, which will always be subject to some misclassification. DC, obtained from the ISQ data, constitute the most valid practical tool available to determine the cause of death on a provincial level. This study did not evaluate differences between registry and death certificates coding variation by country. However, as mentioned earlier poor concordance was reported in two other countries, so it is likely that this is a true phenomenon.
In conclusion, evaluation of causes of death using DC in dialysis patients in Quebec revealed that they do not have substantially different proportion of death due to CVD or infections than the GP. However, infections appeared to be a frequent complication or biological mechanism leading to death. While all-cause and CVD absolute mortality rates remain many times higher among dialysis patients compared to the GP (no matter which source of data), use of registry data alone would lead health care practitioners and researchers to conclude that there is more than 10 percentage points higher proportion of deaths attributed to CVD in dialysis populations than is really the case. In an era of increasing need for accuracy in medical records, we believe that validation of registry data, or development of better linkage with vital statistics in Canada, should be undertaken for dialysis populations. In this way, we may be able to better establish priorities for prevention and therapeutic efforts, or clinical and research resources allocation. While CVD remains an important issue among dialysis patients, infections appear to be an important target to consider as a means to reducing mortality in that population.
- Canadian Institute for Health Information: Treatment of End-Stage Organ Failure in Canada, 2000 to 2009 (2011 Annual Report). 2011, Ottawa: CIHIGoogle Scholar
- U.S. Renal Data System: USRDS 2010 Annual Data Report: Atlas of Chronic Kidney Disease and End-Stage Renal Disease in the United States. 2010, Bethesda, MD: National Institutes of Health, National Institute of Diabetes and Digestive and Kidney DiseasesGoogle Scholar
- de Jager DJ, Grootendorst DC, Jager KJ, van Dijk PC, Tomas LM, Ansell D, Collart F, Finne P, Heaf JG, De Meester J: Cardiovascular and noncardiovascular mortality among patients starting dialysis. JAMA. 2009, 302 (16): 1782-1789. 10.1001/jama.2009.1488.View ArticlePubMedGoogle Scholar
- Carrero JJ, de Jager DJ, Verduijn M, Ravani P, De Meester J, Heaf JG, Finne P, Hoitsma AJ, Pascual J, Jarraya F: Cardiovascular and noncardiovascular mortality among Men and women starting dialysis. Clin J Am Soc Nephrol. 2011, 6 (7): 1722-1730. 10.2215/CJN.11331210.View ArticlePubMedGoogle Scholar
- Roberts MA, Polkinghorne KR, McDonald SP, Ierino FL: Secular trends in cardiovascular mortality rates of patients receiving dialysis compared with the general population. Am J Kidney Dis. 2011, 58 (1): 64-72. 10.1053/j.ajkd.2011.01.024.View ArticlePubMedGoogle Scholar
- Li SQ, Cass A, Cunningham J: Cause of death in patients with end-stage renal disease: assessing concordance of death certificates with registry reports. Aust N Z J Public Health. 2003, 27 (4): 419-424. 10.1111/j.1467-842X.2003.tb00420.x.View ArticlePubMedGoogle Scholar
- Perneger TV, Klag MJ, Whelton PK: Cause of death in patients with end-stage renal disease: death certificates vs registry reports. Am J Public Health. 1993, 83 (12): 1735-1738. 10.2105/AJPH.83.12.1735.View ArticlePubMedPubMed CentralGoogle Scholar
- Baigent C, Landray MJ, Reith C, Emberson J, Wheeler DC, Tomson C, Wanner C, Krane V, Cass A, Craig J: The effects of lowering LDL cholesterol with simvastatin plus ezetimibe in patients with chronic kidney disease (Study of Heart and Renal Protection): a randomised placebo-controlled trial. Lancet. 2011, 377 (9784): 2181-2192. 10.1016/S0140-6736(11)60739-3.View ArticlePubMedPubMed CentralGoogle Scholar
- Wanner C, Krane V, Marz W, Olschewski M, Mann JF, Ruf G, Ritz E: Atorvastatin in patients with type 2 diabetes mellitus undergoing hemodialysis. N Engl J Med. 2005, 353 (3): 238-248. 10.1056/NEJMoa043545.View ArticlePubMedGoogle Scholar
- Wetmore JB, Shireman TI: The ABCs of cardioprotection in dialysis patients: a systematic review. Am J Kidney Dis. 2009, 53 (3): 457-466. 10.1053/j.ajkd.2008.07.037.View ArticlePubMedGoogle Scholar
- Canadian Institute for Health Information: Treatment of End-Stage Organ Failure in Canada, 1999 to 2008 (2010 Annual Report). 2010, Ottawa: CIHIGoogle Scholar
- Fenton SS, Schaubel DE, Desmeules M, Morrison HI, Mao Y, Copleston P, Jeffery JR, Kjellstrand CM: Hemodialysis versus peritoneal dialysis: a comparison of adjusted mortality rates. Am J Kidney Dis. 1997, 30 (3): 334-342. 10.1016/S0272-6386(97)90276-6.View ArticlePubMedGoogle Scholar
- Hemmelgarn BR, Chou S, Wiebe N, Culleton BF, Manns BJ, Klarenbach S, Khan NA, Gourishankar S, Yeates KE, Gill JS: Differences in use of peritoneal dialysis and survival among East Asian, Indo Asian, and white ESRD patients in Canada. Am J Kidney Dis. 2006, 48 (6): 964-971. 10.1053/j.ajkd.2006.08.021.View ArticlePubMedGoogle Scholar
- Jassal SV, Trpeski L, Zhu N, Fenton S, Hemmelgarn B: Changes in survival among elderly patients initiating dialysis from 1990 to 1999. CMAJ. 2007, 177 (9): 1033-1038.View ArticlePubMedPubMed CentralGoogle Scholar
- Moist LM, Trpeski L, Na Y, Lok CE: Increased hemodialysis catheter use in Canada and associated mortality risk: data from the Canadian Organ Replacement Registry 2001–2004. Clin J Am Soc Nephrol. 2008, 3 (6): 1726-1732. 10.2215/CJN.01240308.View ArticlePubMedPubMed CentralGoogle Scholar
- Births and Deaths. http://www.stat.gouv.qc.ca/donstat/societe/demographie/naisn_deces/index_an.htm,
- Landis JR, LKoch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.View ArticlePubMedGoogle Scholar
- Donovan K, Ford D, van Schalkwyk D, Ansell D: UK Renal Registry 12th Annual Report (December 2009): Chapter 16: International comparisons with the UK RRT programme. Nephron Clin Pract. 2010, 115 (Suppl 1): c309-319.View ArticlePubMedGoogle Scholar
- Australia and New Zealand Dialysis and Transplant Registry: ANZDATA Registry Report 2009. Edited by: McDonald S, Excell L, Livingston B. 2009, Adelaide, South Australia:Google Scholar
- U.S. Renal Data System: USRDS 2009 Annual Data Report: Atlas of Chronic Kidney Disease and End-Stage Renal Disease in the United States. 2009, Bethesda, MD: National Institutes of Health, National Institute of Diabetes and Digestive and Kidney DiseasesGoogle Scholar
- Ansell D, Roderick P, Steenkamp R, Tomson CR: UK Renal Registry 12th Annual Report (December 2009): Chapter 7: Survival and causes of death of UK adult patients on renal replacement therapy in 2008: national and centre-specific analyses. Nephron Clin Pract. 2010, 115 (Suppl 1): c117-144.View ArticlePubMedGoogle Scholar
- Ansell D, Tomson CR: UK Renal Registry 11th Annual Report (December 2008): Chapter 15 The UK Renal Registry, UKRR database, validation and methodology. Nephron Clin Pract. 2009, 111 (Suppl 1): c277-285.View ArticlePubMedGoogle Scholar
- Thibault N: Suivi et cycle des naissances et des décès: qu’en est-il au Québec?. L’Écostat. 2007, 11-20. ISSN is 1206-6184Google Scholar
- Koepsell T, Weiss N: Epidemiologic Methods: Studying the Occurrence of Illness. 2003, New York: Oxford University PressGoogle Scholar
- Messite J, Stellman SD: Accuracy of death certificate completion: the need for formalized physician training. JAMA. 1996, 275 (10): 794-796. 10.1001/jama.1996.03530340058030.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/13/51/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.