This article has Open Peer Review reports available.
Effect of misclassification of antiretroviral treatment status on the prevalence of transmitted HIV-1 drug resistance
© Castro et al; licensee BioMed Central Ltd. 2012
Received: 15 April 2011
Accepted: 14 March 2012
Published: 14 March 2012
Estimates of the prevalence of transmitted HIV drug resistance (TDR) in a population are derived from resistance tests performed on samples from patients thought to be naïve to antiretroviral treatment (ART). Much of the debate over reliability of estimates of the prevalence of TDR has focused on whether the sample population is representative. However estimates of the prevalence of TDR will also be distorted if some ART-experienced patients are misclassified as ART-naïve.
The impact of misclassification bias on the rate of TDR was examined. We developed methods to obtain adjusted estimates of the prevalence of TDR for different misclassification rates, and conducted sensitivity analyses of trends in the prevalence of TDR over time using data from the UK HIV Drug Resistance Database. Logistic regression was used to examine trends in the prevalence of TDR over time.
The observed rate of TDR was higher than true TDR when misclassification was present and increased as the proportion of misclassification increased. As the number of naïve patients with a resistance test relative to the number of experienced patients with a test increased, the difference between true and observed TDR decreased. The observed prevalence of TDR in the UK reached a peak of 11.3% in 2002 (odds of TDR increased by 1.10 (95% CI 1.02, 1.19, p(linear trend) = 0.02) per year 1997-2002) before decreasing to 7.0% in 2007 (odds of TDR decreased by 0.90 (95% CI 0.87, 0.94, p(linear trend) < 0.001) per year 2002-2007. Trends in adjusted TDR were altered as the misclassification rate increased; the significant downward trend between 2002-2007 was lost when the misclassification increased to over 4%.
The effect of misclassification of ART on estimates of the prevalence of TDR may be appreciable, and depends on the number of naïve tests relative to the number of experienced tests. Researchers can examine the effect of ART misclassification on their estimates of the prevalence of TDR if such a bias is suspected.
Estimates of the prevalence of transmitted HIV drug resistance (TDR) in a population are derived from resistance tests performed on samples from patients thought to be naïve to antiretroviral treatment (ART). The certainty of whether a patient is naïve to treatment at the time a sample for resistance testing is taken relies on sources of information about a patient's treatment status. Patients who have moved countries or clinical centres may not remember the exact date of starting ART or choose not to share information about previous therapy with their current health care provider. Poor data collection methods and/or ways of recording data on clinical databases may also result in incomplete or incorrect information in an analysis, especially if databases from different clinical centres need to be linked to obtain a patient's full treatment history.
Much of the debate over reliability of estimates of the prevalence of TDR has focused on whether the sample population is representative . However estimates of the prevalence of TDR will also be distorted if some ART-experienced patients are misclassified as ART-naïve, as has been discussed with reference to UK estimates [2, 3]. As large, multicentre cohort studies are increasingly utilised to assess the burden of TDR on a national or regional level, the potential biases in such data must be addressed.
In this paper we quantify the potential extent of this bias and its impact on estimates of the prevalence of TDR, illustrate methods to obtain adjusted estimates of the prevalence of TDR under different assumptions of the rate of misclassification, and conduct sensitivity analyses of trends in the prevalence of TDR over time using data from the UK HIV Drug Resistance Database.
where is the proportion of truly experienced patients with a resistance test misclassified as naïve (a is the number of truly experienced patients with a resistance test misclassified as naïve, A is the number of truly experienced patients with a resistance test), , the ratio of the number of truly naïve patients with a resistance test (B) to the number of truly experienced patients with a resistance test, and R E (E = experienced) and R N (N = naïve) are the rate of resistance in truly experienced and truly naive patients with a resistance test respectively.
To examine the effect of misclassification of treatment status on the trend in the prevalence of TDR over time in the UK, the first resistance test per patient conducted whilst observed as naïve to ART (n = 18,577) and the last test per patient conducted after being observed as treatment experienced (n = 10,792) were identified from UK HIV Drug Resistance database (to end of 2007). The misclassification rate, m, was chosen to be 2%, 5% or 6%. The UK HIV Drug Resistance Database is a central repository of genotypic resistance tests carried out as part of routine clinical care in the United Kingdom . A patient's observed treatment status is classified from demographic and clinical information obtained and linked from various sources; electronic data are provided by the UK Collaborative HIV Cohort study (UK CHIC) , the UK Register of HIV seroconverters , the Survey of Prevalent HIV Infections Diagnosed (SOPHID) , the HIV and AIDS New Diagnoses national database (HAP), and other hospital databases. Information on exposure to ART is also asked for on request forms for resistance tests, and is cross-checked with data from the electronic databases before classifying a patient's observed treatment status at the time of a resistance test; a patient's observed treatment status is recorded as unknown if there is conflicting information. The study has UK Multicentre Ethics Committee approval (MREC/01/2/10).
Major resistance mutations were identified using the 2009 IAS-USA guidelines . Logistic regression was used to examine trends in the prevalence of TDR over time.
Bias in the estimation of the prevalence of TDR under different assumptions of the misclassification rate
Adjusted estimates of the prevalence of TDR
where Y (= B + a) and X (= A - a) are the number of observed ART-naive and ART-experienced patients with a resistance test respectively, and y (= R N B + R E a) and x (= R E A - R E a) are the number of observed ART-naive and ART-experienced patients with resistance (see Additional file 1 for derivation).
Empirical adjustment of the prevalence of TDR to account for the effect of misclassification of treatment status: the trend over time in the UK
The statistically significant upward linear trend between 1997 and 2002 seen for the observed prevalence of TDR was lost when the misclassification rate increased to just under 1% (data not shown). The statistically significant downward linear trend between 2002 and 2007 was lost when the misclassification rate increased to over 4% (data not shown).
We have shown that the effect of misclassification of antiretroviral treatment status on estimates of the prevalence of TDR may be appreciable, even if the rate of misclassification is low. The size of the effect depends on the number of naïve tests relative to the number of experienced tests, as well as the rate of resistance in naïve and experienced patients. If in a population resistance tests are being done more frequently in treatment naïve patients than in treatment experienced, the effect of misclassification of experienced patients as naïve on estimates of the prevalence of TDR will be diluted.
Estimating the misclassification rate in a population is challenging. Knowledge of the accuracy of clinical databases may suggest whether the misclassification rate in one setting may be higher or lower than in another setting but quantifying this difference is more difficult. When estimates of the prevalence of TDR in the UK were first obtained from the UK HIV Drug Resistance Database for all tests conducted in the UK up to 2003  an exercise was carried out to try and verify the accuracy of the ART data. Hospital clinical notes or the resistance test request form (which contains information on exposure to antiretroviral therapy) were checked on a sample of supposedly ART-naive patients with resistant mutations against information from the databases mentioned in the Methods. Adjusting our findings from this exercise to account for the number of patients without resistance who may have been misclassified, we estimated an overall misclassification rate of approximately 2%.
In the UK the number of naïve tests conducted has increased over time more sharply than the number of experienced tests, despite the number of patients on ART increasing, and as a consequence the effect of misclassification of treatment status on estimates of the prevalence of TDR in recent years was minimal. The trend in the prevalence of TDR over time in the UK was dramatically altered when different rates of misclassification were assumed and the downward trend in the prevalence of TDR since 2002 was lost when the misclassification rate increased to over 4%. Whilst this implies that trends over time in the prevalence of TDR should be interpreted with caution, an estimated misclassification rate of approximately 2% provides reassurance that there has been a decline in the prevalence of TDR in the UK. This analysis assumed that the misclassification rate was constant over time, which may be incorrect if there are reasons to suspect that the reliability of treatment history has changed over time, for example, an increase in patients who have migrated from other countries and have an incomplete ART history.
Misclassification of treatment status is just one factor which may influence estimates of TDR, others include biased sampling , different definitions of transmitted resistance , the study of acute infections, chronic infections, or both , geographical differences , and the persistence of transmitted resistance mutations .
The effect of misclassification of ART on estimates of the prevalence of TDR may be appreciable, and depends on the number of naïve tests relative to the number of experienced tests. Our simple formula for calculating adjusted prevalence of TDR allows researchers to examine the effect of ART misclassification on their estimates of the prevalence of TDR if such a bias is suspected. However the method presented depends on the rate of resistance in experienced patients and not all TDR surveillance studies may have this information available.
The UK Collaborative Group on HIV Drug Resistance
Steering Committee: Jane Anderson, Homerton University Hospital, London; David Asboe and Anton Pozniak, Chelsea & Westminster Hospital, London; Sheila Cameron, Gartnavel General Hospital, Glasgow; Patricia Cane, Health Protection Agency, Porton Down; Ian Chrystie, Guy's and St. Thomas' NHS Foundation Trust, London; Duncan Churchill, Brighton and Sussex University Hospitals NHS Trust; Duncan Clark, St Bartholomew's and The London NHS Trust; Valerie Delpech and Deenan Pillay, Health Protection Agency, Centre for Infections, London; Linda Lazarus, Expert Advisory Group on AIDS Secretariat, Health Protection Agency, London; David Dunn, Esther Fearnhill, Hannah Castro and Kholoud Porter, MRC Clinical Trials Unit, London; Philippa Easterbrook and Mark Zuckerman, King's College Hospital, London; Anna Maria Geretti, Clare Booth, Royal Free NHS Trust, London; David Goldberg, Health Protection Scotland, Glasgow; Mark Gompels, Southmead Hospital, Bristol; Antony Hale, Leeds Teaching Hospitals NHS Trust; Steve Kaye, Imperial College, London; Paul Kellam, Wellcome Trust Sanger Institute & UCL Medical School; Svilen Konov, Community Advisory Board; Andrew Leigh-Brown, University of Edinburgh; Nicola Mackie, St. Mary's Hospital, London; Chloe Orkin, St. Bartholomew's Hospital, London; Deenan Pillay, Andrew Phillips and Caroline Sabin, UCL Medical School, London; Erasmus Smit, Health Protection Agency, Birmingham Heartlands Hospital; Kate Templeton, Royal Infirmary of Edinburgh; Peter Tilston, Manchester Royal Infirmary; Ian Williams, Mortimer Market Centre, London; Hongyi Zhang, Addenbrooke's Hospital, Cambridge. Participating laboratories: Addenbooke's Hospital, Cambridge (Hongyi Zhang); Department of Virology, St Bartholomew's and The London NHS Trust (Duncan Clark, Ines Ushiro-Lumb, Tony Oliver, David Bibby); Belfast Health and Social Care Trust (Suzanne Mitchell); HPA Birmingham Public Health Laboratory (Erasmus Smit); Chelsea and Westminster Hospital, London (Adrian Wildfire); Dulwich Hospital, London (Melvyn Smith); Royal Infirmary of Edinburgh (Jill Shepherd); West of Scotland Specialist Virology Lab Gartnavel, Glasgow (Alasdair MacLean); Guy's and St. Thomas' NHS Foundation Trust, London (Ian Chrystie); Leeds Teaching Hospitals NHS Trust (Diane Bennett); Specialist Virology Centre, Liverpool (Mark Hopkins) and Manchester (Peter Tilston); Department of Virology at Royal Free Hospital, London (Clare Booth, Ana Garcia-Diaz); Imperial College, London (Steve Kaye); University College London Hospitals (Stuart Kirk). Coordinating Centre: Medical Research Council Clinical Trials Unit (MRC CTU), London (David Dunn, Esther Fearnhill, Hannah Castro, Kholoud Porter, Kate Coughlin).
The UK HIV Drug Resistance Database is partly funded by the Department of Health; the views expressed in the publication are those of the authors and not necessarily those of the Department of Health. Additional support is provided by Bristol-Myers Squibb, Gilead, Pfizer, and Tibotec (a division of Janssen-Cilag Ltd). We acknowledge part funding from the UCLH/UCL NIHR Comprehensive Biomedical Research Centre. The research leading to these results has received funding from the European Community's Seventh Framework Programme (FP7/2007-2013) under the project "Collaborative HIV and Anti-HIV Drug Resistance Network (CHAIN)"--grant agreement n° 223131.
- Pillay D: Current patterns in the epidemiology of primary HIV drug resistance in North America and Europe. Antivir Ther. 2004, 9 (5): 695-702.PubMedGoogle Scholar
- UK Group on Transmitted HIV Drug Resistance: Time trends in primary resistance to HIV drugs in the United Kingdom: multicentre observational study. BMJ. 2005, 331 (7529): 1368-1371.View ArticleGoogle Scholar
- Fox J, Hill S, Kaye S, Dustan D, McClure M, Fidler S, Mackie NE: Prevalence of primary genotypic resistance in a UK centre: comparison of primary HIV-1 and newly diagnosed treatment-naive individuals. AIDS. 2007, 21: 237-239. 10.1097/01.aids.0000247577.26375.ef.View ArticlePubMedGoogle Scholar
- The UK Collaborative HIV Cohort Steering Committee: The creation of a large UK-based multicentre cohort of HIV-infected individuals: the UK Collaborative HIV Cohort (UK CHIC) study. HIV Med. 2004, 5: 115-124.View ArticleGoogle Scholar
- UK Register of HIV Seroconverters Steering Committee: The AIDS incubation period in the UK estimated from a national register of HIV seroconverters. AIDS. 1998, 12: 659-667.Google Scholar
- Health Protection Agency, Scottish Centre for Infection and Environmental Health, National Public Health Service for Wales, Communicable Disease Surveillance Centre Northern Ireland, Unlinked Anonymous Surveys Steering Group: Renewing the Focus: HIV and Other Sexually Transmitted Infections in the UK in 2002. 2003, London: Health Protection AgencyGoogle Scholar
- Johnson VA, Brun-Vezinet F, Clotet B, Gunthard HF, Kuritzkes DR, Pillay D, Schapiro JM, Richman DD: Update of the drug resistance mutations in HIV-1: December 2009. Top HIV Med. 2009, 17 (5): 138-145.PubMedGoogle Scholar
- Green H, Tilston P, Fearnhill E, Pillay D, Dunn DT, on behalf of the UK Collaborative Group on HIV Drug Resistance: The impact of different definitions on the estimated rate of transmitted HIV drug resistance in the United Kingdom. J Acquir Immune Defic Syndr. 2008, 49: 196-204. 10.1097/QAI.0b013e318185725f.View ArticlePubMedGoogle Scholar
- Jain V, Sucupira MC, Bacchetti P, Hartogensis W, Diaz RS, Kallas EG, Janini LM, Liegler T, Pilcher CD, Grant RM, Cortes R, Deeks SG, Hecht FM: Differential persistence of transmitted HIV-1 drug resistance mutation classes. J Infect Dis. 2011, 203 (8): 1174-1181. 10.1093/infdis/jiq167.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/12/30/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.