Alternative methods to analyse the impact of HIV mutations on virological response to antiviral therapy
 Linda Wittkop^{1, 2},
 Daniel Commenges^{1, 2},
 Isabelle Pellegrin^{3},
 Dominique Breilh^{4},
 Didier Neau^{5},
 Denis Lacoste^{5},
 JeanLuc Pellegrin^{5},
 Geneviève Chêne^{1, 2},
 François Dabis^{1, 2} and
 Rodolphe Thiébaut^{1, 2}Email author
DOI: 10.1186/14712288868
© Wittkop et al; licensee BioMed Central Ltd. 2008
Received: 10 June 2008
Accepted: 22 October 2008
Published: 22 October 2008
Abstract
Background
Principal component analysis (PCA) and partial least square (PLS) regression may be useful to summarize the HIV genotypic information. Without preselection each mutation presented in at least one patient is considered with a different weight. We compared these two strategies with the construction of a usual genotypic score.
Methods
We used data from the ANRSCO3 Aquitaine Cohort Zephir substudy. We used a subset of 87 patients with a complete baseline genotype and plasma HIV1 RNA available at baseline and at week 12. PCA and PLS components were determined with all mutations that had prevalences >0. For the genotypic score, mutations were selected in two steps: 1) pvalue < 0.01 in univariable analysis and prevalences between 10% and 90% and 2) backwards selection procedure based on the CochranArmitage Test. The predictive performances were compared by means of the crossvalidated area under the receiver operating curve (AUC).
Results
Virological failure was observed in 46 (53%) patients at week 12. Principal components and PLS components showed a good performance for the prediction of virological response in HIV infected patients. The crossvalidated AUCs for the PCA, PLS and genotypic score were 0.880, 0.868 and 0.863, respectively. The strength of the effect of each mutation could be considered through PCA and PLS components. In contrast, each selected mutation contributes with the same weight for the calculation of the genotypic score. Furthermore, PCA and PLS regression helped to describe mutation clusters (e.g. 10, 46, 90).
Conclusion
In this dataset, PCA and PLS showed a good performance but their predictive ability was not clinically superior to that of the genotypic score.
Background
The development of HIV resistance mutations is one of the major problems for optimizing treatment of HIVinfected patients. Therefore, resistance testing before starting highly active antiretroviral therapy (HAART) or before switching to a new antiretroviral component is widely recommended [1–4] and now routinely implemented in industrialised countries. Resistance is due to mutations in the viral genome, e.g. mutations in the reverse transcriptase (RT), protease or integrase genes that cause resistance to nucleoside RT inhibitors (NRTIs) and nonnucleoside RT Inhibitors (NNRTIs), protease inhibitors (PIs), or integrase inhibitors, respectively. Genotypic and phenotypic resistance testing are the two commonly used tests. The impact of genotypic mutations on virological response in patients treated with a particular drug regimen are based on in vitro informations or on the virological response reported in patients who switched to that particular regimen. Before the initiation of an optimized treatment, a genotype of the main (major) patients' virus populations (only virus species present at >20–30% are detected and therefore analysed) is assessed. Statistical analyses aim at finding the baseline genotypic mutations associated with virological response in order to predict whether a patient who will switch to a similar regimen is resistant or not. Noteworthy, data are mostly analysed for the main drug of a given regimen only, i.e. NNRTI and/or PI.
However, traditional statistical analyses of the association between genotypic mutations and virological response are hampered by i) the high number of potential mutations, ii) the correlations between mutations and iii) the low number of patients usually available for this type of study. Specifically, the analysis of the effect of high number of mutations measured in a limited number of patients may lead to overfitting issues. Hence, inflated variances result in nonsignificant associations. In order to circumvent these problems and to simplify the interpretation, genotypic mutations are summarised in a socalled genotypic score. This score is the sum of observed resistance mutations at baseline for the given drug in a given patient. The mutations composing the score are selected by different strategies [5, 6]. The drawbacks of this analysis are that a preselection of mutations is required and that every mutation has the same weighting. Alternative strategies such as principal component analysis (PCA) and partial least square (PLS) regression have been suggested for the sake of size reduction of correlated predictors [5, 7–9] and may present advantages to improve the description of associations between mutations. The two techniques do not lead to a selection of mutations but to a different weighting of each mutation presented in the dataset. We aimed at comparing these two strategies with the usual construction of a genotypic score using data from an existing study evaluating the impact of protease mutations on the virological response in patients switching to a fosamprenavir/ritonavirbased HAART [10].
Methods
Data
The Zephir study was designed to investigate the impact of baseline protease genotypic mutations in HIV1 infected PIexperienced patients on virological response. All patients had baseline HIV1 RNA levels >1.7 log_{10} copies/mL and switched to a ritonavirboosted fosamprenavirbased HAART [10]. Patients included were followed at the Bordeaux University hospital and at four other public hospitals in Aquitaine, south western France, all participating to the ANRS CO3 Aquitaine Cohort. We used a subset of 87 patients with a complete baseline genotype and plasma HIV1 RNA available at baseline and at week 12. Virological failure was defined as a HIV1 RNA ≥400 copies/mL and <1 log_{10} copies/mL decrease of HIV1 RNA between baseline and week 12 (virological success: HIV1 RNA <400 copies/mL or ≥1 log_{10} copies/mL reduction). A mutation was defined as a difference between the amino acid sequence of the studied virus and the wild type (HXB2) virus. In total, we created 69 dummy variables (69 mutations among the 99 possible protease mutations were encountered at least once).
Statistical analysis
Construction of a genotypic score
The genotypic score was created in two steps. The first step considered mutations with prevalences ≥10% and ≤90% [5] to assess their association with virological failure. Mutations associated with a pvalue ≥ 0.01 (univariable logistic regression) were selected. Second, the backwards procedure selected the combination with the strongest association with virological response [6]. These m selected mutations were used to calculate the first genotypic score for each patient. For instance, a first set contains the six mutations V32, I47, I50, V77, I84 and L90. The score is defined as S = I_{V32} + I_{I47} + I_{I50} + I_{V77} + I_{I84} + I_{L90} (S varying from 0 to 6). During the backwards selection procedure every mutation was removed one by one and all combinations of (m1) mutations were investigated. The CochranArmitage test for linear trends in proportions was used to compare the probability of virological failure in patients having none to (m1) mutations [11]. The combination providing the lowest pvalue was kept and the procedure was repeated with all combinations of (m2) mutations. The procedure stopped when removal of a mutation did not result in a lower pvalue.
We performed 200 bootstrap samples from the original data set to analyze the variability in mutations' selection. We assumed that variability in the selection of mutations due to the restricted sample size might essentially play a role in the first selection step. Therefore, a bootstrap analysis was performed only to the first selection criteria. In each sample the prevalence of each mutation was calculated. A univariable logistic regression was performed to determine the association of each mutation with virologic failure in each sample. Then we calculated the frequencies of selection of each mutation in the 200 bootstrap samples under the conditions mentioned above (prevalence between 10% and 90% and a pvalue < 0.01 in univariable analysis).
Principal component analysis (PCA)
Each principal component is a linear combination of the original variables, with coefficients equal to the eigenvectors of the correlation or covariance matrix [7, 9]. Principal components analysis determines components which are representing the variability of the mutations. The association between the principal components and the response variable was tested with the Wald test statistics of the estimated regression coefficient related to the principal components. We only tested principal components with an eigenvalue >2 reflecting that ≥3% of the variability of the mutations was explained. Any principal component was kept when it was related to the virological response using a logistic regression according to the Wald test.
Partial least square (PLS) regression
PLS regression is a technique widely used for dealing with numerous correlated explanatory variables [8, 12]. PLS regression aims also at identifying components explaining as much as possible the variance of the predictor variables. These components are simultaneously correlated with the response variable. Overfitting issues were controlled with a leaveoneout crossvalidation during the construction process. The number of factors chosen is usually the one that minimizes the predicted residual sum of squares (PRESS) [13].
Comparison
The probability of virological failure at week 12 was studied using a logistic regression model adjusted for either the genotypic score or the principal components or the PLS components as explanatory variables. The performance of each strategy was compared using the crossvalidated AUC [7, 8]. We used 5fold crossvalidation. We split the dataset in five equal parts. That way we selected five times a dataset with 1/5 of the patients as 'validation set' and the remaining 4/5 of the patients served as 'test set'. In the test set, we determined i) the genotypic score ii) the principal components and iii) the PLS components. The selected mutations were then used to calculate the genotypic score for the patients included in the validation set. The weights for each mutation derived by PCA and PLS were applied to calculate the score of the principal component and the PLS component respectively for the patients of the validation set. For each validation set the AUC under the ROC curve was calculated by means of a logistic regression for the three different methods. Thus, we obtained for each method 5 AUCs and the crossvalidated AUC was calculated as the mean of these 5 AUCs. This approach allows to avoid overfitting because the performance of the methods is tested in a subset of patients that were not used to determine the genotypic score and the weights of mutations in the PCA and PLS components.
Statistical analyses were performed using SAS^{®} version 9.1 software (SAS Institute, Inc., Cary, NC). We used the procedures PROC PRINCOMP for principal component analysis and PROC PLS for partial least square regression. Principal components and PLS components were determined considering all mutations being present in at least one patient.
Results
Study population characteristics have been reported before [10]. We used a subset of 87 patients with a complete baseline genotype and plasma HIV1 RNA available at baseline and at week 12. Virological failure was observed in 46 (53%) patients at week 12. Mutations at codon 63 had the highest prevalence in this population 80% followed by mutations at codons 10 (58%), 71 (51%), 46 (47%), 54 (47%), 37 (47%), 35 (41%), 82 (40%) and 90 (40%). Mutations at codons 11, 12, 13, 14, 15, 19, 20, 32, 33, 34, 36, 41, 43, 47, 55, 57, 60, 61, 62, 64, 69, 72, 73, 77, 84, 89 and 93 had prevalences between 10% and 40%. Mutations at codons 10, 46, 54, 82 and 90 showed the highest association with virological failure in univariable analysis (p < 10^{5}). All patients with virological failure presented a mutation at codon 84.
Genotypic score
Among mutations occurring in more than 10% and less than 90% of the patients, 27, 18 and 11 mutations were selected according to pvalue thresholds of < 0.25, < 0.05 and < 0.01, respectively. The backward selection procedure using the Cochrane Armitage trend test was started with the 11 mutations (10, 33, 36, 46, 54, 62, 71, 73, 82, 84, 90) selected with the most restrictive criteria (p < 0.01) to avoid computational issues. The stability of this selection step was checked on 200 bootstrap samples. Seven (10:100%, 46: 100%, 54: 100%, 71: 95.5%, 82: 97%, 84: 100%, 90: 96%) of the 11 mutations were selected in over 90% of the samples. The other four mutations were selected between 50% and 90% (33: 88%, 36: 68%, 62: 50%, 73: 68.5%). Mutations not included in the IAS list [14] were in general not selected in the bootstrap samples (exceptions: 19: 36.5%, 37: 19% and 41: 19%). This additional bootstrap analysis confirmed that mutations known to be associated with virological failure were chosen for further steps. Mutations (also known as polymorphisms) that also occur occasionally in untreated patients, thus generally without any relation to antiretroviral treatment, were chosen in less than 3% of the bootstrap samples.
During the backward selection procedure the following six mutations 10, 36, 46, 62, 84, and 90 were selected for the calculation of a genotypic score. The genotypic score calculated with these six mutations was significantly associated with virological failure (OR = 4.1 for a difference of one mutation, CI_{95%} [2.4; 7.0]; p < 10^{4}; crossvalidated OR = 4.9).
Principal component analysis
Partial least Square
Comparison
We compared the performance of these three methods with the area under the ROC curve. The crossvalidated AUCs for the PCA, PLS and genotypic score were 0.880, 0.868 and 0.863, respectively. The model with the first principal component slightly outperformed the model with one PLS component. The predictive quality of the genotypic score was slightly lower than the two AUCs obtained for PCA and PLS but still showed a very good performance.
To compare the methods in an illustrative way we used a patient presenting the following 21 protease gene mutations at baseline: mutations at positions 33, 54, 82, 90 defined as major, mutations at positions 10, 13, 20, 35, 36 43, 53, 60, 63, 64, 74 defined as minor and mutations at positions 14, 15, 19, 37, 67, 98 defined as polymorphisms. Virological failure was observed for this patient. The genotypic score was S = I_{10}+I_{36}+I_{90} = 3 and the probability of virological failure was 77% using this score. The main difference between the genotypic score and the principal component value or the PLS component value is that with the latter methods we can take in consideration the fact that the patient has 21 protease gene mutations and give them different weights. For instance, the relative weights for mutations 10, 36, 90 were 4.4%, 2.2%, 4.1% and 4.7%, 2.4%, 4.4% for the PCA and PLS 'score', respectively (figure 2 and 3). The predicted probability of virological failure was 94% and 96% using the PC "score" and the PLS "score", respectively.
Discussion
We investigated PCA and PLS regression to analyse associations between baseline protease mutations and virological failure. PCA and PLS are easily applicable because they are implemented in standard statistical analyses programs such as SAS (SAS Institute, Inc., Cary, NC).
We compared these two techniques with the construction of a genotypic score because they allow considering each mutation with a different weight. The objective of PCA is to find a set of new "latent variables" in form of a linear transformation of the original predictors. The properties of these latent variables are that they are uncorrelated and that they account for as much of the variance of the predictor variables as possible. PCA has been recently used to determine clusters of mutations in patients that were treated with at least one PI [15] and to predict the phenotypic fold change from genotypic information [16]. PLS regression reduces also a set of predictor variables to a set of uncorrelated "latent variables", the socalled PLS components. The main difference between the two techniques is that PLS also considers the strength of each mutation effect on the virological response to construct the components. Hence, these two methods can help solving the issues of the high number of predictors and their different effects. They may also help in describing the relationship between mutations by detecting potential groups of mutations. PLS was mentioned to be a useful analysing strategy for genotypic mutation data [5] but neither applications nor comparisons had been published yet.
In this study population, these two methods were able to identify some mutations that were expected to contribute with higher weights to virologic failure (e.g. mutations at codons 10, 82 and 90 which contribute to resistance to at least 7 of the 8 currently used PIs [5]). Furthermore, known clusters of mutations could be described. Recent papers including covariation analysis [15, 17–19] found some correlated pairs and clusters which are associated with a specific treatment. Two of them used PCA to visualise correlations of mutations. We identified some clusters of mutations, e.g. mutations at codons 10, 46, and 90 and at codons 33, 46, 54 and 82, which were also found to be correlated with each other. Mutations 32 and 47 had the highest correlation coefficient (r = 0.78) in this population and are known to be key mutations for amprenavir [20] and lopinavir [14]. The cluster of mutations at positions 10, 46, 90 [19] and a high correlation between 32 and 47 were also determined by Wu et al and Kagan et al [19, 21]. The mutations 10, 33, 46, 54, 71, 82, 84 and 90 are separated from all other mutations by the PCA and are contributing with the highest weight to calculate this component. The cluster 10, 46, 54, 71, 90 was recently described [17] to appear under lopinavir treatment and these mutations are also related to amprenavirresistance [22]. We found that PCA had indeed detected this latter cluster in our patient's population previously treated by lopinavir or amprenavir (25% and 32% of the patients, respectively). Furthermore, the fact that the principal component was related to virological response highlights that PCA can detect mutation clusters on the way to lopinavir and fosamprenavir resistance although principal component analysis did not consider the virologic response for the construction of the component. As mentioned above, PLS searches latent variables but takes into account the response variable. Consequently one might expect differences for the distribution of the weights given by the mutations. Actually, the mutations found to contribute the highest weight on the PLS component are almost the same. Among the six mutations contributing with the highest weight, mutations at codons 10, 46, 54 82 and 90 were found for the principal component and the PLS component. Mutation at codon 33 was found on the principal component, while mutation 84 was found on the PLS component. In addition, the mutations which contributed with a higher weight for the calculation of the first principal and first PLS components are those which showed the highest association with virological response in univariable analysis. In conclusion, the weightings of the mutations found were consistent across these alternative strategies. A possible explanation is that the patients were mainly pretreated with two PIs known to induce similar mutation patterns than fosamprenavir. In other cases, PLS might outperform PCA when a drug induces completely different mutations since the virological response is considered during the construction of the component.
The above presented example (patient presenting 21 protease gene mutations) highlights the advantage of taking into account all mutations and giving them different weights by either PCA or PLS. This results in a better prediction of virological failure. After crossvalidation the first principal component and the first PLS component only slightly outperformed the genotypic score in the prediction ability. However, it has to be stated that the crossvalidated AUCs showed no clinical relevant difference. In this study population this might partly be explained by the fact that there was an explicit subset of mutations strongly associated with virological failure. This was also substantiated by the bootstrap analyses in which four of the six mutations remaining in the final genotypic score had been selected in over 95% of the bootstrap samples. This clear separation between mutations associated with virological failure from those which are not, could have facilitated the detection of a predictive subset using the classical strategy to construct a genotypic score.
One of the reasons to apply PCA and PLS analyses to these kind of data was that these approaches do not need a preselection of variables (i.e. mutations) as they are summarized in predictors. Hence, all mutations can be considered even when they are present in a small proportion of patients. Among others, the attempt to study these approaches was to study whether considering all mutations has an advantage and if mutations known to be associated with virologic failure are given higher weights. However, the slightly better performance of the alternative approaches may be simply linked with the use of a larger amount of information. This was the minimum expected gain of these approaches compared to the usual one.
Therefore, it would be very helpful to study the performance of PCA and PLS in other, potentially bigger, trials considering other antiretroviral regimen/patients.
Conclusion
PCA and PLS regression were helpful in describing the association between mutations and to detect mutation clusters. PCA and PLS showed a good performance but their predictive ability was not clinically superior to that of the genotypic score.
Appendix
Aquitaine Cohort composition
Scientific Committee: J. Beylot, M. Dupon, M. LongyBoursier, J.L. Pellegrin, J.M. Ragnaud and R. Salamon (Chair).
Scientific Coordination: M. Bruyand, G. Chêne, F. Dabis (Coordinator), S. LawsonAyayi, C. Lewden, R. Thiébaut.
Medical Coordination: N. Bernard, M. Dupon, D. Lacoste, D. Malvy JF. Moreau, P. Mercié, P. Morlat, D. Neau, JL. Pellegrin, and JM. Ragnaud.
Data Management and Statistical Analysis: E. Balestre, L. DequaeMerchadou, V. LavignolleAurillac.
Technical Team: MJ. Blaizeau, M. Decoin, S. Delveaux, D. Dutoit, C. Hanappier, L. Houinou, S. Labarrère, G. Palmer, D. Touchard, and B. Uwamaliya.
Participating Hospital Departments (participating physicians): Bordeaux University Hospitals: J. Beylot (N. Bernard, M. Bonarek, F. Bonnet, D. Lacoste, P. Morlat, and R. Vatan), P. Couzigou, H. Fleury (ME. Lafon, B. Masquelier, and I. Pellegrin), M. Dupon (H. Dutronc, F. Bocquentin, and S. Lafarie), J. L. Pellegrin (O. Caubet, E. Lazaro C. Nouts, and J. F. Viallard), M. LongyBoursier (D. Malvy, P. Mercié, T. Pistonne and C. Receveur), J. F. Moreau (P. Blanco), J. M. Ragnaud (C. Cazorla, D. Chambon, C. De La Taille, D. Neau, and A. Ochoa); Dax Hospital: P. Loste (L. Caunègre); Bayonne Hospital: F. Bonnal (S. Farbos, and M. C. Gemain); Libourne Hospital: J. Ceccaldi (S. Tchamgoué); MontdeMarsan Hospital: S. de Witte.
Abbreviations
 ANRS:

Agence Nationale de Recherche sur le SIDA
 AUC:

Area under the receiver operating characteristics curve
 CI:

Confidence interval
 HAART:

Highly active antiretroviral therapy
 HIV:

Human immunodeficiency virus
 IAS:

International AIDS society
 IQR:

Interquartiles range
 NNRTI:

Nonnucleoside reverse transcriptase inhibitor
 NRTI:

Nucleoside reverse transcriptase inhibitor
 OR:

Odds ratio
 PC:

Principal component
 PCA:

Principal component analysis
 PLS:

Partial least square
 PRESS:

Predicted residual sum of squares
 RT:

Reverse transcriptase.
Declarations
Acknowledgements
We kindly thank Marta Avalos for reading and commenting this paper.
Authors’ Affiliations
References
 Gazzard B, Bernard AJ, Boffito M, Churchill D, Edwards S, Fisher N, Geretti AM, Johnson M, Leen C, Peters B, et al: British HIV Association (BHIVA) guidelines for the treatment of HIVinfected adults with antiretroviral therapy (2006). HIV Med. 2006, 7: 487503. 10.1111/j.14681293.2006.00424.x.View ArticlePubMedGoogle Scholar
 Hammer SM, Saag MS, Schechter M, Montaner JS, Schooley RT, Jacobsen DM, Thompson MA, Carpenter CC, Fischl MA, Gazzard BG, et al: Treatment for adult HIV infection: 2006 recommendations of the International AIDS SocietyUSA panel. Jama. 2006, 296: 827843. 10.1001/jama.296.7.827.View ArticlePubMedGoogle Scholar
 Hirsch MS, BrunVezinet F, Clotet B, Conway B, Kuritzkes DR, D'Aquila RT, Demeter LM, Hammer SM, Johnson VA, Loveday C, et al: Antiretroviral drug resistance testing in adults infected with human immunodeficiency virus type 1: 2003 recommendations of an International AIDS SocietyUSA Panel. Clin Infect Dis. 2003, 37: 113128. 10.1086/375597.View ArticlePubMedGoogle Scholar
 Report 2006 under the direction of Patrick Yeni: Prise en charge médicale des personnes infectées par le VIH, recommandations du groupe d'experts. 2006, République française, MédecinesSciences, Flammarion, (accessed 29 october 2008), [http://www.sante.gouv.fr/htm/actu/yeni_sida/rapport_experts_2006.pdf]
 BrunVezinet F, Costagliola D, Khaled MA, Calvez V, Clavel F, Clotet B, Haubrich R, Kempf D, King M, Kuritzkes D, et al: Clinically validated genotype analysis: guiding principles and statistical concerns. Antivir Ther. 2004, 9: 465478.PubMedGoogle Scholar
 Flandre P, Marcelin AG, Pavie J, Shmidely N, Wirden M, Lada O, Bernard MC, Molina JM, Calvez V: Comparison of tests and procedures to build clinically relevant genotypic scores: application to the Jaguar study. Antivir Ther. 2005, 10: 479487.PubMedGoogle Scholar
 Aguilera A, Escabias M, Valderrama M: Using principal components for estimating logistic regression with highdimensional multicollinear data. Comput Stat Data Anal. 2006, 50: 19051924. 10.1016/j.csda.2005.03.011.View ArticleGoogle Scholar
 Bastien P, Esposito Vinzi V, Tenenhaus M: PLS generalised linear regression. Comput Stat Data Anal. 2005, 48: 1746. 10.1016/j.csda.2004.02.005.View ArticleGoogle Scholar
 Massy W: Principal Components Regression in Exploratory Statistical Research. Journal of the American Statistical Association. 1965, 60: 234256. 10.2307/2283149.View ArticleGoogle Scholar
 Pellegrin I, Breilh D, Coureau G, Boucher S, Neau D, Merel P, Lacoste D, Fleury H, Saux MC, Pellegrin JL, et al: Interpretation of genotype and pharmacokinetics for resistance to fosamprenavirritonavirbased regimens in antiretroviralexperienced patients. Antimicrob Agents Chemother. 2007, 51: 14731480. 10.1128/AAC.0048106.View ArticlePubMedPubMed CentralGoogle Scholar
 Marcelin AG, Masquelier B, Descamps D, Izopet J, Charpentier C, Alloui C, BouvierAlias M, SignoriSchmuck A, Montes B, Chaix ML, et al: TipranavirRitonavir Genotypic Resistance Score in Protease InhibitorExperienced Patients. Antimicrob Agents Chemother. 2008, 52: 32373243. 10.1128/AAC.0013308.View ArticlePubMedPubMed CentralGoogle Scholar
 Tenenhaus M, Esposito Vinzi V: PLS regression, PLS path modeling and generalized Procrustean analysis: a combined approach for multiblock analysis. Journal of Chemometrics. 2005, 19: 145153. 10.1002/cem.917.View ArticleGoogle Scholar
 SAS, Institute, Inc: The PLS Procedure. SAS Online Doc. 2007, SAS Online Doc. 9.1.3: SAS Institute Inc., Cary, NC, USA, 913: accessed 29 october 2008, [http://support.sas.com/onlinedoc/913/docMainpage.jsp]Google Scholar
 Johnson VA, BrunVezinet F, Clotet B, Gunthard HF, Kuritzkes DR, Pillay D, Schapiro JM, Richman DD: Update of the Drug Resistance Mutations in HIV1: 2007. Top HIV Med. 2007, 15: 119125.PubMedGoogle Scholar
 Rhee SY, Liu TF, Holmes SP, Shafer RW: HIV1 subtype B protease and reverse transcriptase amino acid covariation. PLoS Comput Biol. 2007, 3: e8710.1371/journal.pcbi.0030087.View ArticlePubMedPubMed CentralGoogle Scholar
 Rabinowitz M, Myers L, Banjevic M, Chan A, SweetkindSinger J, Haberer J, McCann K, Wolkowicz R: Accurate prediction of HIV1 drug response from the reverse transcriptase and protease amino acid sequences using sparse models created by convex optimization. Bioinformatics. 2006, 22: 541549. 10.1093/bioinformatics/btk011.View ArticlePubMedGoogle Scholar
 Garriga C, PerezElias MJ, Delgado R, Ruiz L, Najera R, Pumarola T, AlonsoSocas Mdel M, GarciaBujalance S, MenendezArias L: Mutational patterns and correlated amino acid substitutions in the HIV1 protease after virological failure to nelfinavir and lopinavir/ritonavirbased treatments. J Med Virol. 2007, 79: 16171628. 10.1002/jmv.20986.View ArticlePubMedGoogle Scholar
 Hoffman NG, Schiffer CA, Swanstrom R: Covariation of amino acid positions in HIV1 protease. Virology. 2003, 314: 536548. 10.1016/S00426822(03)004847.View ArticlePubMedGoogle Scholar
 Wu TD, Schiffer CA, Gonzales MJ, Taylor J, Kantor R, Chou S, Israelski D, Zolopa AR, Fessel WJ, Shafer RW: Mutation patterns and structural correlates in human immunodeficiency virus type 1 protease following different protease inhibitor treatments. J Virol. 2003, 77: 48364847. 10.1128/JVI.77.8.48364847.2003.View ArticlePubMedPubMed CentralGoogle Scholar
 Maguire M, Shortino D, Klein A, Harris W, Manohitharajah V, Tisdale M, Elston R, Yeo J, Randall S, Xu F, et al: Emergence of resistance to protease inhibitor amprenavir in human immunodeficiency virus type 1infected patients: selection of four alternative viral protease genotypes and influence of viral susceptibility to coadministered reverse transcriptase nucleoside inhibitors. Antimicrob Agents Chemother. 2002, 46: 731738. 10.1128/AAC.46.3.731738.2002.View ArticlePubMedPubMed CentralGoogle Scholar
 Kagan RM, Cheung PK, Huard TK, Lewinski MA: Increasing prevalence of HIV1 protease inhibitorassociated mutations correlates with longterm nonsuppressive protease inhibitor treatment. Antiviral Res. 2006, 71: 4252. 10.1016/j.antiviral.2006.02.008.View ArticlePubMedGoogle Scholar
 Johnson VA, BrunVezinet F, Clotet B, Conway B, D'Aquila RT, Demeter LM, Kuritzkes DR, Pillay D, Schapiro JM, Telenti A, Richman DD: Update of the drug resistance mutations in HIV1: 2004. Top HIV Med. 2004, 12: 119124.PubMedGoogle Scholar
 The prepublication history for this paper can be accessed here:http://www.biomedcentral.com/14712288/8/68/prepub
Prepublication history
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.