- Research article
- Open Access
- Open Peer Review
An application of propensity score weighting to quantify the causal effect of rectal sexually transmitted infections on incident HIV among men who have sex with men
BMC Medical Research Methodology volume 15, Article number: 25 (2015)
Exploring causal associations in HIV research requires careful consideration of numerous epidemiologic limitations. First, a primary cause of HIV, unprotected anal intercourse (UAI), is time-varying and, if it is also associated with an exposure of interest, may be on a confounding path. Second, HIV is a rare outcome, even in high-risk populations. Finally, for most causal, non-preventive exposures, a randomized trial is impossible. In order to address these limitations and provide a practical illustration of efficient statistical control via propensity-score weighting, we examine the causal association between rectal STI and HIV acquisition in the InvolveMENt study, a cohort of Atlanta-area men who have sex with men (MSM). We hypothesized that, after controlling for potentially confounding behavioral and demographic factors, the significant STI-HIV association would attenuate, but yield an estimate of the causal effect.
The exposure of interest was incident rectal gonorrhea or chlamydia infection; the outcome was incident HIV infection. To adjust for behavioral confounding, while accounting for limited HIV infections, we used an inverse probability of treatment weighted (IPTW) Cox proportional hazards (PH) model for incident HIV. Weights were derived from propensity score modeling of the probability of incident rectal STI as a function of potential confounders, including UAI in the interval of rectal STI acquisition/censoring.
Of 556 HIV-negative MSM at baseline, 552 (99%) men were included in this analysis. 79 men were diagnosed with an incident rectal STI and 26 with HIV. 6 HIV-infected men were previously diagnosed with a rectal STI. In unadjusted analysis, incident rectal STI was significantly associated with subsequent incident HIV (HR (95%CI): 3.6 (1.4-9.2)). In the final weighted and adjusted model, the association was attenuated and more precise (HR (95% CI): 2.7 (1.2-6.4)).
We found that, controlling for time-varying risk behaviors and time-invariant demographic factors, diagnosis with HIV was significantly associated with prior diagnosis of rectal CT or GC. Our analysis lends support to the causal effect of incident rectal STI on HIV diagnosis and provides a framework for similar analyses of HIV incidence.
As with many preventive exposures, causal associations between preventive exposures (e.g. pharmaceuticals) and incident HIV may be optimally assessed through randomized clinical trials (RCT). However, causal associations between non-preventive exposures, such as high-risk sexual or substance use behaviors, and incident HIV cannot be ethically evaluated using an RCT. Additional limitations may further increase the analytic complexities of assessing these causal relationships. First, high-risk sex behaviors, including unprotected anal intercourse (UAI), receptive anal intercourse (RAI), and partners selected from a high HIV prevalence pool, are time-varying and, as necessary causes, must occur in an interval prior to HIV diagnosis . Given an HIV-related exposure of interest that similarly requires high-risk sex risk behaviors (such as anal trauma or another sexually transmitted infection), these behaviors must be modeled as time-varying factors that may be on a confounding path . Additionally, regression-based incidence analyses are further challenged by limited statistical power due to relatively small numbers of incident HIV, even among high-risk populations. Recent studies have found annual HIV incidence of MSM in urban areas of the United States of 1-7%, requiring large cohorts observed for long periods of time to accumulate sufficient events for analysis [3-7].
Consequently, in the absence of RCT data, establishing a causal association between a non-preventive exposure and incident HIV requires application of epidemiologic analysis methods that can control for time-varying behavioral confounding and accommodate small numbers of observed events. The ideal data would include longitudinal evaluation of the exposure, outcome, and all possible time-varying confounders, with measurements made using methods to minimize misclassification. Given such a dataset, propensity score methods would address these issues and, with confirmation of model assumptions, provide an estimate of the causal effect of interest .
An important example of these analytic limitations is the potential causal association between HIV and sexually transmitted infections (STI). Although recent studies have observed associations between these two infections, evaluating a casual association requires adequate control of high-risk sex in the time period immediately preceding both STI and HIV diagnosis and of patterns of high-risk behaviors [3-7,9,10]. Additionally, sexual history in the interval prior to each diagnosis is required to best control for the potentially time-varying nature of the confounding and to account for changes in behavior that may result from rectal STI diagnosis (Figure 1) [11-13]. Therefore, to address these analytic requirements, we detail the application of propensity score weighting to examine the causal effect of rectal bacterial STI on HIV acquisition . We use a cohort of Atlanta-area MSM with biologically measured exposure (i.e. incident STI) and outcome (i.e. incident HIV) data and longitudinal measures of confounders (i.e. high-risk sex). This report serves as an applied methodological exposition of propensity score weighting that pairs with a forthcoming clinically-oriented report on the associations between a broader set of STIs (including urethral bacterial STIs and syphilis) and HIV . We hypothesized that, controlling for time-varying and time-invariant behavioral and demographic factors, the positive association between rectal STI and subsequent HIV infection would be mitigated, yielding an estimate of the causal effect.
Data sources and definitions
The InvolveMENt study is a recently concluded, longitudinal cohort of black and white, sexually active MSM aged 18–39 years in Atlanta, Georgia, recruited from community-based venues and social media between June 2010 through October 2012 . MSM were tested for HIV at enrollment using rapid antibody tests, with confirmatory serum CD4 and viral load measures for preliminary positives. MSM who were HIV-negative at enrollment were included in the longitudinal portion of the study, attending study visits at 3 and 6 months, and subsequent 6 month intervals for two years, or until HIV seroconversion. At the same visits, participants were tested for urethral and rectal Neisseria gonorrhoeae (gonorrhea) and Chlamydia trachomatis (chlamydia) using nucleic acid amplification testing and Treponema pallidum (syphilis). using the rapid plasma regain (RPR) test with confirmatory quantitative nontreponemal titers and treponemal IgG [16,17]. At each study visit, participants completed a computer-administered questionnaire that collected aggregate sexual behaviors, such as the number of UAI partners, and included a dyadic inventory of the most recent 5 sex partners in the previous 6 months . Demographic and sexual behaviors (i.e.: condom use, receptive and insertive sex roles) were collected for each of these partners.
For this analysis, the outcome was incident HIV infection. The exposure was defined as the first (i.e. earliest) diagnosis of incident rectal STI (either gonorrhea or chlamydia). An STI diagnosis was considered to be incident if the individual tested negative for the same STI in the prior interval, or if the STI diagnosis followed an initial visit with the same STI diagnosis with confirmation of study-provided treatment. As we could not determine the timing of the rectal STI for men who were diagnosed with a rectal STI at the initial study visit, we did not include these infections in the analysis. For individuals with incident STI, person-time was calculated as the difference between the date of STI diagnosis and the date of HIV seroconversion or censoring; for individuals without an STI, person-time was calculated as the difference between the enrollment date and the date of HIV seroconversion or censoring due to study completion or loss to follow-up. The date of HIV seroconversion was estimated as halfway between the dates of the final (ie: seroconversion) visit and penultimate visits .
A crude hazard ratio (HR) for the association between incident rectal STI and incident HIV was calculated using an unadjusted Cox proportional hazards (PH) model.
To adjust for behavioral confounding of the rectal STI-HIV association, while accounting for a limited number of incident HIV infections, we used an inverse probability of treatment weighted (IPTW) Cox proportional hazards (PH) model for incident HIV, where the weights were derived from propensity score modeling of STI incidence (i.e. a marginal structural model) . We note that the propensity score literature typically employs the word ‘treatment’ to differentiate the two exposure groups. As our exposure is not a treatment, we use the term ‘exposure groups’ rather than ‘treatment groups’. We first conceptually outline the approach as a four-step process and then detail the specific application to the rectal STI-HIV association.
Inverse probability of treatment weighted (IPTW) Cox proportional hazards (PH) modeling
Propensity score estimation
When applied to observational data, properly specified propensity scores simulate the gold-standard of epidemiologic studies, the RCT . In an RCT, all potential confounders, both measured and unmeasured, are, on average, evenly distributed across (and thus independent of) exposure status.
However, using non-randomized observational data, as in our analysis, exposure status may be associated with measured and unmeasured covariates. Propensity score estimation begins by modeling exposure status (generally using logistic regression) as a function of potential confounders of the exposure and outcome. In the case of behavioral confounding, these potential confounders should temporally precede both the exposure and the outcome and be associated with both. This model then estimates probabilities of exposure conditional on a set of measured preceding covariates, or “propensity scores”. These scores may be incorporated in subsequent covariate-adjusted, stratified, matched, or weighted analyses in order to balance covariates across exposure groups in an observational study or to control residual confounding resulting from a failure of randomization [8,20].
In time-to-event analyses, applying propensity scores using inverse probability of treatment weights (IPTW) minimizes bias relative to the other methods of applying propensity scores . IPTW are defined as the inverse of the propensity score. In order to reduce the influence of outlying weights (i.e. those observations with a very high or very low propensity score), weights may be stabilized via multiplication by the mean propensity score of the given exposure group [19,22].
Common support assessment
The degree to which the propensity score has been appropriately specified may initially be ascertained through evaluation of common support. Common support is defined by overlapping distributions of propensity scores between exposure groups. Unlike an RCT, confounding in an observational study will almost certainly lead to different distributions of propensity scores between exposure groups. However, overlap in the distributions indicates the potential for a member of the exposed group to be in the unexposed group and that individuals with each level of covariates may have either exposure status (i.e. supporting the assumptions of exchangeability and positivity) . A lack of common support, or a complete separation of propensity scores between the exposure groups indicates severe differences between the two exposure groups and the possibility that confounding cannot be reduced using propensity methods .
Given common support, the degree to which confounding by the modeled factors has been controlled may be assessed by examining balance, or distribution of potential confounders by exposure status. Balance is assessed after applying propensity scores to the sample in a method analogous to that use in the final exposure effect estimate (i.e. apply IPTW to the sample before assess balance). Balance is most often examined using standardized bias, calculated as the difference in mean covariate value between exposure groups, divided by the standard deviation of the covariate in the entire study sample following application of propensity scores . While a standardized bias <0.25 is considered to indicate balance of the potential confounder between exposure groups, others have proposed a threshold of <0.10 [24,25]. In the absence of balanced potential confounders following application of propensity scores, the final effect estimate is prone to residual confounding and, therefore, a better propensity model should be developed. Statistical testing is inappropriate for assessing balance between treatment groups because balance is a property of the sample and not of an underlying population [26,27].
Weighted survival analysis
Application of propensity scores from a model exhibiting both common support and balance will reduce or eliminate confounding by those measured covariates. For time-to-event analyses, application of propensity scores using IPTW (rather than matching, stratification, or adjustment) produces effect estimates with minimal bias . When applied to a Cox PH model, IPTW creates a pseudo-population that permits estimation of the casual effect of the exposure on the outcome, given that all confounders were appropriately accounted for in the propensity model. These models may also be further adjusted by predictors of the outcome to increase precision of the final effect estimate.
Application: estimating the rectal STI-HIV association
Propensity score estimation
Using logistic regression, we modeled the probability of exposure (incident rectal STI) as a function of the following potential confounders: participant’s race, participant’s age at rectal STI diagnosis/censoring, age-race interaction, UAI in the interval of rectal STI diagnosis/censoring, any reported black partners in the interval of rectal STI diagnosis/censoring, any reported receptive anal intercourse (RAI) for the duration of the study, census-tract-level poverty, diagnosis of any non-rectal STIs for the study duration, and any non-injection drug use for the duration of the study. These covariates, chosen a priori, may confound the association of interest as markers of individual risk behaviors or markers of high-prevalence sexual networks, and have been strongly associated with STI and HIV incidence [18,28-30].
The primary confounder of the STI-HIV association, interval-specific UAI, was defined as reporting any UAI partners, condom failure, or inconsistent condom use in the six months prior to rectal STI diagnosis or censoring. For the interval-specific reporting of black partners, missing data in the interval of interest were replaced by data from the most recent interval with data. Non-injection drug use was defined as a positive drug-screen at baseline or self-reported drug use at any interval. Poverty was defined as the 2006–2010 American Community Survey estimate of the percent living in poverty for the census-tract that included the participant’s baseline home address.
Each participant was assigned a weight defined as the stabilized inverse propensity score.
Common support assessment
We examined common support through visual comparison of the distributions of modeled probabilities stratified by observed rectal STI status .
We examined balance of potential confounders by calculating standardized bias. In order to examine the changes in confounder distribution due to IPTW, we calculated standardized biases for the original sample and for the sample following application of IPTW (i.e. the selected method of propensity score application) [31-33].
Weighted survival analysis
We then calculated an adjusted HR using IPTW-weighted Cox proportional hazards (PH) regression, modeling incident HIV as a function of the following predictors of HIV incidence and high-prevalence sexual networks: diagnosis with an incident rectal STI, UAI in the interval of HIV diagnosis/censoring (as defined above), any reported black partners in the interval of HIV diagnosis/censoring, and age at HIV diagnosis/censoring [14,18]. The proportional hazards assumption for STI-HIV HR was assessed using visual examination of log-log survival curves and goodness-of-fit testing using Schoenfeld residuals . IPTW-weighted adjusted survival curves were created .
All analyses were performed in SAS v9.3 (SAS Institute, Cary, NC) . Code for this analysis is available in Additional file 1. The Institutional Review Board of Emory University approved this study. All participants provided written informed consent prior to enrollment.
Of 803 men originally enrolled in the study, 562 (70%) had HIV-negative screening results at baseline. Six men were found to be acutely infected with HIV at the three-month visit, leaving 556 men who were truly HIV-negative at baseline and enrolled prospectively. 552 (99%) men had complete data for all covariates and were included in this analysis. Of these men, over the course of the study, 79 (14%) were diagnosed with an incident rectal STI and 26 (5%) men were diagnosed with HIV (Table 1). In 6 men (23%), the incident rectal bacterial STI preceded the HIV infection.
In unadjusted analysis, incident HIV was significantly associated with prior incident rectal bacterial STI (HR (95% CI): 3.6 (1.4, 9.2)).
As expected based on our a priori confounding assumptions (Figure 1), the observational nature of the data resulted in different, but overlapping, distributions of propensity scores between exposure groups (Figure 2). This difference indicates the true confounding potential due to the imbalance in these covariates. However, the overlapping ranges indicates that the propensity model exhibits common support.
Application of IPTW resulted in balanced covariates between exposure groups, including those covariates that were strongly unbalanced in the unweighted data (Tables 2 and 3). The standardized biases for all covariates were below the generally accepted 0.25 threshold, and, with the exception of the standardized bias for RAI, were below the more conservative 0.10 threshold, suggesting minimal differences in the weighted distributions between exposure groups following application of IPTW.
While not all covariates in the propensity model were significantly associated with incident rectal STI (Additional file 2: Table S1), all were retained due to previously observed associations with incident STI and HIV and their association with high-risk sexual networks [18,28-30].
In the final weighted and adjusted model, incident rectal STI was significantly associated with incident HIV (HR (95% CI): 2.7 (1.2, 6.4)). Full Cox PH model results are provided in Additional file 2: Table S2. The weighted, adjusted association was both more precise and attenuated (25% reduction) when compared to the crude HR. The attenuation of the HR following control for confounding is evident in the crude and adjusted survival curves (Figure 3).
Our analysis demonstrates the use of propensity score methods to examine the causal effect of rectal bacterial STI infection on HIV seroconversion. This method accounts for time-varying behavioral confounding and maximizes the information obtained from a limited number of events, permitting observational data to simulate an RCT. We found that, in a cohort of initially HIV-negative MSM, controlling for time-varying risk behaviors and time-invariant demographic factors, diagnosis with HIV was significantly associated with prior diagnosis of rectal STI. Among our sample, the time to HIV infection was significantly decreased in men who had been previously diagnosed with rectal STI, compared to those who had not (Figure 3). Our analysis accounts for the primary time-varying confounder of the rectal STI-HIV association, UAI in the interval of STI diagnosis or censoring, and other time-varying and time-invariant confounders. Adjusting for HIV risk factors in the Cox PH model and weighting by the stabilized propensity score attenuated the association and increased its precision as compared to the crude HR. Therefore, our analysis lends support to the association between incident rectal STI and HIV diagnosis being truly causal.
Associations observed in prior studies, which did not include data on specific high-risk behaviors preceding both STI and HIV diagnoses, could have been confounded by deviations from “typical” behavioral patterns [4,6,7]. Prior studies have also relied on self-reported STI diagnoses . Our analysis addressed these limitations, ensuring that temporal relationships between STI infection and its preceding UAI, between HIV infection and its preceding UAI, and between STI infection and HIV infection are accounted for in the analysis and ensuring that both HIV and STI were diagnosed using biological methods.
These potentially changing patterns of behavior and their inclusion as necessary causes of both our exposure and outcome required the use of more complex methods. Additionally, the relatively small number of seroconversions in our cohort limited the number of covariates that could be included in a Cox PH model . The application of propensity model derived IPTW to a Cox PH model solved these analytic challenges by permitting our observational data to approximate a randomized trial, balancing the two exposure groups (in our case, those with and without rectal STI) on measured confounders . Also, propensity models permitted adjustment for a large number of confounders without their direct inclusion in the model. For time-to-event analyses with a small number of events, IPTW maximizes data available while maintaining balance of measured covariates between exposure groups and producing a minimally biased effect estimate .
While our analysis addressed many issues with prior analyses, limitations remain. The estimation of causal effect requires no unmeasured confounders and inclusion of all confounders without misclassification . UAI in the interval of rectal STI diagnosis is the primary, overriding confounder of the association in that it is the most proximal, direct behavior by which an individual could acquire both a rectal STI and HIV. We also controlled for other weaker confounders, but cannot rule out the possibility of unmeasured confounders. As we have included the primary source of confounding, we believe that the potential for bias due to unmeasured confounding is low.
There is evidence that UAI is misclassified for some participants in our sample. While UAI was significantly associated with incident STI, it was not significantly associated with incident HIV in this analysis (Additional file 2: Tables S1 and S2). Since UAI is a practically necessary cause of both infections, the odds ratio between UAI and HIV should be infinite, yet such estimates are hardly observed in HIV/STI research, suggesting that UAI misclassification is universal [5,7,38-41]. Based on our data, we believe UAI to be underreported among those infected with STI or HIV, but the direction of misclassification among those who are uninfected is unclear. Additional studies understanding misclassification of this critical HIV risk variable in MSM are needed.
Additionally, given our small number of events, we were unable to explore the role of multiple STIs in HIV acquisition, as others have done . As we selected the first instance of rectal STI, rather than accounting for multiple rectal STI diagnoses, our effect estimates are conservative. Future studies should examine individual STIs and combinations of STIs to further refine this association.
In support of prior research, our analysis strongly suggests that rectal bacterial STI may be a cause of HIV infection, and not solely a marker of high-risk behaviors. Packaging STI prevention with HIV prevention in MSM may be effective in reducing incidence of both, despite a lack of success of this approach in heterosexuals .
In this analysis, we have detailed the use of a propensity score weighted Cox PH model, providing a causal framework for future analyses of HIV incidence. By employing this method, we have approximated the gold standard of study design, the RCT, when such a design is impossible. Given the typically small number of events in HIV incidence studies, propensity score weighting permits adjustment for a large number of time-varying covariates that may be on confounding paths, resulting in a precise effect estimate.
Human immunodeficiency virus
Inverse probability of treatment weighting
Men who have sex with men
Receptive anal intercourse
Sexually transmitted infection
Unprotected anal intercourse
Mayer KH, Venkatesh KK. Interactions of HIV, other sexually transmitted diseases, and genital tract inflammation facilitating local pathogen transmission and acquisition. Am J Reprod Immunol. 2011;65:308–16.
Howards PP, Schisterman EF, Poole C, Kaufman JS, Weinberg CR. “Toward a clearer definition of confounding” revisited with directed acyclic graphs. Am J Epidemiol. 2012;176:506–11.
Solomon MM, Mayer KH, Glidden DV, Liu AY, McMahan VM, Guanira JV, et al. Syphilis Predicts HIV Incidence Among Men and Transgender Women Who Have Sex With Men in a Preexposure Prophylaxis Trial. Clin Infect Dis. 2014;59:1020–6.
Bernstein KT, Marcus JL, Nieri G, Philip SS, Klausner JD. Rectal gonorrhea and chlamydia reinfection is associated with increased risk of HIV seroconversion. J Acquir Immune Defic Syndr. 2010;53:537–43.
Buchbinder SP, Glidden DV, Liu AY, McMahan V, Guanira JV, Mayer KH, et al. HIV pre-exposure prophylaxis in men who have sex with men and transgender women: a secondary analysis of a phase 3 randomised controlled efficacy trial. Lancet Infect Dis. 2014;14:468–75.
Jin F, Prestage GP, Imrie J, Kippax SC, Donovan B, Templeton DJ, et al. Anal sexually transmitted infections and risk of HIV infection in homosexual men. J Acquir Immune Defic Syndr. 2010;53:144–9.
Pathela P, Braunstein SL, Blank S, Schillinger JA. HIV Incidence Among Men With and Those Without Sexually Transmitted Rectal Infections: Estimates From Matching Against an HIV Case Registry. Clin Infect Dis. 2013;57:1203–9.
Austin PC. An Introduction to Propensity Score Methods for Reducing the Effects of Confounding in Observational Studies. Multivar Behav Res. 2011;46:399–424.
Røttingen J-A, Cameron DW, Garnett GP. A Systematic Review of the Epidemiologic Interactions between Classic Sexually Transmitted Diseases: HIV How Much Really Is Known ? Sex Transm Dis. 2001;28:579–97.
Sexton J, Garnett G, Røttingen J-A. Metaanalysis and Metaregression in Interpreting Study Variability in the Impact of Sexually Transmitted Diseases on Susceptibility to HIV Infection. Sex Transm Dis. 2005;32:351–7.
Payn B, Tanfer K, Billy JOG, Grady WR. Men’s Behavior Change Following Infection With a Sexually Transmitted Disease. Fam Plann Perspect. 1997;29:152–7.
Fox J, White PJ, Macdonald N, Weber J, McClure M, Fidler S, et al. Reductions in HIV transmission risk behaviour following diagnosis of primary HIV infection: a cohort of high-risk men who have sex with men. HIV Med. 2009;10:432–8.
Fortenberry JD. Post-treatment sexual and prevention behaviours of adolescents with sexually transmitted infections. Sex Transm Infect. 2002;78:365–8.
Kelley CF, Vaughan AS, Luisi N, Sanchez TH, Del Rio C, Sullivan PS, et al. The effect of high rates of bacterial sexually transmitted infections on HIV incidence in a cohort of Black and White men who have sex with men in Atlanta, GA. AIDS Res Hum Retroviruses. 2015: epub ahead of print.
Sullivan PS, Peterson J, Rosenberg ES, Kelley CF, Cooper H, Vaughan AS, et al. Understanding Racial HIV/STI Disparities in Black and White Men Who Have Sex with Men: A Multilevel Approach. PLoS One. 2014;9:e90514.
Portnoy J, Garson W, Smith CA. Rapid Plasma Reagin Test for Syphilis. Public Health Rep. 1957;72:761–6.
Van Der Pol B, Ferrero DV, Buck-Barrington L, Hook III E, Lenderman C, Quinn T, et al. Multicenter Evaluation of the BDProbeTec ET System for Detection of Chlamydia trachomatis and Neisseria gonorrhoeae in Urine Specimens, Female Endocervical Swabs, and Male Urethral Swabs. J Clin Microbiol. 2001;39:1008–16.
Rosenberg ES, Sullivan PS, Kelley CF, Sanchez TH, Luisi N, del Rio C, et al. Race and Age Disparities in HIV Incidence and Prevalence Among MSM in Atlanta, GA. In: Conf Retroviruses Opportunistic Infect. Boston, MA. 2014. p. 108.
Robins JM, Hernán MÁ, Brumback B. Marginal Structural Models and Causal Inference in Epidemiology. Epidemiology. 2013;11:550–60.
Williamson EJ, Forbes A, White IR. Variance reduction in randomised trials by inverse probability weighting using the propensity score. Stat Med. 2014;33:721–37.
Austin PC. The performance of different propensity score methods for estimating marginal hazard ratios. Stat Med. 2013;32:2837–49.
Harder VS, Stuart EA, Anthony JC. Propensity score techniques and the assessment of measured covariate balance to test causal associations in psychological research. Psychol Methods. 2010;15:234–49.
Hernán MÁ, Robins JM. Estimating causal effects from epidemiological data. J Epidemiol Community Health. 2006;60:578–86.
Ho DE, Imai K, King G, Stuart EA. Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference. Polit Anal. 2006;15:199–236.
Normand ST, Landrum MB, Guadagnoli E, Ayanian JZ, Ryan TJ, Cleary PD, et al. Validating recommendations for coronary angiography following acute myocardial infarction in the elderly: a matched analysis using propensity scores. J Clin Epidemiol. 2001;54:387–98.
Imai K, King G, Stuart EA. Misunderstandings between experimentalists and observationalists about causal inference. J R Stat Soc Ser A. 2008;171:481–502.
Austin PC. The relative ability of different propensity score methods to balance measured covariates between treated and untreated subjects in observational studies. Med Decis Making. 2009;29:661–77.
Kelley CF, Rosenberg ES, O’Hara BM, Frew PM, Sanchez TH, Peterson JL, et al. Measuring population transmission risk for HIV: an alternative metric of exposure risk in men who have sex with men (MSM) in the US. PLoS One. 2012;7:e53284.
Newcomb ME, Mustanski B. Racial differences in same-race partnering and the effects of sexual partnership characteristics on HIV Risk in MSM: a prospective sexual diary study. J Acquir Immune Defic Syndr. 2013;62:329–33.
Millett GA, Peterson JL, Flores SA, Hart TA, Jeffries WL, Wilson PA, et al. Comparisons of disparities and risks of HIV infection in black and other men who have sex with men in Canada, UK, and USA: a meta-analysis. Lancet. 2012;380:341–8.
Morgan SL, Todd JJ. A diagnostic routine for the detection of consequential heterogeneity of causal effects. Sociol Methodol. 2008;38:231–81.
Flury BK, Riedwyl H. Standard distance in univariate and multivariate analysis. Am Stat. 1986;40:249–51.
Robins JM. Marginal structural models versus structural nested models as tools for causal inference. In: Halloran E, Berry D, editors. Stat Model Epidemiol Environ Clin trials. New York, NY: Springer; 1999. p. 95–134.
Kleinbaum DG, Klein M. Evaluating the proportional hazards assumption. In: Surviv Anal A, editor. Self-Learning Text. 3rd ed. New York: Springer; 2012. p. 161–200.
Cole SR, Hernán MÁ. Adjusted survival curves with inverse probability weights. Comput Methods Programs Biomed. 2004;75:45–9.
Lanehart RE, de Gil PR, Kim ES, Bellara AP, Kromrey JD, Lee RS. Propensity score analysis and assessment of propensity score approaches using SAS procedures. In: Proc SAS Glob Forum 2012 Conf. Volume 1. Cary, NC: SAS Institute Inc; 2012. p. 314.
Peduzzi P, Concato J, Feinstein A, Holford T. Importance of events per independent variable in proportional hazards regression analysis II. Accuracy and precision of regression estimates. J Clin Epidemiol. 1995;48:1503–10.
Jansen IAV, Geskus RB, Davidovich U, Jurriaans S, Coutinho RA, Prins M, et al. Ongoing HIV-1 transmission among men who have sex with men in Amsterdam: a 25-year prospective cohort study. AIDS. 2011;25:493–501.
Anderson C, Gallo MF, Hylton-Kong T, Steiner MJ, Hobbs MM, Macaluso M, et al. Randomized controlled trial on the effectiveness of counseling messages for avoiding unprotected sexual intercourse during sexually transmitted infection and reproductive tract infection treatment among female sexually transmitted infection clinic patient. Sex Transm Dis. 2013;40:105–10.
Mayer KH, Wang L, Koblin B, Mannheimer S, Magnus M, del Rio C, et al. Concomitant socioeconomic, behavioral, and biological factors associated with the disproportionate HIV infection burden among Black men who have sex with men in 6 U.S. cities. PLoS One. 2014;9:e87298.
Sanders EJ, Okuku HS, Smith AD, Mwangome M, Wahome E, Fegan G, et al. High HIV-1 incidence, correlates of HIV-1 acquisition, and high viral loads following seroconversion among MSM. AIDS. 2013;27:437–46.
Sullivan PS, Carballo-Diéguez A, Coates T, Goodreau SM, McGowan I, Sanders EJ, et al. Successes and challenges of HIV prevention in men who have sex with men. Lancet. 2012;380:388–99.
We gratefully acknowledge the contributions of the InvolveMENt participants and the contributions of many dedicated public health professionals who worked to design, launch and monitor the study, and to provide services to participants.
This work was supported by the National Institutes of Health: K23AI108335 (to CFK), R01MH085600 (to PSS), The Atlanta Clinical and Translational Science Institute UL1TR000454, National Center for Research Resources P51RR169, the Office of Research Infrastructure Programs/OD P51OD11107, and the Emory Center for AIDS Research P30AI050409.
The authors declare that they have no competing interests.
ASV performed all analyses, interpreted results, and wrote the first and final drafts of the paper. CFK and ESR conceived the analysis, interpreted results, and critically revised the manuscript. NL managed and prepared the data. CDR and PSS participated in conception and design of the study and critical revision of the manuscript. All authors read and approved the final manuscript.