 Research article
 Open Access
 Published:
Simulation shows undesirable results for competing risks analysis with timedependent covariates for clinical outcomes
BMC Medical Research Methodology volume 18, Article number: 79 (2018)
Abstract
Background
We evaluate three methods for competing risks analysis with timedependent covariates in comparison with the corresponding methods with timeindependent covariates.
Methods
We used causespecific hazard analysis and two summary approaches for inhospital death: logistic regression and regression of the subdistribution hazard. We analysed real hospital data (n=1864) and considered pneumonia on admission / hospitalacquired pneumonia as timeindependent / timedependent covariates for the competing events ’discharge alive’ and ’inhospital death’. Several simulation studies with timeconstant hazards were conducted.
Results
All approaches capture the effect of timeindependent covariates, whereas the approaches perform differently with timedependent covariates. The subdistribution approach for timedependent covariates detected effects in a simulated noeffects setting and provided counterintuitive effects in other settings.
Conclusions
The extension of the Fine and Gray model to timedependent covariates is in general not a helpful synthesis of the causespecific hazards. Causespecific hazard analysis and, for uncensored data, the odds ratio are capable of handling competing risks data with timedependent covariates but the use of the subdistribution approach should be neglected until the problems can be resolved. For general rightcensored data, causespecific hazard analysis is the method of choice.
Background
Competing events occur frequently in timetoevent studies in clinical epidemiology [1]. For instance, discharge is a competing event for hospital death since discharged patients are usually in a better health condition (with improved survival) than hospitalized patients. It is common that there are timedependent covariates in combination with competing events. A widely discussed topic is hospitalacquired infections (a timedependent covariate) and their effect on the risk of dying in the hospital (discharge as a competing event) (see e.g. [2]). The first step in such settings is to conduct a causespecific hazard (CSH) analysis and to infer the effect from these findings.
The subdistribution by Fine and Gray is commonly used to determine how one of many competing outcome probabilities is affected by timeindependent covariates [3]. The subdistribution offers an easy way to receive a summary analysis of all CSH’s and reestablishes the useful onetoone relationship with the cumulative incidence function. For timedependent covariates, the analysis gets more involved and the standard model by Fine and Gray does not hold anymore [4]. Beyersmann and Schumacher offered a solution for using the subdistribution in a timedependent framework [5]. This approach and further extensions are used in current literature to assess the influence of a timedependent covariate on the event of interest [6–9].
In this paper, we consider a hospital setting with pneumonia on admission/hospitalacquired pneumonia (HAP) as timeindependent/timedependent covariates for the competing events ’discharge alive’ and ’inhospital death’ with timeconstant hazards. First, we present our real data example and reassess the benefits of a CSH analysis and two types of synthesis of the causespecifc analyses: the logistic regression and the regression of the subdistribution hazard by Fine and Gray in a timeindependent framework. We profit here from the specific situation in hospital epidemiology where survival analysis is used to investigate timedependent events, but where followup is essentially complete. Thus, logistic regression may be applied.
Then, we describe the CSH analysis, the logistic regression, and the subdistribution approach by Beyersmann and Schumacher applied in this timedependent scenario thoroughly. We give a summary table of the expected properties in both a timeindependent and a timedependent framework. For further understanding, we conduct several simulation studies to study the performance more thoroughly. In conclusion, we summarize the findings of this paper as well as discuss the properties and results from the simulation study of the different approaches.
Methods
As already mentioned, a common example of a timedependent competing risks setting is a hospitalacquired infection, e.g. pneumonia, and its effect on hospital death and discharge alive. Therefore, we will consider a binary timeindependent covariate with values in {0, 1}, incorporating pneumonia on admission in the following way: 0 as the absence of a pneumonia (risk factor) and 1 as the presence of pneumonia (risk factor). Note, that we will not model recovery. In other words, the covariate value will not change back to 0 when the patient recovers from pneumonia and patients in state 1 are inhospital pneumonia patients in the sense that pneumonia has occured in the past. The competing events are death in the hospital (3, 5 respectively) and discharge alive (2, 4 respectively). Additionally, no censoring will be modeled. This mimics a realistic setting in hospital data, since censoring is in general uncommon. Most of the patients will be followed until their death in the hospital or until their discharge (alive). The censoring is exclusively administrative and typically negligible. The corresponding 6state multistate model in a timedependent setting can be seen in Fig. 1(top). The bottom part displays the corresponding subdistribution process.
Real data example
The data set is from the SIR 3 (Spread of nosocomial Infections and Resistant pathogens) cohort study conducted at the Charité university hospital in Berlin, Germany [10]. Patients were followed until discharge or death in the hospital; there was no followup beyond discharge. It is the same data set that Beyersmann and Schumacher used in their paper to study the usefulness of the subdistribution approach [5].
For illustrative purposes, we removed the censored individuals (n =30 (1.6%)) to obtain a complete data set that suits our assumed setting. This is why our results differ slightly from the ones obtained by Beyersmann and Schumacher. The impact of pneumonia on admission (timeindependent) and HAP (timedependent covariate) on the risk of dying in the hospital is investigated; discharge alive is the competing event for inhospital death as discharged patients have an improved survival compared to hospitalized patients.
In the data set, there were 1876 admissions to the hospital, 30 of those were censored, which leaves 1846 patients in the data set. Two hundred eight patients were admitted with pneumonia of which 160 were discharged alive. The remaining 48 patients died in the hospital. In total, 1638 patients were admitted without pneumonia. Of these, 1472 were discharged alive and 166 died in the hospital.
With respect to HAP, of the uncensored 1846 individuals, 151 developed a pneumonia in the hospital. Of those, 33 died in the hospital and 118 were discharged alive. Of the 1695 patients who didn’t acquire pneumonia in the hospital, 1514 patients were discharged alive and 181 patients died during their stay.
Simulated data
For studying the performance of the different approaches, we used the following simulation technique. Throughout this paper, we assume constant hazards. In the simulation studies we simulated 100 data sets with 10000 individuals to see if the methods provide accurate results on average. For the simulation of timeindependent covariates, we have a classical competing risks setting with two risk factor groups (’pneumonia on admission’ yes or no). For illustration, we assume timeconstant hazard rates. Thus we have following hazards: discharge hazard of patients without pneumonia on admission (α_{02}), inhospital death hazard of patients without pneumonia on admission (α_{03}) and the corresponding hazards (α_{14}, α_{15}) for patients with pneumonia on admission. We simulated data according to the procedure in the book by Beyersmann [11]. That is, for patients without pneumonia, length of stay was simulated with an allcause hazard α_{02}+α_{03}, resulting in inhospital death with probability \(\frac {\alpha _{03}}{(\alpha _{02} + \alpha _{03})}\).
For the timedependent setting, we simulated individuals in the 6state multistate model as a nested sequence of competing risks processes as described in [11]. That is, all patients start in state 0 and we simulate the first transition as a competing risk experiment between states 2, 3, and 1 with allcause hazard α_{01}+α_{02}+α_{03} for simulation of length of stay, e.g. resulting in a pneumonia with probability \(\frac {\alpha _{01}}{(\alpha _{01} + \alpha _{02} + \alpha _{03})}\). Since the states 2 and 3 are absorbing, the experiment is over for all patients that make a transition into one of these states. If however, the patient moved into state 1, we conduct another competing risks experiment between states 4 and 5 with an allcause hazard α_{14}+α_{15}. Since both states are absorbing, the simulation ends, once all individuals make a transition into one of these states. The R code used for simulation and analysis of the data is supplied as Additional file 1.
Competing risk analysis for timeindependent covariates
Causespecific hazard analysis for discharge (alive) and inhospital death
The classical approach to investigate the binary timeindependent covariate "pneumonia on admission" would be to conduct a CSH analysis for both competing events, death and alive discharge. Then, one would compare the hazard ratios (HR) of both events in order to assess the impact of the covariate. For timeconstant hazards, it is
for pneumonia vs. no pneumonia on admission. Such a causespecific analysis gives insights into effects on the instantaneous (i.e. daily) risk of dying in the hospital and being discharged from the hospital. Both HR’s have to be interpreted sidebyside for each risk factor. As it is an instantaneous risk approach and discharge is a competing event for inhospital death, it provides no direct insights into the cumulative risk of dying in the hospital. Cumulative approaches are presented in the following two sections.
Logistic regression for inhospital death
In a simple logistic regression model, one studies the effect of the binary timeindependent covariate pneumonia on admission on the cumulative risk of inhospital death at the end of followup. In other words, the odds ratio (OR) compares the cumulative risk of inhospital death on the plateau of the cumulative incidence functions. The odds for inhospital death at the end of followup for patients with pneumonia on admission is given through
and the odds for inhospital death at the end of followup for patients without pneumonia on admission is
as can be seen in [2, 12]. Then, the OR in our scenario with constant hazards is the quotient of the HR of the event of interest, death, and the one for the competing event, discharge, and resolves to
An OR greater than 1 implies a higher risk of experiencing the event of interest, here inhospital death, for patients with the risk factor pneumonia. Contrarily, an OR smaller than 1 connotes a lower risk of inhospital death for patients with pneumonia on admission. Looking at the formula of the OR, we see that both causespecific HR’s are involved. For example, an HR for discharge of less than 1 and an HR for death of 1 would lead to an OR greater than 1 and to the interpretation of a higher risk of dying for patients with pneumonia on admission.
Summarizing, the OR together with the CSH analysis is able to capture both indirect (effects through the competing hazard) and direct effects of the covariate if one additionally considers the baseline hazard. It has a probability interpretation and an easytocommunicate way to assess the effect. It is not a direct probability measure, but a function thereof. Yet, it does not allow for censoring, does not account for timetoevent, and is only able to display effects on a cumulative incidence function on a plateau.
The subdistribution approach for inhospital death
The subdistribution by Fine and Gray offers an easy way to receive a summary analysis of all CSH’s by introducing a subdistribution hazard [3]. The subdistribution hazard is the hazard that is directly linked to the cumulative incidence function. For estimation, Fine and Gray stop individual trajectories with the occurence of a competing event. In other words, the patients experiencing a competing event stay in the risk set forever. This leads to the subdistribution hazard being smaller than the CSH since the risk set is artificially inflated. The higher the competing hazard, the more patients experience a competing event and the more the subdistribution hazard is lowered in comparison to the CSH.
To analyze the effect of a covariate, one would look at the subdistribution hazard ratio (SHR) of the event of interest, here death, and get a direct reflection of the effect of the covariate on the probability of the event of interest. A SHR of greater than 1 would imply a higher risk of dying in the hospital with pneumonia on admission. A SHR of 1 would imply no effect and a SHR of less than 1 connotes a lower risk of dying in the hospital with pneumonia on admission. It is an easytocommunicate summary analysis of all CSH’s. The SHR quantifies the effect which is seen in the cumulative incidence functions (over the time in hospital). A crucial point of criticism is the lack of a exact interpretation and the misspecificcation cause through proportional CSHs not implying proportional subdistributions in general [13, 14]. The properties of the subdistribution in comparison with logistic regression are summarized in Table 1. Next, we will explain the analysis when timedependent covariates are involved.
Competing risk analysis for timedependent covariates
We will now consider HAP as a timedependent binary covariate. This again includes a multistate model with two competing risks, death and discharge (alive), and only one binary timedependent covariate, HAP (see Fig. 1 top). A patient is admitted to the hospital and can either be discharged alive or die (with or without experiencing an HAP). Thus, we additionally obtain the hazard α_{01} to acquire HAP.
Causespecific hazard analysis for discharge (alive) and inhospital death
As for timeindependent covariates, the CSH analysis should always be part of the investigation [15]. This includes looking at the HR’s for death and discharge. Analogously, separate Cox models will be applied to each competing event with the only difference that the covariate is now timedependent. See the timeindependent case for details on the interpretation of the results of the Cox model.
Logistic regression for inhospital death
Again, at the end of hospital stay means that the internal timedependency within the hospital is ignored. We denote P(inhospital deathwith HAP) and P(inhospital deathwithout HAP) as the probability of inhospital death at the end of hospital stay for patients with and without an HAP, respectively. As HAP develops over time, these probabilities are not simple. According to Cube et al. [12], with α_{0}=α_{01}+α_{02}+α_{03} and α_{1}=α_{14}+α_{15} and the state occupation probabilities P_{0j}(t)=P(in state j at time t), the respective timedependent versions are
and
For timeconstant hazards, Cube et al. recently showed [12] that these become the limits of their timedependent versions and resolve to
and
With similar arguments as in the timeindependent setting, this includes analyzing the OR for the event of interest, i.e. death,
which consists of analyzing the quotient of the two death odds
and
[2, 12]. Logistic regression does not allow for censoring. This is not an acute issue in hospital data since there usually is very little censoring, but has to be taken into account in more general settings. The OR is easy to analyze and the interpretation of the OR stays the same as in the previous sections. The OR is a summary analysis of all CSHs and catches the effect of the timedependent covariate very well. The properties can also be seen in Table 1. Other than the fact that logistic regression does not allow for censoring, it has many of the perks desired in an approach in a timedependent competing risks framework. Summarizing, it offers an easytocommunicate summary analysis which is independent of the infection hazard and has a probability interpretation. It is questionable whether not including the infection hazard holds enough information to describe a timedependent setting with a plausible probability interpretation. As we will see later, including the infection hazard might also be problematic.
The subdistribution approach for inhospital death
In 2008 [5] Beyersmann and Schumacher extended the Fine and Gray model to timedependent covariates by modeling competing events and the values of a categorical timedependent covariate in one multistate model. Even though the cumulative incidence function for timedependent covariates is not clearly defined, the aim of this approach is to achieve a synthesis of the CSH analysis. The idea of Beyersmann and Schumacher is to transform the 6state multistate model in Fig. 1 (top) into a subdistributiontype model that can be seen in Fig. 1 (bottom) corresponding to the scenario in the timedependent setting. The subdistributiontype process (bottom) leaves individuals who experience a competing event in the risk set of the previous occupied state. In our example, an individual would stay in state 0 or 1 after experiencing a competing event. This alters the risk sets considerably, keeping individuals with a competing event at risk forever as in the Fine and Gray approach, and will be a topic of a discussion later on. This means that the subdistribution will be composed of state 0 and state 1 with the difference that a transition out of state 0 and into state 1 is possible, that is late entry in state 1 and exit to a nonabsorbing state from state 0. An issue resulting from this is the risk set in state 1 has to build up first. The covariate process will be stopped at the last known value. As a consequence of this, the same covariate is analyzed in a standard Cox model and in an extended Fine and Gray model, that is the stopped covariate process Z↦Z(t∧T), where t∧T is the minimum of the time t and the length of stay T. Therefore, Beyersmann and Schumacher introduced a timedependent covariate in a competing risks setting by combining the multistate with the subdistribution framework. This approach provides one quantity, the SHR, that measures the impact of the covariate on the event of interest directly and is easy to communicate to statisticians and nonstatisticians. Analogous to the timeindependent setting, the exact interpretation remains unresolved and is the subject of ongoing discussion [13]. Furthermore, proportional CSH’s do not in general imply proportional subdistributions [14].
Results
First, we analyzed the SIR 3 data set according to the three different approaches with respect to pneumonia on admission and additionally with respect to HAP. The results are summarized in the upper part of Table 2. The estimated constant hazards can also be found in this table. The results of the simulation study will be presented on the bottom of this table and the resulting properties will be compared in Table 1.
Pneumonia on admission
The Cox analysis of the CSH’s showed no effect of pneumonia on admission on the hazard to die in the hospital (HR(death) =1). Additionally, analysis showed a HR for discharge of 0.44. Patients with pneumonia on admission have a lower instantaneous (i.e., daily) chance of getting discharged alive compared with patients without pneumonia on admission and are therefore being exposed to the risk of dying in hospital for a longer time, each day anew. This indirect effect make patients with pneumonia on admission eventually die more frequently in the hospital compared with patients without pneumonia on admission. Thus, the cumulative risk to die in the hospital is indirectly increased due to their prolonged length of stay. It would be useful to receive a summary analysis via logistic regression or the SHR. The OR in this data set takes value 2.66, the SHR value 2.37, and they are both able to catch and summarize the effect of pneumonia on admission on the risk of death very well. Since the effect on the discharge hazard is pretty distinct, it is not surprising to have values higher than 2.
Hospitalacquired Pneumonia
The HR for death is 0.9 (the 95% confidence interval includes 1) and the one for discharge takes value 0.59. Therefore, the situation is similar (even though less pronounced) to the one in the timeindependent setting, but the risk sets behave differently, which we illustrated in Fig. 2. There is no significant effect on the death hazard, but the discharge hazard is reduced for individuals who experienced pneumonia in the hospital. The OR is comparable to the timeindependent setting and takes value 2.34, whereas the SHR is considerably higher compared to the one in the timedependent setting with a value of 3.44. This is surprising since the initial situation is similar in the two scenarios with respect to the hazards into the absorbing states. Furthermore, the SHR in the timedependent setting compared to the one in the timeindependent setting is considerably higher. We further investigated this unexpected result by simulation.
In Fig. 2, a clear difference in the risk sets can be seen immediately. In the timeindependent setting, all patients already have their final covariate value, 0 or 1, and the risk sets only shrink during the process when patients make a transition into an absorbing state.
In the timedependent setting, all individuals start in the intitial state 0, whereas the risk set in state 1 is empty and individuals have to make the transition into state 1 before they appear in the risk set and are then under the influence of the hazards of transitions out of state 1. Therefore, the curves of the risk sets in both the original multistate model and the subdistribution model are quite different, and the risk sets in state 0 and in state 1 change in a different manner by moving to the subdistribution process. The risk set in state 0 in the subdistribution approach is bigger than the corresponding risk set in the multistate model. In contrast, the risk sets of the infected individuals are almost equal just after the initial time.
Simulation studies
First, we wanted to study a similar situation as the situation in the SIR 3 data in the timeindependent and the timedependent setting. This is why we simulated a new data set with those constant hazards that we approximately estimated from the SIR 3 study (Scenario 0). As we can see, the trend of the results does not change. The approaches capture the underlying true value in the timeindependent setting very well and both the OR and the SHR produce similar results, which was already found by Beyersmann [16]. Again, the SHR is rather large.
Next, we wanted to mimic this setting in a noeffect model (Scenario 1). We would expect all of the effect measures to be 1 or at least the confidence intervals to include 1 independent of the timedependency. As we can see, the timeindependent setting delivers the expected results. In the timedependent setting, the SHR takes value 1.91 and would lead to the false conclusion of HAP having a pronounced effect on the death risk, although we assumed a noeffect model.
This is an undesirable artefact and has to be investigated further. Therefore, we chose three additional scenarios (Scenario 2−4 in Table 2) with different tendencies of the effects. Scenario 2 only has an effect on the death hazard, which is higher for patients with either type of pneumonia. Again, the timeindependent simulation showed the desired results as it will do in the next scenarios, whereas the SHR with a value of 3.57 is rather large. In scenario 3, pneumonia is set to have a slight effect on the death hazard, which is reduced out of state 1. Here, the SHR of the timedependent setting does not produce a useful result, since it is returning a value that would lead to the false conclusion of pneumonia having a negative effect on the event of interest, death. Similar to scenario 3, scenario 4 has an indirect effect on the risk of dying, which is obtained via an increased discharge hazard for patients with pneumonia. Again, only the SHR in the timedependent setting arises suspicion in leading to the false conclusion that pneumonia has a negative effect. These results are not plausible and leaves to the acute need for clarification of the problems.
We simulated data in a different initial model but obtained similar undesirable results. To further investigate the effect of a hazard on the misperformance, we altered its value around the initial value of the hazard while keeping the other hazards fixed as in the initial model and took a look at the returned SHR. Higher values of α_{14},α_{02} respectively, lead to less plausible, in the sense of closer to the real value 1, results, whereas higher values of α_{15},α_{03} respectively, lead to more plausible results. The results with varying infection hazard, α_{01}, will be presented in the next section.
The infection hazard
With higher infection hazards, there is no clear trend in performance observable, though a very small infection hazard leads to more plausible results than with a distinct infection hazard. We investigated this with another simulation study, where only the infection hazard α_{01} was varied, whereas all others were kept constant at the values of the initial model. The idea was to downsize the lefttruncation. Therefore, we cut the initial infection hazard of value 0.05 at a predefined time point. There is a tendency of values closer to value 1 for cutting the infection hazard sooner. The earlier the internal lefttruncation is curtailed, the closer the setting is to the timeindependent case. This indicated that the infection hazard is pivotal in the subdistribution approach with timedependent pneumonia status. We summarized the properties in Table 1 and discuss the undesirable findings in the next section.
Discussion
We found the subdistribution approach returning unexpected effects in a simple simulation study with constant hazards, whereas the simple adhoc logistic regression returned reasonable results. The subdistribution approach detected effects in a simulated noeffects setting and provided counterintuitive effects in other settings.
To our knowledge, this misperformance did not arouse suspicion in hospital epidemiology. It is very common that hospitalacquired infections are associated with an decreased discharge hazard (α_{14}<α_{02}) and not associated with the death hazard (α_{15}≈α_{03}). One would therefore expect an indirect effect of hospitalacquired infections on hospital mortality due to an extended lengthofstay and prolonged exposure to the death hazard. Thus, a SHR >>1 would be expected and it is not surprising that the subdistribution approach was not questioned in that scenario. In that matter, a current article by van Vught et. al. arouse our attention [7], where the SHR was used for the investigation of the timedependent covariate hospitalacquired infections and multiple medical interventions and seemed to mirror the underlying true values very well. This can be explained by a similar setting to our simulation study, where we reduced the infection hazard. Patients that are in the hospital for at least two days are included in the study. Since the patients are already in the hospital for two days before they are included in the study and most of the interventions, e.g. mechanical ventilation, happen before that time, the internal lefttruncation is very limited. Most people that get an intervention during their stay are already in state 1 when they are recorded in the study and only few of them make the transition after they are included in the study. Since this setting is closer to a timeindependent setting and the internal lefttruncation is cut early, it is plausible that the SHR seems to capture the underlying true values very well as seen in our simulation study.
During simulations, the internal lefttruncation aroused suspicion and this example would underline the effect of better results with an earlier curtailed lefttruncation. As we saw, cutting the infection hazard earlier lead to more plausible results and explains why van Vught et al. found plausible subdistribution results.
Additionally internal lefttruncation leads to a risk set shift, in which the risk sets in the initial states representing covariate values behave in a different manner with timedependent covariates than they do with timeindependent covariates especially in the beginning of the study (recall Fig. 2).
If the competing discharge hazard is very small, the subdistribution hazard is close to the CSH of death and therefore the subdistribution approach can capture the noeffect model more easily. Vice versa, the higher the death hazard, the more patients leave the risk set ultimately and the subdistribution and the CSH are closer. The results of the simulation study confirm these considerations as the SHR was more plausible with higher death hazards and lower discharge hazards, respectively.
These are strong indicators that the internal lefttruncation and the resulting risk set shift might cause the misperformance of the subdistribution approach. A weighting technique by Geskus [17] delivered promising results when applied to the subdistribution approach. Right now, we are still working on the theoretical background to support our findings. In a noeffect model, the weighting produced plausible results and even for a model with a distinct effect of the timedependent covariate the results were more plausible. It is a promising start but has to undergo more theoretical considerations before this weighted subdistribution approach can be used in clinical practice. Another adjusted SHR was used by Ong et. al. to approach this problem more implicitly [18].
Another issue that cannot be neglected is the misspecification of the model assumptions as already discussed by Grambauer et. al. [14]. The proportional hazards assumption for the CSH’s or the subdistribution hazards usually preclude each other. Grambauer et. al. showed that the analysis still offers an useful summary analysis even if the model is misspecified. The possible problems in the subdistribution approach caused by misspecification should not be neglected anyhow. However, the timedependent case leads to more problems than already present in the timeindependent case. We have not investigated the situation of multiple timedependent covariates, yet conjecture that the difficulties translate to multiple regression.
Summarizing, the subdistribution approach has shown undesireable results in several simulation studies and the use of the approach should be neglected until this issue has been resolved. Alternatives and thorough discussion of timedependent covariates in a competing risks setting can also be found in a paper by Cortese et. al. [19]. Since the theoretical background is not fully resolved yet, we strongly recommend avoiding the use of the subdistribution approach for assessing the effect of a timedependent covariate. In hospital epidemiology, we recommend the use of logistic regression in combination with a CSH analysis instead. This recommendation expands to the case of nonconstant hazards. It has useful properties (Table 1) and an easytocommunicate interpretation. It holds the advantages that we would wish for in a model and the simulation performance is good. Since censoring is not a big issue in the setting of hospitalacquired infections, this lack of allowance for censoring can be accepted as long as no better alternatives are at hand.
Conclusions
This manuscript shows that the proposed extension of the subdistribution approach to timedependent covariates is in general not a helpful synthesis of the CSH analysis. The causespecific hazards should be the primarily analyzed, potentially followed by logistic regression as a simple adhoc analysis in the presence of no censoring to synthesize the causespecific hazard analyses. The use of the subdistribution approach for timedependent covariates requires methodological improvements before application.
Abbreviations
 CSH:

causespecific hazard
 HAP:

hospitalacquired pneumonia
 HR:

hazard ratio
 OR:

odds ratio
 SHR:

subdistribution hazard ratio
References
 1
Walraven C, Davis D, Forster A, Wells G. Timedependent bias was common in survival analyses published in leading clinical journals. J Clin Epidemiol. 2004; 57(7):672–82.
 2
Wolkewitz M, Cube M, Schumacher M. Multistate Modelling to Analyse Nosocomial Infection Data: an Introduction with Demonstration. Infect Control Hosp Epidemiol. 2017; 38(8):953–9. https://ddoi.org/10.1017/ice.2017.107.
 3
Fine J, Gray R. A proportional hazards model for the subdistribution of a competing risk. J Am Stat Assoc. 1999; 94(446):496–509.
 4
Latouche A, Porcher R, Chevret S. A note on including timedependent covariate in regression model for competing risks data. BMJ. 2005; 47(6):807–14.
 5
Beyersmann J, Schumacher M. Timedependent covariates in the proportional subdistribution hazards model for competing risks. Biostatistics. 2008; 9(4):765–76.
 6
Klouwenberg P, Zaal I, Spitoni C, Ong D, Kooi A, Bonten Mea. The attributable mortality of delirium in critically ill patients: prospective cohort study. BMJ. 2014;349.
 7
Vught L, Klouwenberg P, Spitoni C, Scicluna B, Wiewel M, Horn Jea. Incidence, risk factors, and attributable mortality of secondary infections in the intensive care unit after admission for sepsis. JAMA. 2016; 315(14):1469–79.
 8
Dautzenberg M, Wekesa A, Gniadkowski M, Antoniadou A, Giamarellou H, Petrikkos Gea. The association between colonization with carbapenemaseproducing enterobacteriaceae and overall icu mortality. Crit Care Med. 2015; 43(6):1170–7.
 9
Ong D, Bonten M, Spitoni C, Lunel F, Frencken J, Horn Jea. Epidemiology of multiple herpes viremia in previously immunocompetent patients with septic shock. Clin Infect Dis. 2017; 64(9):1204–1210.
 10
Grundmann H, Beyersmann J, Gastmeier P, Bärwolff S, Geffers C, Behnke Mea. Risk factors for the development of nosocomial pneumonia and mortality on intensive care units: application of competing risks models. Crit Care. 2008; 12(2):44.
 11
Beyersmann J, Allignol A, Schumacher M. Competing Risks and Multistate Models with R, 1. aufl. edn. Berlin Heidelberg: Springer; 2011.
 12
Cube M, Schumacher M, Wolkewitz M. Basic parametric analysis for a multistate model in hospital epidemiology. BMC Med Res Methodol. 2017; 17(1):111.
 13
Andersen P, Keiding N. Interpretability and importance of functionals in competing risks and multistate models. Stat Med. 2012; 31(1112):1074–88.
 14
Grambauer N, Schumacher M, Beyersmann J. Proportional subdistribution hazards modeling offers a summary analysis, even if misspecified. Stat Med. 2010; 29(78):875–84.
 15
Latouche A, Allignol A, Beyersmann J, Labopin M, Fine J. A competing risks analysis should report results on all causespecific hazards and cumulative incidence functions. J Clin Epidemiol. 2013; 66(6):648–53.
 16
Beyersmann J. Classical regression models for competing risks In: Klein JP, vanHouwelingen HC, Ibrahim JG, editors. Handbook of Survival Analysis. Scheike, TH. Boca Raton: CRC Press: 2014. p. 656.
 17
Geskus R. Causespecific cumulative incidence estimation and the fine and gray model under both left truncation and right censoring. Biometrics. 2011; 67(1):39–49.
 18
Ong D, Bonten M, Safdari K, Spitoni C, Frencken J, Witteveen Eea. Epidemiology, management, and riskadjusted mortality of icuacquired enterococcal bacteremia. Clin Infect Dis. 2015; 61(9):1413.
 19
Cortese G, Andersen P. Competing risks and timedependent covariates. BMJ. 2010; 52(1):138–158.
 20
Allignol A. Kmi: KaplanMeier Multiple Imputation for the Analysis of Cumulative Incidence Functions in the Competing Risks Setting. R package version 0.5.1. https://CRAN.Rproject.org/package=kmi.
Acknowledgements
The article processing charge was funded by the German Research Foundation (DFG) and the Albert Ludwigs University Freiburg in the funding programme Open Access Publishing. This work is on behalf of COMBACTEMAGNET Consortium.
Funding
This work has been funded by the German Research Foundation (Deutsche Forschungsgemeinschaft) (grant No. WO 1746/11); MW received this funding. This research project also receives support from the Innovative Medicines Initiative Joint Undertaking under grant agreement No. 115737 resources of which are composed of financial contribution from the European Union Seventh Framework Programme (FP7/20072013) and EFPIA companies in kind contribution. The research leading to these results was conducted as part of the COMBACTEMAGNET consortium. For further information please refer to www.COMBACTE.com.
Availability of data and materials
The main part of the data (1421 of 1876 patients, 75.7%) is publicly available in the Rpackage kmi [20]. The statistical code is provided as supplementary material.
Author information
Affiliations
Contributions
MW, MS, JB and IP were involved in the development of the concept and provided substantial advice on drafts of the paper. MW, MS and IP carried out the literature search. IP wrote the first draft of the paper and conducted all necessary analyses. MW, MS, JB and IP contributed to critical revisions of the paper and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file
Additional file 1
Zip file of R code used in the analyses. (ZIP 8 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License(http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver(http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Poguntke, I., Schumacher, M., Beyersmann, J. et al. Simulation shows undesirable results for competing risks analysis with timedependent covariates for clinical outcomes. BMC Med Res Methodol 18, 79 (2018). https://doi.org/10.1186/s1287401805355
Received:
Accepted:
Published:
Keywords
 Timedependent covariates
 Subdistribution approach
 (Internal) lefttruncation
 Fine and gray model