 Research article
 Open access
 Published:
The use of restricted mean time lost under competing risks data
BMC Medical Research Methodology volume 20, Article number: 197 (2020)
Abstract
Background
Under competing risks, the commonly used subdistribution hazard ratio (SHR) is not easy to interpret clinically and is valid only under the proportional subdistribution hazard (SDH) assumption. This paper introduces an alternative statistical measure: the restricted mean time lost (RMTL).
Methods
First, the definition and estimation methods of the measures are introduced. Second, based on the differences in RMTLs, a basic difference test (Diff) and a supremum difference test (sDiff) are constructed. Then, the corresponding sample size estimation method is proposed. The statistical properties of the methods and the estimated sample size are evaluated using Monte Carlo simulations, and these methods are also applied to two real examples.
Results
The simulation results show that sDiff performs well and has relatively high test efficiency in most situations. Regarding sample size calculation, sDiff exhibits good performance in various situations. The methods are illustrated using two examples.
Conclusions
RMTL can meaningfully summarize treatment effects for clinical decision making, which can then be reported with the SDH ratio for competing risks data. The proposed sDiff test and the two calculated sample size formulas have wide applicability and can be considered in real data analysis and trial design.
Background
Competing risks arise frequently in many applications in medical studies. In a competing risks setting, patients may fail due to multiple causes. The most commonly researched endpoint is recorded as the event of interest; other endpoints, whose occurrence may preclude the occurrence of the event of interest, are recorded as competing events [1]. When competing risks exist, the KaplanMeier estimation tends to overestimate the cumulative incidence function, which may cause large errors and lead to incorrect conclusions [2, 3]. The commonly used measures in the present competing risks data analysis are the cumulative incidence function (CIF), subdistribution hazard (SDH), and causespecific hazard (CSH) [4, 5]. CIF curves are used to describe or explore patients’ trend of survival in cases of competing risks, and the measures of treatment effect corresponding to the SDH and CSH are the subdistribution hazard ratio (SHR) and causespecific hazard ratio (CHR), respectively. Lau et al. [3] pointed out that the CHR regards competing events as right censored and is more suitable for epidemiologic studies, while the SHR is good at estimating risk factors and treatment effects, which makes it more applicable in clinical studies. Thus, the SHR is given as the commonly used descriptive index for the comparison of CIFs between groups. However, the SHR also has limitations in some applications: i) the most commonly used method, the Gray test [6], needs to satisfy the proportional SDH assumption [7]; ii) normally, the descriptive statistic used for competing risks data is the CIF curve; however, the statistical inference is the Gray test based on the SDH; thus, the statistical description and statistical inference do not match exactly; iii) when the SHR is used to summarize the treatment effect, the test framework contains only an SHR of the treatment group vs. the control group instead of the SDH for each group. Without baseline (control group) information, the SHR may be a relatively abstract concept for patients [8, 9]; iv) the estimation of the SDH is based on conditional probability, so that the SHR does not reflect the risk ratio of two groups, which complicates the interpretation of survival outcomes [10].
Based on the above limitations of the SHR, the median time can reflect the effect of survival, but only on a single time point, which is not a meaningful way to summarize the effect on patients over a time period. Calkins et al. [11] referred to the concept of the restricted mean survival time under competing risks (RMSTc), which is based on the restricted mean survival time (RMST) [12, 13] spent in a state free of composite events. However, the simple use of composite endpoints may not have clinical meaning [14]. In addition, the RMSTc causes the loss of accuracy regarding the event of interest, and the result can be simplified to the RMST based on the single endpoint by taking all events as one composite event.
Anderson [15] defined the number of life years lost under competing risks settings and proposed a regression model based on pseudovalue observations. Zhao et al. [16] introduced the restricted mean time lost (RMTL), which corresponds to the area under the CIF curve of the event of interest and represents the average of the lost time for the event of interest within a specific restricted period of time.
This paper develops statistical methods based on the RMTL that can avoid the limitations of the SHR and RMSTc. The paper is organized as follows. Section 2 presents the definition and estimation of measures based on the hazard, the RMTL, and the corresponding hypothesis tests and sample size formulas. In Section 3, we conduct simulation studies to assess the impact of the proposed tests. Two examples are used to illustrate the proposed methods in Section 4. Section 5 provides a discussion of our research.
Methods
Assume a randomized study with n patients in two groups (k = 1,2). The timetoevent and censoring times are denoted by T = t_{i}, i = 1, 2, …, n and C, respectively. For simplicity, we assume that C is independent of T. τ is the truncation time point, also called the cutoff time point. Without loss of generality, two endpoints are assumed in this research: one event of interest (j = 1) and one competing event (j = 2). Let I_{1}(t) and I_{2}(t) be the CIFs for the event of interest and competing event, respectively. Based on the nonparametric maximum likelihood estimation of the CIF, the estimate of CIF I_{j}(t) is \( {\hat{I}}_j(t)=\sum \limits_{t_i\le t}\left({d}_{ij}/{n}_i\right)\hat{S}\left({t}_{i1}\right) \), where d_{ij} is the number of events of type j that occur at time t_{i}, the number of individuals at risk at t_{i} is denoted by n_{i}, and \( \hat{S}(t) \) is the KaplanMeier estimate when all events (both j = 1 and j = 2) are considered.
Descriptive analysis
Existing measure based on the CSH and SDH
Both the CSH and the SDH are hazardrelated measures. Under competing risks, the CSH of an event of interest is defined as
which indicates the patients’ hazard of the event of interest at t without any prior event. The corresponding descriptive measure CHR is the ratio of the CSHs of two groups.
The SDH of an event of interest is given by
which describes the patients’ hazard of the event of interest at t only without previously having experienced the event of interest. The corresponding descriptive measure SHR is the ratio of the SDHs of two groups.
In formulas (1) and (2), the main difference between the CSH and SDH is the number of individuals at risk. For the CSH, the number at risk at t includes only patients who do not experience any type of event, while the number at risk of the SDH includes patients who do not experience the event of interest while still including patients who have experienced competing events.
Alternative measure based on the RMTL
The RMTL of the event of interest is defined as \( \mathrm{RMTL}={\int}_0^{\tau }{I}_1(t) dt \) [15, 16]. Then, based on the CIF estimation of the event of interest, \( {\hat{I}}_1(t) \), the estimate of the RMTL is given by
and the estimated variance in \( \hat{\mathrm{RMTL}} \) is
where \( E\left({\hat{\mathrm{RMTL}}}^2\right) \) is estimated by
and f_{1}(t) is the density function of I_{1}(t).
The descriptive measure of the RMTL is the RMTL difference between two groups. From formula (3), the effect size of the difference in the RMTLs (RMTLd) is related to the difference between the two areas under the CIF curves.
Hypothesis Test Procedures
Existing test procedures based on the CSH and SDH
The logrank test can be directly used as the test corresponding to the CSH [17].
The most commonly used test for the SDH is the Gray test (Gray) [6], the test statistic of which is defined as
where \( {\lambda}_{SDH}^{(k)}(t) \) is the estimate of the SDH for group k. The weight function is defined as \( {\varpi}_k(t)={n}_k(t)\frac{1{\hat{I}}_k\left(t\right)}{{\hat{S}}_k\left(t\right)} \), n_{k}(t) is the number of individuals at risk at time t in group k, \( {\hat{I}}_k\left(t\right) \) is the lefthand limit of the CIF for the event of interest in group k, and \( {\hat{S}}_k\left(t\right) \) is the lefthand limit of the probability of being free of any event in group k, as estimated by the KaplanMeier method.
New tests based on the RMTLd
Basic difference test
Assuming that Δ is the RMTLd between two groups, then the estimates of Δ, \( \hat{\Delta} \), are \( \hat{\Delta}={\int}_0^{\tau}\left[{\hat{I}}_{12}(t){\hat{I}}_{11}(t)\right] dt \), where \( {\hat{I}}_{1k}(t) \) is the CIF estimate for the event of interest in group k. Thus, we present a basic test procedure based on the RMTLd. Under the null hypothesis H_{0} : Δ = 0, the basic difference test (Diff) statistic is given by \( Z=\frac{\hat{\Delta}}{\sqrt{\operatorname{var}\left(\hat{\Delta}\right)}}\sim N\left(0,1\right), \) and the estimate variance \( \operatorname{var}\left(\hat{\Delta}\right) \) is derived by the delta method; that is,
where \( {\operatorname{var}}_k=2\tau {\int}_0^{\tau }{\hat{I}}_{1k}(t) dt2{\int}_0^{\tau }t{\hat{I}}_{1k}(t) dt{\left[{\int}_0^{\tau }{\hat{I}}_{1k}(t) dt\right]}^2 \) according to formula (3), and n_{k} is the sample size in the k_{th} group.
Supremum difference test
We refer to the supremum difference test (sDiff) statistics [18] based on the RMTLd. The test statistic is given by \( {Q}_S=\sup \left\{\left\hat{\varDelta}\left({t}_r\right)\right,{t}_r\le \tau \right\}/\hat{\sigma}\left(\tau \right) \), where \( \hat{\varDelta}\left({t}_r\right) \) is calculated by
The standard error of \( \hat{\varDelta}\left({t}_r\right) \) is solved by
based on Aalen’s variance [19] of the CIF estimator, where ρ is the correlation coefficient between \( {\hat{I}}_{12}\left({t}_i\right){\hat{I}}_{11}\left({t}_i\right) \), and \( {\hat{I}}_{12}\left({t}_{i\hbox{'}}\right){\hat{I}}_{11}\left({t}_{i\hbox{'}}\right) \), where i ≠ i'. ρ is difficult to estimate because it involves the assumption of an unknown underlying CIF distribution of the actual data. Lyu et al. [20] found that when ρ = 0.50, the test statistic does not inflate the type I error rate and maintains high power. Hence, we fixed ρ at an acceptable value of 0.5 in this article.
Under the null hypothesis, the distribution of Q_{S} can be approximated by the distribution of sup{M(x), 0 ≤ x ≤ 1}, where M is a standard Brownian motion process. According to Billingsley [21], the probability distribution of supM(t) is given by
Assuming that formula (7) converges when a → m [22], then m is solved as \( m=\max \left\{\left\lceil \frac{x\sqrt{2}}{\pi}\sqrt{\log \frac{1}{\pi \varepsilon}}\frac{1}{2}\right\rceil, 1\right\} \), where ⌈·⌉ refers to the minimum positive integer of this value, and ε is the permissible error for estimating P[supM(t) > x]..
The sample size formula based on the RMTLd
Under competing risks, the use of Gray is limited by the proportional SDH assumption. Hence, the corresponding sample size formula is not always available. In addition, the estimated Gray sample size (based on the Gray) depends on the incidence of the event of interest; that is, a large deviation between the actual incidence and the assumed incidence results in a broad range of estimated sample sizes. This paper does not discuss the sample size formula for the RMSTc (which can be estimated by the method based on the single endpoint), as our focus is on the event of interest. The sample size formulas based on Diff and sDiff are proposed in the following section.
Method based on the basic difference test
According to Diff, as shown in Section 2.2.2, the following hypotheses are considered: H_{0} : Δ = 0; H_{1} : Δ ≠ 0. The test statistic under the null hypothesis \( Z=\frac{\hat{\Delta}}{\sqrt{\sigma \left(\hat{\Delta}\right)}}\sim N\left(0,1\right) \) is rejected at the approximate α level of significance if \( \mid \frac{\hat{\Delta}}{\sqrt{\sigma \left(\hat{\Delta}\right)}}\mid >{z}_{\alpha /2} \). We write the expression z_{1 − α/2} = Φ^{−1}(1 − α/2), where Φ is the standard normal distribution. Then, under the alternative hypothesis with a desired power of 1 − β, the sample size can be obtained by solving 1 − β = P(Z > z_{1 − α/2} H_{1}) = P(Z > z_{1 − α/2} H_{1}) + P(Z < − z_{1 − α/2} H_{1}).
By symmetry of the normal distribution, P(Z > z_{1 − α/2} H_{1}) and P(Z < − z_{1 − α/2} H_{1}) are equal. Thus, we obtain \( 1\beta \simeq \Phi \left({z}_{1\alpha /2}+\frac{\varDelta }{\sigma}\right) \), i.e., (z_{1 − β} + z_{1 − α/2})^{2}σ = Δ.
According to formula (5), we have \( {\sigma}^2=\frac{\sigma_1^2}{n_1}+\frac{\sigma_2^2}{n_2}=\left(1+r\right)\times \left(\frac{\sigma_1^2}{n}+{r}^{1}\times \frac{\sigma_2^2}{n}\right) \), where \( \frac{n_2}{n_1}=r \). Thus, the total required sample size is
Method based on the Supremum difference test
In the sample size calculation of the supremum test, the main purpose is to obtain ξ in function \( n=\xi \cdot \tilde{n} \), where \( \tilde{n} \) is the calculated sample size based on Diff.
As with H_{0} : Δ = 0; H_{1} : Δ ≠ 0, we assume that Δ = η ≠ 0 under the alternative hypothesis. Then, we write the expression
where M(⋅) is a standard Brownian motion process and u(t) is a time function. Then, U(t) is a standard Brownian motion process that deviates with a mean of η. Here, we assume \( \eta =\lambda \sqrt{R} \) with a fixed effect size λ, where R = nR(τ), and R(t) is the probability that the event of interest happened before t. Then, the relation of R and η is given by
Assume that V_{1 − α/2} is the critical value of the supremum value of the standard Brownian motion process, i.e.,
By the symmetry of Brownian motion, both probabilities, \( P\left\{\underset{u\in \left[0,1\right]}{\sup }M(u)>{V}_{1\alpha /2}\right\} \) and \( P\left\{\underset{u\in \left[0,1\right]}{\operatorname{inf}}M(u)<{V}_{1\alpha /2}\right\} \), are equal. Hence, we only need to consider the calculation of \( P\left\{\underset{u\in \left[0,1\right]}{\sup }M(u)>{V}_{1\alpha /2}\right\} \) here. According to the joint distribution of \( \underset{u\in \left[0,1\right]}{\sup }{M}_{\eta }(u) \) and M_{η}(1) [22], M_{η}(⋅) is the Brownian motion with a mean of η. Eng and Kosorok [23] obtained the following function after integration:
Thus, the sample size needed to achieve a desired power of 1 − β with a twosided type I error of α can be obtained by
where \( \overline{\Phi}=1\Phi \) and Φ is the standard normal distribution.
Under the alternative hypothesis, we obtain the limiting distribution of U_{n}(τ) as M_{η}(1), which is a normal deviation with mean η and variance 1. With a critical value Z_{1 − α/2}, we solve for \( \tilde{\eta} \) in the following expression: \( \overline{\Phi}\left({Z}_{1\alpha /2}\tilde{\eta}\right)=1\beta, \) that is, \( \tilde{\eta}={Z}_{1\alpha /2}+{Z}_{1\beta }. \) Hence, we obtain
Because formulas (8) and (11) have the same effect size λ, the denominators cancel, and the ratio becomes \( \frac{R}{\tilde{R}}=\frac{\eta^2}{{\tilde{\eta}}^2}=\xi \), where only η remains to be solved.
First, we need to estimate the critical value V in formula (9). From the cumulative probability distribution [21].
let \( V=1\frac{4}{\pi}\sum \limits_{a=0}^{\infty}\frac{{\left(1\right)}^a}{2a+1}{e}^{\left[{\pi}^2{\left(2a+1\right)}^2/8{x}^2\right]}, \) and assume that V converges when a → m. Then, m is solved as \( m=\max \left\{\left\lceil \frac{x\sqrt{2}}{\pi}\sqrt{\log \frac{1}{\pi \varepsilon}}\frac{1}{2}\right\rceil, 1\right\} \) [23], where ⌈·⌉ refers to the minimum positive integer of this value, and ε represents the residuals. Finally, assume a function, \( Y(x)=\overline{\Phi}\left(ux\right)+{e}^{2 ux}\overline{\Phi}\left(u+x\right) \), with a derivative function of \( Y\hbox{'}(x)=\kern1em \overline{\varphi}\left(ux\right)+{e}^{2 ux}\overline{\varphi}\left(u+x\right)+2{ue}^{2 ux}\overline{\Phi}\left(u+x\right) \). Use the NewtonRaphson iteration to solve for η in formula (10), let \( {o}_i=\frac{\left(1\beta \right)Y(x)}{Y\hbox{'}(x)} \), and iterate the cycle until ο ≤ ε; the estimate η is given by \( \eta =\tilde{\eta}+\sum {o}_i \).
Results
Hypothesis test procedures
Simulation design
To compare the performance of the above tests, Monte Carlo simulations were carried out to study the type I error and the statistical power under a variety of situations. The following procedures were performed to test the hypotheses: Gray, Diff, and sDiff. The performance of these tests was evaluated by using 6 alternative scenarios (Fig. 1): (A) two groups with no difference (the comparison for type I error); (B) two groups with a proportional SDH difference; (C) two groups with a nonproportional SDH difference; (D) an early difference in the CIFs; (E) CIFs with a late difference; (F) two CIFs with a cross difference.
Let τ_{1} and τ_{2} be the last event of interest time in the two groups. Here, we considered a commonly used option, the minimum of the last event in the time of interest in two groups (τ = min(τ_{1}, τ_{2})), as τ. The event of interest and the competing event were generated from CIFs with piecewise Weibull distributions. The specific parameter settings are presented in Web Table A1. The distribution of events was based on the binomial distribution B (N, p_{1}), where N represents the sample size of each group and p_{1} is the maximum cumulative incidence of events of interest, which is set as p_{1} = I_{1}(∞) = 0.7. The censored times C in the two groups were generated from uniform distributions. Then, each individual was assigned an observed time t = min(T, C) and the event indicator δ = 0[T > C]. By changing the distribution parameters of C, both groups were set to have the same censoring rates of approximately 0, 15, 30 and 45%. We also considered equal group sizes (n_{1} = n_{2} = 50, 100, 150) and unequal group sizes (n_{1} = 50, n_{2} = 100; n_{1} = 50, n_{2} = 150; n_{1} = 50, n_{2} = 200). All simulations were performed using 5000 iterations. The nominal significance level of each method was fixed at the conventional level of 0.05.
Simulation results
As Table 1 shows, the type I error rates for Diff are stable under 0 censoring but gradually inflate with increasing censoring rates, which represent the most radical test. As the type I error rates of Diff are inflated, this test is not included in the comparison of test power. Compared to Diff, Gray is steadier. The type I error rates of sDiff are relatively conservative for light censoring but increase with increasing censoring rates.
The power results are shown in Table 1. When two CIF curves have a proportional SDH (Fig. 1b), the powers of all the tests increase with increasing sample size but decline with increasing censoring rates. Gray demonstrates the optimal power in this situation, followed by sDiff. For the nonproportional SDH difference (Fig. 1c), sDiff is the most powerful test, while Gray has the lowest power in this situation. For the early difference in the CIF curves (Fig. 1d), with increasing censoring rates, sDiff becomes much more powerful, and Gray exhibits the lowest power in this situation. When considering the late difference in the CIF curves (Fig. 1e), the powers of all tests decline with increasing censoring rates. In this situation, Gray is more powerful, followed by sDiff. In the case of a cross difference in the CIF curves (Fig. 1f), Gray has the lowest power. With increasing censoring rates, sDiff is much more powerful than Gray.
Note that in situation C (nonproportional SDH), situation D (early difference), and situation F (cross difference), all tests exhibit gradually increasing power with increasing censoring rates. This result occurs because the two CIF curves are not convergent in the later period but diverge with the increased censoring, which makes the increased difference between the two CIF curves proportional.
To summarize the simulation results, we applied the analysis of variance (ANOVA) technique [24] to evaluate the type I error and power. For type I error, the absolute small and closetozero estimates indicate that rates are close to 0.05. For power, good performance is indicated by large estimated values (see details in Additional file 1). Table 2 shows that sDiff corrects the inflated type I error of Diff when censoring occurs. In Table 3, sDiff is slightly lower than Gray when there is a proportional SDH (situation B), and when there is a late difference (situation E), the difference between Gray and sDiff is approximately only 2.242%, whereas the powers of sDiff are much higher than those of Gray in other situations. Considering all situations, combinations of sample sizes, and censoring rates, sDiff performs better in most situations.
Calculations of sample size
Simulation design
A simulation study was also performed to evaluate the proposed sample size formula. Two scenarios were considered (Fig. 1 bc): (B) two groups with a proportional SDH difference and (C) two groups with a nonproportional SDH difference. Both scenarios were examined under four scenarios with either 0.05 or 0.01 for the twosided type I error and with either 0.8 or 0.9 as the power. The followup time, τ, which is also the truncation time point, was set as the minimum of the last observed time of the pilot study for two groups. Assume two groups with an equal sample size, i.e., r = 1. Then, based on situation B and situation C, the necessary parameters were estimated by simulation, and finally, we obtained the calculated sample size with the given parameters. In addition, Monte Carlo simulations were used to examine the observed power. The simulations were performed using 1000 replications.
Simulation results
As shown in Table 4, the calculated sample size of all the tests increases with a decreasing type I error rate and with an increasing target power. When the CIFs satisfy the proportional SDH assumption (situation B, Fig. 1b), the calculated sample sizes of Gray, Diff and sDiff are close to each other, with Diff having the highest observed power. In this situation, Gray and sDiff have a similar observed power, which is close to the target power. When there is a nonproportional SDH (situation C, Fig. 1c), the calculated sample sizes of Gray are much higher than those of Diff and sDiff, and sDiff has a relatively high observed power. In addition, the observed powers of Gray do not reach the target power in this situation.
In addition, the comparison of power for Gray, Diff and sDiff with a fixed sample size (calculated by sDiff) is shown in Web Table A2. The results show that the power under situation B for Diff is larger than that for Gray and sDiff, but the three tests have similar power. However, in situation C, the power of Gray is much lower than that of Diff and sDiff.
As the type I error rates of Diff are inflated with censoring, the corresponding sample size formula is considered unstable. In general, when the CIFs satisfy the proportional SDH assumption, both Gray and sDiff can be considered; when the SDH is nonproportional, sDiff is considered more adaptive.
Applications
Example 1: Bone marrow transplantation data
The data used to evaluate the effect of Tcell depletion on bone marrow transplantation [25] came from 408 patients divided into a Tcell depleted group (Yes) with 354 cases and a Tcell not depleted group (No) with 54 cases. The censoring rates for the two groups were approximately 41% and 28%, respectively. The study included two types of events: death from treatmentrelated causes, which was defined as the event of interest, and relapse, which was set as a competing event. At the end of followup, 161 patients (146 from the Yes group and 15 from the No group) experienced an event of interest, and 87 patients (70 from the Yes group and 17 from the No group) experienced competing events. A test of the proportional SDH assumption yielded a result of P = 0.264.
The descriptive statistics and the hypothesis test results for the examples are shown in Table 5. In the hazardrelated measures, the CHR and SHR showed that the ratios of the Yes group vs. the No group were 0.86 (0.59, 1.25) and 0.60 (0.36, 1.00), respectively. However, the logrank test, which is based on the CHR, showed no significant differences (P = 0.053), while Gray based on the SHR indicated that there were significant differences between the two groups (P = 0.049). In addition, we could not obtain the estimated CSH or SDH for either group, which led to a lack of descriptive information for either group; only a CHR or an SHR could be obtained. This outcome led to difficulty in clinical interpretation.
For the composite endpoint, the RMSTc showed that the mean survival time of the patients in the Yes group was 1.83 (− 5.03, 8.69) months longer than that of the patients in the No group within the truncation time point of 41.8 months, and there were no significant differences (P = 0.601). Additionally, the RMSTc could not provide information regarding treatmentrelated death.
Let τ =41.8 months; Table 5 shows that the RMTL of treatmentrelated death in the Yes group was 9.57 (5.18, 13.96) months, which corresponds to the area under the CIF curve, i.e., S2 in Fig. 2a. In the No group, the RMTL corresponds to the area under the CIF curve, i.e., S1 + S2 = 15.49 (13.53, 17.45) months. Hence, the difference in RMTL between the two groups has an area of S1, which means that the patients in the Yes group took 5.92 (1.11, 10.72) months longer to succumb to treatmentrelated death. According to Table 5, the RMTLbased tests (Diff and sDiff) showed significance at the conventional level of 0.05.
As shown in Fig. 2b, a selection of different τ values led to a difference in the calculated sample size for Diff and sDiff: the calculated sample size increased with increasing τ and became steady after 20 months. The calculated sample sizes at τ= 41.8 months were 280 and 298 for Diff and sDiff, respectively, both of which were close to the sample size calculated by Gray (n = 300).
Example 2: Lymphocytic leukemia data
A previous study compared the effects of radiotherapy in the treatment of patients with lymphocytic leukemia (LL). A total of 1400 patients were randomly extracted from the Surveillance, Epidemiology, End Results (SEER) Program. Among these patients, two groups were included: the no radiotherapy group (No RT) consisted of 1318 cases, and the radiotherapy group consisted of 82 cases. The censoring rates in the two groups were approximately 3% and 44%, respectively. During the followup, death from LL was set as the event of interest; death from other causes was recorded as a competing risk. At the end of the research, 364 patients (333 from the No RT group and 31 from the RT group) had died from LL, and 467 patients (452 from the No RT group and 15 from the RT group) had died from other causes. The corresponding test indicated a severe violation of the proportional SDH assumption (P = 0.006).
Regarding the hazardrelated indexes, Table 5 shows that the No RT group had a lower hazard ratio than the RT group (CHR = 1.14 (0.78,1.65); SHR = 1.45 (0.98, 2.14)). However, in this example, the SHR varied with time (P = 0.006) instead of being constant. Therefore, the CHR and SHR may not be available for this example.
When considering the composite endpoint, the RMSTc showed that the mean survival time of the RT patients was 0.66 (− 1.13,2.28) years longer than that of the No RT patients within the truncation time point of 15.3 years (Table 5), which reflected the overall survival but could not reflect the survival rates of patients who died of LL.
Let τ= 15.3 years; Table 5 shows that the RMTL of LLrelated death in the RT group was 4.68 (3.34, 6.03) years, which is equal to the area of S1 + S2 in Fig. 2c and corresponds to the area under the CIF curve. In the No RT group, the RMTL was S2 = 2.96 (2.69, 3.24) years. The difference in the RMTL between the two groups was S1 = 1.72 (0.35, 3.09) years, which is the delay time until the patients in the No RT group succumbed from LLrelated death. As shown in Table 5, for all test procedures, only Diff and sDiff, which were based on the RMTL, showed significance at the conventional level of 0.05.
As Fig. 2d shows, with increasing τ, the calculated sample sizes showed a trend of decreasing first and then increasing, and they reached the smallest estimation of sample size at approximately 7 years, which was much less than the results found with Gray (n = 886). The calculated sample sizes at τ= 15.3 years were 344 and 364 for Diff and sDiff, respectively.
Discussion
When dealing with competing risks datasets, the SHR is often used as a typical descriptive method with the test procedures. However, because the SHR lacks baseline information (a control group) and does not directly reflect the risk ratio of the two groups, it may complicate the interpretation of the survival outcome and may be a relatively abstract concept for patients. The RMSTc can directly describe patient survival and does not depend on the proportional SDH assumption, but the simple use of composite endpoints does not always have clinical meaning and degrades the accuracy of patient information [14]. Conversely, the RMTL can avoid some limitations of the above methods. Moreover, the relationship between the RMTL and RMSTc can be derived as RMTL_{1} + RMTL_{2} + ⋯ + RMTL_{j} + RMST_{c} = τ, where RMTL_{j} means the area under the CIF curves for cause j. As RMTL_{j} is interpreted as the average survival time lost due to cause j within τ, the RMTL can be observed from the CIF curves directly, while the SHR cannot directly reflect the CIF curves. In addition, Gray, which corresponds to the SHR, needs to satisfy the proportional SDH assumption, while the RMTLrelated tests do not. From the simulation results of the hypothesis testing procedures, sDiff, which is based on the RMTLd, corrects the severe skewness of Diff under high censoring and has improved power under various scenarios compared to Gray. In general, sDiff maintains good performance compared to Gray and Diff. In addition, this paper also contains sample size formulas based on the RMTLd. When the proportional SDH assumption is satisfied, the calculated sample sizes of Diff and sDiff are close to that of Gray, while Diff still has the highest power. Because the type I error rates of Diff are inflated with censoring, we still suggest that Gray and sDiff be used in this situation; however, when the SDH is nonproportional, the sample sizes estimated by Gray are much larger than those estimated by Diff and sDiff with the lowest observed power. Hence, in this situation, sDiff seems more adaptable for use.
The sample sizes calculated in the examples (Fig. 2b, d) suggest that different choices of τ may have a large influence on the calculation of the sample size. In example 1, the calculated sample size increases with increasing τ and is similar to the sample size estimated by Gray after 20 months (Fig. 2b), while in example 2, the calculated sample sizes show a trend of decreasing first and then increasing (Fig. 2d). Hence, it is important to choose an appropriate τ for the calculated sample size of Diff and sDiff. In practical research, τ is always determined as the followup time in the study design. If all patients in one of the groups experience an endpoint during the followup period, then the study is stopped, and this time point is determined as the final analysis of the study, i.e., τ; otherwise, if patients in either group do not have a completely observed endpoint until the end of the followup period, then the designed followup period is regarded as the truncation time point. In this paper, the calculated sample sizes in simulations are based on the minimum time of the last observation of the event of interest in the two groups as τ. The issue of how to define an appropriate τ in a specific research context will be considered in a future study.
Conclusions
The RMTL can meaningfully summarize treatment effects for clinical decision making, which can be reported with the SDH ratio for competing risks data. The proposed sDiff test is robust and can be considered for statistical inference in real data analysis; the two proposed calculated sample size formulas have wide applicability and can also be applied to real trial designs.
Additional file
The additional file contains the theory of variance techniques (ANOVA) used to evaluate the type I error and power, the parameter settings of the two CIFs for the simulations and the comparison of power with a fixed sample size.
Availability of data and materials
Data in Example 1 is available in R package timereg: https://CRAN.Rproject.org/package=timereg . Data in Example 2 are available from SEER (The Surveillance, Epidemiology, and End Results Program): https://seer.cancer.gov/ .
Abbreviations
 CI:

Confidence interval
 CHR:

Causespecific hazard ratio
 CIF:

Cumulative incidence function
 CSH:

Causespecific hazard
 Diff:

Basic difference test
 LL:

Lymphocytic leukemia
 RMST:

Restricted mean survival time
 RMSTc:

Restricted mean survival time under competing risks
 RMTL:

Restricted mean time lost
 SDH:

Subdistribution hazards
 sDiff:

Supremum difference test
 SHR:

Subdistribution hazard ratio
References
Bakoyannis G, Touloumi G. Practical methods for competing risks data: a review. Stat Methods Med Res. 2012;21:257–72.
Van WC, Mcalister FA. Competing risk bias was common in KaplanMeier risk estimates published in prominent medical journals. J Clin Epidemiol. 2016;69:170–3.
Lau B, Cole SR, Gange SJ. Competing risk regression models for epidemiologic data. Am J Epidemiol. 2009;170:244–56.
Kalbfleisch JD, Prentice RL. The statistical analysis of failure time data. second ed. New York: Wiley; 2002.
Fine JP, Gray RJ. A proportional hazards model for the subdistribution of a competing risk. J Am Stat Assoc. 1999;94:496–509.
Gray RJ. A class of Ksample tests for comparing the cumulative incidence of a competing risk. Ann Stat. 1988;16:1141–54.
Li J, Scheike TH, Zhang MJ. Checking Fine and Gray subdistribution hazards model with cumulative sums of residuals. Lifetime Data Anal. 2015;21:197–217.
Uno H, Wittes J, Fu H, Solomon SD, Claggett B, Tian L, et al. Alternatives to hazard ratios for comparing the efficacy or safety of therapies in noninferiority studies. Ann Intern Med. 2015;163:127–34.
Kim DH, Uno H, Wei LJ. Restricted mean survival time as a measure to interpret clinical trial results. JAMA Cardiol. 2017;2:1179–80.
Sutradhar R, Austin PC. Relative rates not relative risks: addressing a widespread misinterpretation of hazard ratios. Ann Epidemiol. 2018;28:54–7.
Calkins KL, Canan CE, Moore RD, Lesko CR, Lau B. An application of restricted mean survival time in a competing risks setting: comparing time to ART initiation by injection drug use. BMC Med Res Methodol. 2018;18:27.
Royston P, Parmar MKB. The use of restricted mean survival time to estimate the treatment effect in randomized clinical trials when the proportional hazards assumption is in doubt. Stat Med. 2011;30:2409–21.
Royston P, Parmar MKB. Restricted mean survival time: an alternative to the hazard ratio for the design and analysis of randomized trials with a timetoevent outcome. BMC Med Res Methodol. 2013;13:152.
Mell LK, Jeong JH. Pitfalls of using composite primary end points in the presence of competing risks. J Clin Oncol. 2010;28:4297–9.
Andersen PK. Decomposition of number of life years lost according to causes of death. Stat Med. 2013;32:5278–85.
Zhao L, Tian L, Claggett B, Pfeffer M, Kim DH, Solomon S, et al. Estimating treatment effect with clinical interpretation from a comparative clinical trial with an end point subject to competing risks. JAMA Cardiol. 2018;3:357–8.
Tai BC, Wee J, Machin D. Analysis and design of randomised clinical trials involving competing risks endpoints. Trials. 2011;12:127.
Gill RD. Censoring and stochastic integrals. Amsterdam: The Mathematical Center; 1980.
Aalen O. Nonparametric estimation of partial transition probabilities in multiple decrement models. Ann Stat. 1978;6:534–45.
Lyu J, Chen J, Hou Y, Chen Z. Comparison of two treatments in the presence of competing risks. Pharm Stat. 2020. https://doi.org/10.1002/pst.2028.
Billingsley P. Converge of probability measures. New York: Wiley; 1968.
Borodin AN, Salminen P. Handbook of brownian motionfacts and formulae. Basel: Birkhauser; 2000.
Eng KH, Kosorok MR. A sample size formula for the supremum logrank statistic. Biometrics. 2005;61:86–91.
Klein JP, Logan B, Harhoff M, et al. Analyzing survival curves at a fixed point in time. Stat Med. 2007;26(24):4505.
Thomas HS. timereg: flexible regression models for survival data. R package version 1.9.3. 2019. https://CRAN.Rproject.org/package=timereg.
Acknowledgements
The authors thank the editors and two referees for their constructive comments.
Declarations
Not applicable.
Funding
This work is supported by the National Natural Science Foundation of China (81673268, 81903411), Natural Science Foundation of Guangdong Province (2018A030313849) and the Guangdong Basic and Applied Basic Research Foundation (2019A1515011506). The funding body had no role in the design of the study and collection, analysis, and interpretation of data, and in writing the manuscript.
Author information
Authors and Affiliations
Contributions
ZC and YH motivated the idea of the manuscript. ZC and JL jointly originated the methodology. JL performed the statistical analysis and prepared the manuscript, including figures and Tables. ZC, JL and YH jointly contributed to drafting the article. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable. This work contains no human data.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Lyu, J., Hou, Y. & Chen, Z. The use of restricted mean time lost under competing risks data. BMC Med Res Methodol 20, 197 (2020). https://doi.org/10.1186/s12874020010409
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12874020010409