Adjusting for measurement error in baseline prognostic biomarkers included in a time-to-event analysis: a joint modelling approach

Background

Methodological development of joint models of longitudinal and survival data has been rapid in recent years; however, their full potential in applied settings are yet to be fully explored. We describe a novel use of a specific association structure, linking the two component models through the subject specific intercept, and thus extend joint models to account for measurement error in a biomarker, even when only the baseline value of the biomarker is of interest. This is a common occurrence in registry data sources, where often repeated measurements exist but are simply ignored.

Methods

The proposed specification is evaluated through simulation and applied to data from the General Practice Research Database, investigating the association between baseline Systolic Blood Pressure (SBP) and the time-to-stroke in a cohort of obese patients with type 2 diabetes mellitus.

Results

By directly modelling the longitudinal component we reduce bias in the hazard ratio for the effect of baseline SBP on the time-to-stroke, showing the large potential to improve on previous prognostic models which use only observed baseline biomarker values.

Conclusions

The joint modelling of longitudinal and survival data is a valid approach to account for measurement error in the analysis of a repeatedly measured biomarker and a time-to-event. User friendly Stata software is provided.

Many biomarkers such as systolic blood pressure (SBP) have been identified as key prognostic factors in the development and validation of cardiovascular risk scores [1, 2]. However, often only baseline values of these biomarkers are used, despite the existence of repeated measures, especially in registry sources such as the General Practice Research Database (GPRD) [3]. Furthermore, biomarkers are often measured with error. Failing to adjust for such measurement error leads to estimates being biased towards the null [4].

A joint model of longitudinal and survival data allows us to investigate the relationship between a repeatedly measured biomarker, subject to measurement error, such as SBP, and the time to an event of interest, such as time to non-fatal stroke. The approach which has dominated the methodological literature involves linking the two component submodels using shared random effects [5, 6]. From a classical perspective, these methods require computationally intensive numerical integration, which is difficult to implement. However, due to the recent introduction of user-friendly software in R [7, 8] and Stata [9], these models are starting to find their place in applied research [10, 11], but the potential uses of and forms of the association parameters, linking the longitudinal and survival components, are yet to be fully explored. Alternatively, many authors have proposed a Bayesian approach, proving readily available BUGS code to implement the models [12, 13].

The most commonly used association structures include the current value parameterisation [5]; whereby we directly link the value of the biomarker, as estimated by the longitudinal submodel, to survival, and the first derivative or slope [10]; allowing the investigation of the effect that the rate of change of the biomarker has on survival.

There is often interest in predicting prognosis based on an initial baseline measurement [1, 2]. In this paper we investigate the use of the joint model framework with a random intercept association structure as an approach to adjust for measurement error, inherent in biomarkers such as SBP. By incorporating the repeated measures we thus make the most efficient use of the data available. In particular, as a prognostic model for future patients, we describe how this framework can be used to predict survival for new patients who will only have baseline measurements.

A joint model of longitudinal and survival data consists of two component submodels: the longitudinal submodel and the survival submodel. We define a set of baseline covariates, U _i , which can potentially differ between submodels. The longitudinal submodel allows us to model the trajectory of a repeatedly measured biomarker over time, adjusting for baseline covariates. The standard approach assumes a linear mixed effects model [14]. We observe

with

where Y _i (t _ij ) is the observed longitudinal response for the i ^th patient measured at the j ^th time point. W _i (t _ij ) is our true unobserved trajectory function consisting of design matrices X_i^{\prime }(t_{\mathit{\text{ij}}}) and Z_i^{\prime }(t_{\mathit{\text{ij}}}) for the fixed and random effects, β and b _i , respectively, where b _i  ∼ MVN(0,Σ). We can incorporate flexibility here by allowing both X_i^{\prime }(t_{\mathit{\text{ij}}}) and Z_i^{\prime }(t_{\mathit{\text{ij}}}) to contain restricted cubic spline functions of measurement time [15]. We also have a vector of baseline covariates u _i  ∈ U _i , and corresponding regression coefficients, δ. Finally, ε _ij is our normally distributed measurement error with constant variance {\sigma }_e^2. We further assume that the random effects and error term are independent, and that cov (ε _ij ,ε _ik ) = 0 (where j ≠ k).

The time-to-event submodel usually takes the form of a proportional hazards model

with h ₀(t) the baseline hazard function and v _i  ∈ U _i is a vector of baseline covariates with corresponding log hazard ratios, ϕ. The parameter α ₁ is commonly named the association parameter, indicating the strength of association between the longitudinal biomarker and the time to event. If α ₁ = 0, then the joint model reduces to the two separate models and fitting a joint model will not prove advantageous. This parameterisation assumes the hazard is dependent on the biomarker through its current value. This form of association is one of many ways to link the two component sub-models. The baseline hazard function, h ₀(t), can be modelled using a parametric distribution, most frequently the Weibull, or less restrictively using flexible parametric survival models [16], or of course can be left unspecified [17]. However, an unspecified baseline hazard function leads to underestimation of the standard errors of parameter estimates [18], and consequently bootstrapping is required to obtain appropriate standard errors.

For illustration, we let W _i (t _ij ), the longitudinal submodel, be a linear function of time where the intercept and slope varies between subjects

giving a model with a random intercept and random linear slope. As an alternative way of linking the component models to that of Equation (3), we may link elements of the trajectory function, W _i (t _ij ), to the hazard directly. For example, we can link the subject specific baseline biomarker values through the intercept association structure, where

in this expression α ₂ now estimates the strength of the association between the patient specific baseline biomarker values, as estimated by the longitudinal submodel, and the time-to-event. This way we can let the risk of event depend directly on the subject specific value of the biomarker at time t = 0.

If interest lies in prediction when a new patient is observed at baseline, the issue of measurement error can be accounted for through this approach. A benefit of this association structure also lies in the evaluation of the joint likelihood. Under most parametric survival submodels (e.g. Weibull distribution) and time-dependent association structures (eg. current value), numerical quadrature is required to integrate out not only the random effects, but under Equation (3), nested quadrature is also required to evaluate the cumulative hazard function. Under the time-independent association structure of Equation (5), we avoid this nested quadrature as the cumulative hazard function has an analytically tractable form, which provides computational benefits.

As discussed in the introduction, this model formulation can be an alternative to the standard approach of using the observed baseline biomarker value

where Y _0i is the observed baseline biomarker value and α ₃ is the log hazard ratio for a one unit increase in the observed baseline biomarker value. Although simple to fit, Equation (6) does not account for potential measurement error in Y _0i .

Simulation study

In order to assess the performance of the standard approach of including observed biomarker values, compared to the full joint model described above, we evaluated both through simulation [19]. For ease of exposition we assume a longitudinal model with random intercept and slope, assuming a continuous biomarker of interest with

where β ₀ = β ₁ = 0, and b _0i  ∼ N(0,1), b _1i  ∼ N(0,0.25²) with correlation between (b _0i ,b _1i ) of 0.25. Observed measurements are then generated from Y_{\mathit{\text{ij}}}\sim \mathrm{N}(W_i(t_{\mathit{\text{ij}}}),{\sigma }_e^2), where t _ij is the time of the j ^th measurement for the i ^th patient. We vary σ _e from {0.1,0.5,1}.

We assume a Weibull baseline hazard function with λ = 0.1 and γ = 1.5. A binary variable, X ₁ to represent treatment group was generated from Bin (1,0.5), with an associated log hazard ratio of ϕ ₁ = -0.5. A continuous covariate, X ₂, to represent age at baseline was generated from N(65,12) with an associated log hazard ratio of ϕ ₂ = 0.01. We then generate survival times from a Weibull distribution where the hazard is defined as h(t) = h ₀(t) exp(α ₂ β _0i  + ϕ ₁ X ₁ + ϕ ₂ X ₂), with α ₂ the association parameter, indicating the effect of a one unit increase in the value of the subject specific intercept on the risk of event. We vary α ₂ = {-0.5,0.25,0.25,0.5}. Each simulation contained 300 patients with up to 5 annual measurements (including baseline), and administrative censoring at 5 years. This corresponds to an approximate 18.9% survival proportion at 5 years (calculated at the mean of covariate values, X_1=\frac{1}{2},X_2=65 and β _0i  = 0). To each dataset we fit a Weibull proportional hazards model including the observed baseline measurement, and a Weibull-based joint model with the random intercept association structure. We adjust for age and treatment in the survival submodel. Each scenario is simulated 1000 times.

To illustrate the varying measurement error standard deviations used in the simulation scenarios, we show in Figure 1 observed longitudinal measurements from the same 100 patients with σ _e  = {0.1,0.5,1}, and when α = 0.25. Figure 1 illustrates that as the measurement error standard deviation increases, the variability in the observed biomarker values increases.

Example simulated observed longitudinal measurements with varying measurement error standard deviation.

Full size image

The GPRD cohort

The General Practice Research Database (GPRD) Group has obtained ethical approval from a Multi-centre Research Ethics Committee (MREC) for all purely observational research using GPRD data; namely, studies which do not include patient involvement The core work of the GPRD is covered by MREC approval granted by the Trent Multi- Research Ethics Committee (REC reference number 05/MRE04/87) and this study was approved by the GPRD Independent Scientific Advisory Committee (ISAC) (Protocol number 09_094). This study is based in part on data from GPRD obtained under licence from the UK Medicines and Healthcare Product Regulatory Agency (MHRA). However, the interpretation and conclusions contained in this study are those of the authors alone.

The example cohort used to illustrate the methods in this paper consists of 4,850 obese patients diagnosed with type 2 diabetes mellitus. We have 107,347 measurements of SBP, with maximum follow-up of 22 years. There were 278 stroke events observed.

In Figure 2 we show the observed SBP measurements for 9 randomly selected patients, who had at least 10 measurements, illustrating some nonlinear trajectories. To accommodate such nonlinearities we can use restricted cubic splines in the linear mixed effects submodel. In particular, we specify the following longitudinal submodel

Longitudinal response measurements for SBP for 9 randomly selected patients who had at least 10 measurements. The dashed line represents the fitted longitudinal trajectories based on the joint model.

Full size image

Where s _F (t _ij ;k _F ) is the restricted cubic spline basis of measurement time with corresponding fixed effects, β _F , with knot locations k _F , and s _R (t _ij ;k _R ) is the restricted cubic spline basis of measurement time with corresponding random effects, b _R , and knot locations k _R .

Prelimenary modelling of the longitudinal data can be conducted to guide model selection, in particular, the degrees of freedom for the spline terms capturing the underlying longitudinal trajectory over time.

To allow flexibility in the survival submodel we use the flexible parametric survival model [16, 20], which models the baseline log cumulative hazard function using resticted cubic splines. We can once again undertake seperate analysis of just the survival data to inform model selection. In particular, we can use the AIC and BIC to guide the selection of the number of degrees of freedom to capture the baseline hazard function, following Rutherford et al. (2013) [21]. Our final joint model is then

where

where the baseline log cumulative hazard function, log[H ₀(t)], is expanded into a restricted cubic spline function of log(t), s(log(t);γ,k _S ), with knot locations k _S and coefficient vector, γ. This framework has recently been incorporated into a joint model [22]. In each submodel we adjust for the baseline effects of age, sex and BMI. We fit the joint model with the random intercept association structure shown in Equation (5). For comparison, we also apply the standard flexible parametric survival model, adjusting for observed baseline SBP, age, sex and BMI.

Simulation study results

Bias and coverage estimates for the association parameter are presented in Table 1. Under the standard Weibull model, we observe increasing bias in the estimates of the association between baseline biomarker values and survival, as the magnitude of the measurement error standard deviation, σ _e , increases. In parallel we observe very poor coverage probabilities under the Weibull approach. For example, with α = 0.5 and σ _e  = 1, we observe bias of -0.261 (percentage bias of -52.2%) and coverage of 0.4%. In contrast, under the joint modelling approach we observe minimal bias and coverage probabilities close to 95% across all scenarios.

Analysis of GPRD cohort

We now present the analysis of the GPRD cohort. In all analyses we use SBP/10 so that a unit increase in SBP/10 represents a clinically meaningful 10 unit increase in SBP. Our primary interest is the association between baseline SBP and the risk of stroke. Baseline (t _ij  = 0) corresponds to when each patient entered the cohort, i.e. the time of first SBP measurement.

We began by assuming a random intercept and selecting the degrees of freedom for the fixed spline terms using the AIC and BIC. In this case, both selected five degrees of freedom for s _F (t _ij ;k _F ), with an AIC of 417565.8 and BIC of 417604.1. For the random splines of time we assumed a linear term, which equates to one spline term for s _R (t _ij ;k _R ). This allows a very flexible form to take into account the variation in SBP over time. We further adjust for age, sex and Body-Mass Index (BMI) at baseline.

For the flexible parametric survival submodel, both AIC and BIC selected two degrees of freedom, with an AIC of 2408.7173 and BIC of 2430.483. If one degree of freedom had been selected, then this would be equivalent to a Weibull survival model.

Results are presented in Table 2. Under the standard flexible parametric survival model we observe a hazard ratio for a ten unit increase in baseline SBP of 1.111 (95% CI: 1.051, 1.172). Under a joint model we observe an increased hazard ratio of 1.198 (95% CI: 1.107, 1.298). The increased effect using a joint model is consistent with that observed in the simulation study, i.e. that the bias in the standard survival model is towards the null. The fitted trajectories seen in Figure 2 appear to capture the subject-specific measurements well, although some panels appear to only require a linear trend.

We illustrate how the bias from the standard approach increases with SBP in Figure 3, showing predictions from both models for a female patient aged 60, with low (90), medium (130) and high (200) SBP baseline measurements. To quantify the differences, at 10 years under the standard model we observe a survival probability of 0.881 for a SBP of 200, compared to 0.816 under the full joint model.

Predicted survival from the flexible parametric survival model and joint model, for a female, aged 60 years, BMI of 30, with SBP of 90, 130 or 200.

Full size image

A wealth of patient data is becoming available in registry sources such as the GPRD, providing extensive opportunities to utilise the joint modelling framework. We have shown that by incorporating repeated measures of a biomarker within a unified joint model framework, we reduce bias due to measurement error, even when only the baseline level of the biomarker is predictive of survival. As illustrated in the simulation study, ignoring measurement error in biomarkers such as blood pressure can lead to a marked underestimation of covariate effects. In our application, through the use of restricted cubic splines in the linear mixed effects submodel, we can model highly nonlinear trajectories over time, compared to linear slope models. Furthermore, the flexible parametric survival submodel can also capture complex baseline hazard functions, an important component when predicting survival at the patient level [22].

Given that, to our knowledge, all current cardiovascular risk scores only use baseline measures, with no adjustment for measurement error, the prospects of utilising this framework to improve prognostic risk scores is quite substantial. Predicting survival for a new patient using this framework follows naturally, as often only a first baseline biomarker observation will be available. However, such a modelling approach also allows a dynamic risk prediction approach to be adopted, whereby a patient’s estimated future risk is updated as each new biomarker value is obtained [23]. Such an approach could enable response to treatment to be monitored and patients counselled accordingly.

In the analysis of the GPRD cohort, we incorporated flexibility in both the longitudinal submodel through the use of restricted cubic splines, and the flexible parametric survival submodel. Given that both submodels require choosing the number of degrees of freedom, a simple sensitivity analysis can be undertaken to assess knot locations and number of knots. We showed recently that the flexible parametric survival submodel is very robust to both knot placement and number of knots within a joint model framework [22], and furthermore, an extensive simulation study has been conducted by Rutherford et al. (2013), which showed excellent performance of the flexible parametric model to capture simple and complex baseline hazard functions [21]. Furthermore, given that primary interest was in the survival component, and the estimate of association, often modelling the longitudinal component with a suitable sensible functional form will provide an improved estimate compared to simplistic approaches of seperate modelling.

In this paper we have concentrated on a specific association structure linking the 2 component submodels; however, it may be of interest to investigate linking multiple components of a biomarkers trajectory to the time to an event of interest. For example, recent work by Rothwell et al. (2010) [24] has shown associations between not only baseline blood pressure, but also variability over time as important predictors of cardiovascular events. Furthermore, we have only compared the standard approach of adjusting for observed baseline biomarker values to the full joint model. It would be of interest to compare alternative approaches for adjusting for measurement error, not only in baseline biomarkers, but also under a time-dependent association structure [25, 26].

Extensions to the modelling framework include incorporating multiple biomarkers. In particular, in our example we modelled SBP over time, whilst adjusting for baseline BMI. It may be of interest to model not only SBP but also the inter-relationships between different biomarkers such as BMI, and how they are related to an event of interest [13].

To facilitate the use of the methods in practice, user friendly Stata software, written by the first author, is available, with a variety of survival model choices and association structures, including those discussed in this article [9, 27]. To illustrate computational aspects of the framework, the presented joint model applied to the cohort took just over 13 minutes to converge on a standard laptop computer.

The joint modelling of longitudinal and survival data is a valid approach to account for measurement error in the analysis of a repeatedly measured biomarker and a time to event. User friendly Stata software is provided.

MJC is funded by a National Institute for Health Research (NIHR) Doctoral Fellowship (DRF-2012-05-409) and KRA is partially supported as a NIHR Senior Investigator (NI-51-0508-10061).

The cohort of obese patients with type 2 diabetes mellitus was obtained from the General Practice Research Database (GPRD) under Independent Scientific Advisory Committee (ISAC)-approved Protocol 09_094, and which was funded by a National Institute for Health Research (NHIR) Health Technology Assessment (HTA) Programme Project Grant (07/85/02).

The authors would like to thank Monica Hernández for initial preparatory work on the data from the GPRD cohort of patients, Roberta Ara for useful initial discussions regarding anti-obesity treatment, and finally the reviewers whose comments greatly improved the paper.

Affiliations

1. Department of Health Sciences, Adrian Building, University of Leicester, University Road, Leicester, LE1 7RH, UK

   • Michael J Crowther
   • , Paul C Lambert
   •  & Keith R Abrams

2. Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Box 281, S-171 77, Stockholm, Sweden

   • Paul C Lambert

Corresponding author

Correspondence to Michael J Crowther.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

All authors were involved in conception and design of the project. MJC conducted the simulation study, analysed the clinical dataset and wrote the first draft of the manscript. PCL and KRA both revised the manuscript. All authors read and approved the final manuscript.

Reprints and Permissions