 Research article
 Open Access
 Published:
Use of generalised additive models to categorise continuous variables in clinical prediction
BMC Medical Research Methodology volume 13, Article number: 83 (2013)
Abstract
Background
In medical practice many, essentially continuous, clinical parameters tend to be categorised by physicians for ease of decisionmaking. Indeed, categorisation is a common practice both in medical research and in the development of clinical prediction rules, particularly where the ensuing models are to be applied in daily clinical practice to support clinicians in the decisionmaking process. Since the number of categories into which a continuous predictor must be categorised depends partly on the relationship between the predictor and the outcome, the need for more than two categories must be borne in mind.
Methods
We propose a categorisation methodology for clinicalprediction models, using Generalised Additive Models (GAMs) with Pspline smoothers to determine the relationship between the continuous predictor and the outcome. The proposed method consists of creating at least one averagerisk category along with high and lowrisk categories based on the GAM smooth function. We applied this methodology to a prospective cohort of patients with exacerbated chronic obstructive pulmonary disease. The predictors selected were respiratory rate and partial pressure of carbon dioxide in the blood (PCO2), and the response variable was poor evolution. An additive logistic regression model was used to show the relationship between the covariates and the dichotomous response variable. The proposed categorisation was compared to the continuous predictor as the best option, using the AIC and AUC evaluation parameters. The sample was divided into a derivation (60%) and validation (40%) samples. The first was used to obtain the cut points while the second was used to validate the proposed methodology.
Results
The threecategory proposal for the respiratory rate was ≤ 20;(20,24];> 24, for which the following values were obtained: AIC=314.5 and AUC=0.638. The respective values for the continuous predictor were AIC=317.1 and AUC=0.634, with no statistically significant differences being found between the two AUCs (p =0.079). The fourcategory proposal for PCO2 was ≤ 43;(43,52];(52,65];> 65, for which the following values were obtained: AIC=258.1 and AUC=0.81. No statistically significant differences were found between the AUC of the fourcategory option and that of the continuous predictor, which yielded an AIC of 250.3 and an AUC of 0.825 (p =0.115).
Conclusions
Our proposed method provides clinicians with the number and location of cut points for categorising variables, and performs as successfully as the original continuous predictor when it comes to developing clinical prediction rules.
Background
Generally speaking, in medical practice it is quite common for physicians to take many clinical parameters that are essentially continuous variables and categorise them for practical reasons. Clinical practice tends to perceive test results as either normal or abnormal, or as normal, uncertain or abnormal, or alternatively to use such results as a severity scale of the patient’s prognosis for a given outcome. In particular, this is the case in clinical research where many continuous variables are categorised on the basis of the normality/abnormality principle, disease severity (ordinal) or grouping (nonordinal). This practice reflects physicians’ way of thinking and their clinical decisionmaking process, and so in a research context categorisation is a common way [1] of rendering results more useful and more practical.
More specifically, a field where categorisation is widely used is that of clinical prediction rules (CPRs), which are relevant for decisionmaking in medicine [2]. Many CPRs are based on statistical models in which a number of clinical variables are regarded as potential predictors. Where the aim is to apply the model to routine clinical practice, definitions of outcomes and predictors should be in line with standard practice [2]. Furthermore, both the association between the predictor and the response variable, and the probability distribution of the predictor could determine the strength of the covariate in the model. Hence, the final model’s performance and goodnessoffit will depend on the choice of a good and practical definition of the variables, an adequate measure of the association between predictor and outcome, and the strength of the covariate in the model. It is well documented that, from a purely statistical point of view, it is preferable to develop a statistical model using continuous rather than categorical covariates, since categorisation may lead to loss of information and reduction in power [3, 4]. From a practical standpoint, however, continuous predictors are not often considered in the development of CPRs [2, 5, 6]. There are two main reasons for this: firstly, whenever a continuous covariate is incorporated into a model, the assumption of the linear relationship between the outcome and the covariate should be tested, and this is often not acceptable. Consequently, the statistical analysis itself could become a methodological challenge. Secondly, categorisation is like a mirror of clinical practice. Research results are important in the development of clinical practice, where decisions tend to be categorical in nature. Consequently, models with categorical predictors could be more easily understood and applied to clinical decisionmaking by clinicians. At times, decisions are based on clinical criteria that take a continuous marker as baseline, and select one or more cut points to determine whether or not a given patient has a certain status or diagnosis. Such criteria can vary enormously from one practitioner, hospital or even country, to another (an illustration of this will be given below); indeed, a metaanalysis conducted by Lim and Kelly showed that reported cutoff values for PCO2 (partial pressure of carbon dioxide in the blood) for screening hypercapnia ranged from 30 to 46 mmHg [7]. The search for adequate categorisation of clinical continuous variables is thus a relevant topic in the development of CPRs.
Previous work has been done on the categorisation of continuous variables. In a review of methods for categorising a predictor, the methods concerned were divided into two groups [6]: a) exploratory plots; and, b) a minimum pvalue approach. Insofar as exploratory plots are concerned, Hin et al. proposed a method for dichotomising continuous variables using Generalised Additive Models (GAMs) [8]. The number of categories into which the continuous predictor should be categorised depends partly on the relationship graphical and numerical between the predictor and the outcome: hence, the need to create more than two categories should be borne in mind. This happens, for instance, with variables such as blood pressure, where a single cut point cannot be used to divide patients into high and lowrisk groups, since patients with high and those with low values are both associated with higher risk [9]. Furthermore, a very recent work criticised the arbitrary and frequent use made of quantiles in epidemiological research to categorise continuous variables [10].
Recent literature is unanimous in making the point that categorising continuous predictors should be well justified and motivated, and that, if necessary, the selected criterion for categorisation should be objective and sufficiently validated. The aim of this study was to propose a criterion for categorising continuous variables to be used in CPRs, by seeking both the optimal number of categories and the optimal cut points. The starting point of our proposed method is to examine the association between a continuous covariate and a predefined relevant outcome, using GAMs. This will allow us, in turn, to focus on the prediction of the chosen outcome, select the pertinent cut points, and create as many categories as required. The proposed method of categorisation considers the functional relationship between the covariate and the outcome, thereby ensuring that critical information is not lost from the continuous variable. Moreover, it is intended that the ensuing categorisation will be useful from a practical point of view, by combining good prediction ability with ease of use in routine clinical practice. The proposed method of categorisation was applied to real data drawn from the IRYSSCOPD Study (IRYSS: Red de investigación cooperativa para la Investigación en Resultados de Salud y Servicios Sanitarios  Cooperative Health Outcomes & Health Services Research Network), and then validated by comparing it to other methods.
The remainder of this paper is divided into three sections. In the Methods section, the GAM theory is briefly described and the proposed categorisation methodology is explained in detail. In addition, this section presents the IRYSSCOPD Study in which the proposed methodology is to be tested and validated, with a detailed outline of the methods used for validation purposes. The Results section reports the results of the application of the proposed methodology to real data as well as the validation process. Finally, the paper ends with a discussion and some conclusions.
Methods
The Methods section is divided into two subsections: the first is devoted to the theoretical aspects of the methodology and includes a brief introduction to GAMs, in order to render the proposed methodology more easily understandable; the second focuses on the methods for applying the proposed methodology to real data and the criteria selected for validating the proposal.
Theoretical methods
Generalised additive models
GAM [11] is an extension of the Generalised Linear Model (GLM) where the modelling of the mean functions relaxes the assumption of linearity, albeit additivity of the mean function pertaining to the covariates are assumed. Whilst the mean functions of some covariates may be assumed to be linear, the nonlinear mean functions are modelled using smoothing methods, such as kernel smoothers, lowess, smoothing splines or regression splines. In general, the model has the following structure
where μ = E(Y) for Y, a response variable with some exponential family distribution, g is the link function, and f _{ i } are some smooth functions of the covariates X _{ i } for each i = 1,…,p.
GAMs provide more flexibility than do GLMs, as they relax the hypothesis of linear dependence between the covariates and the expected value of the response variable. The main drawback of GAMs lies in the estimation of the smooth functions f _{ i }, and there are different ways to address this. One of the most common alternatives is based on splines, which allow the GAM estimation to be reduced to the GLM context [12]. Splines are piecewise polynomials that join at points called knots: two major families belong to these models, i.e., regression splines and smoothing splines. Regression splines consist of selecting the number and location of the knots, and imposing restrictions so that the piecewise polynomials join smoothly. Smoothing splines [13], use as many knots as unique values of the covariate X _{ i } and control the model’s smoothness by adding a penalty to the leastsquares fitting objective [14]. An intermediate alternative to building the smooth functions and one that considers the advantages of both smoothing and regression splines is the use of penalised splines (also known as Psplines), introduced by Eilers and Marx [15]. Psplines use fewer knots than smoothing splines and introduce more general roughness penalties which relaxes the importance of the knot location. We have included a brief description of splines here and more detailed theoretical information is included in Appendix Appendix 1: Splines.
Categorisation methodology
Our proposal consists of categorising continuous variables by using GAM models with Pspline smoothers. Without loss of generality, let us assume that there is a continuous variable X which we wish to categorise and a response variable Y with some exponential family distribution. In such a case, the GAM model defined in (1) is fitted with X as the covariate and Y as the response variable.
where g is the link function and μ = E(Y).
The aim of this method is to categorise the covariate X, based on the influence it has on the response variable Y. The number of categories as well as the location of the cut points will depend on the graphical relationship obtained by using the GAM model with Pspline smoothers. On the basis of this model, the graphical display shows the relationship between X and f(X), where X is plotted on the horizontal axis and the smooth function f is plotted on the vertical axis. f(X) is the centered mean function where the centering coefficient is α _{0}, this is f(X) = 0 refers to the average value of the covariate. We therefore propose to start by creating an averagerisk category around this averagerisk point, together with as many high and lowrisk categories as are required to capture the relationship between X and f(X), as outlined in detail below.
We consider an averagerisk category, by building an interval around the point x _{0} ∈ X, such that f(x _{0}) = 0. To do so, we calculate the value for x _{0}, by computing the inverse of f, and then the estimated value \widehat{{\mu}_{0}}, such that:
and its 95% confidence interval \left(\widehat{{\mu}_{{0}_{\mathit{\text{inf}}}}},\widehat{{\mu}_{{0}_{\mathit{\text{sup}}}}}\right) given by
and
where \mathit{\text{se}}\left(\widehat{{\mu}_{0}}\right) is the estimated standard error of the expected response given by the GAM evaluated at point \widehat{{\mu}_{0}}.
Finally, we obtain the interval \left({x}_{{0}_{\mathit{\text{inf}}}},{x}_{{0}_{\mathit{\text{sup}}}}\right) by reversing the process, such that
and
This is, the points {x}_{{0}_{\mathit{\text{inf}}}} and {x}_{{0}_{\mathit{\text{sup}}}} are thus the cut points that determine the averagerisk category. Therefore, the interpretation of this averagerisk category, is that for any x\in ({x}_{{0}_{\mathit{\text{inf}}}},{x}_{{0}_{\mathit{\text{sup}}}}) this point is considered an averagerisk point, the same as x _{0}.
If x _{0} is not unique, i.e., if the graph displayed crosses the vertical axis more than once at point 0, then there will be more than one averagerisk category, provided that the band at x _{0}, is not too wide (with the band being taken to mean the confidence interval shown in the graph). In other words, if x _{01} and x _{02} are two values for which the graph crosses the vertical axis at point 0, two averagerisk categories will be considered, as long as \left({x}_{0{1}_{\mathit{\text{inf}}}},{x}_{0{1}_{\mathit{\text{sup}}}}\right) and \left({x}_{0{2}_{\mathit{\text{inf}}}},{x}_{0{2}_{\mathit{\text{sup}}}}\right) do not overlap. If the last happens, we hypothesise that it may be due to two situations. The first is that one of the two intervals is based on a very small sample size which leads to a nonaccurate and hence very wide interval. The second is the overlapping of two intervals of similar size. Under the first circumstance, we suggest to dismiss the interval based on a very small sample. However, if the second circumstance happens, we will consider the union of both intervals as the averagerisk category.
Once the averagerisk category has been defined, the following two possible scenarios are considered in order to create high and lowrisk categories:

1.
The relationship shown on the graph between the covariate and the outcome given by the GAM is linear along the entire range of X. Under this scenario, we propose to categorise X into a minimum of three categories, with the cut points for the three being selected as the limits of the averagerisk category. This hypothetical situation is depicted in Figure 1(a). Moreover, if more categories are needed to ensure that the linear relationship between the covariate and the outcome is adequately retained, these could be created by considering appropriate cut points, preferably based on clinical criteria, in any of the designated highrisk or lowrisk categories; or,

2.
The relationship shown on the graph between the covariate and the outcome given by the GAM is not linear, which means that there is either a jump or a change in the slope. Firstly, we propose to proceed as described above for the first three categories, labelled "averagerisk", "lowrisk" and "highrisk". Secondly, the points at which the slope change occurs will be deemed to be extra cut points. Consequently, this will lead to the corresponding lowrisk or highrisk categories, or both, being recategorised as very low and low or very high and highrisk categories respectively. The selection of these extra cut points will be made on the basis of graphical visualisation of the slope and the clinical significance of the cut point in question. This hypothetical situation of one extra cut point is depicted in Figure 1(b)
In both cases, the need for more than the proposed minimum number of categories will be evaluated by comparing the results of adding more categories to the original continuous covariate, using the validation criterion explained in detail below.
Implementation methods
Application to the IRYSSCOPD study database
We applied the methodology proposed in this paper to a prospective cohort of patients with chronic obstructive pulmonary disease (COPD), including for study purposes a sample of 2877 patients with exacerbated COPD attending the emergency departments (EDs) of 16 participating hospitals in Spain. Information was recorded: at the date on which patients were evaluated at the ED; at the date on which the decision was made to admit patients or discharge them home; and during followup after admission or discharge home. The main data collected were those relating to patients’ respiratory function (e.g., arterial blood gases, respiratory rate (RR), dyspnea) on arrival at the ED and at the time of the decision to admit them to ward or discharge them home (for fuller details see the IRYSSCOPD Study [16]).
By way of an illustration of the application of the proposed methodology, we selected part of the IRYSSCOPD Study, specifically: one dichotomous outcome; poor evolution in the first 7 days from arrival at the ED (which includes any of the following: death, ICU admission, the need for invasive mechanical ventilation, cardiac arrest, noninvasive mechanical ventilation for more than 2 days when mechanical ventilation was not needed before admission, and/or admission to an intermediate respiratory care unit for 2 or more days [16]); and two continuous covariates, namely, the blood gas parameter, PCO2, and the RR. Exacerbated COPD is a severe condition quite commonly seen at EDs, where proper decisionmaking tools are vitally important for performing the necessary diagnoses and implementing the treatments that are urgently required. Among the basic diagnosis tests used for classifying the severity of presentation of exacerbated COPD in such patients, arterial blood gases are the main tool. PCO2 is a highly valuable item of information drawn from arterial blood gases; similarly, another key item of information is proper assessment of patients’ respiratory rate, something that is invariably affected in these cases. Furthermore, these two variables represent the two possible theoretical scenarios described above.
Considering a dichotomous outcome Y, the link logit was used in the GAM model. In such a case, the model described in (2) for one covariate X would be more precisely specified by the following expression:
where p represents the probability of Y = 1, which is interpreted as the probability of a patient having a poor evolution.
Validation
The total sample was randomly divided into a derivation (60%) and validation (40%) sample. Cut points were obtained using the derivation sample while validation sample was used for method evaluation purposes.
The method for categorising continuous covariates was evaluated, by comparing the performance of the proposed categorical predictor in the model to that of the original continuous variable modelled by a GAM as the best option in the same model. In addition, we also compared the proposed categorisation to the dichotomised variable suggested by Hin et al. (1999) [8].
To compare models using different approaches to represent the same covariate, two criteria were selected: the first was the Akaike Information Criterion (AIC), a wellknown, classical method for comparing two models [17]; the second method of evaluation was based on the specific model defined in equation (3) and the study’s designated purpose. In this particular case, we desired to evaluate the prediction ability of the model selected. We thus proposed to use the area under the receiver operating characteristic (ROC) curve (AUC) as the parameter that quantifies a logistic model’s ability to predict. The AUCs for two ROC curves were compared using the DeLong test [18].
Additionally, the goodnessoffit of the proposed categorisation was evaluated by means of the HosmerLemeshow test, which assesses the concordance between observed and expected event rates in a logistic regression model [19]. Finally, the need for additional categories, in excess of a minimum of three, was also checked by testing for statistically significant differences in risk between additional and adjacent categories.
Finally, we performed a sensitivity analysis in order to assess the impact sample size may have on the width of the averagerisk category. We recalculated the averagerisk category for PCO2 and for samples of size 200, 400, 600, 800, 1000 and 1200 obtained resampling without replacement from the original sample.
All statistical analyses were performed using the R software package. The mgcv, BB and pROC libraries were specifically used to compute the GAM model, cut points and AUC values respectively. The R code used to implement the proposed methodology in the application presented here is shown in Additional file 1.
Results
Categorisation process
RR: The relationship between the RR and poor evolution, as plotted by an additive logistic regression model with smoothing Psplines, is depicted in Figure 2. It will be seen that the relationship between the RR and poor evolution was linear and that there was only one value for which f(x _{0}) = 0 (x _{0} = 22). Application of the proposed methodology to determine the limits of the averagerisk category showed this category to be (2024). It was therefore decided that the RR would be classified into 3 categories (Figure 2), with a high risk of poor evolution for values above 24 and a low risk of poor evolution for those below 20: accordingly, our final proposal for classifying the RR into three categories was ≤ 20; (20,24]; > 24.
In the search for an optimal fit to the original model, the need for a fourth category was explored. Taking the number of individuals with an RR above 24 and the available clinical information about the disease into consideration [20], an additional cut point of 30 was selected. The following fourcategory RR version, namely, ≤ 20; (20,24]; (24,30]; > 30, was thus also tested.
In addition, the RR variable was dichotomised as indicated before, whereby an RR value for which there is an average risk of poor evolution is taken as the cut point, which in our case was 22: consequently, our dichotomous RR proposal was ≤ 22; > 22.
PCO2: The relationship between PCO2 and poor evolution, as plotted by an additive logistic regression model with smoothing Psplines, is shown in Figure 3. In this case, the relationship did not prove linear, with a trend towards a less steep slope for higher values. We started by calculating an averagerisk category: this was (4352), meaning that there was a high risk of poor evolution for values above 52 and a low risk of poor evolution for those below 43. The need to select more cut points was then explored. From 40 to 43, the relationship was linear, and below this there was no significance because the confidence interval was too wide. Above 52, however, there were several points where there was a slope change. While all values above 80 were dismissed, since the confidence interval was too wide and there were very few patients with PCO2 values as high as this, graphical examination of values below 80 nevertheless showed 65 to be a reasonable cut point for distinguishing between the high and very highrisk categories. Finally, we decided on the 4category PCO2 proposal shown in Figure 3, namely, ≤ 43;(4352]; (5265]; > 65.
As in the case of the RR above, the PCO2 variable was also dichotomised, whereby a PCO2 value for which there is an average risk of poor evolution is taken as the cut point. Since the value in this particular instance was 47, the dichotomous PCO2 proposal was therefore ≤ 47; > 47.
Validation
We considered the assessment parameters, AIC and AUC, obtained from the continuous predictor in a GAM as the best option and those obtained with the dichotomised option as perhaps needing improvement. Detailed results of the validation process are shown in Table 1.
RR: Our approach proposed that the RR be classified into a minimum of 3 categories, for which the following values were obtained: AIC=314.5 and AUC=0.638 for the 3category option versus AIC=317.1 and AUC=0.634 for the continuous predictor, with no statistically significant differences being found between the two AUCs (p = 0.8198). The respective values for the dichotomous predictor were AIC=318.1 and AUC=0.594. Statistically significant differences in AUCs were observed between the dichotomous and proposed 3category approaches (p = 0.049).
Lastly, the 4category option yielded an AIC of 316.2 and an AUC of 0.64. No statistically significant differences in AUCs were observed when this was compared to both the continuous (p = 0.6833) and the 3category approaches (p = 0.5968). Moreover, when the model for the 4category option was adjusted, however, nonstatistical differences were found between the estimated parameters for the (24,30] and > 30 categories (p = 0.074). Detailed results of the adjusted model are shown in Table 2.
Additionally, the models for the 4category and 3category options were both well calibrated (HosmerLemeshow test pvalues > 0.05 in both cases). Furthermore, when the proposed 3category option was applied to other outcomes, such as admission to ward, it was able to detect differences between categories. When compared to the averagerisk category, the estimates of the coefficients in a logistic model for the low and highrisk categories were 0.81 and 0.68 respectively (pvalues < 0.001 in both cases).
PCO2: Our approach proposed that the PCO2 variable be classified into 4 categories, for which the following values were obtained: AIC=258.1 and AUC=0.81 for the 4category option versus AIC=250.26 and AUC=0.825 for the continuous predictor, with no statistically significant differences between the two AUCs (p = 0.1148). The respective values for the dichotomous predictor were AIC=281.5 and AUC=0.742. Statistically significant differences in AUCs were observed, not only between the continuous and dichotomous approaches (p < 0.0001), but also between the dichotomous and proposed 4category approaches (p = 0.0001). In addition, we verified the need to create a fourth category, by comparing the 4category against the 3category predictor (our minimum proposal). Statistically significant differences were found between both AUCs (p = 0.0004), with the AUC value for the 3category predictor being 0.779.
Furthermore, when the model for the 4category option was adjusted, statistically significant differences were found between the estimated parameters for the (5265] and > 65 categories (p < 0.0001). Lastly, the HosmerLemeshow test assessed the goodnessoffit of both the 3 and 4category options (p > 0.05). Detailed results are shown in Table 2.
Moreover, when the proposed 4category option was applied to other outcomes, such as admission to ward, it was able to detect differences between categories. When compared to the averagerisk category, the estimates of the coefficients for the low, high and very highrisk categories were 0.16, 0.67 and 1.49 respectively (pvalues of 0.24, < 0.001 and < 0.001 respectively).
Additionally, testing the performance of both variables in a multivariate logistic regression model, comparison between the model with RR and PCO2 as continuous and that with these two variables classified into 3 and 4 categories respectively yielded no statistically significant differences in AUCs (AUC=0.827 for the former versus AUC=0.814 for the latter; p = 0.7021).
Finally, results from the sensitivity analysis for sample size variation for PCO2 are shown in Figure 4.
Discussion
In clinical practice, decisions need to be made by reference to clinical parameters, which are usually continuous measurements. Accurate knowledge of the relationship between such parameters and the risk of developing a certain outcome helps identify individuals most at risk. Considering these parameters as continuous predictors is preferable from a statistical point of view, since categorisation may lead to loss of information and reduction in power [3]. Nevertheless, in the development of CPRs for application in clinical practice, it may be preferable for a certain amount of information to be sacrificed in the interests of enhanced utility and ease of use in daily clinical practice.
When the researchers were developing a prediction model in the context of the IRYSSCOPD Study, several reasons led them to categorise the continuous clinical variables that had been collected for study purposes. Not all the data needed for the study were available in the clinical records, and even where these were available, they were not always in a desirable format, appearing, for instance, as a description of patient status rather than a numerical value, e.g., in the IRYSSCOPD Study, some patients’ RR was recorded as “eupneic” or “taquibneic” instead of being cited as a number on a continuous scale. Despite the fact that clinicians failed to agree on the cut points to apply to each code, they did, in contrast, regard the “eupneic” and “taquibneic” patients as “normal” and “altered” respectively, which means that, while they would be able to classify such patients on a categorical scale, they would nevertheless leave them as missing data on a continuous scale. The adoption of categorisation of these parameters that are partially available as continuous variable and partially available as ordinal variable facilitate reconciliation of information. Moreover, in a study such as the IRYSSCOPD [16], ED clinical practice prevails over research requirements. Hence, the data available was the information routinely recorded at the ED for COPD patients. In our opinion, the sacrifice of some information in the subset of data recorded as continuous variable to avoid information exclusion of the subset of data recorded as ordinal variable is a worthwhile tradeoff. One consequence of this was that, categorisation of variables such as RR, enabled an average of 38% of values not to be excluded.
Bearing this in mind, our aim was to furnish a method of categorisation for clinical parameters selected as predictors, taking the following three principles into account: 1) categorisation would depend on the outcome of interest and, by extension, on the model selected for analysis; 2) any loss of information as compared to the continuous predictor would be minimal; and 3) the method would provide clinicians with a convenient and easily interpretable categorical predictor.
Studying the relationship between the predictor and the outcome was absolutely necessary in order to fulfil the first two principles. We decided to start by plotting the relationship graphically. GAM functions were selected because they are a powerful technique for estimating the relationship between continuous predictor variables and outcomes [11], with no need for any assumptions about this relationship. Pspline smoothers are suggested in the literature as being the most convenient technique for estimating smooth functions [21]. When developing the proposed methodology, we considered the method suggested by Hin et al. (1999) [8] as the first approach to our designated objective: their proposal consists of dichotomising the predictor variable by using GAMs, taking the value for which an average risk is obtained as the cut point. We felt that a specific cut point could be highly dependent on the sample size or even the random sample itself, and that an interval, rather than a single point, might therefore be a wiser choice as an averagerisk category. Although sample size would also affect the length of any interval, the latter would nevertheless provide more information to clinicians than would a single point. On the other hand, ensuring a minimum loss of information visàvis the continuous variable was one of our stated goals, and so we hypothesised that two categories were possibly not enough.
Our proposal, motivated in part by the work by Hin et al (1999) [8], occupies the middle ground between their approach and the original continuous predictor. This paper shows that our categorisation proposal does not lose critical information from the original predictor, respects the relationship between the original predictor and the outcome, and offers validated results with better predictive ability than does the dichotomous approach. Moreover, our proposal starts by suggesting a minimum number of 3 categories, and offering the necessary cut points to ensure that such a categorisation is a good categorised approximation to the continuous option. We have shown that in general, this approach improves Hin et al proposal (1999) in terms of fitting and prediction. The proposal includes a method to build an interval around the averagerisk point using the inverse of the 95% confidence interval for the expected response. Although more complex techniques could provide other alternatives, in our opinion this is a simple and easy to understand way that shows the advantages and usefulness of a three category approach. In any given case, the need for more categories can be evaluated by researchers, depending upon the relationship between the predictor and the outcome, sample size and clinical knowledge of the problem. Moreover, any improvement resulting from the addition of more categories can be statistically tested. Although this is an illustrative example, in the application presented here we selected 4 categories for PCO2 and 3 categories for RR.
The first limitation of the proposed categorisation lies in the fact that it depends on the outcome and so its use cannot be recommended in every situation. This means that one might obtain different categorisation proposals for the same predictor, if one were to consider different outcomes or different modelling approaches. Although this characteristic of the proposal could be seen as a strength in the specific modelling situation, it must however be carefully reviewed when different modelling situations are being considered. Moreover, the proposed method of categorisation for one continuous predictor can be applied with additional (continuous or categorical) covariates in the model, which means that categorisation can be tailored to the model, including adjustment for several confounders. We have previously mentioned that the width of the averagerisk category will depend on sample size, which is an obvious limitation. Sensitivity analysis showed that for sample sizes above 200 results were quite stable, while for size 200 the interval was much wider. In our opinion, for a moderate sample size as 200 probably there was not enough data to catch the relationship between the predictor and the response variable, and so, the averagerisk category became very wide. In a simulation study with samples of size 200, we obtained that in 90% of them there were no differences between our proposal and the method suggested by Hin et al. (1999) [8]. Therefore, in this case we would recommend to check the performance of the dichotomised option first, merely for simplicity. Nevertheless, our proposal includes assessing the need for that third category in each case, and it compares the two versus the three categories approaches. The third limitation of our proposal resides in the subjectivity implied in the selection of extra cut points, in cases where more than three categories were necessary. We have given an outline of a way to do this in two different situations; and indeed, the addition of extra cut points in one of the specific applications was shown to improve the final result. However, we have also shown that improvement is progressive, increasing as more cut points are added, basically because comparison is made with the continuous predictor. Cut points are selected on the basis of the predictor/outcome relationship given by the graphical display, which means that as more cut points are added, not only will the categorical and the continuous predictors be more similar, but the selected categorisation will also be more datadependent. Apart from statistical significance, therefore, an important part of researchers’ work will be to seek a balance between loss of information and practicality.
In brief, we propose a method for categorising continuous predictors in clinical prediction models, which includes both the number of categories and the best cut points. The proposal has been facevalidated by clinicians, and the proposed categorical predictor has been shown to perform as successfully as the original continuous predictor when it comes to developing CPRs.
Appendix 1: Splines
In general, the generalized additive model has the following structure
where μ = E(Y) for Y, a response variable with some exponential family distribution, g is the link function, and f _{ i } are some smooth functions of the covariates X _{ i } for each i = 1,…,p.
The most common alternative for the estimation of the smooth functions f _{ i } are based on splines. Splines are piecewise polynomials, being pieces defined by a sequence of knots ζ _{1} < ζ _{2} < …ζ _{ m }, in such a way that pieces join smoothly at these knots. A spline of degree r can be defined by a power series as follows:
where
The most popular splines are cubic splines or splines of degree 3 (r = 3), of the form:
Smoothing splines are discussed in detail in Green and Silverman (1994) [13]. The use of smoothing splines with as many nodes as observations per GAM component, reduces the problem to the GLM with a penalty parameter of the curvature of the curve, thus imposing smoothing. Traditionally, smooth functions estimation is performed at a time, through an iterative algorithm on each smooth function, keeping the rest of the GAM components fixed in the obtained estimation, until the convergence is achieved. The resulting system of equations has N × p equations, which makes it a computationally difficult estimation problem (N number of observations and p number of covariates).
An alternative which allows to adjust all the smooth functions integrated in the GAM simultaneously is the use of regression splines, where the smooth functions are built as the sum of Bsplines [22]. Actually, what it is used is a base of splines to build the smooth functions, hence the name Bsplines. In general, a Bspline basis of degree r comprises:

1.
(r + 1) piecewise polynomials, each of degree r

2.
These (r + 1) piecewise polynomials join at r inner knots.

3.
At the junction point, the derivatives up to r  1 order are continuous.

4.
The Bspline is positive on a domain covered by r + 2 knots and zero otherwise.

5.
Except at the frontiers, each Bspline overlaps with 2r neighbour piecewise polynomials.

6.
For each value x of X, there are r + 1 nonzero Bsplines.
In this way, a smooth Bspline base is independent of the response variable. The smooth functions are modelled as a base of Bsplines depending on the following factors: i) the range of the independent variable X; ii) The number and location of knots; and iii) the degree of the Bspline.
When using this smoothing approach, for each GAM component, the smooth function is reduced to a linear combination of Bsplines f _{ i } = B _{ i } α _{ i }, where for each i = 1,…,p, B _{ i } is the Bsplines matrix of N × m dimension (N number of observations and m number of knots). This is,
and α _{ i } = (α _{1i },…,α _{ m i })^{T} is the mdimensional coefficient vector, associated to the Bspline basis, also called the Bsplines amplitudes. As an example, in the particular case in which there is one covariate and a normally distributed response variable, the expression (4) reduces to:
so that α can be estimated as in a GLM model by minimizing the residual sum of square given by:
where b _{ j k } = B _{ k }(x _{ j }) is the value of the kth Bspline at the point x _{ j }. The smoothness of the curve depends on the number of Bsplines, hence, the number of knots and the value of the amplitudes, and therefore, the αvector. The advantage of this option is that Bsplines are easy to build, but the main problem now resides in the optimization of the position and the number of knots.
An intermediate alternative to build the smooth functions, which considers both the smoothing splines and the regression splines advantages is the use of penalized splines also known as Psplines and introduced by Eilers and Marx [15]. Psplines use fewer knots than smoothing splines and introduce more general roughness penalties which relaxes the importance of the knot location. The idea is to start with a Bspline basis, considering more knots than if we were using regression splines (but not as many as observations), and subsequently introduce a penalization in the same way as if we were using smoothing splines. However, in Psplines, the coefficients of the model are the ones penalized rather than the curvature. In this way, similar coefficients are obtained for those nearby, and this provides a computational advantage over smoothing splines.
The substitution of the term Bspline for the term Pspline is motivated by the fact that the model fitting method is modified. The model based on Psplines is based on setting a reasonable number of knots, adding a penalty to the differences in coefficients between each two adjacent knots. Thus the number of knots ensures flexibility while avoiding the overestimation and ensuring smoothness by penalization.
If we consider the same conditions as in (4) the GAM based on Psplines can be expressed as:
where α = {\left({\alpha}_{11},\dots ,{\alpha}_{1{m}_{1}},\dots ,{\alpha}_{p1},\dots ,{\alpha}_{p{m}_{p}}\right)}^{\mathbf{\text{T}}} is the coefficients vector, m _{ i } is the number of Psplines, this is, the number of knots, for the i ^{th} covariate, for each i = 1,…,p. and B is the N\times (1+\sum _{i=1}^{p}{m}_{i}) regressor matrix defined as
In general, the estimation method consists on maximizing the penalized version of the loglikelihood expressed as:
where the term l(y;α) represents the loglikelihood of the vector of response variables Y; for each i=1,…,p the λ _{ i } ≥ 0 are the smoothing parameters and P _{ i } is a m _{ i } × m _{ i } dimension matrix that defines the penalty structure over the ddimensional differences between every two adjacent Psplines coefficients. The estimation method is explained in detail in [23].
Abbreviations
 AIC:

Akaike Information Criterion
 COPD:

Chronic Obstructive Pulmonary Disease
 CPR:

Clinical Prediction Rule
 ED:

Emergency Department
 GAM:

Generalised Additive Model
 GLM:

Generalised Linear Model
 ROC:

Receiver Operating Characteristic
 RR:

Respiratory Rate
 PCO2:

partial pressure of carbon dioxide in the blood
 CI:

Confidence Interval.
References
Turner E, Dobson J, Pocock J: Categorisation of continuous risk factors in epidemiological publications: a survey of current practice. Epidemiol Perspect Innov. 2010, 7: 910.1186/1742557379.
Steyerberg EW: Clinical Prediction Models. A Practical Approach to Development, Validation, and Updating. 2009, New York: Springer
Royston P, Altam D, Sauerbrei W: Dichotomizing continuous predictors in multiple regression: a bad idea. Stat Med. 2006, 25: 127—141
Froslie K, Roislien J, Laake P, Henriksen T, Qvigstad E, Veierod M: Categorisation of continuous exposure variables revisited. A response to the Hyperglycaemia and Adverse Pregnancy Outcome (HAPO) Study. BMC Med Res Methodol. 2010, 10: 10310.1186/1471228810103.
Bouwmeester W, Zuithoff N, Mallett S, Geerlings M, Vergouwe Y, Steyerberg E, Altman D, Moons K: Reporting and methods in clinical prediction research: a systematic review. Plos Med. 2012, 9: e100122110.1371/journal.pmed.1001221.
Mazumdar M, Glassman J: Categorizing a prognostic variable: review of methods, code for easy implementation and applications to decisionmaking about cancer treatments. Stat Med. 2000, 19: 113132. 10.1002/(SICI)10970258(20000115)19:1<113::AIDSIM245>3.0.CO;2O.
Lim B, Kelly A: A metaanalysis on the utility of peripheral venous blood gas analyses in exacerbations of chronic obstructive pulmonary disease in the emergency department. Eur J Emerg Med. 2010, 17: 246248. 10.1097/MEJ.0b013e328335622a.
Hin L, Lau T, Rogers M, Chang M: Dichotomization of continuous measurements using generalized additive modelling  application in predicting intrapartum caesarean delivery. Stat Med. 1999, 18: 11011110. 10.1002/(SICI)10970258(19990515)18:9<1101::AIDSIM99>3.0.CO;2Q.
Hansson L, Zanchetti A, Carruthers S, Dahlöf B, Elmfeldt D, Julius S, Ménard J, Rahn K, Wedel H, Westerling S: Effects of intensive bloodpressure lowering and lowdose aspirin in patients with hypertension: principal results of the Hypertension Optimal Treatment (HOT) randomised trial. Lancet. 1998, 351: 17551762. 10.1016/S01406736(98)043116.
Bennette C, Vickers A: Against quantiles: categorization of continuous variables in epidemiologic research, and its discontents. BMC Med Res Methodol. 2012, 12: 2110.1186/147122881221.
Hastie T, Tibshirani R: Generalized Additive Models. 1990, London: Chapman & Hall
Currie I, Durban M, Eilers P: Generalized linear array models with applications to multidimensional smoothing. J R Stat Soc B. 2006, 68: 259280. 10.1111/j.14679868.2006.00543.x.
Green P, Silverman B: Nonparametric Regression and Generalized Linear Models. 1994, London: Chapman & Hall
Ruppert D: Selecting the number of knots and for penalized splines. J Comp Graph Stat. 2002, 11: 735757. 10.1198/106186002853.
Eilers P, Marx B: Flexible smoothing with Bsplines and penalties. Stat Sci. 1996, 11: 89121. 10.1214/ss/1038425655.
Quintana J, Esteban C, Barrio I, Garcia S, Gonzalez N, Arostegui I, Lafuente I, Bare M, Blasco J, Vidal S, TI G: The IRYSSCOPD appropriateness study: objectives, methodology, and description of the prospective cohort. BMC Health Serv Res. 2011, 11: 32210.1186/1472696311322.
Akaike H: A new look at the statistical model identification. IEEE T Automat Contr. 1974, 19: 716723. 10.1109/TAC.1974.1100705.
Robin X, Turck N, Hainard A, Tiberti N, Lisacek F, Sanchez J: Müller M: pROC: an opensource package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics. 2011, 12: 7710.1186/147121051277.
Hosmer D, Lemeshow S: Applied Logistic Regression. 2000, New Jersey: Wiley
Quintana JM, GarciaGutierrez S, Aguirre U, GonzalezHernandez N: Estándares de uso adecuado de tecnologías sanitarias. Creación de criterios explícitos de indicación de ingreso hospitalario en la exacerbación de EPOC. 2008, Madrid: Agencia Laín Entralgo
Rice J, Wu C: Nonparametric mixed effects models for unequally sample noisy curves. Biometrics. 2001, 57: 253259. 10.1111/j.0006341X.2001.00253.x.
de Boor: A Practical Guide to Splines. 1978, New York: Springer
Marx B, Eilers P: Direct generalized additive modeling with penalized likelihood. Comput Stat Data Anal. 1998, 28: 193209. 10.1016/S01679473(98)000334.
Prepublication history
The prepublication history for this paper can be accessed here:http://www.biomedcentral.com/14712288/13/83/prepub
Acknowledgements
This study was supported by grants UE+09/62, MTM201014913, GIU10/21, 2012111008, IT62013 and UFI11/52. The work of IB was supported by grant GIU10/21 from the University of the Basque Country UPV/EHU and the CIBER en Epidemiología y Salud Pública (CIBERESP). The collection of the COPD data used for this study was supported in part by grants from the Fondo de Investigación Sanitaria (PI 061010, PI061017, PI06714, PI060326 and PI060664), Basque Country Regional Health Authority, Galdakao Hospital Research Committee and the thematic networks Red IRYSS (Investigación en Resultados y Servicios Sanitarios) of the Instituto de Salud Carlos III (G03/220). The authors declare that there were no conflicts of interest and, lastly, would like to thank María Xosé RodríguezÁlvarez for her invaluable help with the implementation of the R code, Michael Benedict for revising the English and the referees and the associate editor for providing thoughtful comments and suggestions which led to substantial improvement of the presentation of the material in this article. The IRYSS COPD group included the following coinvestigators: Dr. Jesús MartínezTapias (Hospital Virgen de las Nieves, Granada); Alba Ruiz (Hospital de Motril, Granada); Dr. Eduardo Briones (Unidad de Epidemiología, Distrito Sanitario Sevilla), Dra. Silvia Vidal (Unidad de Investigación, Hospital Costa del Sol, Marbella); Dr. Emilio Perea Milla, Francisco Rivas (Servicio de Epidemiología, Hospital Costa del Sol, Málaga  REDISSEC); Dr. Maximino Redondo (Servicio de Laboratorio, Hospital Costa del Sol, Málaga  REDISSEC); Javier Rodríguez Ruiz (Responsable de Enfermería del Área de Urgencias, Hospital Costa del Sol, Málaga); Dra. Marisa Baré (Epidemiología y Evaluación, Corporació Sanitaria Parc TaulíCSPT, Sabadell REDISSEC), Dra. Concepción Montón (Servicio de Neumología, CSPT REDISSEC), Dr. Manel Lujan, Dra. Amalia Moreno, Dra. Josune Ormaza, Dr. Javier Pomares (Servicio de Neumología, CSPT); Dr. Juli Font (Medicina, Servicio de Urgencias; CSPT), Dra. Cristina Estirado, Dr. Joaquín Gea (Servicio de Neumología, Hospital del Mar, Barcelona); Dra. Elena Andradas (subdirectora de Promoción de la Salud y Epidemiología del Ministerio de Sanidad, Servicios Sociales e Igualdad), Dr. Juan Antonio Blasco (Unidad de Evaluación de Tecnologías Sanitarias, Agencia Laín Entralgo, Madrid), Dra. Nerea Fernández de Larrea (Subdirección General de Tecnología e Innovación Sanitarias. Consejería de Sanidad de la Comunidad de Madrid/REDISSEC); Dra. Esther Pulido (Servicio de Urgencias, Hospital GaldakaoUsansolo, Bizkaia); Dr. Jose Luis Lobo (Servicio de Neumología, Hospital Txagorritxu, Araba); Dr. Mikel Sánchez (Servicio de Urgencias, Galdakao); Dr. Luis Alberto Ruiz (Servicio de Respiratorio, Hospital de Cruces, Bizkaia); Dra. Ane Miren Gastaminza (Hospital San Eloy, Bizkaia); Dr. Ramon Agüero (Servicio de Neumología, Hospital Marques de Valdecilla, Santander); Dr. Gabriel Gutiérrez (Servicio de Urgencias, Hospital Cruces, Bizkaia); Dra. Belén Elizalde (Dirección Territorial de Gipuzkoa); Dr. Felipe Aizpuru (Unidad de Investigación, Hospital Txagorritxu, Álava/REDISSEC); Dra. Inmaculada Arostegui (Departamento de Matemática Aplicada, Estadística e Investigación Operativa, UPV/EHU REDISSEC; Amaia Bilbao (Hospital Universitario Basurto/REDISSEC); Dr. Cristóbal Esteban (Servicio de Neumología, Hospital GaldakaoUsansolo, Bizkaia/REDISSEC); Dra. Nerea González, Susana Garcia, Iratxe Lafuente, Urko Aguirre, Irantzu Barrio; Miren Orive, Edurne Arteta, Dr. Jose M. Quintana (Unidad de Investigación, Hospital GaldakaoUsansolo, Bizkaia/REDISSEC).
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
Study design, IB, IA and JMQ; proposal of analysis to be performed, IB and IA; statistical analysis and outcomes: IB and IA; interpretation of results, IB, IA and JMQ; drafting, review and revision of text, IB, IA and JMQ; datacollection, all IRYSSCOPD Group members. All authors read and approved the final manuscript.
Electronic supplementary material
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Barrio, I., Arostegui, I., Quintana, J.M. et al. Use of generalised additive models to categorise continuous variables in clinical prediction. BMC Med Res Methodol 13, 83 (2013). https://doi.org/10.1186/147122881383
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/147122881383
Keywords
 Respiratory Rate
 Akaike Information Criterion
 Exacerbate Chronic Obstructive Pulmonary Disease
 Regression Spline
 Continuous Predictor