Skip to main content
Download PDF

A hybrid machine learning framework to improve prediction of all-cause rehospitalization among elderly patients in Hong Kong

BMC Medical Research Methodology volume 23, Article number: 14 (2023) Cite this article

A Correction to this article was published on 13 February 2023

This article has been updated

Abstract

Background

Accurately estimating elderly patients’ rehospitalisation risk benefits clinical decisions and service planning. However, research in rehospitalisation and repeated hospitalisation yielded only models with modest performance, and the model performance deteriorates rapidly as the prediction timeframe expands beyond 28 days and for older participants.

Methods

A temporal zero-inflated Poisson (tZIP) regression model was developed and validated retrospectively and prospectively. The data of the electronic health records (EHRs) contain cohorts (aged 60+) in a major public hospital in Hong Kong. Two temporal offset functions accounted for the associations between exposure time and parameters corresponding to the zero-inflated logistic component and the Poisson distribution’s expected count. tZIP was externally validated with a retrospective cohort’s rehospitalisation events up to 12 months after the discharge date. Subsequently, tZIP was validated prospectively after piloting its implementation at the study hospital. Patients discharged within the pilot period were tagged, and the proposed model’s prediction of their rehospitalisation was verified monthly. Using a hybrid machine learning (ML) approach, the tZIP-based risk estimator’s marginal effect on 28-day rehospitalisation was further validated, competing with other factors representing different post-acute and clinical statuses.

Results

The tZIP prediction of rehospitalisation from 28 days to 365 days was achieved at above 80% discrimination accuracy retrospectively and prospectively in two out-of-sample cohorts. With a large margin, it outperformed the Cox proportional and linear models built with the same predictors. The hybrid ML revealed that the risk estimator’s contribution to 28-day rehospitalisation outweighed other features relevant to service utilisation and clinical status.

Conclusions

A novel rehospitalisation risk model was introduced, and its risk estimators, whose importance outweighed all other factors of diverse post-acute care and clinical conditions, were derived. The proposed approach relies on four easily accessible variables easily extracted from EHR. Thus, clinicians could visualise patients’ rehospitalisation risk from 28 days to 365 days after discharge and screen high-risk older patients for follow-up care at the proper time.

Peer Review reports

Introduction

Hospitalisation amongst older adults is common [1], prolonged [2], avoidable [3] and often results in rehospitalisation [4] compared with that of their younger counterparts. As the global population ages rapidly [5], the disease burden that an ageing population imposes on the healthcare system also exacerbates [6]. Predicting older patients’ rehospitalisation risk could benefit clinical decisions and service planning. However, studies predicting probability of rehospitalisation focus primarily on the post-discharge timeframe of 28 or 30 days, and predictors such as patients’ diagnostic and clinical profiles and the care quality received prior to discharge [7]. Moreover, the performance of the published models of 28-day (or sometimes 30-day) rehospitalisation is generally modest, with only a few notable exceptions [7]. No statistical difference has been observed between the performance of regression-based models and applied machine learning (ML, mean c-statistics of 0.74 vs. 0.71) [7] even though ML generally outperforms traditional statistical models [8,9,10,11,12,13,14].

The modest performance of models that use patients’ acute diagnoses and clinic profiles as predictors deteriorates quickly when the timeframe of rehospitalisation prediction goes beyond 28 days post-discharge. Similarly, poorer model performance is found in studies with older adults as participants than with only younger ones [15]. In particular, the prediction performance is even poorer when modelling older adults’ rehospitalisation over an extended timeframe (e.g. 1 year) by using only the clinical characteristics of patients in an acute care setting as the predictors [16, 17]. Meanwhile, some studies considered older adults’ rehospitalisation over an extended timeframe by using predictors related to functionality and dependency [18,19,20,21,22]. Frequent hospitalisations were often defined as having two or more episodes of hospitalisations within a year [21,22,23,24,25]. The predictors based on which rehospitalisation over an extended timeframe is modelled are momentous measures of one’s level of deterioration rather than patients’ clinical and diagnostic statuses; the performance of these models was also modest, with an average c-statistics of 0.69 [26,27,28,29,30,31,32,33,34,35,36,37,38,39].

In sum, the literature showed that the performance of modelling older adults’ rehospitalisation is modest for a 28- to 30- day prediction after discharge, and the model performance deteriorates for a longer-range prediction, after controlling the effect of diagnostic/clinical/functional profiles of patients and care quality patients received prior to discharge. To the authors’ knowledge, neither the frequently-used regression-based models nor the ML models in the literature have accounted for any temporal dimension [7, 40, 41]. To this end, the present study aimed to develop a model for estimating elderly rehospitalisation risk within any timeframe under 1 year by accounting for older adults’ deterioration over time. With the model developed here, risk estimators were derived, and the proposed approach was validated retrospectively and prospectively. The proposed model’s effect was also iteratively compared against the effects of any post-acute, ambulatory and residential care received after discharge by hybridising the risk estimator with an ML model [42, 43]. Notably, it has been shown that post-acute and ambulatory services received post-discharge are less likely to be rehospitalised, and older adults are more likely to have received convalescent and ambulatory care upon discharge [44, 45]. By contrast, older residential care recipients are more likely to be hospitalised than community -dwelling order adults [46]. However, to the authors’ knowledge, none of the published models on rehospitalisation prediction accounted for the effects of post-acute, ambulatory and residential care that elderly patients received post-discharge.

Method

This study is based on data extracted from electronic health records (EHRs) of older patients (60+) admitted to the medical ward (internal medicine) of the study hospital (a 1900-bed acute tertiary hospital in Hong Kong) between 2014 and 2017. For the purpose of model building, we tracked the rehospitalisation episodes of a cohort of community-dwelling patients who were discharged in 2014 for at least 1 year, with the last discharge of the cohort tracked until Dec 31, 2015. It is of note that community-dwelling patients, unlike residents of residential care homes, had no around-the-clock professional care provided post-discharge. After having developed the model, the model was validated retrospectively and prospectively. In retrospective validation, the model was tested in an out-of-sample cohort whose outcomes of interest were already known at the time of the study. By contrast, prospective validation examined the model’s accuracy by predicting an outcome that was unknown at the time of prediction and only verified the prediction when the outcome had become known. Here, for the purpose of prospective validation, data were collected after the proposed model was piloted as part of the clinical operations of the study hospital. More specifically, retrospective validation was carried out on an out-of-model sample of community-dwelling patients discharged in 2015 (from January to December). Their rehospitalisation episodes were tracked for a year, with the last discharge of the retrospective validation cohort tracked until Dec 31, 2016. Prospective validation was conducted monthly on 12-month cohorts discharged in 2016 from the study hospital.

Cohorts for model validation versus model training were split to avoid overlaps in admission records, individual patients, or timeframes. For example, models for estimating risk should reflect the “intended clinical use” [74]. The proposed model’s intended clinical use is to enable decision-makers to estimate the future rehospitalisation risk of the current cohort of patients about to be discharged. Thus, this study has taken the more challenging task of testing the model with data sampled from a subsequent period rather than contemptuous ones.

No statistical difference was found between the model-building and model-validation datasets concerning the following metrics: the 28-day rehospitalisation rates were 21.6 and 20.5% in the model-building and model-validation datasets, respectively; the corresponding averages of acute length of stay (LOS) were 6.3 and 6.0, respectively; the intensive-care-unit (ICU) admission rates were 0.304 and 0.342%, respectively; and amongst those admitted to the ICU, the average ICU LOSs were 5.6 and 8.3 days, respectively. The prevalence of having ever been diagnosed with chronic illnesses in the model-building and model-validation datasets were as follows: cancer: 7.1% versus 7.3%; COPD: 21.5% versus 20.0%; stroke: 26.4% versus 23.7%; and diabetes: 26.2% versus 23.7%. The probability distribution of the validation dataset was as follows: the 28-, 30-, 60-, 90-, 120-, 150-, 180-, 210-, 240-, 270-, 300-, 330- and 365-day rehospitalisation rates were 20.5, 21.5, 30.7, 36.3, 40.1, 43.0, 45.6, 47.8, 49.8, 51.4, 52.9, 54.2 and 55.6%, respectively.

In addition to validating the proposed model retrospectively and prospectively, we iteratively compared our estimator for rehospitalisation risk against the effect of post-acute, ambulatory, and residential care on 28-day rehospitalization in a sample of patients admitted to the study hospital in 2017. Unlike the model-building and model validation cohorts, the cohort for testing the risk estimator against the effects of other post-discharge services different patients received included community-dwelling elderly and residential care home residents.

The rest of the method section describes the development of the model from which the risk estimator was derived and the hybrid ML model through which the conditional inference of the risk estimator was made against the effect of other post-discharge services.

Building a temporal zero-inflated Poisson (tZIP) model

In the current study a zero-inflated Poisson (ZIP) model with four predictors and a temporal offset function was built to estimate the likelihood of rehospitalisation within any timeframe under 1 year.

Firstly, ZIP model was chosen here to ensure the robustness of our analysis despite the excessive zero counts in our rehospitalisation data. Secondly, in terms of predictors, length of stay, acuity of admission, Charlson comorbidity score [47, 48] and the number of Emergency Room (ER) visits in the previous 6 months were chosen because these four factors (collectedly known as the ‘LACE’ [49]) are often regarded as the ‘gold standard’ in informing interventions to reduce rehospitalisation across clinical settings [9]. The LACE is one of the most validated sets of risk factors for rehospitalisation [40, 50]. Below, the LACE score was not standardised as LACE is already a validated instrument and the unstandardised score afforded the LACE-based modelling result to be more interpretable. Finally, a temporal offset functions were included in the ZIP model (hence, tZIP) to account for the deterioration of the aging population over time. Below, the parameter derived from the offset function was standardised into a value between 0 and 1 to parameterise the proportion of the 2-year study period each record’s offset term represents. Since the standardisation here represented only a linear transformation of the natural time scale, only in-sample data were used to standardise the offset terms during model building and validation.

Please refer to the supplementary material for tZIP model’s mathematical formulation and the derivation of the model’s joint estimator (JE).

We used R to analyse the data. The tZIP model was examined using the R package ‘pscl.’ The R package ‘pROC’ was used to generate the area under the receiver operating curve (AUC) and the area under the precision-recall curve (AUPRC) for measuring performance, and ‘ggplot2’ was used to generate plots. AUPRC is particularly sensitive to positive cases (i.e. readmission) when the data are highly imbalanced.

Prospective validation

In addition to validating our model with a retrospective cohort, we have also performed a prospective validation. Specifically, after our model was implemented as part of the actual clinical operation, we prospectively compared our model’s prediction against the rehospitalisation outcome of monthly discharged cohorts tracked in real-life. While rarely performed, prospective validation can enable better integration of research into clinical practices and a more accurate evaluation of the research’s direct impact on patient care [51]. Here, prospective validation was performed monthly on 12 monthly cohorts of community-dwelling patients discharged in 2016 from the study hospital. The EHR of the study hospital was subsequently reviewed until December 2017 to assess if the patients were rehospitalised within 28 days following their discharges.

Hybrid ML method for validating the JE in tZIP against the effects of post-acute, ambulatory and residential services patients received after discharge

In addition to prospective validation, a hybrid ML method was introduced to compare the contribution of our risk estimator to the 28-day rehospitalisation with the individual and collective effects of patient clinical profiles and his/her utilisation of health services on the 28-day rehospitalisation. Here, patient clinical profiles consist of features representing one’s diagnoses, comorbidity, intervention procedures, and ICU or surgical events [38]. On the other hand, the services whose utilization was of interest include acute, post-acute, ambulatory, and residential care offered by the medical system studied here. The comparisons were conducted iteratively via conditional inferences. The objective of applying the hybrid ML method was to test the hypothesis that the JE’s contribution to 28-day rehospitalisation outcomes was greater than, and independent from, the unique or combined contributions of all other clinical and utilisation-related features. Hence, the result of hybrid ML was reported separately from the retrospective and prospective validations. As the objective of our retrospective and prospective validations was to examine the performance of JE in predicting monthly cohort’s rehospitalization outcomes among community-dwelling elderly alone.

In literature, hybridisation between a linear model and an ML model is performed to improve ML models’ generalisability [42, 43], performance [42, 52,53,54] and interpretability [55]. Here, the purpose of hybridisation is instead to leverage the ML model’s unique ability to compare the marginal contribution of each feature to all others in the pool and test the hypothesis that the predictability of the risk estimator is greater than, and independent from, the effects of post-acute, ambulatory and residential care patients received post-discharge. Rather than hybridising with a linear model, the ML model in the current study was hybridised with a ZIP regression estimator [56] with a mixture of probability functions [57] due to the excessive zeros and a long tail resulting from the low prevalence of rehospitalisation events over time.

In addition, Unbiased Recursive Partitioning with Surrogate Splitting (URPSS) [58] method was applied in our hybrid ML model to compare the marginal contributions of the estimators and all the different services patients received post-discharge or sometimes received concurrently. The following characteristics of URPSS aligned with the study’s objective and provided URPSS with an edge over other partitioning methods of the decision tree [59]. First, splitting along the decision tree does not take place in isolation for URPSS; instead, each feature is recursively compared with every other feature in the pool to make conditional inferences of the effect of each feature on the outcome. Second, URPSS’ global optimisation allows features to be selected in an unbiased manner and consequently, the overfitting of data is minimised in partitioning. Third, in addition to data missing randomly, URPSS could handle logically (and thus systematically) missing data, which are abundant amongst services offered post-discharge. For example, if a patient is not eligible to receive a service, data on specific aspects of receiving services, such as the timing and duration, are coded as missing. Please refer to the supplementary material for a detailed description of, and a schematic on, the URPSS process.

Result

Model building

A total of 18,805 index hospitalisations in the model building between Jan 1, 2014, and Dec 31, 2014, were included. Table 1 presents the tZIP-relevant statistics. The average LOS per index hospitalisation was 6.4 days (SD = 7.4). The Charlson comorbidity index was on an average of 1.0 (SD = 1.4), and the average number of ER visits within 6 months was 0.8 times (SD = 1.2), with a median of zero ER visits within 6 months. Specifically, the model building sample’s average exposure time (time between discharge and subsequent rehospitalisation) was 448.7 days (SD = 186.5), with an average rehospitalisation count of 1.6 times (SD = 2.3) and the first quartile being zero.

Table 1 Descriptive statistics of predictors (LACE), exposure time, and rehospitalisation outcomes in the training dataset
Full size table

Notwithstanding the disproportional amount of zeros in the response variable, the ZIP model estimated that 59.3% of the zero rehospitalisation actually belonged to the Poisson distribution (λ), representing at-risk patients whose zero rehospitalisation could turn positive if given time (i.e. “active”). Meanwhile, the remaining 40.7% of zero rehospitalisation were considered “inactive”, i.e., belonging to the binomial distribution (p). When selecting a temporal offset function for the tZIP model, the function where p is convexly decreasing and λ is concavely increasing as post-discharge time increases yielded a model that fitted the training dataset best and was used in the analyses reported in the following.

Table 2 demonstrates the estimated coefficients and the corresponding odds ratios (ORs) and rate ratios (RRs) from the logistic (with a distribution of p) and Poisson (with a distribution of λ) components of the tZIP model. For the logistic component, the presence/high score of the four factors of LACE is negatively associated with one’s rehospitalisation being ‘inactive’ (i.e., with a rehospitalisation probability of p). Hence, greater likelihood of rehospitalisization entailed. Especially, the number of ER visits during the past 6 months (OR = 0.627, P-value <2E-16) and the index hospitalisation being acute (OR = 0.627, P-value <2E-16) have the most significant effect that triggers rehospitalisation, followed by a high score on the Charlson comorbidity index (OR = 0.971, P-value = 8.59E-03) and an extended length of stay during the index hospitalisation (OR = 0.988, P-value = 1.93E-05). Meanwhile, a mix of effects of the four factors of LACE could be observed on the expected rehospitalisation if an index hospitalisation is in active rehospitalisation status (i.e., with a rehospitalisation probability of λ) As shown in Table 2, the number of ER visits in the past 6 months (RR = 1.161, P-value <2E-16) and the Charlson comorbidity index (RR = 1.054, P-value <2E-16) were positively associated with the expected number of active rehospitalisation. By contrast, the longer length of stay during the index hospitalisation was associated with less expected rehospitalisation (RR = 0.995, P-value = 3.82E-09), whilst the more acute the index hospitalisation was, the less rehospitalisation could be expected (RR = 0.812, P-value <2E-16).

Table 2 Odds ratios and rate ratios of the logistic and poisson components of the tZIP Model
Full size table

Model validation

The tZIP model was validated using the 2015 cohort’s hospitalisation records (n = 15,055) that were not included in the model building. Considering the care and resource planning was conducted periodically within 1 year, the annual cohort was divided into 12 subsets on the basis of each record’s month of admission, with the data extraction day (i.e., end-of-observation date) being the rth day after the average discharge time of the subset’s observations. Subsequently, the proposed approach’s accuracy in predicting the 30-day and longer-term (up to 365-day) rehospitalisation was evaluated. In parallel, the performance (parameterised as AUCs and AUPRCs) of Cox’s proportional hazard model (Cox model hereafter) and the traditional LACE score model (Linear model hereafter) were compared; both shared the same predictors as the tZIP model.

Figures 1, 2, 3 and 4 show that the JE outperformed the Cox and Linear models. In particular, the orange line in Figs. 1 and 2 showed that the JE outperformed Cox and Linear models in predicting 28-day rehospitalisation, with JE’s AUCs being generally above 80% and AUPRCs around 75%. By contrast, the AUCs of the Cox and Linear models fell between 60 and 70%, and the AUPRCs generally fell around 50% or below. Similarly, Figs. 3 and 4 show that JE outperformed Cox and Linear models in predicting 30-day and longer-term (up to 365-day) rehospitalisation. Whilst JE’s AUCs stayed above 80% between 30 and 365 days, Cox and Linear models’ AUCs hovered around 65% (Fig. 3). Meanwhile, the 30-, 90- and 180-day AUPRCs were 73, 85% and around 90%, respectively, for JE and below 50, 70 and 75%, respectively, for Cox and Linear models (Fig. 4).

Fig. 1
figure 1

Comparing AUCs of 28-day rehospitalisation predictions: linear model, Cox’s proportional hazard model and JE

Full size image
Fig. 2
figure 2

Comparing AUPRCs of 28-day rehospitalisation predictions: linear model, Cox’s proportional hazard model and JE

Full size image
Fig. 3
figure 3

Comparing AUCs of longer-term rehospitalisation predictions: linear model, Cox’s proportional hazard model and JE

Full size image
Fig. 4
figure 4

Comparing AUPRCs of longer-term rehospitalisation predictions: linear model, Cox’s proportional hazard model and JE

Full size image

In addition to comparing Cox’s model and JE’s performance in predicting the studied cohort’s rehospitalisation outcomes across different timeframes, Fig. 5 reports the cohort’s survival rates by the two models, i.e., the proportion of studied cohort not rehospitalised overtime against the observed survival rate in a Kaplan–Meier plot. As shown in, Fig. 5, the survival rate estimated by JE was much closer to the observed survival rate than Cox’s model’s estimation.

Fig. 5
figure 5

 Comparing to survival rates estimated by Cox’s proportionals: hazards model and JE compared with the observed survival rate

Full size image

Prospective validation was also performed in addition to retrospective validation. As shown in Fig. 6, the performance of the JE in prospective validation consistently stayed above 80%.

Fig. 6
figure 6

Prospective validation AUCs of JE over a one-year period

Full size image

Result from the hybrid ML

The hybrid ML algorithm selected our JE first among the entire pool of clinical and service utilisation-related features in a 28-day rehospitalisation outcome-supervised URPSS process (AUC = .78). In other words, JE was selected by the algorithm as the ‘mother node:’ The feature from which all other features were split and on which all other features’ effects were conditionally based. Hence, the finding supported the hypothesis that the contribution of JE on 28-day rehospitalisation was superior to, and independent from, the contribution of all other features, singly or in combination. Consequently, as the objective of applying a hybrid ML algorithm was to test the hypothesis that the JE’s contribution outranks all other features, individual paths that spilt from JE the ‘mother node’ were not shown as they were not the focus of this study.

Discussion

The rich EHR data provide opportunities to develop temporal risk prediction modelling for large-scale populations. In this study, a mixture model with two temporal components and a model-based joint risk estimator for depicting all-cause rehospitalisation risk over time within any timeframe between 28- and 365-day post-discharge were developed and validated. With AUCs of above 80% in the external validation samples, the proposed approach outperformed most relevant published models with an average AUC of 69% [26,27,28,29,30,31,32,33,34,35,36,37,38,39] and it was on par with the relatively advanced ML models with a median AUC of 68% [60]. Using the same dataset of the tZIP model, the AUCs of Cox and Linear models closely aligned with the literature’s best AUC, between 60 and 70%. The modest AUCs of Cox and Linear models provided evidence that ignoring temporal changes or assuming linear changes in rehospitalisation risk over time led to a poorer fit of older patients’ rehospitalisation patterns. In turn, the good performance, for the first time, confirmed the nonlinearity association between rehospitalisation risk and exposure time for older patients. Such nonlinearity between risk and time could be directly visualised in the exploration of the studied data shown in Additional file 1: Fig. S-1.

This study contributes to an enhanced understanding of the association between time and rehospitalisation risk for older patients. The proposed approach allowed the EHR-based data to choose the type of nonlinearity empirically. Methodologically, generalised linear models could also be time-varying as an alternative to other time-varying models, such as survival models, that were used in literature [61]. Another alternative to handling nonlinear risk changes over time is to solely transform Poisson or logistic regression models to make time-varying predictions at constant rates similar to the Cox model [58, 62]. In the present work, tZIP was found to fit the data better than ZIP, whilst ZIP fitted the data better than the transformed Poisson or logistic regression. This finding affirmed the importance of handling excessive zeros in observed rehospitalisation counts amongst older patients and the nonlinear risk changes over time.

The clinical meaning of the nonlinear association between time and rehospitalisation risk of older adults is no less critical. Rehospitalisation models should be developed separately for older and young patient populations. The identified temporal complexity is possibly driven by the fact that older adults deteriorate more rapidly and nonlinearly than their younger counterparts. It, in turn, explains why poor performance amongst older adult samples than their younger counterparts was observed in time-invariant rehospitalisation prediction models that dominate the literature [15]. Hence, more research is needed.

This study addressed the gap in the literature; that is, previous studies seldom examined in one paper rehospitalisations that take place in different timeframes (say, 28 and 365 days), which makes it difficult to gauge a risk estimator’s performance over different rehospitalisations timeframes. Besides good discrimination in predicting 28-day rehospitalisation, a time-varying estimator of rehospitalisation risk that is flexible in its application to any rehospitalisation timeframe between 28 and 365 days was put forward to extend the temporality of a risk estimator for rehospitalisation. The risk estimators performed consistently better than the Cox and Linear models over the course of 365 days. However, a slight decrease in AUC was observed as the timeframe for predicting rehospitalisation risk widened to 1 year. The fluctuations in the JE’s predictability of rehospitalisation could be attributed to the highly variable post-discharge services and follow-up care the sample may have received between 28 and 365 days after discharge. However, by iteratively comparing the risk estimator with the post-acute, ambulatory, and residential care the elderly patients received post-discharge, the proposed ML model demonstrated that the JE’s superb performance was not affected by patients’ post-discharge service ecology. To the authors’ knowledge, the current study was the first to use hybrid ML to examine the performance of a rehospitalisation prediction model within one’s post-discharge environment.

In fact, whilst patients’ rehospitalisation risk and the clinical decisions informed by the risk estimates are affected by patients’ post-discharge environment, it has not been incorporated as a component in any of the published models on rehospitalisation risk. Notably, Goldstein et al. [63] concluded that the poor performance of risk prediction models is generally attributable to their failure to estimate risk in accordance with the “intended clinical use at the point of clinical decision.” For example, benefiting clinical decisions at the point of discharge planning is the accurate estimation of patients’ rehospitalisation risk and the extent that it could be mitigated by the service ecology to which patients are being discharged. Consequently, a temporal offset function was built into the proposed model to encapsulate the 2-year trajectory of the rehospitalisation-mitigating effect of the regional population’s service ecology. In addition, the built model was validated by comparing the marginal predictability of JE against the acute, post-acute, ambulatory, and residential care in the patient’s post-discharge service ecology.

Using EHR data brought a similar disadvantage shared by previous studies that certain variables are not collected within the EHR [57]. The cohorts employed in the present study were older Chinese patients discharged alive from the hospital in Hong Kong. The direct modelling results should apply to all such patient populations in Hong Kong. However, the medical services differences by geographical areas remain unstudied in current Hong Kong, which may also affect the applicability of the results. The estimation results may not be generalisable to other Chinese older patient populations outside of Hong Kong or non-Chinese older patients. Researchers could replicate the entire design with their EHR data and contexts regarding these theoretically inapplicable samples. The EHR data for the model-building and the model-validation cohorts were sampled consecutively from the same medical ward, possibly increasing the validation AUCs. Research with EHR data could hardly obtain a completely external sample to validate a model but the use of an out-of-model sample could be a solution to the issue.

The proposed approach assumed that the clinical and functional declines of the selected older adults population remained the same during the study period, which could be unrealistic in a rapid aging context. To offset this assumption’s potential adverse effect, rehospitalisation events over 2 years were used as an omnibus proxy measure to capture the deterioration of the study population. For example, in the literature on frequent hospitalisations, the researcher measured participants’ ability to live independently in the community to assess their level of deterioration [64]. However, studies published thus far relied only on one-time measures of the participants’ ability to independently engage in activities of daily living as an assessment of their decline and deterioration. Zhao et al. [65] stated that rehospitalisation risk models should be based on ‘all discharges as opposed to just the first discharge per patient and utilise methods that account for clustered data.’ Deterioration and decline are, by definition, temporal constructs that include previous care utilisation, chronicity and temporal model formulation to control. Future studies could have more measures on functional status and one’s environment for stable factors that continuously affect one’s rehospitalisation risk. The unspecific effects of post-acute and residential care on rehospitalisation were considered in this study, and they showed to be secondary to the proposed estimator.

Institutionalised older patients accounted for around 40% of elderly utilisation in the study hospital. Their hospital utilisation also affects the allocation of medical resources to the community-dwelling older adults. Previous studies did not target this co-existing population when studying community-dwelling patients, possibly due to limited data availability. To address this limitation, a rehospitalisation estimator was validated in a cohort with community-dwelling elderly and long-term residential care residents. Similar to the hybrid ML validation, the temporal estimator’s contribution to 28-day rehospitalisation prediction remained outweighed the contribution of patients’ discharge location.

However, the model’s overall performance deteriorated from greater than 80% AUC to 78% AUC after including residential care patients. In fact, the model performance deteriorated despite the application of ML and a comprehensive feature pool that includes patients’ clinical profiles and their post-discharge environment captured on EHRs. Such deterioration could be attributed to factors not captured by EHR, such as the quality of care provided in different long-term care facilities to patients discharged and patients’ functional and psychosocial challenges, which could be improved in future research if more critical non-EHR information could be collected.

Conclusions

With the zero inflation and dual-parameter temporal components in predicting rehospitalisation counts within a 2-year exposure time, a new rehospitalisation risk model and its risk estimators that accounted for the nonlinear post-discharge deterioration were proposed and validated. The approach outperformed the estimations conducted with time-invariant or rate-invariant models, especially in an extended rehospitalisation timeframe. The good discriminations of the time-varying estimation of rehospitalisation risk were not affected by the chronic and complex conditions that characterised elderly hospitalisations. The time-varying risk estimator was the prominent factor amongst the diverse post-acute care a patient may receive due to his/her conditions at discharge. The proposed approach also relied on four LACE variables that could be easily computed from EHR systems and allowed clinicians to visualise a patient’s rehospitalisation risk from 4 weeks to 365 days since discharge. This new approach is useful in screening and identifying high-risk older patients for proper follow-up care at the proper time, which shall benefit healthcare systems in clinical, policy and operational aspects if adopted in practice.

Availability of data and materials

The Hong Kong Hospital Authority owns the data, and hence we cannot share it publicly. The datasets generated and/or analysed during the current study are not publicly available due to restrictions being put on data sharing by Hong Kong’s Personal Data (Privacy) Ordinance (Cap. 486) (PDPO), including, but not exclusive to, PDPO’s Guidance Note in Cross-border Data Transfer. In addition, the Research Ethics Committees of the Hospital Authority do not allow a third-party transfer of patient data. Nor do the Ethics Committees permit study PI to make public EHRs of Hospital Authority’s patients. Data are however available from the authors upon reasonable request and with permission of the Hong Kong Hospital Authority.

Change history

References

  1. Kirby SE, Dennis SM, Jayasinghe UW, Harris MF. Patient-related factors in frequent readmissions: the influence of condition, access to services and patient choice. BMC Health Serv Res. 2010;10:216 Available from: https://pubmed.ncbi.nlm.nih.gov/20663141/ [cited 3 Jan 2022].

    Article  PubMed  PubMed Central  Google Scholar 

  2. Curiati PK, Gil-Junior LA, Morinaga CV, Ganem F, Curiati JAE, Avelino-Silva TJ. Predicting hospital admission and prolonged length of stay in older adults in the emergency department: the PRO-AGE scoring system. Ann Emerg Med. 2020;76(3):255–65. https://doi.org/10.1016/j.annemergmed.2020.01.010.

    Article  PubMed  Google Scholar 

  3. Nyweide DJ, Anthony DL, Bynum JPW, Strawderman RL, Weeks WB, Casalino LP, et al. Continuity of care and the risk of preventable hospitalization in older adults. JAMA Intern Med. 2013;173(20):1879–85 Available from: https://pubmed.ncbi.nlm.nih.gov/24043127/ [cited 3 Jan 2022].

    Article  PubMed  Google Scholar 

  4. Strom JB, Kramer DB, Wang Y, Shen C, Wasfy JH, Landon BE, et al. Short-term rehospitalization across the spectrum of age and insurance types in the United States. PLoS One. 2017;12(7):1–12.

    Article  Google Scholar 

  5. Fehlings MG, Tetreault L, Nater A, Choma T, Harrop J, Mroz T, et al. The aging of the global population: the changing epidemiology of disease and spinal disorders. Neurosurgery. 2015;77(4):S1–5.

    Article  PubMed  Google Scholar 

  6. Picco L, Achilla E, Abdin E, Chong SA, Vaingankar JA, McCrone P, et al. Economic burden of multimorbidity among older adults: impact on healthcare and societal costs. BMC Health Serv Res. 2016;16(1):1–12. https://doi.org/10.1186/s12913-016-1421-7.

    Article  Google Scholar 

  7. Mahmoudi E, Kamdar N, Kim N, Gonzales G, Singh K, Waljee AK. Use of electronic medical records in development and validation of risk prediction models of hospital readmission: systematic review. BMJ. 2020;369:1–10.

    Google Scholar 

  8. Hao S, Wang Y, Jin B, Shin AY, Zhu C, Huang M, et al. Development, validation and deployment of a real time 30 day hospital readmission risk assessment tool in the Maine healthcare information exchange. PLoS One. 2015;8(10):1–15.

    CAS  Google Scholar 

  9. Jamei M, Nisnevich A, Wetchler E, Sudat S, & Liu E. Predicting all-cause risk of 30-day hospital readmission using artificial neural networks. PloS One. 2017;12(7):e0181173. https://dx.plos.org/10.1371/journal.pone.0181173.

  10. Rajkomar A, Oren E, Chen K, Dai AM, Hajaj N, Hardt M, et al. Scalable and accurate deep learning with electronic health records. NPJ Digit Med. 2018;1(1):1–10. https://doi.org/10.1038/s41746-018-0029-1.

    Article  Google Scholar 

  11. Zolbanin HM, Delen D. Processing electronic medical records to improve predictive analytics outcomes for hospital readmissions. Decis Support Syst. 2018;112:98–110. https://doi.org/10.1016/j.dss.2018.06.010.

    Article  Google Scholar 

  12. Roimi M, Gutman R, Somer J, Ben Arie A, Calman I, Bar-Lavie Y, et al. Development and validation of a machine learning model predicting illness trajectory and hospital utilization of COVID-19 patients: a nationwide study. J Am Med Inform Assoc. 2021;28(6):1188–96.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Romero-Brufau S, Whitford D, Johnson MG, Hickman J, Morlan BW, Therneau T, et al. Using machine learning to improve the accuracy of patient deterioration predictions: Mayo Clinic early warning score (MC-EWS). J Am Med Inform Assoc. 2021;28(6):1207–15.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Huang Y, Talwar A, Chatterjee S, Aparasu RR. Application of machine learning in predicting hospital readmissions: a scoping review of the literature. BMC Med Res Methodol. 2021;21(1):1–14 Available from: https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-021-01284-z [cited 10 Jan 2022].

    Article  Google Scholar 

  15. Bagg S, Pombo AP, Hopman W. Effect of age on functional outcomes after stroke rehabilitation. Stroke. 2002;33(1):179–85.

    Article  PubMed  Google Scholar 

  16. Tan SY, Low LL, Yang Y, Lee KH. Applicability of a previously validated readmission predictive index in medical patients in Singapore: a retrospective study. BMC Health Serv Res. 2013;13:366 Available from: http://www.ncbi.nlm.nih.gov/pubmed/24074454 [cited 6 Nov 2018].

    Article  PubMed  PubMed Central  Google Scholar 

  17. Sarijaloo FB, Park J, Zhong X, Wokhlu A. Predicting 90 day acute heart failure readmission and death using machine learning-supported decision analysis. Clin Cardiol. 2021;44(2):230–7.

    Article  PubMed  Google Scholar 

  18. Frizzell JD, Liang L, Schulte PJ, Yancy CW, Heidenreich PA, Hernandez AF, et al. Prediction of 30-day all-cause readmissions in patients hospitalized for heart failure: comparison of machine learning and other statistical approaches. JAMA Cardiol. 2017;2(2):204–9.

    Article  PubMed  Google Scholar 

  19. Xue Y, Klabjan D, Luo Y. Predicting ICU readmission using grouped physiological and medication trends. Artif Intell Med. 2019;95:27–37.

    Article  PubMed  Google Scholar 

  20. Min X, Yu B, Wang F. Predictive modeling of the hospital readmission risk from patients’ claims data using machine learning: a case study on COPD. Sci Rep. 2019;9(1):1–10. https://doi.org/10.1038/s41598-019-39071-y.

    Article  Google Scholar 

  21. Lohman MC, Scherer EA, Whiteman KL, Greenberg RL, Bruce ML. Factors associated with accelerated hospitalization and re-hospitalization among Medicare home health patients. J Gerontol A Biol Sci Med Sci. 2018;73(9):1280–6.

    Article  PubMed  Google Scholar 

  22. O’Leary KJ, Chapman MM, Foster S, O’Hara L, Henschen BL, Cameron KA. Frequently hospitalized patients’ perceptions of factors contributing to high hospital use. J Hosp Med. 2019;14(9):521–6.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Wu J, Grannis SJ, Xu H, Finnell JT. A practical method for predicting frequent use of emergency department care using routinely available electronic registration data. BMC Emerg Med. 2016;16(1):1–9. https://doi.org/10.1186/s12873-016-0076-3.

    Article  CAS  Google Scholar 

  24. Vojta CL, Vojta DD, Tenhave TR, Amaya M, Lavizzo-Mourey R, Asch DA. Risk screening in a Medicare/Medicaid population: administrative data versus self report. J Gen Intern Med. 2001;16(8):525–30.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Longman JM, I Rolfe M, Passey MD, Heathcote KE, Ewald DP, Dunn T, et al. Frequent hospital admission of older people with chronic disease: a cross-sectional survey with telephone follow-up and data linkage. BMC Health Serv Res. 2012;12(1):1–13.

    Article  Google Scholar 

  26. Boult C, Dowd B, McCaffrey D, Boult L, Hernandez R, Krulewitch H. Screening elders for risk of hospital admission. J Am Geriatr Soc. 1993;41:811–7.

    Article  CAS  PubMed  Google Scholar 

  27. Coleman EA, Wagner EH, Grothaus LC, Hecht J, Savarino J, Buchner DM. Predicting hospitalization and functional decline in older health plan enrollees: are administrative data as accurate as self-report? J Am Geriatr Soc. 1998;46(4):419–25.

    Article  CAS  PubMed  Google Scholar 

  28. Shelton P, Sager MA, Schraeder C. The community assessment risk screen (CARS): identifying elderly persons at risk for hospitalization or emergency department visit. Am J Manag Care. 2000;6(8):925–33.

    CAS  PubMed  Google Scholar 

  29. Op het Veld LPM, Beurskens AJHM, de Vet HCW, van Kuijk SMJ, Hajema KJ, Kempen GIJM, et al. The ability of four frailty screening instruments to predict mortality, hospitalization and dependency in (instrumental) activities of daily living. Eur J Ageing. 2019;16(3):387–94. https://doi.org/10.1007/s10433-019-00502-4.

    Article  Google Scholar 

  30. Theou O, Sluggett JK, Bell JS, Lalic S, Cooper T, Robson L, et al. Frailty, hospitalization, and mortality in residential aged care. J Gerontol A Biol Sci Med Sci. 2018;73(8):1090–6.

    Article  PubMed  Google Scholar 

  31. Liang YD, Zhang YN, Li YM, Chen YH, Xu JY, Liu M, et al. Identification of frailty and its risk factors in elderly hospitalized patients from different wards: a cross-sectional study in China. Clin Interv Aging. 2019;14:2249–59.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Lyon D, Lancaster GA, Taylor S, Dowrick C, Chellaswamy H. Predicting the likelihood of emergency admission to hospital of older people: development and validation of the emergency admission risk likelihood index (EARLI). Fam Pract. 2007;24(2):158–67.

    Article  PubMed  Google Scholar 

  33. Jensen GL, Friedmann JM, Coleman CD, Smiciklas-wright H. Screening for hospitalization and nutritional risks among community-dwelling older persons. Am J Clin Nutr. 2001;74(2):5–9.

    Article  Google Scholar 

  34. Mosley DG, Peterson E, Martin DC. Do hierarchical condition category model scores predict hospitalization risk in newly enrolled medicare advantage participants as well as probability of repeated admission scores? J Am Geriatr Soc. 2009;57(12):2306–10.

    Article  PubMed  Google Scholar 

  35. Wagner JT, Bachmann LM, Boult C, Harari D, Von Renteln-Kruse W, Egger M, et al. Predicting the risk of hospital admission in older persons - validation of a brief self-administered questionnaire in three European countries. J Am Geriatr Soc. 2006;54(8):1271–6.

    Article  PubMed  Google Scholar 

  36. O’Caoimh R, Gao Y, Svendrovski A, Healy E, O’Connell E, O’Keeffe G, et al. The risk instrument for screening in the community (RISC): a new instrument for predicting risk of adverse outcomes in community dwelling older adults. BMC Geriatr. 2015;15(1):1–9.

    Article  Google Scholar 

  37. Mazzaglia G, Roti L, Corsini G, Ferrucci A, Bari and M Di. Screening of older community-dwelling people at risk for death and hospitalization: the Assistenza socio-sanitaria in Italia project. J Am Geriatr Soc. 2007;55(12):1955–60.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Canadian Institute for Health Information. Early identification of people at-risk of hospitalization. 2013. Available from: https://secure.cihi.ca/free_products/HARP_reportv_En.pdf.

    Google Scholar 

  39. Tan BY, Gu JY, Wei HY, Chen L, Yan SL, Deng N. Electronic medical record-based model to predict the risk of 90-day readmission for patients with heart failure. BMC Med Inform Decis Mak. 2019;19(1):1–9.

    Article  Google Scholar 

  40. Zhou H, Della PR, Roberts P, Goh L, Dhaliwal SS. Utility of models to predict 28-day or 30-day unplanned hospital readmissions: an updated systematic review. BMJ Open. 2016;6(6):e011060.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Sutter T, Roth JA, Chin-Cheong K, Hug BL, Vogt JE. A comparison of general and disease-specific machine learning models for the prediction of unplanned hospital readmissions. J Am Med Inform Assoc. 2021;28(4):868–73.

    Article  PubMed  Google Scholar 

  42. Kohavi R. Scaling up the accuracy of naive-Bayes classifiers: a decision-tree hybrid. KDD; 1996.

    Google Scholar 

  43. Zhou ZH, Chen ZQ. Hybrid decision tree. Knowledge-Based Syst. 2002;15(8):515–28 Available from: http://www.sciencedirect.com/science/article/pii/S0950705102000382 [cited 6 Dec 2017].

    Article  Google Scholar 

  44. Fox MT, Persaud M, Maimets I, Brooks D, O’Brien K, Tregunno D. Effectiveness of early discharge planning in acutely ill or injured hospitalized older adults: a systematic review and meta-analysis. BMC Geriatr. 2013;13(1):1 Available from: BMC Geriatrics.

    Article  Google Scholar 

  45. Mutai H, Furukawa T, Araki K, Misawa K, Hanihara T. Long-term outcome in stroke survivors after discharge from a convalescent rehabilitation ward. Psychiatry Clin Neurosci. 2013;67(6):434–40.

    Article  PubMed  Google Scholar 

  46. Szekendi MK, Vaughn J, Lal A, Ouchi K, Williams MV. The prevalence of inpatients at 33 U.S. hospitals appropriate for and receiving referral to palliative care. J Palliat Med. 2016;19(4):360–72.

    Article  PubMed  Google Scholar 

  47. Charlson M, Szatrowski TP, Peterson J, Gold J. Validation of a combined comorbidity index. J Clin Epidemiol. 1994;47(11):1245–51 Available from: http://linkinghub.elsevier.com/retrieve/pii/0895435694901295 [cited 19 Jun 2017].

    Article  CAS  PubMed  Google Scholar 

  48. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40(5):373–83 Available from: http://linkinghub.elsevier.com/retrieve/pii/0021968187901718 [cited 19 Jun 2017].

    Article  CAS  PubMed  Google Scholar 

  49. Van Walraven C, Dhalla IA, Bell C, Etchells E, Stiell IG, Zarnke K, et al. Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community. CMAJ. 2010;182(6):551–557. Available from: http://www.ncbi.nlm.nih.gov/pubmed/20194559 [cited 20 Jun 2017].

  50. Kansagara D, Englander H, Salanitro A, Kagen D, Theobald C, Freeman M, et al. Risk prediction models for hospital readmission: a systematic review NIH public access. JAMA. 2011;306(15):1688–98 Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3603349/pdf/nihms429222.pdf [cited 23 Aug 2019].

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  51. Brajer N, Cozzi B, Gao M, Nichols M, Revoir M, Balu S, et al. Prospective and external evaluation of a machine learning model to predict in-hospital mortality of adults at time of admission. JAMA Netw Open. 2020;3(2):1–14.

    Article  Google Scholar 

  52. Gama J, Fernandes R, Rocha R. Decision trees for mining data streams. Intell Data Anal. 2006;10(1):23–45.

    Article  Google Scholar 

  53. Kotsiantis SB. Decision trees: a recent overview. Artif Intell Rev. 2013;39(4):261–83.

    Article  Google Scholar 

  54. Wijaya A, Bisri A. Hybrid decision tree and logistic regression classifier for email spam detection. In: 2016 8th international conference on information technology and electrical engineering (ICITEE): IEEE; 2016. p. 1–4. Available from: http://ieeexplore.ieee.org/document/7863267/ [cited 5 Dec 2018].

    Google Scholar 

  55. Chen C, Li O, Tao D, Barnett A, Rudin C, & Su JK. This looks like that: deep learning for interpretable image recognition. Adv Neural Inf Process Syst. 2019;32:1–12.

  56. Lambert D. Zero-inflated Poisson regression, with an application to defects in manufacturing. Technometrics. 1992;34(1):1 Available from: https://www.jstor.org/stable/1269547?origin=crossref [cited 11 Jul 2018].

    Article  Google Scholar 

  57. Gianfrancesco MA, Goldstein ND. A narrative review on the validity of electronic health record-based research in epidemiology. BMC Med Res Methodol. 2021;21(234). https://doi.org/10.1186/s12874-021-01416-5.

  58. Mantel N, Hankey BF. A logistic Rugression analysis of response-time data where the Hazard function is time dependent. Commun Stat Theory Methods. 1978;7(4):333–47 Available from: http://www.tandfonline.com/doi/abs/10.1080/03610927808827627 [cited 14 May 2018].

    Article  Google Scholar 

  59. Bertsimas D, Dunn J. Optimal classification trees. Mach Learn. 2017;106(7):1039–82.

    Article  Google Scholar 

  60. Huang Y, Talwar A, Chatterjee S, & Aparasu RR. Application of machine learning in predicting hospital readmissions: a scoping review of the literature. BMC Med Res Methodol. 2021;21(1):1–14.

  61. Artetxe A, Beristain A, Graña M. Predictive models for hospital readmission risk: a systematic review of methods. Comput Methods Prog Biomed. 2018;164:49–64.

    Article  Google Scholar 

  62. Frome EL. The analysis of rates using Poisson regression models. Biometrics. 1983;39(3):665 Available from: http://www.jstor.org/stable/2531094?origin=crossref [cited 9 May 2018].

    Article  CAS  PubMed  Google Scholar 

  63. Goldstein BA, Navar AM, Pencina MJ, Ioannidis JPA. Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review. J Am Med Inform Assoc. 2017;24(1):198–208 Available from: https://academic.oup.com/jamia/article-lookup/doi/10.1093/jamia/ocw042.

    Article  PubMed  Google Scholar 

  64. Dahlin-Ivanoff S, Gosman--Hedström G, Edberg A-K, Wilhelmson K, Eklund K, Duner A, et al. Elderly persons in the risk zone. Design of a multidimensional, health-promoting, randomised three-armed controlled trial for “prefrail” people of 80+ years living at home. BMC Geriatr. 2010;10(1):27 Available from: http://bmcgeriatr.biomedcentral.com/articles/10.1186/1471-2318-10-27.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Zhao H, Tanner S, Golden SH, Fisher SG, Rubin DJ. Common sampling and modeling approaches to analyzing readmission risk that ignores clustering produce misleading results. BMC Med Res Methodol. 2020;20(1):1–9 Available from: https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-020-01162-0 [cited 14 Jan 2022].

    Article  CAS  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

As reported in the submission, supported by two funding sources, one from a Hong Kong Research Council, and the other from City University of Hong Kong. Both are public funded agencies: 1) Research Grant Council (RGC) of Hong Kong SAR, China, T32–102/14 N; 2) City University of Hong Kong, CityU9610404.

Author information

Author notes

  1. Jingjing Guan and Eman Leung are joint first-author.

Authors and Affiliations

  1. Epitelligence, Hong Kong SAR, China

    Jingjing Guan

  2. JC School of Public Health and Primary Care, The Chinese University of Hong Kong, Hong Kong SAR, China

    Eman Leung & Kin-on Kwok

  3. Stanley Ho Centre for Emerging Infectious Diseases, The Chinese University of Hong Kong, Hong Kong SAR, China

    Kin-on Kwok

  4. Hong Kong Institute of Asia-Pacific Studies, The Chinese University of Hong Kong, Hong Kong SAR, China

    Kin-on Kwok

  5. Department of Management Sciences, City University of Hong Kong, Hong Kong SAR, China

    Frank Youhua Chen

Authors
  1. Jingjing Guan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eman Leung
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kin-on Kwok
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Frank Youhua Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JJ and EL formulated the models and drafted the main manuscript text; JJ conducted the data analysis; KK assisted in writing the text and discussion; FC supported the project, participated in the writing, and assisted in revision. All authors reviewed the manuscript. The authors read and approved the final manuscript.

Corresponding author

Correspondence to Frank Youhua Chen.

Ethics declarations

Ethics approval and consent to participate

Ethics approval - approved by City University of Hong Kong Research Committee - the Human Subjects Ethics Sub-Committee. For consent to participate, not applicable: no experiment in this study involves humans and/or the use of human tissue samples.

Consent for publication

Not applicable.

Competing interests

The authors have no conflict of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The original online version of this article was revised: Fig. 4 in the original version of this article has been replaced.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guan, J., Leung, E., Kwok, Ko. et al. A hybrid machine learning framework to improve prediction of all-cause rehospitalization among elderly patients in Hong Kong. BMC Med Res Methodol 23, 14 (2023). https://doi.org/10.1186/s12874-022-01824-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12874-022-01824-1

Keywords

BMC Medical Research Methodology

ISSN: 1471-2288

Contact us