Progression of liver cirrhosis to HCC: an application of hidden Markov model
© BioMed Central Ltd 2011
Received: 26 November 2010
Accepted: 4 April 2011
Published: 4 April 2011
Skip to main content
© BioMed Central Ltd 2011
Received: 26 November 2010
Accepted: 4 April 2011
Published: 4 April 2011
Health service databases of administrative type can be a useful tool for the study of progression of a disease, but the data reported in such sources could be affected by misclassifications of some patients' real disease states at the time. Aim of this work was to estimate the transition probabilities through the different degenerative phases of liver cirrhosis using health service databases.
We employed a hidden Markov model to determine the transition probabilities between two states, and of misclassification. The covariates inserted in the model were sex, age, the presence of comorbidities correlated with alcohol abuse, the presence of diagnosis codes indicating hepatitis C virus infection, and the Charlson Index. The analysis was conducted in patients presumed to have suffered the onset of cirrhosis in 2000, observing the disease evolution and, if applicable, death up to the end of the year 2006.
The incidence of hepatocellular carcinoma (HCC) in cirrhotic patients was 1.5% per year. The probability of developing HCC is higher in males (OR = 2.217) and patients over 65 (OR = 1.547); over 65-year-olds have a greater probability of death both while still suffering from cirrhosis (OR = 2.379) and if they have developed HCC (OR = 1.410). A more severe casemix affects the transition from HCC to death (OR = 1.714). The probability of misclassifying subjects with HCC as exclusively affected by liver cirrhosis is 14.08%.
The hidden Markov model allowing for misclassification is well suited to analyses of health service databases, since it is able to capture bias due to the fact that the quality and accuracy of the available information are not always optimal. The probability of evolution of a cirrhotic subject to HCC depends on sex and age class, while hepatitis C virus infection and comorbidities correlated with alcohol abuse do not seem to have an influence.
The evolution of chronic degenerative disease is characterized by progression through intermediate states to advanced disease and death. For these diseases, survival analysis must take into account the various transitions from one state to the next, as well as a series of prognostic variables that can have an influence on each event including death. For example, liver cirrhosis can evolve to hepatocellular carcinoma, and the presence of comorbidities, exposure to hepatitis B or C virus, as well as alcohol consumption and age, can influence the terminal event. In fact, liver cirrhosis is well known to consist of a diffuse alteration of the liver structure resulting from protracted processes of liver inflammation and necrosis of different natures. The main causes of liver cirrhosis are chronic viral hepatitis B or C and the consumption of alcohol. In particular, alcohol abuse can halve the time of onset of cirrhosis in a patient already affected by chronic viral hepatitis (from about 20-30 years to 10-15 years). Hepatocellular carcinoma occurs at a rate of 1% to 4% per year after cirrhosis is established  and cirrhosis underlies HCC in approximately 80%-90% of cases worldwide . Stochastic multistate or competing models, like Markov chains, are those best suited to the analysis of such phenomena [3–6]. It would, of course, be too long and costly to program clinical studies, or indeed prospective and follow-up trials, to study the natural history of chronic degenerative diseases in order to be able to apply multistate models correctly. In fact, in patients affected by these diseases passage from one state to the next often occurs after fairly long intervals.
Retrospective studies, based on the use of health service databases of administrative type (HSDBA), can be a valid alternative, despite the limits posed by the fact that the quality and accuracy of the available information are not always optimal. For example, using the hospital discharge sheets (HDS) database, patients can be followed from the probable diagnosis of onset of the disease through the subsequent worsening states. Moreover, by means of linkage with the death certificates database (DCDB), it is ultimately possible to trace the cause of death, if applicable.
A common problem when applying Markov models to HSDBA is that assessment of the disease state of an individual can be subject to classification errors. A similar classification problem frequently occurs in research in the field of social sciences, where wide use is made of a series of models that take into account latent states [7–9].
Multistate models that exploit the properties of Markov chains offer a useful methodological structure for describing complex time-dependent outcomes . The procedure for estimation of the probability of transition most widely adopted in Markov models is the Cox proportional model. This model can describe survival time in function of a multitude of prognostic factors , under the fundamental assumption of the proportionality of hazards, in other words that the examined factors will have a constant impact over time on the risk of death.
Jackson et al. (2003)  described a procedure for simultaneously estimating the transition rates and the probabilities of misclassification in a hidden Markov model, supplying software for implementing the multistate hidden Markov model in the R Project programming environment. Aim of the present work is to study the pathway leading subjects affected by liver cirrhosis to develop hepatocellular carcinoma and to death, determining the transition probabilities through the degenerative disease states and verifying whether, apart from being risk factors for the onset of cirrhosis, chronic viral hepatitis B and C infection and alcohol abuse also have a role in the process leading cirrhotic subjects to develop hepatocellular carcinoma and/or to death.
Retrospective observational studies can be conducted using the HSDBA, to assess the natural history of the disease in a group of subjects. In fact, the HDS database can be employed to individuate all subjects admitted to hospital one or more times, as well as the duration of the interval between one hospitalization and the next. For each hospitalization, the disease state observed and the covariates of interest can be traced. However. the disease state may be affected by an unknown degree of error, due both to an imperfect diagnosis and to incorrect classification. Moreover, due to the irregular nature of follow-up, observations of the actual time of entry into a disease state are frequently interval censored. The proposed Markov model allows us to take into account the above characteristics.
In a sample of n subjects, for the ith subject we assume that the following variables are observed at the jth visit:
Tij chronological time of clinical visit
Yij binary disease outcome measurement
Zij vector of covariates.
When Y is binary, f(y|x) can be interpreted as the probability of correctly or incorrectly classifying the disease state given the true state of the subject. The conditional independence of misclassification probabilities at successive time points is a strong assumption. However, dependence between successive measurements is confounded with dependence between the true disease states. It is not possible to disentangle these two features of the model with misclassified data .
Equations (1) and (2) constitute a hidden Markov model.
If the disease status is observed accurately, then X(Tj) and Yj coincide, and the model is reduced to a pure continuous time Markov process.
The intensities form a matrix Q whose rows sum to zero, so that the diagonal entries are defined by .
The hazards proportionality can be verified using the Schoenfeld residuals of the model [17, 18], defined as the value x ik of the covariate K for individual i who actually died at time ti minus the expected value, where the expected value is given by and p i is the probability of death of individual i at time ti. The graph, that represents the trend of the Schoenfeld residuals calculated for each individual and each covariate, can be used to directly visualize the hazards ratio . Assuming proportionality of the hazards, the Schoenfeld residuals are independent of time. The presence of a linear relationship with time, an index of non proportionality, can be tested by performing a simple linear regression and a trend test: a slope significantly different from zero would be evidence against proportionality and an increasing (decreasing) trend would indicate an increasing (decreasing) hazards ratio over time.
The covariates inserted in the model were age, sex, the presence of disease correlated to alcohol abuse, the presence of diagnostic codes correlated to hepatitis C virus infection and the Charlson Index assessing the subject's clinical severity.
The Charlson index, developed in 1987  and adapted to health data banks by Deyo et al. , is based on ICD9-CM diagnosis codes and contains 17 categories of comorbidity, each with an associated weight ranging from 1 to 6; the sum of all the weights gives the value of the index that, being determined in this way, takes into account both the number of comorbidities and their severity. The Charlson Index was divided into 2 classes: less than or equal to 3, greater than 3, as also was age: less than or equal to 65 years, older than 65 years. We selected 65 as the age cut-off because this is considered in the literature to be the mean age for development of liver cancer [21, 22] and also because it corresponded to the median value of the observed distribution of cases of HCC, guaranteeing the stability of the model.
The analysis was conducting using the electronic Hospital Discharge Sheet coming from all the Apulia hospitals for the years 2000-2006, and Death Certificate DataBase related to all deaths events in Apulia for the years 2000-2006. From both databases were selected cases with the following ICD-9-CM (International Statistical Classification of Diseases and Related Health Problems 9threvision Clinical Modification) as principal or secondary diagnosis:
Liver cirrhosis (LC): 571.2; 571.5
Hepatocellular carcinoma (HCC): 155.0; 155.2.
To establish the starting point of the first state, defined as of the first hospitalization with LC diagnosis, were selected patients in whom the onset of cirrhosis presumably occurred between 01/01/2000 and 31/12/2000. For this purpose, we eliminated patients who had been hospitalized at least once for cirrhosis or hepatocellular carcinoma in the years 1998 and 1999. After identification the clinical course of the selected cirrhotic patients was reconstructed searching others hospitalizations with diagnosis of LC or HCC in HDS databases, or death correlated with LC or HCC in HDS and DCDB databases.
Summary of the number of transitions of state in the data set.
Lost to Follow-up
Frequency of the covariates at the start of follow-up.
(% of 1925 cirrhotic patients)
Age (>65 years)
Charlson Index (>3)
Hepatitis B Virus
Hepatitis C Virus
(070.41, 070.44, 070.51, 070.54)
(291.-, 303.0-, 303.9-, 305.0-, 357.5, 425.5, 535.3-, 790.3)
Estimates of the mean permanency times in the transitory states.
Proportionality Test based on Schoenfeld's residuals.
Parameters and standard errors estimated with the hidden Markov model.
Results of model
Transition Intensities (with covariates set at their mean values)
Probabilities of misclassification (with covariates set at their mean values)
Estimated Odds Ratios for the covariates inserted in the hidden Markov model (95% confidence intervals in brackets).
Transitions of State
State 1 -> State 2
State 1 -> State 3
State 2 -> State 3
(Ref.: no HCV)
(Ref.: no alcohol)
(Ref. Charls. Ind.≤3)
The probabilities of transition from one state to the next are generally higher in males; in particular, the probability of progressing to HCC is never higher than 15.7% in females, whereas it reaches 30% in males after 4 years. In the first 40 months after the onset of liver cirrhosis, the probability of developing hepatocellular carcinoma is greater than the probability of death in males: 15.7% versus 6.8% after one year, 24.5% versus 15.5% after two years. In females, instead, the probability of death is little lower than that of developing HCC in the first few months, while already after two years the probability of death is higher (13.4% versus 11.8%).
The male-female differences in the probabilities of transition from cirrhosis to death grow over the first 3 years (being 10% at 36 months) but remain constant thereafter. The probability of developing HCC in the short term is higher in males than females (after 2 years, it is 25.8% in males versus 13.2% in females), but the values tend to converge in the longer term (6.3% in males versus 5.5% in females after 7 years).
The probabilities of death, both for subjects with only cirrhosis and with HCC, are generally higher than in subjects with a less severe casemix. In females the casemix does not seem to affect the probability of transition cirrhosis-HCC, whereas in males the more severe casemix has a long term effect when the probability of developing HCC declines in favor of a greater probability of death.
By exploiting the properties of Markov chains applied to a stochastic multistate model, we have calculated the temporal intensities of transition during the degenerative course of chronic liver cirrhosis. It was also possible to determine the time hazards of degeneration of the liver disease until death. Various studies have employed Cox models with the principal aim of determining the risk factors for the progression of cirrhosis to HCC [24, 25]. In 2000, Degos et al.  studied progression to HCC and death using an "illness-disease-death" in a small cohort of subjects with a diagnosis of HCV-related cirrhosis, estimating the time of the events with the Kaplan Meier method. Then, in 2007 Ioannou et al.  applied the Cox proportional hazards model to a large administrative database of cirrhotic patients to determine the incidence of hepatocellular carcinoma, but without calculating the probabilities of transition from the first to the second state. Moreover, they acknowledged that a limit of their study was the risk of error when filling out the diagnosis codes ICD-9. In our study, using the data contained in the administrative health services databases, the multistate hidden Markov model we applied enabled us to identify the possible misclassification errors that can occur.
Previous studies based on surveillance programs for hepatocellular carcinoma in cirrhotic subjects reported an incidence of hepatocellular carcinoma of 1.5, 2.5, 6.7 per 100 subjects a year. In our study we found an incidence of HCC of 1.5% per year. Ioannou et al. (2007) , who conducted their analysis on an administrative database as we have done, found an incidence of 2.4% per year. The difference between these two values (1.5% vs 2.4%) is probably due to the different reference population, but also to insertion in our model of the misclassification matrix. In fact, the probability of misclassifying subjects with HCC as subjects with cirrhosis alone was revealed to be 14.08%, while the reverse error, i.e. misclassifying cirrhotic subjects as affected by HCC, was 2.73%.
The estimated parameters for the covariate "age class" were statistically significant for all the transitions. "Sex" was significant only for the transition of state from cirrhosis to HCC, while the Charlson Index had an effect only on the transition from HCC to death.
In various longitudinal studies it has been shown that advanced age and the male sex are associated with an increased risk of HCC in cirrhotic subjects [24, 31–33], as was also shown in the present study. In fact, male cirrhotic subjects have approximately twice the probability of developing hepatocellular carcinoma as compared to female cirrhotic patients, while elderly patients (aged ≥ 65 years) have a higher risk of degeneration of the liver disease, and especially of dying while affected by cirrhosis.
The ample presence of concomitant diseases (Charlson Index ≥ 3) increases the risk of death in subjects with HCC. The Charlson Index was not found to have an incidence on the transition from cirrhosis to HCC. The insertion of specific comorbidities among the model covariates, such as diabetes mellitus [27, 34, 35], could help to identify the co-morbid conditions that may become risk factors for progression to HCC in cirrhotic subjects.
Alcohol is proposed to cause HCC mainly because it causes cirrhosis, whereas its association with HCC without cirrhosis is controversial and it probably has no direct carcinogenic role . In a case-control study conducted in 2007, Kumar et al.  showed that although HCV RNA positivity and alcohol abuse significantly increased the risk of hepatocellular carcinoma among cirrhotic patients, no significant risk increase was evident in the absence of cirrhosis. In our study the estimates of the parameters related to hepatitis C virus and to the presence of morbidity correlated to alcohol abuse did not result significant. This result likely confirms that hepatitis C virus and alcohol abuse are risk factors for the onset of cirrhosis , but once the cirrhosis has become established they do not have an influence on the development of HCC.
Despite the advantages of the structured hidden Markov model approach, there are some limitations. As is typical of population dynamic models, collinearity between parameter estimates can lead to identifiability problems . As a consequence, maximum likelihood estimates can sometimes yield implausible parameter values, and maximization algorithms may fail to converge . The problem becomes particularly severe when time series are short and data scarce. Moreover, addition to the model of further covariates could exacerbate this problem. However, it seems likely that such problems with the proposed structured hidden Markov models might be overcome by adopting a Bayesian formulation.
Markov model proved to be a useful tool for analysis of the course of a chronic degenerative disease like liver cirrhosis. In particular, the hidden Markov model that takes into account the risk of misclassification is well suited to the analysis of administrative health data because it can capture bias due to the problem that the data quality is not always optimal, as well as enabling the study of the effect of different covariates on the transitions of state.
A further improvement of the model could be that of predicting the state of subjects who have undergone surgery and appear cured or temporarily HCC-free. In our case, due to the paucity of such observations, it was not possible to consider a model like this.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.