Visualising and modelling changes in categorical variables in longitudinal studies
© Jones et al.; licensee BioMed Central Ltd. 2014
Received: 18 November 2013
Accepted: 21 February 2014
Published: 27 February 2014
Graphical techniques can provide visually compelling insights into complex data patterns. In this paper we present a type of lasagne plot showing changes in categorical variables for participants measured at regular intervals over time and propose statistical models to estimate distributions of marginal and transitional probabilities.
The plot uses stacked bars to show the distribution of categorical variables at each time interval, with different colours to depict different categories and changes in colours showing trajectories of participants over time. The models are based on nominal logistic regression which is appropriate for both ordinal and nominal categorical variables. To illustrate the plots and models we analyse data on smoking status, body mass index (BMI) and physical activity level from a longitudinal study on women’s health. To estimate marginal distributions we fit survey wave as an explanatory variable whereas for transitional distributions we fit status of participants (e.g. smoking status) at previous surveys.
For the illustrative data the marginal models showed BMI increasing, physical activity decreasing and smoking decreasing linearly over time at the population level. The plots and transition models showed smoking status to be highly predictable for individuals whereas BMI was only moderately predictable and physical activity was virtually unpredictable. Most of the predictive power was obtained from participant status at the previous survey. Predicted probabilities from the models mostly agreed with observed probabilities indicating adequate goodness-of-fit.
The proposed form of lasagne plot provides a simple visual aid to show transitions in categorical variables over time in longitudinal studies. The suggested models complement the plot and allow formal testing and estimation of marginal and transitional distributions. These simple tools can provide valuable insights into categorical data on individuals measured at regular intervals over time.
KeywordsCategorical variables Graphical methods Longitudinal studies Marginal distribution Nominal regression Transition probabilities
With the increasing interest in longitudinal and life-course studies, it is desirable to develop graphical techniques for visualising and exploring complex patterns within groups of participants over the course of a study. However graphical presentation of variables measured at different times in longitudinal studies can be challenging. To be useful a graphical technique should be simple to implement and interpret, provide valuable insights into the structure of the data, and be viable for large sample sizes.
A well-known method for graphically displaying longitudinal data is the spaghetti plot  where individual subject’s measurements of a repeated outcome are shown chronologically over time. This graphical method is simple and effective at showing changes in a variable for individuals. However it is only appropriate for continuous data and small sample sizes. Plotting a large number of trajectories can lead to multiple intersecting lines that fail to show important patterns in the data.
Recently the lasagne plot has been developed that is claimed to address the limitations of the spaghetti plot . Based on heat maps  each subject’s trajectory over time is shown in a horizontal layer with colour used to depict the magnitude of the response value at each time-point. Data for groups of individuals are then stacked on top of each other in layers, hence the term, lasagne.
In this paper we describe a form of lasagne plot for showing changes in categorical variables for participants in longitudinal studies. In addition to the plot, we recommend including a table showing marginal distributions over time. To complement the plot we illustrate the use of standard statistical models that estimate marginal and transitional distributions of categorical variables over time consistent with the patterns depicted graphically or in the table.
To illustrate the construction and interpretation of the plots, data from the Australian Longitudinal Study on Women’s Health (ALSWH)  were used. This ongoing survey of 40,000 adult women in three age groups was initiated in 1996 and has five or more waves of data for each of the three age group cohorts. The study has been approved by Ethics Committees at the University of Queensland and University of Newcastle. We used data from the women born between 1973 and 1978 to illustrate our proposed methods.
Self-reported data on smoking status, body mass index (BMI) and physical activity level were obtained from participants in 1996, 2000, 2003, 2006 and 2009. Smoking status is categorised as never smoker, current smoker, or ex-smoker; BMI is categorised as healthy or underweight (BMI ≤ 25.0), overweight (25.0 < BMI ≤ 30.0), or obese (BMI > 30.0); and physical activity is categorised as low/sedentary (inactive), moderate activity or high activity . As the proportion of participants classified as underweight (BMI < 18.5) was very small and diminished over time, for simplicity we combined this category with the healthy weight category (18.5 < BMI ≤ 25.0) and refer to the combined category as just healthy weight for the remainder of the manuscript. To simplify the illustration we have restricted analysis to those participants with complete data for each of the categorical variables. For smoking status there was a constraint that current or ex-smokers could not be categorised as never smokers at a later survey. Comparable data for physical activity were not available for the first survey hence we restrict our analyses to data from surveys 2 to 5.
The proposed plot uses stacked bars to show the distribution of categorical variables across surveys, with different colours to depict different categories and changes in colours over waves depicting trajectories of groups of participants over time. The plot shows transitional distributions of categorical variables across surveys hence the status of participants can be tracked over the course of the study. As well as longitudinal changes represented by the stacked bars, cross sectional data can also be presented in tabular form above each bar. The plot and table can be produced using standard software such as SAS Statistical Graphics (SAS Institute Inc., Cary, NC).
To estimate the marginal and transitional probabilities for categorical variables we used nominal logistic regression models . These models include binary or binomial logistic regression for variables with just two categories, as well as models for more than two categories. For ordinal categorical variables assumptions such as proportional odds are needed to make use of the additional information about the natural order of the categories.
As the data are longitudinal it is necessary to take into account the correlation between successive measurements on the same individuals. This can be done using mixed models for individuals. Until recently however such models for categorical outcomes could not be readily fitted with standard software. An alternative approach is to model the data as independent observations but use variance estimates robust to this assumption.
For this paper, to complement the proposed plot, nominal logistic regression models were fitted using Stata/IC, version 12.0 for Windows (StataCorp, College Station, TX) with robust variances. With Stata version 13 mixed models could have been fitted.
where j = 2, …, J categories; π j is the probability of being in category j; π 1 is the probability of being in the reference category; x j T is the transpose of the matrix of predictor variables for each participant; and β j is the vector of coefficients to be estimated for each category j.
Models to estimate marginal probabilities included variables for survey wave. Goodness-of-fit of the models was assessed by comparing estimated and observed marginal probabilities. Ordinal models could have potentially been fitted for the ordinal outcomes BMI group and physical activity level however to facilitate comparison across the three outcomes of interest we chose to fit nominal models for all three outcome variables.
Models to estimate transition probabilities included predictor variables that indicated outcome status at previous surveys . Goodness-of-fit was assessed by comparing estimated and observed transition probabilities as well as calculating McFadden’s pseudo R2 which is an estimate of the magnitude of improvement of the fitted model compared to the uninformative or null model . We also calculated the proportion of correct predictions provided by the final model and contrasted the result with the proportion of correct predictions from an uninformative model where no explanatory variables were fitted. The delta method was used to estimate standard errors for transition probabilities so that 95% confidence intervals could be calculated.
To guide our decision on how many previous surveys to include as explanatory information in the models, we estimated variance inflation factors (VIF) and percentage increases in log likelihood. We preferred percentage increases in log likelihood to the more common approach of using absolute increases to assess model fit because they are more informative in terms of predictability for individuals. As an additional visual tool to illustrate distributions of outcome variables over time, probability tree diagrams depicting proportions of participants in each response category at each wave were used to assist with constructing the transition models.
where Survey = 2, …, 5.
Predicted probabilities from the fitted models had consistently high agreement with the observed probabilities with absolute differences within 1-2% in all cases (data not shown). Compared to being inactive the relative risk of being in the moderate physical activity category decreased at each survey by 7% (RRR = 0.93; 95% CI: 0.90, 0.95) and the relative risk of being in the high physical activity category decreased at each survey by 14% (RRR = 0.86; 95% CI: 0.85, 0.88). With healthy weight as the reference group, the relative risk of being in a higher BMI category increased at each survey (RRR = 1.17; 95% CI: 1.15, 1.20 for overweight and RRR = 1.32; 95% CI: 1.29, 1.34 for obese). For smoking status, where never smokers was the reference category, the relative risk of being an ex-smoker increased (RRR 1.17; 95% CI: 1.15, 1.19) whereas the relative risk of being a current smoker decreased at each survey (RRR 0.81; 95% CI: 0.79, 0.82).
Percentage changes in log likelihood
Variable at survey wave 5
Two surveys previous
Three surveys previous
Physical activity level
Model estimates showed that previous moderate activity was associated with an 80% increased relative risk of current moderate activity (RRR 1.84; 95% CI: 1.65, 2.04) and more than a doubling in relative risk of current high activity (RRR 2.15; 95% CI: 1.93, 2.40). In addition previous high activity is associated with a more than doubling in relative risk of current moderate activity (RRR 2.33; 95% CI: 2.09, 2.59) and a more than five-fold increase in relative risk of current high activity (RRR 5.40; 95% CI: 4.87, 5.99). Pseudo R2 for the fitted model was 4.5% and the proportion of correct predictions was 56% (compared to 53% correct predictions for an uninformative model) indicating a poor predictability of physical activity level for individuals based on previous survey results. However predicted probabilities from the fitted model agreed with the observed probabilities to within 1% for all comparisons indicating a good overall model fit. Estimated transition probabilities showed that previous moderate activity was associated with a 47% (95% CI: 45%, 48%) probability of current low or sedentary activity, a 27% (95% CI: 26%, 29%) probability of current moderate activity and a 26% (95% CI: 24%, 28%) probability of current high activity. Previous high activity was associated with a 32% (95% CI: 30%, 33%) probability of current low or sedentary activity, a 24% (95% CI: 22%, 25%) probability of current moderate activity and a 44% (95% CI: 43%, 46%) probability of current high activity. Previous low or sedentary activity was associated with a 63% (95% CI: 62%, 64%) probability of current low or sedentary activity, a 20% (95% CI: 19%, 21%) probability of current moderate activity and a 16% (95% CI: 15%, 17%) probability of current high activity.
where Ι (Healthy) -1 indicates healthy weight at the previous survey, Ι (Obese) -1 indicates obesity at the previous survey, Ι (Healthy) -2 indicates healthy weight two surveys previously, and Ι (Obese) -2 indicates obesity two surveys previously.
Relative risk ratios based on transitional model for BMI group (reference = overweight)
Relative risk ratio (95% confidence interval)
Previously healthy weight
14.2 (12.2, 16.5)
0.83 (0.47, 1.44)
Healthy weight two surveys previously
5.11 (4.22, 6.18)
Obese two surveys previously
0.68 (0.35, 1.35)
Previously healthy weight
0.20 (0.13, 0.29)
11.6 (9.20, 14.5)
Healthy weight two surveys previously
0.59 (0.47, 0.75)
Obese two surveys previously
2.92 (2.25, 3.80)
Estimates obtained from the model showed that being an ex-smoker at the previous survey (but not being an ex-smoker two surveys previously) was associated with a doubling in relative risk of being an ex-smoker currently (RRR 2.01; 95% CI: 1.12, 3.63) whereas being an ex-smoker for both previous surveys was associated with a 12-fold increased relative risk of being an ex-smoker currently (RRR 12.8; 95% CI: 6.95, 23.5). Being a current smoker at the previous survey was associated with a 72% lower relative risk of being an ex-smoker currently (RRR 0.28; 95% CI: 0.16, 0.50). The final model had pseudo R2 = 0.77 with 91% correct predictions (compared to 52% correct predictions for an uninformative model) hence smoking status for the previous surveys was highly predictive of current status for individuals. Predicted and observed transitional probabilities agreed to within 1% in all cases hence goodness-of-fit statistics indicated the model fitted the observed data well. Predicted probabilities showed previous never smokers had 99% (95% CI: 98.8%, 99.3%) chance of being a never smoker at the current survey, 0.6% (95% CI: 0.4%, 0.8%) chance of being an ex-smoker and 0.3% (95% CI: 0.1%, 0.5%) chance of being a current smoker. Previous current smokers had 34% (95% CI: 32%, 37%) chance of being an ex-smoker in the current survey and 66% (95% CI: 63%, 68%) of being a current smoker. An ex-smoker for the two previous surveys had 4% (95% CI: 3%, 5%) chance of being a current smoker at the current survey and 96% (95% CI: 95%, 97%) chance of being an ex-smoker. However for ex-smokers at the previous survey, who were not ex-smokers two surveys previously, the transition probabilities were 21% (95% CI: 18%, 24%) for current smoking and 79% (95% CI: 76%, 82%) for ex-smoking.
The plot we have illustrated visually depicts changes in categorical variables for individuals over time. However the marginal distribution at follow up time-points is not as clearly shown, therefore we recommend inclusion of a table above the stacked bars showing the marginal distribution at each time-point. Simple nominal logistic regression models can be used to formalise the visual information provided by the plot and estimate marginal and transitional probabilities as well as relative effects. Probability tree diagrams are useful in helping develop the models.
Transitional probabilities, in particular, provide useful and easily interpretable summary information. For example, based on ALSWH data, conditional on being overweight for two previous surveys, Australian women in their twenties had 23% (95% CI: 21%, 26%) probability of being obese at the next survey but only 7% (95% CI: 6%, 9%) probability of being of healthy weight (or underweight). We suggest McFadden’s pseudo R2 as a summary measure for assessing predictability of categorical outcomes and, to guide decisions on how many previous measures should be included in the transition models, we propose using variance inflation factors and percentage increases in log likelihood.
Spaghetti plots are very useful for showing changes in a numerical variable for a limited number of individuals over time but are not applicable for categorical data or large numbers of individuals. Lasagne plots have been proposed as an alternative to spaghetti plots for categorical data and/or many individuals. There are however several other methods for graphically representing categorical data but they have a number of limitations. For example, in the mosaic plot the relative frequency of each level of a variable and its relationship to another variable is represented by a mosaic of tiles ; see Additional file 3: Figure S2. A variable degree of shading for each tile is then incorporated to represent the degree of deviation from a null hypothesis of independence. However adding more variables increases complexity and showing the distribution of a categorical variable over multiple waves of a longitudinal survey is not feasible.
Another technique is known as parallel sets ; a similar concept to Sankey diagrams . In these diagrams the relationship between variables is shown using parallelograms whose width is proportional to the frequencies involved (Additional file 4: Figure S3). Parallel sets are appropriate for categorical data collected on large numbers of participants over multiple surveys but the plot lacks simplicity and software to produce the figures is not readily available.
The lasagne plot we illustrate offers some advantages over these alternative methods in terms of ease of depiction and interpretation. But, irrespective of which graphical method is used, the information obtained is only descriptive hence the need for methods that allow formal testing and estimation.
To simplify our illustration we restricted analysis to individuals who provided complete responses over four surveys. However this restriction could be relaxed to include all participants. In this case missing data could form an additional category and be included in the plot, tabulation and models. The addition of a missing data category could provide additional insights into the data. For example, it could show that certain categories in previous surveys are associated with increased risk of missing data in subsequent surveys. It may also be of interest to tabulate the patterns of missing data across surveys. We illustrate the inclusion of missing data as a category in the graphical analysis of BMI categorised into healthy, overweight/obese, or missing (Additional file 5: Figure S4). The plot suggests previous missingness predicts current missingness but missingness does not appear to be associated with the other BMI categories of healthy weight and overweight/obese.
A limitation of the lasagne plot is that it is not feasible to include a large number of categories. In our example we used three categories. Including more categories would make interpretation increasingly difficult. We therefore recommend four categories at most. If there are more than four categories then we recommend collapsing the data into fewer categories. For physical activity level, for example, we collapsed sedentary and low activity into “inactive”. Continuous variables could also be summarised using these methods however they would require categorisation with consequential loss of detail. A further limitation is that the number of categories shown at later time-points can be high making interpretation difficult. If this is the case we suggest making separate plots of transitions from each individual category at the initial survey to supplement the overall plot. We illustrate this idea for smoking status in Additional file 6: Figures S5 and Additional file 7: S6. Finally we have illustrated the plot and models with data from a longitudinal survey where the participants have been assessed at regular periods over time. If data had been collected at irregular time-points, our methodology may not be appropriate. Despite these limitations, we believe the plot and models are appropriate in general for categorical variables collected in longitudinal studies.
The lasagne plot we illustrate provides a simple way to show transitions in the status of individuals observed longitudinally. The regression models we suggest complement the plots and allow formal testing and reporting of marginal and transitional distributions. These analytical tools can be implemented in standard statistical software such as SAS and Stata and can provide valuable insights into categorical variables measured on individuals at regular intervals over time.
Australian Longitudinal Study of Women’s Health
Body mass index
Variance inflation factor
Relative risk ratio.
Funding: The Australian Longitudinal Study on Women’s Health is funded by the Australian Department of Health. MJ and GDM are funded by the Australian National Health and Medical Research Council (APP1000986). RH is funded by the Australian Department of Health and AD is funded by the University of Queensland. The funding bodies had no role in the collection, analysis, and interpretation of data; the writing of the manuscript, or the decision to submit the manuscript for publication. There was no additional person who contributed materials essential for the study or who contributed to the preparation of this article.
- Hedeker D, Gibbons R: Longitudinal data analysis. 2006, Hoboken, New Jersey: John Wiley and SonsGoogle Scholar
- Swihart B, Caffo B, James B, Strand M, Schwartz B, Punjabi N: Lasagna plots: a saucy alternative to spaghetti plots. Epidemiology. 2010, 21: 621-625. 10.1097/EDE.0b013e3181e5b06a.View ArticlePubMedPubMed CentralGoogle Scholar
- Wilkinson L, Friendly M: The history of the cluster heat map. Am Stat. 2009, 63: 179-184. 10.1198/tas.2009.0033.View ArticleGoogle Scholar
- Dobson AJ, Barnett A: An Introduction to Generalized Linear Models. 2008, Boca Raton, Florida: Chapman & Hall/CRC, 3Google Scholar
- Lee C, Dobson AJ, Brown WJ, Bryson L, Byles J, Warner-Smith P, Young AF: Cohort profile: the Australian Longitudinal Study on Women's Health. Int J Epidemiol. 2005, 34: 987-991. 10.1093/ije/dyi098.View ArticlePubMedGoogle Scholar
- Brown WJ, Trost SG: Life transitions and changing physical activity patterns in young women. Am J Prev Med. 2003, 25: 140-143. 10.1016/S0749-3797(03)00119-3.View ArticlePubMedGoogle Scholar
- Ware J, Lipsitz S, Speizer F: Issues in the analysis of repeated categorical outcomes. Stat Med. 1988, 7: 95-107. 10.1002/sim.4780070113.View ArticlePubMedGoogle Scholar
- Long J: Regression Models for Categorical and Limited Dependent Variables. 1997, Thousand Oaks: Sage PublicationsGoogle Scholar
- Friendly M: Mosaic displays for multi-way contingency tables. J Am Stat Assoc. 1994, 89: 190-200. 10.1080/01621459.1994.10476460.View ArticleGoogle Scholar
- Kosara R: Parallel sets: interactive exploration and visual analysis of categorical data. Trans on Visualization and Comput Graph. 2006, 12: 1-12.View ArticleGoogle Scholar
- Schmidt M: Der Einsatz von sankey-diagrammen im stoffstrommanagement. Beitraege der Hochschule Pforzheim. 2006, Nr. 124Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/14/32/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.