Assessing the validity of the Global Activity Limitation Indicator in fourteen European countries
BMC Medical Research Methodology volume 15, Article number: 1 (2015)
The Global Activity Limitation Indicator (GALI), the measure underlying the European indicator Healthy Life Years (HLY), is widely used to compare population health across countries. However, the comparability of the item has been questioned. This study aims to further validate the GALI in the adult European population.
Data from the European Health Interview Survey (EHIS), covering 14 European countries and 152,787 individuals, were used to explore how the GALI was associated with other measures of disability and whether the GALI was consistent or reflected different disability situations in different countries.
When considering each country separately or all combined, we found that the GALI was significantly associated with measures of activities of daily living, instrumental activity of daily living, and functional limitations (P < 0.001 in all cases). Associations were largest for activity of daily living and lowest though still high for functional limitations. For each measure, the magnitude of the association was similar across most countries. Overall, however, the GALI differed significantly between countries in terms of how it reflected each of the three disability measures (P < 0.001 in all cases). We suspect cross-country differences in the results may be due to variations in: the implementation of the EHIS, the perception of functioning and limitations, and the understanding of the GALI question.
The study both confirms the relevance of this indicator to measure general activity limitations in the European population and the need for caution when comparing the level of the GALI from one country to another.
Health expectancies are increasingly used as summary measures of population health. Since 2005, the European Union (EU) has monitored an indicator of life expectancy without activity limitations, known as "Healthy Life Years" (HLY). Increasing HLY is crucial for the EU in order to reduce the social and economic burden associated with life expectancy lengthening. The European Innovation Partnership on Active and Healthy Ageing is targeting a two-year increase in HLY by 2020[1, 2].
The European Commission deployed efforts to harmonise the data used in EU Member States to measure HLY, in contrast to other health expectancies data which often lack international harmonisation. The Statistics of Income and Living Conditions (SILC) survey, coordinated by Eurostat, provides the data on activity limitations via the Global Activity Limitation Indicator (GALI). The GALI belongs to the family of disability indicators, targeting situations in which health disorders and conditions have impacted people’s usual activities. It is a single-item survey instrument which was developed with an explicit definition of the underlying concepts, which facilitates its translation and inclusion into different European surveys. Since the inclusion of the indicator in the SILC, there have been efforts to improve its harmonisation, including a major revision of the translations into EU languages in 2008.
Despite harmonisation in data collection, cultural understanding and differences in reporting may threaten (cross-national) validity of the GALI. In Belgium, the GALI performed appropriately against other health indicators. In France, the GALI was also strongly associated with functional and activity limitations, but the association with these other measures varied by education level and employment status, independently of the level of general health[5, 6]. A first cross-national study including 11 countries from the Survey of Health, Ageing and Retirement in Europe revealed consistent relationships across countries between the GALI and other measures of disability in the older population. Whether these results hold for the wider adult European population remains unknown.
Using data from the European Health Interview Survey (EHIS), we assessed how the GALI is associated with other measures of disability, and whether the GALI is consistent or reflects disability differently among adults in 14 European countries. Our study, which is part of the EU Joint Action on Healthy Life Years, contributes to a better understanding of the European indicator HLY in providing a first cross-validation of the GALI in adults aged 15 years and older.
The EHIS was conducted between 2007 and 2010 in individuals aged 15 years and older in 19 countries. Relevant data from 14 countries was available at the time of the analysis: Belgium, Bulgaria, Cyprus, Czech Republic, France, Greece, Hungary, Latvia, Malta, Poland, Romania, Slovakia, Slovenia, and Spain (Table 1). Microdata were analysed at the premises of Eurostat. Procedures for application for access to the microdata are given by Eurostat (http://ec.europa.eu/eurostat/web/microdata/overview).
The sample sizes range from 1,955 (Czech Republic) to 35,100 (Poland) persons per country, representing the adult population (including institutional population in Belgium, Czech Republic, France and Malta). Response rates varied between 56.0% (Czech Republic) and 95.5% (Greece). Proxy interviewing was used in most countries (varying from 0.7% (Greece) to 26.0% (Cyprus)) and participation was mandatory for Cyprus, France, Spain and Greece.
The EHIS questions were implemented either as one specific survey or as elements of existing national surveys, following Eurostat translation protocols from the original English questionnaire. Sampling design and data collection methods varied from country to country, but (normalised) sampling weights were available for the analyses. Examination of the question wording and responses categories revealed missing questions or comparability problems in some countries. Non-comparable variables were considered as missing in these countries. For each respective analysis countries with missing variables were excluded along with the respondents who had missing values on the key variables.
Global Activity Limitation Indicator (GALI)
The Global Activity Limitation Indicator (GALI) is a single-item survey instrument reported by the individual him or herself to assess health-related activity limitations: "For at least the past six months, to what extent have you been limited because of a health problem in activities people usually do?". Possible responses are: severely limited, limited but not severely and not limited at all. The indicator refers to general restrictions in activity without specifying the type of activity concerned (work, household chores, leisure, personal care etc.). Because of the low numbers reporting themselves as severely limited, severe and moderate limitations were merged into one category (limited), as is commonly done when calculating the HLY indicator.
Limitations in activity of daily living (ADL)
Difficulties in activities of daily living correspond to the most severe level of activity limitations. The measure is based on the difficulty or need of assistance for basic activities everyone is expected to perform independently: washing, getting (un)dressed, feeding, getting in and out of bed,
using the toilet. Severe difficulties with these activities reflect situations of dependence requiring human assistance. These situations create social exclusion in many areas of life. ADL scores (‘any ADL’ and ‘sum of ADL’) were created using 5 activities of daily living questions, independently of the level of severity.
Limitation in instrumental activity of daily living (IADL)
Difficulties in instrumental activities of daily living are broader than ADL limitations and concern domestic activities which allow an individual to live independently: difficulty or need of assistance for preparing meals, using the telephone, shopping, managing medication, doing light housework, doing occasional heavy housework, taking care of finances and everyday administrative tasks. IADL scores (‘any IADL’ and ‘sum of IADL’) were created using 7 instrumental activities of daily living questions, independently of the level of severity. A filter was applied to the IADL questions to account exclusively health-related limitations.
Functional limitations refer to difficulties in performing basic actions used in daily life. Unlike ADL/IADL indicators, the functional limitations indicator evaluates the level of severity: severity of functional limitations - as opposed to the number of domains with limitations - impacts more directly the risk of meeting difficulties in activities. A summary variable measuring functioning by severity (no limitation; any moderate but no severe limitation; any severe limitation) was constructed from 6 items assessing the extent of limitation in physical actions: walking a certain distance, going up or down stairs, squatting and kneeling, carrying in the hands or in the arms, using hands and fingers to manipulate small objects, biting and chewing[16, 17]. A dichotomous variable (any limitation vs. none) was also constructed.
To investigate the validity of the GALI, we compared it with three standard measures of disability. None of these instruments is a gold standard for the GALI, but positive associations with the GALI are expected. The GALI taps limitations in the performance of social roles and activities (such as work, school, parenting, leisure) and has a broader definition of activity than ADL and IADL measures[4, 16]. Association of IADL and ADL measures with the GALI should be strong and stronger for the ADL measure, which captures more disabling limitations than the IADL measure. Most people reporting daily activity limitations should report global activity limitations; but, some individuals reporting global activity limitations might be limited in other activities than basic daily activities.
In the disablement process, functional limitations immediately precede activity limitations. Since individuals with functional limitations have a higher risk of being limited in activities, we expect some individuals with functional limitations to report activity limitations. However, not all individuals with functional limitations have long-term limitations in their activities, so the association between the GALI and functional limitations could be weaker than with daily activity limitations.
In addition to examining patterns in the associations across all countries, this study further evaluates to what extent the magnitude of these associations varies between countries.
The relationships between the GALI and three measures of disability was investigated 1) in the European population as a whole, and 2) in every country separately, which allowed us to test whether the relationships were consistent in different countries. We performed additional analyses, restricted to those aged 50 years and over, for comparison with those reported by Jagger et al. using the Survey of Health, Ageing and Retirement in Europe (SHARE).
Pooled analyses: for every measure used to evaluate the GALI (sum of ADL, sum of IADL and functional limitations by severity; all treated as categorical variables), a logistic regression model was fitted, adjusting for the effects of gender, age (measured in years) and interactions between the predictors, if statistically significant (α = 0.05). The probability of being classed as limited or not limited for the GALI was estimated for each category or value of the measure of interest. The relationship between the GALI and each measure was assessed.
Country-specific analyses: treating each national EHIS sample separately, logistic regression models were fitted to estimate the odds ratios between the GALI and each disability measure (dichotomised as no limitation vs. at least one limitation), adjusting for age and gender. We used dichotomised versions of the disability measures to avoid sparseness and to ease comparability with the SHARE study. Random-effect meta-analysis models were then fitted using country-specific odds ratios from the logistic regression models (odds ratios >100 were excluded). We assessed heterogeneity between countries in the association between the GALI and the three other measures with Cochran’s Q test and Higgins I2 statistic [7, 18, 19].
The 14 countries were fairly similar in terms of age and gender compositions, with a mean age of between 43.3 years (Cyprus and Slovakia) and 47.3 years (Greece and Hungary) and a proportion of men varying from 45.3% (Latvia) to 49.2% (Cyprus) (Table 1).
The percentage reporting global activity limitations varied widely by country and was lowest in Cyprus (18.1%) and highest in Latvia (43.6%). When compared to the SILC 2009, these figures were higher in 7 countries (i.e. more than 5% differences), as illustrate age-standardised and gender comparisons (Additional file1).
The distribution of limitations measured by the other measures of disability also showed substantial variations by country. The percentage with at least one ADL limitation was lowest in France (3.4%) and highest in Slovenia (15.7%); the percentage with at least one IADL limitation was lowest in Malta (9.7%) and highest in Latvia (23.2%); and the percentage with at least one functional limitation was lowest in Cyprus (20.3%) and highest in Latvia (33.8%). The magnitude of limitations converged across the four measures in some countries: Hungary, Latvia and Slovenia displayed high levels of disability on the four measures; whilst Cyprus had among the lowest prevalence levels.
We then examined the global association between the GALI and other disability measures. Of people reporting ADL and IADL limitations, 89% and 82% respectively were likely to report global activity limitations (Table 2). The probability to report global activity limitations among those who have neither ADL nor IADL limitations was about 20%. A third of people with functional limitations did not consider themselves as limited in their activities. People who reported none of the functional limitations listed in the questionnaire had a very low probability of reporting global activity limitations.
The probability of reporting limitation based on the GALI increased as the number of ADL and IADL limitations increased (up to about 99% for respectively 5 and 7 ADL/IADL limitations) (Figure 1). The association was less pronounced with functional limitations by severity (no functional limitation: 14%; at least one severe functional limitation: 76%).
Next, we determined whether the GALI measured disability similarly across countries, that is, whether individuals identified as having disability, defined using ADL, IADL or functional limitations, had similar probabilities of reporting GALI limitations between the different EU countries. Results from the meta-analyses revealed significant positive associations of the GALI with each measure (Figure 2). In all countries, respondents with disability were more likely to report limitations based on the GALI (P < 0.001 in all cases), indicating a consistency in the associations. The overall odds ratios estimated from the meta-analyses were largest for ADL (15.4), intermediate for IADL (11.4) and lowest though still high for functional limitations (6.7). The more selective the disability indicator, the stronger the association with the GALI: individuals with more severe types of disability are more prone to report global activity limitations than people with milder forms of disability.
Heterogeneity in the size of the odds ratios reached statistical significance in all analyses (P < 0.001; I2 > 50%): the relationship between the GALI and other measures was more pronounced in some countries compared with others. For instance, the odds of being limited by the GALI if an individual had difficulties with at least one ADL compared with none varied from 6.7 (95% CI: 4.7, 9.4) for Slovenia to 53.2 (95% CI: 35.6, 79.6) for Romania. Variability in the point estimates of the odds ratios was intermediate for IADL (odds ratios varying from 7.4 to 26.3) and lowest for functioning (odds ratios varying from 4.2 to 11.7; 85% of the odds ratios comprised between 5.2 and 8.7).
However, most countries showed consistent patterns of associations with the GALI for ADL and IADL analyses, but not for functioning: countries with a strong association between the GALI and ADL also tended to exhibit a strong association between the GALI and IADL. For instance, Bulgaria had odds ratios of 14.8 and 14.5 in ADL and IADL analyses respectively.
Overall, the size of the associations differed between countries, but the pattern within countries was the same: stronger associations between ADL and IADL and the GALI, weaker association with functional limitations.
When considering each country separately or all combined, we found that the GALI consistently appeared to be a good indicator of disability in the adult population, corroborating previous studies[4, 7]. Our study confirmed a stronger association between the GALI and ADL, intermediate with IADL and somewhat lower with functioning.
We further observed that the strength of the associations that relates the GALI to disability measures varied across countries. Further analyses (not reproduced here) using different subsets of countries (EU-15 countries; excluding outliers; or excluding countries with large sample sizes (Belgium, France, Poland, Romania, Spain)) reached similar conclusion. This result partly challenges a former study of the older European population, using the SHARE. To understand differences in the results, we mimicked the SHARE study using the EHIS participants aged 50 years and older (see Additional file2). Comparison with the SHARE was possible for ADL and IADL analyses although the questions slightly differed between the two surveys. Apart from some extreme odds ratios, results were very comparable. Countries included in both studies had comparable estimates (i.e. Belgium, Greece and Spain), with the exception of France which had an extreme value in our study due to lower ADL limitations compared to other countries. Yet, our study had more power and reached statistical significance for both ADL and IADL heterogeneity tests even after the exclusion of outliers, whereas the SHARE study found significant heterogeneity for IADL only.
It appears that the main difference with the SHARE study was that, in our study, ADL and IADL measures were extremely strong predictors of the GALI in some countries. Respondents of those countries tended to associate ADL and IADL measures to the GALI more often. For example, in Romania, 99.8% of the respondent who reported no IADL limitations, reported no limitation on the GALI. We did not find these high associations in other countries.
We suspect survey effects to be (partly) responsible for these differences. The SHARE survey methodology is centrally managed with no room for variability in the survey mode and method. As opposed to SHARE, the EHIS is not implemented homogeneously across countries, resulting in various administration modes, population and sampling frames (e.g. inclusion or exclusion of the institutionalised population), sampling designs, item non-responses rates, uses of proxies and even question orders. These survey characteristics impact survey responses[20, 21] and are likely to hamper comparability if they change from country to country. For example, item non-response rates varied greatly across countries and may cause different selection biases. For IADL, the proportion of individuals analysed was highest in Cyprus (almost 100%) and lowest in Poland (87%).
Another explanation may come from the self-reported nature of the data. The GALI and the other measures of disability are subject to social and cultural variations in reporting, even in perfectly harmonised surveys. Variation in the GALI prevalence and in its association with other measures may therefore be influenced by reticence about reporting global activity limitations or other types of disability. This may explain why the SHARE study found no significant cross-country variability in the association between the GALI and the objective measures of disability (i.e. maximum grip strength and walking speed). As to the GALI itself, it particularly triggers reporting variations by referring to usual activities in the question: "have you been limited […] in activities people usually do". Depending on age, culture, social background and country, individuals may interpret limitations in usual activities differently, independently of their disability situation. In order to account for heterogeneity in reporting styles, recent statistical techniques using anchoring vignettes were developed. For example, such vignettes enabled the estimation of cross-country differentials in work disability reporting. Having such tools for the GALI question would certainly contribute to better understanding of the threshold used by respondents to report or not to report activity limitations.
Our study is the first comprehensive evaluation of the GALI in the adult population of 14 European countries. Its strengths are the number of countries covered in the EHIS survey and the data quality in terms of the range of measures of disability, the sample sizes and population coverage (i.e. the whole adult population). A limitation is the differential survey methods across the EHIS participating countries.
As we validated the GALI using measures which are also self-reported, we could not, in contrast to the SHARE study, demonstrate that the GALI reflects objectively measured activity limitations. What we showed, however, is that the GALI performs well for reporting perceived activity limitations. We confirmed that the GALI is a useful global instrument for measuring activity limitations in the fashion self-rated health assesses general health status.
The GALI - as the measure underlying the European indicator HLY - should be validated in the adult European population. The fact that, in most countries, we observed consistent and gradual associations with the GALI for ADL, IADL and functioning is encouraging and suggests that the GALI question is understood similarly in different countries. Yet, a few countries stood out by extreme results. We suspect that the lack of harmonisation of the EHIS is responsible for these inconsistencies. That is to say, we may be facing an issue of survey data comparability rather than one of cross-national validity of the GALI itself.
Whether this explanation holds or not, our results have implications for the indicator HLY when based on the EHIS. HLY based on the SILC - which is the data source for the indicator - may suffer from similar harmonisation problems at the level of the implementation of the survey. Similar outlying countries are therefore likely to exist in the SILC data, which may in turn influence the HLY figures and hamper their comparability. We believe that improving further the harmonisation of the data collection of the EHIS and the SILC across the European countries is necessary to enhance the quality of the HLY figures across Europe. Further understanding of the methodological, cultural and health factors influencing the GALI is needed in order to fully validate and compare HLY figures across countries.
The study both confirms the relevance of the GALI to measure general activity limitation in the European population and highlights the need for caution when comparing the levels of the GALI from one country to another; analysis of patterns and trends should be preferred when looking at European disability and HLY.
Jagger C, McKee M, Christensen K, Lagiewka K, Nusselder W, Van Oyen H, et al.: Mind the gap - reaching the European target of a 2-year increase in healthy life years in the next decade.Eur J Public Health 2013, 23:829–33. 10.1093/eurpub/ckt030
Lagiewka K: European innovation partnership on active and healthy ageing: triggers of setting the headline target of 2 additional healthy life years at birth at EU average by 2020.Arch Public Health 2012, 70:23. 10.1186/0778-7367-70-23
Oortwijn W, Mathijssen J, Lankhuizen M, Cave J: Evaluating the Uptake of the Healthy Life Years Indicator. Brussels: Rand-Europe; 2006:1–74.
Van Oyen H, Van der Heyden J, Perenboom R, Jagger C: Monitoring population disability: evaluation of a new Global Activity Limitation Indicator (GALI).Soz Praventivmed 2006, 51:153–61. 10.1007/s00038-006-0035-y
Tubeuf S, Jusot F, Devaux M, Sermet C: Social Heterogeneity in Self-reported Health Status and Measurement of Inequalities in Health. Paris: Irdes; 2008.
Cambois E, Robine JM, Mormiche P: Did the prevalence of disability in France really fall sharply in the 1990s?Popul (Engl edition) 2007, 62:313–37. 10.3917/pope.702.0313
Jagger C, Gillies C, Cambois E, Van Oyen H, Nusselder W, Robine JM: The Global Activity Limitation Index measured function and disability similarly across European countries.J Clin Epidemiol 2010, 63:892–9. 10.1016/j.jclinepi.2009.11.002
Robine JM, Cambois E, Nusselder W, Jeune B, Van Oyen H, Jagger C: The joint action on healthy life years (JA: EHLEIS).Arch Public Health 2013, 71:2. 10.1186/0778-7367-71-2
Gauci D: Synthesis Report on use of EHIS Quality Assessment Criteria. Malta: Department of Health Information and Research; 2011.
Tuomi-Nikalu A, Ahonen S, Koponen P: Comparison of EHIS Source Questions With National Survey Questions. Helsinki: National Institute for Health and Welfare; 2011.
Jagger C, Gillies C, Moscone F, Cambois E, Van Oyen H, Nusselder W, et al.: Inequalities in healthy life years in the 25 countries of the European Union in 2005: a cross-national meta-regression analysis.Lancet 2008, 372:2124–31. 10.1016/S0140-6736(08)61594-9
Katz S, Ford AB, Moskowitz RW, Jackson BA, Jaffe MW: Studies of illness in the aged. The Index of ADL: a standardized measure of biological and psychosocial function.JAMA 1963, 185:914–9. 10.1001/jama.1963.03060120024016
Verbrugge LM, Merrill SS, Liu X: Measuring disability with parsimony.Disabil Rehabil 1999, 21:295–306. 10.1080/096382899297729
Lawton M, Brody E: Assessment of older people: Self-maintenance and Instrumental Activities of Daily Living.Gerontology 1969, 9:179–86. 10.1093/geront/9.3_Part_1.179
Verbrugge LM, Jette AM: The disablement process.Soc Sci Med 1994, 38:1–14. 10.1016/0277-9536(94)90294-1
Robine JM, Jagger C, Egidi V, Gispert M, Nusselder W, Perenboom R, et al.: Creating a coherent set of indicators to monitor health across Europe: the Euro-REVES 2 project.Eur J Public Health 2003, 13:6–14. 10.1093/eurpub/13.suppl_3.6
de Bruin A, Picavet HS, Nossikov A: Health Interview Surveys: Towards International Harmonization of Methods and Instruments. Copenhagen: World Health Organisation; 1996.
Cochran WG: The combination of estimates from different experiments.Biometrics 1954, 10:101–29. 10.2307/3001666
Higgins JP, Thompson SG: Quantifying heterogeneity in a meta-analysis.Stat Med 2002, 21:1539–58. 10.1002/sim.1186
Deeg DJ, Verbrugge LM, Jagger C: Disability measurement. In Determining Health Expectancies. Edited by: Robine JM, Jagger C, Mathers CD, Crimmins EM. Chichester, UK: Wiley Online Library; 2003:203–19.
Bowling A: Mode of questionnaire administration can have serious effects on data quality.J Public Health (Oxf) 2005, 27:281–91. 10.1093/pubmed/fdi031
King G, Murray C, Salomon J, Tandon A: Enhancing the validity and cross-cultural comparability of measurement in survey research.Am Polit Sci Rev 2003, 97:567–84.
Angelini V, Cavapozzi D, Paccagnella O: Cross-country differentials in work disability reporting among older Europeans.Soc Indic Res 2012, 105:211–26. 10.1007/s11205-011-9878-6
Jylhä M: What is self-rated health and why does it predict mortality? Towards a unified conceptual model.Soc Sci Med 2009, 69:307–16. 10.1016/j.socscimed.2009.05.013
Verma V: Issues in Data Quality and Comparability in EU-SILC. 2006. http://www.stat.fi/eusilc/verma_5-1.pdf
The JA: EHLEIS Team. [http://www.eurohex.eu/index.php?option=aboutehemu#team]
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/15/1/prepub
The Joint Action EHLEIS is co-funded by the European Commission, (grant number DG SANCO 20102301), the French Ministry of Health (DRESS), the French National Solidarity Fund for Autonomy (CNSA) and 10 EU Member States (Belgium, Czech Republic, Denmark, France, Germany, Greece, Italy, The Netherlands, Sweden, United Kingdom). The funding source had no role in the study design; in the collection, analysis and interpretation of data; in the writing of the report; or in the decision to submit the paper for publication, although Eurostat is responsible for data collection. The authors thank Eurostat for their support.
The authors declare that they have no competing interests.
HVO initiated the study and overall design. NB conducted all analyses and wrote the first draft. HVO, EC, TF, CJ, WN and JMR advised on the statistical aspects of the study design, analysis stages and revision of drafts, and were involved in the discussion and interpretation of results. All authors read and approved the final manuscript.
Electronic supplementary material
Additional file 1:Age-standardised comparison of the GALI distribution (% limited) between the EHIS and the SILC 2009. Table comparing the GALI distribution by gender between the EHIS (European Health Interview Survey) and the SILC (Statistics on Income and Living Conditions) in 14 European countries. Results are age-standardised. (DOCX 16 KB)
Additional file 2:Cross-country comparison of association between the GALI and other measures of disability in adults aged 50 years and older. Figure describing the results of random-effect meta-analysis models to estimate the odds ratios between the GALI and (a) activity of daily living (ADL) limitations; (b) instrumental activities of daily living (IADL) limitations in adults aged 50 years and older. Slovakia (a) and Romania (b) were excluded because of extreme values (Odds Ratio (OR) > 100) and no comparable data was available for Belgium and France in (b). Source: European Health Interview Survey. (DOCX 268 KB)
About this article
Cite this article
Berger, N., Van Oyen, H., Cambois, E. et al. Assessing the validity of the Global Activity Limitation Indicator in fourteen European countries. BMC Med Res Methodol 15, 1 (2015). https://doi.org/10.1186/1471-2288-15-1