The 12-item World Health Organization Disability Assessment Schedule II (WHO-DAS II): a nonparametric item response analysis
© Luciano et al; licensee BioMed Central Ltd. 2010
Received: 18 January 2010
Accepted: 20 May 2010
Published: 20 May 2010
Previous studies have analyzed the psychometric properties of the World Health Organization Disability Assessment Schedule II (WHO-DAS II) using classical omnibus measures of scale quality. These analyses are sample dependent and do not model item responses as a function of the underlying trait level. The main objective of this study was to examine the effectiveness of the WHO-DAS II items and their options in discriminating between changes in the underlying disability level by means of item response analyses. We also explored differential item functioning (DIF) in men and women.
The participants were 3615 adult general practice patients from 17 regions of Spain, with a first diagnosed major depressive episode. The 12-item WHO-DAS II was administered by the general practitioners during the consultation. We used a non-parametric item response method (Kernel-Smoothing) implemented with the TestGraf software to examine the effectiveness of each item (item characteristic curves) and their options (option characteristic curves) in discriminating between changes in the underliying disability level. We examined composite DIF to know whether women had a higher probability than men of endorsing each item.
Item response analyses indicated that the twelve items forming the WHO-DAS II perform very well. All items were determined to provide good discrimination across varying standardized levels of the trait. The items also had option characteristic curves that showed good discrimination, given that each increasing option became more likely than the previous as a function of increasing trait level. No gender-related DIF was found on any of the items.
All WHO-DAS II items were very good at assessing overall disability. Our results supported the appropriateness of the weights assigned to response option categories and showed an absence of gender differences in item functioning.
The World Health Organization Disability Assessment Schedule II (WHO-DAS II) was developed by the WHO's Assessment, Classification and Epidemiology Group within the framework of the WHO/NIH Joint Project on Assessment and Classification of Disablements . It is a 36-item instrument designed to measure disability irrespective of health-related etiology in six domains: understanding and communicating, getting around, self-care, getting along with people, life activities, and participation in society. These domains reflect two dimensions of the International Classification of Functioning, Disability and Health (ICF) model : activity limitations (understanding and communicating; getting around; and self-care) and participation (getting along with others; life activities; and participation in society). A one-dimensional screener with 12 items was also developed for measuring global disability, which is especially suitable for epidemiological studies and routine outcome assessment.
The psychometric properties of the WHO-DAS II have been tested in approximately 28 centres in more than 18 geographically and culturally diverse countries. Previous studies, conducted with patients suffering diverse physical and mental conditions, have focused on the factor structure, internal consistency, item-total correlations, etc, using classical test theory as framework [3–10]. However, this type of analyses rely on omnibus statistics that average over levels of individual variation and offer no means to gauge the quality of individual items or options across different levels of disability. Moreover, traditional analyses are sample dependent, showing certain variations among clinical groups and even within clinical groups.
Item response theory (IRT) methods are powerful tools that provide detailed information about item functioning [11–13]. IRT comprises a group of parametric and non-parametric models expressing the probability of a particular response to a scale item as a function of the latent trait of the individual and of characteristics of the item . Some advantages of IRT models with respect to traditional test methods for health outcome assessment are the next [11, 15]: (1) item statistics are independent of the individuals included in the sample and person statistics are independent of the administered items (invariance); (2) the standard error of the estimate is unique for each latent trait level; whereas the traditional test-based standard error of the measurement is assumed to be the same for all individuals regardless of their underlying trait level; (3) item information and test information vary as a function of the underlying trait level; (4) it is possible to assess differential item functioning (DIF), defined as different probabilities of endorsing an item by individuals from two groups who are equal on the latent trait. Finally, it is important to highlight that IRT and classical test theory methods have not to be conceived as rivals, in fact, as Pollard et al  have recently pointed out, the use of both methods is more informative than only using one of the methods.
The present work extends previous studies using IRT methods to assess the item quality of the 12-item WHO-DAS-II. First, a non parametric item analysis [17, 18] was performed to examine the effectiveness of each item and their options in discriminating between changes in the underliying disability level, among patients with a first time diagnosed major depressive episode. Our second specific objective was to evaluate WHO-DAS II items for DIF related to gender.
In the present work we utilized the ERASMAP dataset. The ERASMAP was a cross-sectional observational study carried out in Spain. It was designed to identify the sociodemographic and clinical factors associated with diagnostic delay in primary care patients with a first time diagnosed major depressive episode. A total of 1210 general practitioners from 874 healthcare centres agreed to participate in the study, which was performed in accordance with the ethical standards laid down in the 1964 Declaration of Helsinki and was approved by the Clinical Research and Ethics Committee of the University Hospital La Princesa (Madrid, Spain).
3615 adult (18 years or older) patients attending general practice, who were for the first time diagnosed with major depressive episode. Patients with a previous diagnosis of major depressive episode, bipolar disorder, schizophrenia or delusional disorder, and those who were receiving treatment with any psychotropic medication were not included in the study.
- The 12-item interviewer administered version of the World Health Organization Disability Assessment Schedule II (12-item WHO-DAS II) [1, 8, 19]. Respondents are asked to state the level of difficulty experienced taking into consideration how they usually do the activity, including the use of any assistive devices and/or the help of a person. In each item, individuals have to estimate the magnitude of the disability during the previous 30 days using a five-point scale (none = 1, mild = 2, moderate = 3, severe = 4, extreme/cannot do = 5). The total score is calculated with a SPSS syntax (available through the WHO) and may vary from 0 to 100 with higher scores reflecting greater disability (the score indicates the percent of the highest possible score obtained). The Spanish version applied in this study demonstrated sound psychometric properties and evidence of unidimensionality in a previous work  (Mean = 53.83, SD = 17.63; Exploratory factor analysis: percentage of variance explained by the 1st factor = 46.15%; ratio of the first to the second eigenvalue > 3; all factor loadings > 0.55; Cronbach's α = 0.89).
During the consultation, the participating general practitioners assessed the patients meeting the inclusion criteria using a paper-and-pencil interview. Prior to the assessment, all patients had provided written informed consent.
First, we examined item characteristic curves (ICC) for patients to examine each item's overall ability to discriminate among the levels of disability, with steeper slopes indicating a closer relationship to the latent trait and therefore a more discriminating item . The dashed vertical lines in each plot indicate the percentage of individuals that fell below various standard normal scores. The vertical lines of varying length on the ICC are error bars that indicate the estimated 95% point-wise confidence limits for the value of the curve (item score) at a specified disability level (standard normal score). The wider these error bars, the more uncertainty associates with a respondent's item response at that trait level. Second, an item's effectiveness also depends on how well its options function. We examined option characteristic curves (OCC) for each item to check whether each option was dominant over an appropriate but limited range of the trait thus reflecting the rank order of the item options. If OCCs are not distinguishable or if their endorsement probability is never dominant over an appropriate range of the trait, then the original differential weighting of these options is considered inappropriate, and they should be combined or dropped .
We decided to use the non-parametric kernel-smoothing technique  for examination of item and option characteristics as well as for DIF analysis taking into account the following considerations: non-parametric IRT models do not require complex estimation procedures, can be applied to relatively small data sets, are less imposing concerning distributional form of item response functions and help to avoid misleading results obtained from parametric IRT models. In this work, the analyses were conducted with TestGraf . With the kernel-smoothing technique implemented by TestGraf, the researcher determines the item response functions directly from the data without forcing the data to conform to a logistic IRT model.
DIF is a bias that occurs when a scale item performs differently across different demographic groups after controlling for the underlying trait measured by the instrument. To examine DIF, TestGraf calculates a weighted average of the squared difference between the focal or comparison group's probability of endorsing an item and the reference or baseline group's probability of endorsing an item. Thus, a composite index of DIF is obtained after comparison of the response characteristic curves. If the focal group (the women in our case) has a higher probability of endorsing an item, the index of DIF will be positive, while the index will be negative if the reference group (the men in our case) has a higher probability. Taking into account the Santor and colleagues' criteria , a value equal or greater than 0.30 indicates the existence of DIF, whereas a value equal or less than 0.10 indicates little or no DIF.
Characteristics of the study sample (n = 3615)
Age, M (SD)
Marital status %
Living with a partner
Education level %
Did not graduate from primary school
Work status %
Paid employment but in sick leave
Differential Item Functioning (DIF) related to gender
Prior to the DIF analysis, we conducted a Student's t-test for independent samples in order to examine if there were significant gender differences in disability at the scale level. The analysis revealed that women (n = 2360; M = 54.96, SD = 17.52) had significantly higher disability than men (n = 1125; M = 51.54, SD = 17.69), t(3483) = 5.36, p < .001.
Mean raw scores and mean gender item bias for men and women.
1. Standing for long periods such as 30 minutes?
2. Taking care of your household responsibilities?
3. Learning a new task, for example, learning how to get to a new place?
4. How much of a problem did you have in joining in community activities (for example, festivities, religious or other activities) in the same way as anyone else can?
5. How much have you been emotionally affected by your health problems?
6. Concentrating on doing something for ten minutes?
7. Walking a long distance such as a kilometre [or equivalent]?
8. Washing your whole body?
9. Getting dressed?
10. Dealing with people you do not know?
11. Maintaining a friendship?
12. Your day to day work?
In the present work, we employed a non parametric IRT method to examine the items effectiveness, response category functioning and differential item functioning related to gender of the 12-item WHO-DAS II.
Overall, the results obtained in the present research indicate that all WHO-DAS II items performed well at discriminating varying levels of disability. The inspection of the ICCs and the OCCs indicated that all items assessed well the entire continuum of disability. We could see that certain items, for instance items 8 and 9 (bathing and dressing, respectively), ask about activities in which patients clearly experience fewer problems, whereas in others, for instance items 5 and 12 (emotionally affected by the health problem and work, respectively), patients report more problems or difficulties. Finally, the weights assigned to the individual item options are appropriate for measuring the underlying trait due to the absence of overlap between adjacent OCCs.
Following Santor et al criteria , we can consider the items as "good" or "very good" because there was some range of severity in which the majority of options were more likely to be endorsed than any other, the OCCs increased rapidly with changes in overall severity, the region in which each option was most likely to be endorsed were ordered, left to right, in accordance with their option scores (weights), and options spanned the full continuum of severity from -3 to +3. In addition, we did not find "easy" (the majority of options on an item are endorsed at low levels of severity) or "hard" items (the majority of options on an item are endorsed at high levels of severity). Finally, men and women who were at the same point on the disability continuum did not respond differently to items on the WHO-DAS II, that is, group mean differences between men and women in disability cannot be attributable to gender item bias.
Our results partially support those obtained by Rehm and collaborators  with a previous version of the instrument. Using data from two field trials, these authors examined the 12-item WHO-DAS II (screener version that possessed different items) by means of confirmatory factor analysis, non-parametric (Mokken scale analysis) and parametric (Birnbaum's two-parametric model) methods of IRT. The non-parametric analysis indicated that the scale could be considered of medium scalability, however, the parametric analysis indicated that the ICCs did intersect, suggesting the need of developing a new version of the instrument that would be IRT compatible.
We have to acknowledge the following limitation in the present work. Although the 12-item WHO-DAS II is sufficiently unidimensional for IRT analysis, we found covariation in a previous study  within some pairs of items (1 and 7, 8 and 9, 10 and 11; the confirmatory factor analysis indicated that the three error covariances were statistically significant, ranging from a minimum of 0.42 to a maximum of 0.83), which supposes a violation of the local independence criterion required by IRT. However, having in mind that IRT methods are quite robust to minor violations related to the local independence assumption, especially when a scale consists of 10 or more ítems , we think that there are not enough reasons to judge the results reported above as unreliable or non valid.
IRT methods enable researchers to examine important scale properties that can not be addressed with traditional analyses . In this work, using non parametric IRT analyses, we found that WHO-DAS II items and options discriminate well among different latent levels of disablement and that it is a nonbiased instrument with respect to gender. Future studies should try to extend our findings using a parametric IRT model in order to confirm that the instrument is IRT compatible and allows cross-cultural comparability.
This study was funded by H. Lundbeck A/S, which was responsible for field work and collection of data. They did not have any role in the analysis and interpretation of data, in the writing of the manuscript, and in the decision to submit the manuscript for publication. JVL and AF are grateful to the "Instituto de Salud Carlos III" (Red RD06/0018/0017) for a postdoctoral and a predoctoral contract, respectively.
- World Health Organization Disability Assessment Schedule II (WHO-DAS II). [http://www.who.int/icidh/whodas/]
- World Health Organization. International Classification of Functioning, Disability and Health. [http://www.who.int/classifications/icf/en/]
- Baron M, Schieir O, Hudson M, Steele R, Kolahi S, Berkson L, Couture F, Fitzcharles MA, Gagné M, Garfield B, Gutkowski A, Kang H, Kapusta M, Ligier S, Mathieu JP, Ménard H, Starr M, Stein M, Zummer M: The clinimetric properties of the World Health Organization Disability Assessment Schedule II in early inflammatory arthritis. Arthritis Rheum. 2008, 59: 382-390. 10.1002/art.23314.View ArticlePubMedGoogle Scholar
- Chávez LM, Canino G, Negrón G, Shrout PE, Matías-Carrelo LE, Aguilar-Gaxiola S, Hoppe S: Psychometric properties of the Spanish Version of Two Mental Health Outcome Measures: World Health Organization Disability Assessment Schedule II and Lehman's Quality of Life Interview. Ment Health Serv Res. 2005, 7: 145-159. 10.1007/s11020-005-5783-4.View ArticlePubMedGoogle Scholar
- Chisolm TH, Abrams HB, McArdle R, Wilson RH, Doyle PJ: The WHO-DAS II: psychometric properties in the measurement of functional health status in adults with acquired hearing loss. Trends Amplif. 2005, 9: 111-126. 10.1177/108471380500900303.View ArticlePubMedPubMed CentralGoogle Scholar
- Chwastiak LA, Von Korff M: Disability in depression and back pain: evaluation of the World Health Organization Disability Assessment Schedule (WHO DAS II) in a primary care setting. J Clin Epidemiol. 2003, 56: 507-514. 10.1016/S0895-4356(03)00051-9.View ArticlePubMedGoogle Scholar
- Hudson M, Steele R, Taillefer S, Baron M, the Canadian Scleroderma Research Group: Quality of life in systemic sclerosis: psychometric properties of the World Health Organization Disability Assessment Schedule II. Arthritis Rheum. 2008, 59: 1128-1136. 10.1002/art.23914.View ArticleGoogle Scholar
- Luciano JV, Ayuso-Mateos JL, Fernández A, Serrano-Blanco A, Roca M, Haro JM: Psychometric properties of the twelve item World Health Organization Disability Assessment Schedule II (WHO-DAS II) in Spanish primary care patients with a first major depressive episode. J Affect Disord. 2010, 121: 52-58. 10.1016/j.jad.2009.05.008.View ArticlePubMedGoogle Scholar
- McKibbin C, Patterson TL, Jeste DV: Assessing disability in older patients with schizophrenia: results from the WHODAS-II. J Nerv Ment Dis. 2004, 192: 405-413. 10.1097/01.nmd.0000130133.32276.83.View ArticlePubMedGoogle Scholar
- Pösl M, Cieza A, Stucki G: Psychometric properties of the WHO-DAS II in rehabilitation patients. Qual Life Res. 2007, 16: 1521-1531. 10.1007/s11136-007-9259-4.View ArticlePubMedGoogle Scholar
- Hays RD, Morales LS, Reise SP: Item response theory and health outcomes measurement in the 21st century. Med Care. 2000, 38 (Suppl 9): II28-42.PubMedPubMed CentralGoogle Scholar
- Rabe-Hesketh S, Skrondal A: Classical latent variable models for medical research. Stat Methods Med Res. 2008, 17: 5-32. 10.1177/0962280207081236.View ArticlePubMedGoogle Scholar
- Reise SP, Waller NG: Item response theory and clinical measurement. Annu Rev Clin Psychol. 2009, 5: 25-46. 10.1146/annurev.clinpsy.032408.153553.View ArticleGoogle Scholar
- Chang Ch, Reeve BB: Item response theory and its applications to patient-reported outcomes measurement. Eval Health Prof. 2005, 28: 264-282. 10.1177/0163278705278275.View ArticlePubMedGoogle Scholar
- Sachs J, Law YK, Chan CKK: A non parametric item analysis of a selected item subset of the Learning Process Questionnaire. Br J Educ Psychol. 2003, 73: 395-423. 10.1348/000709903322275902.View ArticlePubMedGoogle Scholar
- Pollard B, Dixon D, Dieppe P, Johnston M: Measuring the ICF components of impairment, activity limitations and participation restriction: an item analysis using classical test theory and item response theory. Health Qual Life Outcomes. 2009, 7: 41-10.1186/1477-7525-7-41.View ArticlePubMedPubMed CentralGoogle Scholar
- Mokken RJ: A theory and procedure of scale analysis. 1971, The Hague: MoutonView ArticleGoogle Scholar
- Molenaar IW: Thirty years of nonparametric Item Response Theory. Appl Psychol Meas. 2001, 25: 295-299. 10.1177/01466210122032091.View ArticleGoogle Scholar
- Vázquez-Barquero JL, Vázquez Bourgón E, Herrera Castanedo S, Saiz J, Uriarte M, Morales F, Gaite L, Herrán A, Ustün TB: Spanish version of the new World Health Organization Disability Assessment Schedule II (WHO-DAS-II): initial phase of development and pilot study. Cantabria disability work group. Actas Esp Psiquiatr. 2000, 28: 77-87.PubMedGoogle Scholar
- Orlando M, Reeve BB: Applying item response theory (IRT) modelling to questionnaire development, evaluation, and refinement. Qual Life Res. 2007, 16: 5-18. 10.1007/s11136-007-9198-0.View ArticleGoogle Scholar
- Santor DA, Ramsay JO: Progress in the technology of measurement: Applications of Item Response Models. Psych Assess. 1998, 10: 345-359. 10.1037/1040-3518.104.22.1685.View ArticleGoogle Scholar
- Ramsay JO: Kernel-smoothing approaches to nonparametric item characteristic curve estimation. Psychometrika. 1991, 56: 611-630. 10.1007/BF02294494.View ArticleGoogle Scholar
- Ramsay JO: TestGraf: A program for the graphical analysis of multiple choice test and questionnaire data. [http://www.psych.mcgill.ca/faculty/ramsay/ramsay.html]
- Santor DA, Ramsay JO, Zuroff DC: Nonparametric item analyses of the Beck Depression Inventory: Evaluating gender item bias and response option weights. Psych Assess. 1994, 6: 255-270. 10.1037/1040-3522.214.171.124.View ArticleGoogle Scholar
- Santor DA, Ascher-Svanum H, Lindenmayer JP, Obenchain Rl: Item response analysis of the Positive and Negative Syndrome Scale. BMC Psychiatry. 2007, 7: 66-10.1186/1471-244X-7-66.View ArticlePubMedPubMed CentralGoogle Scholar
- Rehm J, Üstün B, Saxena S, Nelson CB, Chatterji S, Ivis F, Adlaf E: On the development and psychometric testing of the WHO screening instrument to assess disablement in the general population. Int J Methods Psychiatr Res. 1999, 8: 110-122. 10.1002/mpr.61.View ArticleGoogle Scholar
- Reise SP, Ainsworth AT, Haviland MG: Item response theory. Fundamentals, applications, and promise in psychological research. Curr Dir Psychol Sci. 2005, 14: 95-101. 10.1111/j.0963-7214.2005.00342.x.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/10/45/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.