Skip to main content

Patient-reported outcome measures for physical function in cancer patients: content comparison of the EORTC CAT Core, EORTC QLQ-C30, SF-36, FACT-G, and PROMIS measures using the International Classification of Functioning, Disability and Health

Abstract

Background

Patient-reported physical function (PF) is a key endpoint in cancer clinical trials. Using complex statistical methods, common metrics have been developed to compare scores from different patient-reported outcome (PRO) measures, but such methods do not account for possible differences in questionnaire content. Therefore, the aim of our study was a content comparison of frequently used PRO measures for PF in cancer patients.

Methods

Relying on the framework of the International Classification of Functioning, Disability and Health (ICF) we categorized the item content of the physical domains of the following measures: EORTC CAT Core, EORTC QLQ-C30, SF-36, PROMIS Cancer Item Bank for Physical Function, PROMIS Short Form for Physical Function 20a, and the FACT-G. Item content was linked to ICF categories by two independent reviewers.

Results

The 118 items investigated were assigned to 3 components (‘d – Activities and Participation’, ‘b – Body Functions’, and ‘e – Environmental Factors’) and 11 first-level ICF categories. All PF items of the EORTC measures but one were assigned to the first-level ICF categories ‘d4 – Mobility’ and ‘d5 – Self-care’, all within the component ‘d – Activities and Participation’. The SF-36 additionally included item content related to ‘d9 – Community, social and civic life’ and the PROMIS Short Form for Physical Function 20a also included content related to ‘d6 – domestic life’. The PROMIS Cancer Item Bank (v1.1) covered, in addition, two first-level categories within the component ‘b – Body Functions’. The FACT-G Physical Well-being scale was found to be the most diverse scale with item content partly not covered by the ICF framework.

Discussion

Our results provide information about conceptual differences between common PRO measures for the assessment of PF in cancer patients. Our results complement quantitative information on psychometric characteristics of these measures and provide a better understanding of the possibilities of establishing common metrics.

Peer Review reports

Background

Physical function (PF) is a domain of health-related quality of life (HRQOL) that refers to activities that are fundamental to maintaining functional independence and influence independent living [1, 2].

PF is also a key endpoint in cancer clinical trials that plays a crucial role in the assessment of treatment efficacy [3, 4]. The importance of PF is well reflected in guidance documents of the European Medicines Agency [5] and the US Food and Drug Administration [6], and the domain is frequently part of drug-related patient-reported outcome (PRO) labelling claims [3].

Moreover, patient-reported PF has been shown to be an independent prognostic factor for overall survival across different types of cancer and disease stages [7], frequently exceeding the Eastern Cooperative Oncology Group (ECOG) performance status in prognostic value [8]. In studies determining health utilities for calculating quality-adjusted life years, PF was associated with the largest utility decrements, i.e. the largest impact on a patient’s evaluation when weighting HRQOL against life expectancy [9, 10].

A variety of well-validated multi-dimensional PRO measures and measurement systems are available that target PF and help to determine whether patients are able to perform tasks ranging from light activities to strenuous exercise. The most frequently used PRO measures in clinical trials [11] are the European Organisation for Research and Treatment of Cancer (EORTC) measures, the Functional Assessment of Chronic Illness Therapy (FACIT) measures, and the SF-36; and in particular for measuring PF, the EORTC QLQ-C30 and the SF-36 are used most often [12]. With the introduction of the Patient-Reported Outcomes Measurement Information System [PROMIS, 13], another option for the collection of PROs has been added. PROMIS, and the newly developed EORTC CAT Core [14, 15], are based on the concept of item banks. These rely on Item Response Theory (IRT) measurement models that enable the generation of computer-adaptive assessments and static short-forms tailored to specific settings [16].

The use of different PRO measures limits the comparability of study findings, even if the various measures assert to measure the same construct and are named similarly. To overcome this limitation common metrics have been introduced for certain PRO measures [17,18,19] that allow score conversion from one measure to another based on a variety of statistical methods. While the statistical methods are key for this, meaningful conversions of scores and pooling of such data should also account for differences and similarities of the content of the different PRO measures, i.e. they should consider whether the same aspects of PF are measured.

The items from the above-mentioned PRO measures assessing PF frequently relate to the ability to perform instrumental activities of daily living (e.g. self-care), but also to mobility, movement and fine motor skills. However, differences in the operationalization of PF may compromise comparability of scores from the different measures, even if statistical models may be developed for score conversion. The International Classification of Functioning, Disability and Health [ICF, 20] provides a framework for categorizing information on patients’ health and has frequently been used for comparing the item content of PRO measures in various medical fields [21,22,23,24].

This study is part of the first step of an ongoing EORTC QLG project, which aims to investigate the potential for linking scores from commonly used PRO measures in cancer research, with a focus on the EORTC CAT Core domains [14]. Information on item content differences and congruence is key for a better understanding of situations where common metrics enable meaningful conversions of scores from different PRO measures. Therefore, in the first phase, we aim to qualitatively assess the content of the different measurement tools to investigate possible conceptual (dis)similarities. In the second phase, quantitative analyses of the actual linkage of scores from these measures using statistical methods will be conducted. In this article, we present the results from the qualitative analysis comparing the item content of the physical domains of the following frequently used PRO measures using the ICF framework:

  • EORTC CAT Core Physical Functioning item bank

  • EORTC QLQ-C30 Physical Functioning scale

  • SF-36 Physical Function scale

  • PROMIS Short Form v2.0 Physical Function 20a

  • PROMIS Cancer Item Bank v1.1 – Physical Function

  • FACT-G Physical Well-being scale

Methods

Comparator measures for physical function

EORTC CAT Core and EORTC QLQ-C30

The EORTC CAT Core [14, 15] has been developed to measure the same 14 functional health domains and symptoms as the EORTC QLQ-C30 v3.0 [25], the most widely used PRO measure in cancer research [11, 26, 27]. It comprises item banks for each of the QLQ-C30 domains (with the exception of Global QOL). The item bank for PF consists of 31 items including the five PF items from the QLQ-C30 [28]. The additional items have been developed to fit conceptually and psychometrically with the QLQ-C30 PF items [28, 29]. For item bank development, ICF categories were used as well as the definition of PF according to Stewart and Kamberg [30], which defines PF as 'the performance of or capability to perform a variety of physical activities' such as 'bathing, dressing, walking, bending, climbing stairs, and running'.

The EORTC CAT Core item banks and the EORTC QLQ-C30 v3.0 use a 4-point rating scale as response format with categories ranging from ‘Not at all’ to ‘Very much’, without referring to a specific recall period.

SF-36

The Short Form 36 (SF-36) is a 36-item HRQOL measure [31, 32] that comprises eight individual domains including PF. The PF scale is conceptualized as the ‘performance of or capacity to perform a variety of activities that are normal for an individual in good health’ [33], including self-care, mobility, and physical activities. The questionnaire items assess limitations of physical activities and functioning due to health conditions. The PF domain consists of 10 items with a 3-point rating scale response format (response categories: ‘Yes, limited a lot’, ‘Yes, limited a little’, and ‘No, not limited at all’) and no specific recall period.

PROMIS cancer item bank v1.1 – physical function

The Patient-Reported Outcomes Measurement Information System (PROMIS) Cancer Item Bank v1.1 for PF is an item bank based on the PROMIS Physical Function Item Bank v1.0. The cancer-specific item bank includes 45 items, of which 8 items are uniquely cancer specific [34]. In general, domain mapping (e.g. physical function, including the conceptual framework and structure) in PROMIS was developed through independent literature reviews, a consensus-building Delphi process and statistical analysis concerning dimensionality of assessed health status. This process also embedded the WHO physical, mental and social framework, as well as the ICF framework and a 2-factor model of physical and mental health [35].

In PROMIS, PF is defined as ‘the ability to carry out various activities that require physical capability, ranging from self-care (basic activities of daily living) to more vigorous activities that require increasing degrees of mobility, strength, and/or endurance’ [36].

The questions that do not have a specific recall period are answered on a 5-point Likert scale ranging from ‘without any difficulty’ to ‘unable to do’ or ‘not at all’ to ‘cannot do’.

PROMIS – short form v2.0 – physical function 20a

The PROMIS Physical Function 20a [13] is a generic short-form based on the PROMIS Physical Function Item Bank v2.0 [34]. Six items from the PROMIS Cancer Item Bank v1.1 are included in the Physical Function 20a short-form. No recall period is specified in the short-form. The questions are answered on a 5-point Likert scale ranging from ‘Not at all’ to ‘Cannot do’ or ‘Without any difficulty’ to ‘Unable to do’.

FACT-G

The Functional Assessment of Cancer Therapy Scale – General (FACT-G, [37]) is a well-validated and commonly used questionnaire for the assessment of HRQOL in cancer patients. It provides scores for four domain scales including a physical well-being scale and a total score calculated from all four scales. Item generation was realised by interviewing patients and oncology specialists in a semi structured manner. The 27 items of the FACT-G version 4.0 [38] are rated on a 5-point Likert scale ranging from ‘Not at all’ to ‘Very much’, referring to a seven day recall period. The physical well-being scale consists of seven items that assess e.g. common symptoms in cancer patients such as fatigue or pain, a question on side-effects of treatment, and a question on being bedbound.

Linking of item content to the ICF framework

The ICF introduced in 2001 [20] by the World Health Organization (WHO) provides a unified standard language and conceptual framework for the description of health and health-related well-being. It has a hierarchical structure that consists of four components coded with letters (‘b – Body function’, ‘s – Structure’, ‘d – Activities and Participation’, and ‘e – Environmental factors”) and further levels of (sub)categories coded with numbers.

According to the ICF classification, the letters representing the components are followed by numbers, with the first digit indicating the first-level (chapter) category, the second and third digit indicating the second-level category, and the fourth digit stating the third-level category. Examples for the hierarchical structure of the ICF categories are given in Table 1.

Table 1 Examples of the hierarchical structure of the International Classification of Functioning, Disability and Health (ICF) categories (WHO, 2001)

To compare the item content of the PF measures we relied on the ICF version 2001 [20] and the methodology introduced by Cieza et al. [39,40,41]. The authors have established linking rules that define how to link questionnaire items covering different ICF categories, content not included in the ICF, or content not explicitly named in a corresponding ICF category. These linking rules have been used widely in the literature to compare the content of different PRO measures assessing a wide range of domains [21,22,23,24].

In an initial step of linking item content to the ICF classification, meaningful concepts are identified in each item of the questionnaires. Next, these concepts are mapped onto corresponding third-level ICF categories, i.e. assigned to ICF codes. If an item contains more than one meaningful concept, these are linked separately to the respective ICF categories, i.e. a single item may be linked to multiple ICF categories (e.g. PROMIS PF Short-form 20a Item No 3: ‘Are you able to dress yourself, including tying shoelaces and buttoning your clothes?’ was linked to d440 ‘Fine hand use’, and d540 ‘Dressing’). According to the recommendations by Cieza et al. [39,40,41], meaningful concepts of items that cannot be represented by ICF categories are coded as not covered (nc) if the concept is outside the ICF framework, and as not defined (nd) if the concept cannot be assigned to a component.

As part of the linking procedure each individual item in the PRO measures under investigation was coded independently by two of the following reviewers: FL, EL, CP, and JMG. Disagreements between two reviewers were discussed to reach consensus and another reviewer of the above was consulted to help resolving disagreements if needed.

Following the linking of item content, we analysed descriptively for each PRO measure under investigation, the number of codings per ICF category, the number of items (not) covered by ICF categories, and the number of different ICF categories covered by each PRO measures.

Results

Across all PRO measures under investigation the 118 PF items were assigned to 3 components (‘d – Activities and Participation’, ‘b – Body Functions’, and ‘e – Environmental Factors’), 11 first-level ICF categories, 30 s-level categories, and 69 third-level categories. Four concepts were categorized as ‘not covered’ or ‘not definable’ within the ICF framework.

The 31 items of the EORTC CAT Core PF item bank were assigned to 14 different second-level categories in ‘d – Activities and Participation’ and to 1 s-level category in ‘e – Environmental Factors’ (an item referring to a walking aid). Within ‘d – Activities and Participation’, all items belonged to the first-level categories ‘d4 – Mobility’ and ‘d5 – Self-care’. The most frequently found second-level categories were ‘d430 – Lifting and carrying objects’ (10 codings), ‘d450 – Walking’ (8 codings), ‘d455 – Moving around’ (7 codings), and ‘d520 – Caring for body parts’ (6 codings).

The five items of the EORTC QLQ-C30 PF scale (which are part of the EORTC CAT Core PF item bank) covered 8 different second-level categories, all within the component ‘d – Activities and Participation’ (6 codings in ‘d4 – Mobility’ and 4 codings in ‘d5 – Self-care’). The most common second-level categories were ‘d415 – Maintaining a body position’ and ‘d450 – Walking’ (2 codings each).

The SF-36 covered 9 different second-level categories with its 10-item PF scale, all of them being part of the component ‘d – Activities and Participation’. Fifteen codings were in ‘d4 – Mobility’, 2 codings in ‘d5 – Self-care’, and 2 codings in ‘d9 – Recreation and leisure’. The second-level categories ‘d430 – Lifting and carrying objects’ (4 codings), ‘d450 – Walking’, and ‘d455 – Moving around’ (3 codings each) were assigned most often.

The cancer-specific PROMIS item bank for PF covered 19 different second-level categories in the component ‘d – Activities and Participation’ and 1 s-level category (‘b455 – Exercise tolerance functions’; 3 codings) in the component ‘b – Body functions’. Within the component ‘d – Activities and participation’, the item bank covered the first-level categories ‘d2 – General tasks and demands’ (1 coding), ‘d4 – Mobility’ (45 codings), ‘d5 – Self-care’ (9 codings), ‘d6 – Domestic life’ (14 codings), and ‘d9 – Community, social and civic life’ (7 codings). The most frequently found second-level categories were ‘d430 – Lifting and carrying objects’ (15 codings), ‘d640 – Doing housework’ (11 codings), and ‘d455 – Moving around’ (8 codings).

The PROMIS PF Short Form 20a covered 15 different second-level categories, all of them being part of the component ‘d – Activities and Participation’. These second-level categories belonged to ‘d4 – Mobility’ (20 codings), ‘d5 – Self-care’ (6 codings), ‘d6 – Domestic life’ (3 codings), and ‘d9 – Community, social and civic life’ (1 coding). The most frequently found individual second-level categories were ‘d410 – Changing basic body position’ (5 codings), ‘d510 – Washing oneself’ (5 codings), and ‘d430 – Lifting and carrying objects’ (4 codings).

The FACT-G Physical Wellbeing scale with its 7 items covered six different second-level categories in the components ‘b – Body function’ (4 codings) and ‘d – Activities and participation’ (2 codings) and contained four concepts that could not be assigned to ICF categories. The six second-level categories were: ‘b130 – Energy and drive functions’, ‘b289 – sensation of pain, other and unspecified’, ‘b455 – Exercise tolerance functions’, ‘b535 – Sensations associated with the digestive system’, ‘d415 – Maintaining a body position’, and ‘d760 – Family relationships’.

The percentage of codings in the component ‘d – Activities and participation’ was largest for the EORTC QLQ-C30 (10 out of 10 codings; 100%), the PROMIS Short Form 20a (30/30; 100%) and the SF-36 (19/19; 100%) followed by the EORTC CAT Core (48/49; 98.0%), the cancer-specific PROMIS item bank for PF (76/79; 96.2%), and the FACT-G (2/10; 20%). Within the component ‘d – Activities and participation’ the first-level category ‘d4 – Mobility” was representing more than half of the coded item content for all PRO measures (but the FACT-G): SF-36 (15/19; 78.9%), PROMIS Short Form 20a (20/30; 66.7%), EORTC CAT Core (32/49 codings; 65.3%), EORTC QLQ-C30 (6/10; 60.0%), cancer-specific PROMIS item bank for PF (45/79%; 57.0%), and FACT-G (1/10; 10%). The category ‘d5 – Self-care’ was the second most coded first-level category for the EORTC QLQ-C30 (4/10; 40.0%) and the EORTC CAT Core (16/49; 32.7%), while it was less commonly found for the PROMIS Short Form 20a (6/30; 20.0%), the cancer-specific PROMIS item bank for PF (9/79%; 11.4%), the SF-36 (2/19; 10.5%), and the FACT-G (1/10; 10%). The first-level category ‘d6 – Domestic life” was coded only for the PROMIS measures: cancer-specific PROMIS item bank for PF (14/79; 17.7%) and PROMIS Short Form 20a (3/30; 10%), while the first-level category ‘d9 – Community, social and civic life’ was also relevant to the SF-36: SF-36 (2/19; 10.5%), PROMIS Short Form 20a (1/30; 3.3%), and cancer-specific PROMIS item bank for PF (7/79; 8.9%).

Further details on the PF domain of all PRO measures under investigation are shown in Table 2 and Table 3 and Fig. 1. Results for third-level categories are reported in Supplementary Table S1. When interpreting the descriptive statistics in the tables and figure, please note that multiple third-level ICF categories could be assigned to each item of the respective measure. For example the item 4 ‘Do you have any trouble walking up a flight of stairs?’ from the EORTC CAT Core PF was assigned to d450 ‘Walking’, and d455 ‘Moving around’.

Table 2 Comparison of the characteristics of the PRO measures under investigation
Table 3 Number of third-level categories reported within each first- and second-level category of the International Classification of Functioning, Disability and Health (ICF) represented in the PRO measures under investigation
Fig. 1
figure 1

Bar graph showing the proportions of International Classification of Functioning, Disability and Health (ICF) categories that have been linked within the respective patient-reported outcome measures for physical function

Discussion

In our analysis, we classified and compared the item content of six commonly used PRO measures for PF in cancer patients relying on the ICF reference system established by the WHO to assess concept equivalence, i.e. the degree to which they measure the same concepts.

The vast majority of the items (97%) could be assigned to ICF categories within the component ‘d—Activities and Participation’. For all PRO measures but the FACT-G, the first-level category ‘d4 – Mobility’ covered more than half of the item content, followed by ‘d5 – Self-care’ for the EORTC measures, the SF-36, and the PROMIS Short Form 20a. For the cancer-specific PROMIS item bank ‘d6 – Domestic life’ was the second most frequently used first-level category. The FACT-G Physical Well-being was the most heterogeneous measure with items related to ‘d – Activities and Participation’, ‘b – Body Functions’, and content that could not be categorized within the ICF framework.

The most relevant difference between the EORTC and the PROMIS measures was found for the first-level categories ‘d6—domestic life’ and ‘d9—community, social and civic life’ that were covered by the PROMIS, but not by the EORTC measures. This finding reflects differences in the overall EORTC and PROMIS measurement systems. The EORTC QLQ-C30 has distinct scales for physical, role, and social functioning, and this distinction has been maintained by the EORTC CAT Core, that provides individual item banks to measure role functioning [14, 15, 42] and social functioning [14, 15]. Therefore first-level categories such as d6 (Domestic life) or d9 (Community, social and civic life) have not been included in the EORTC physical functioning item bank. In quantitative analyses, the EORTC role functioning domain has been shown to be a domain that is strongly associated with, but still distinguishable from, the PF domain [43]. However, in the literature is still a debate on conceptual differences between physical and role functioning [44]. In the PROMIS framework a distinct role function measure is not available, since the concepts of role functioning and social functioning are combined in the item bank v2.0 Ability to Participate in Social Roles and Activities (e.g. measuring social function and social relationships; [45]).

The finding that the EORTC CAT Core includes more items related to the self-care ICF domain, i.e., items assessing low levels of physical function, than the comparator measures possibly reflects the focus on cancer populations and the development of the item bank in cooperation with the European Palliative Care Research Collaborative [29].

For the PROMIS measures, a content analysis using the ICF has been conducted previously by Tucker et al. [46] who, in line with our analysis, reported that most of the item content was related to d4 ‘Mobility’ and d5 ‘Self-care’ in the ‘Activities and Participation’ component and coverage of other first-level categories such as d6 ‘Domestic Life’ or d9 ‘Community, Social and Civic Life’ was limited. Consistent with our results a low number of items was also found to be related to “Body Functions”. Furthermore, our results are also in accordance with the analysis of the SF-36 by the original authors of the linking methodology [39] who also found the “Activities and Participation” component to cover all the content of the PF scale.

The physical well-being domain of the FACT-G assesses, for example, pain, reduced energy, and feelings of illness or impairments caused by side effects of the therapy, thus providing an assessment of general symptom burden rather than assessing PF specifically. Differences between the EORTC QLQ-C30 and the FACT-G domains have been highlighted previously [47, 48], and while the scale name itself reflects the conceptual difference, we decided to include this scale in our analysis since it has been linked to PF measures previously [49].

For the cancer-specific PROMIS PF item bank and the EORTC CAT Core, the results from our content analysis may also be used for content balancing in computer-adaptive assessments [50] or when creating short-forms or sub-sets from item banks [51] for physical function. Content balancing methods allow the selection of items not only based on psychometric criteria (e.g. maximum information) but also ensure that all important aspects of PF are adequately covered in an assessment. Content balancing may help to improve measurement accuracy and support consistent item selection [52].

A major challenge for a conceptual comparison of measures for PF is the lack of a comprehensive conceptual framework that explicitly defines PF. Despite previous efforts [2, 53] no single widely accepted and applicable definition has yet been established (which may at least in part result from the different purposes and perspectives when measuring PF). For our analysis, we used the ICF as this is a common framework for content comparisons of PRO measures and provides very detailed categories for the analysis of PF. However, we would like to emphasise that the type of framework used necessarily impacts on the assessment of similarities and differences between PRO measures. A further limitation of this study is the selection of PRO measures for PF that we analyzed. We did not rely on a systematic review for identifying all such measures applied in cancer patients but selected only those most frequently used in clinical research [11, 26, 27] and clinical practice [54] with the additional inclusion of PROMIS measures that are quickly gaining importance for PRO measurement across medical fields [55, 56]. For PROMIS we only investigated two measures of physical function, and content from other PROMIS short-forms may differ and include/exclude specific ICF categories. Furthermore, our analysis only focused on the comparison of item content but did not consider psychometric characteristics and the measurement range, i.e. the coverage of low, medium, and high levels of PF by the various measurement instruments. While such information is available from previous studies [13,14,15, 57], the levels of PF were not investigated in this analysis, which was based on the ICF framework.

In a next step in our ongoing project, we will evaluate scale equivalence with quantitative methods, such as regression models, IRT models, or equipercentile equating [58], to assess the possibilities of equating PF scores from the EORTC CAT Core and other PRO measures included in this analysis. The comparison of PRO measures based on the ICF classifications in this study will add to the results from applying quantitative methods to decide for which PRO measures linking scores or creating a common metric is meaningful.

In conclusion, the results from our analysis may inform clinicians and researchers when selecting the optimal PRO measure for PF in a specific study or patient population. With regard to linking of PRO measures we expect that the shared content related to mobility and self-care, which was predominant in the physical domain of all measures but the FACT-G, suggests that conceptually meaningful linking can be conducted, and quantitative methods are likely to allow for sufficient precision of such procedures.

Availability of data and materials

The datasets used and/or analysed during the current study available from the corresponding author on reasonable request.

References

  1. Garber CE, Greaney ML, Riebe D, Nigg CR, Burbank PA, Clark PG. Physical and mental health-related correlates of physical function in community dwelling older adults: A cross sectional study. BMC Geriatr. 2010;10:6. https://doi.org/10.1186/1471-2318-10-6.

    Article  Google Scholar 

  2. Painter P, Stewart AL, Carey S. Physical Functioning: Definitions, Measurement, and Expectations. Adv Ren Replace Ther. 1999;6(2):110–23. https://doi.org/10.1016/s1073-4449(99)70028-2.

    Article  CAS  Google Scholar 

  3. Gnanasakthy A, Barrett A, Evans E, D’Alessio D, Romano CD. A Review of Patient-Reported Outcomes Labeling for Oncology Drugs Approved by the FDA and the EMA (2012–2016). Value Health. 2019;22(2):203–9. https://doi.org/10.1016/j.jval.2018.09.2842.

    Article  Google Scholar 

  4. Kluetz PG, Slagle A, Papadopoulos EJ, Johnson LL, Donoghue M, Kwitkowski VE, Chen W-H, Sridhara R, Farrell AT, Keegan P, Kim G, Pazdur R. Focusing on Core Patient-Reported Outcomes in Cancer Clinical Trials: Symptomatic Adverse Events, Physical Function, and Disease-Related Symptoms. Clin Cancer Res. 2016;22(7):1553–8. https://doi.org/10.1158/1078-0432.CCR-15-2035.

    Article  CAS  Google Scholar 

  5. European Medicines Agency. (2016). The use of patient-reported outcome (PRO) measures in oncology studies - Appendix 2 to the guideline on the evaluation of anticancer medicinal products in man. https://www.ema.europa.eu/en/documents/other/appendix-2-guideline-evaluation-anticancer-medicinal-products-man_en.pdf

  6. Food and Drug Administration. (2020). Principles for Selecting, Developing, Modifying, and Adapting Patient-Reported Outcome Instruments for Use in Medical Device Evaluation. Food and Drug Administration. https://www.fda.gov/regulatory-information/search-fda-guidance-documents/principles-selecting-developing-modifying-and-adapting-patient-reported-outcome-instruments-use

  7. Efficace F, Collins GS, Cottone F, Giesinger JM, Sommer K, Anota A, Schlussel MM, Fazi P, Vignetti M. Patient-Reported Outcomes as Independent Prognostic Factors for Survival in Oncology: Systematic Review and Meta-Analysis. Value in. 2021;24(2):250–67. https://doi.org/10.1016/j.jval.2020.10.017.

    Article  Google Scholar 

  8. Mol, L., Ottevanger, P. B., Koopman, M., & Punt, C. J. A. (2016). The prognostic value of WHO performance status in relation to quality of life in advanced colorectal cancer patients. European Journal of Cancer (Oxford, England: 1990), 66, 138–143. https://doi.org/10.1016/j.ejca.2016.07.013

  9. Gamper, E. M., King, M. T, Norman, R, Efficace, F, Cottone, F, Holzner, B, & Kemmler, G (2020). Eortc QLU-C10D value sets for Austria, Italy, and Poland. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 29(9), 2485–2495. https://doi.org/10.1007/s11136-020-02536-z

  10. Kemmler G, Gamper E, Nerich V, Norman R, Viney R, Holzner B, King M. German value sets for the EORTC QLU-C10D, a cancer-specific utility instrument based on the EORTC QLQ-C30. Qual Life Res. 2019;28(12):3197–211. https://doi.org/10.1007/s11136-019-02283-w.

    Article  Google Scholar 

  11. Giesinger, J. M., Efficace, F., Aaronson, N., Calvert, M., Kyte, D., Cottone, F., Cella, D., & Gamper, E.-M. (2021). Past and Current Practice of Patient-Reported Outcome Measurement in Randomized Cancer Clinical Trials: A Systematic Review. Value in Health. Advance online publication. https://doi.org/10.1016/j.jval.2020.11.004; PMID: 33840437

  12. Atkinson TM, Stover AM, Storfer DF, Saracino RM, D’Agostino TA, Pergolizzi D, Matsoukas K, Li Y, Basch E. Patient-Reported Physical Function Measures in Cancer Clinical Trials. Epidemiol Rev. 2017;39(1):59–70. https://doi.org/10.1093/epirev/mxx008.

    Article  Google Scholar 

  13. Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, Amtmann D, Bode R, Buysse D, Choi S, Cook K, Devellis R, DeWalt D, Fries JF, Gershon R, Hahn EA, Lai J-S, Pilkonis P, Revicki D, Hays R. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. J Clin Epidemiol. 2010;63(11):1179–94. https://doi.org/10.1016/j.jclinepi.2010.04.011.

    Article  Google Scholar 

  14. Petersen, M. A., Aaronson, N. K., Arraras, J. I., Chie, W. C., Conroy, T., Costantini, A., Dirven, L., Fayers, P., Gamper, E. M., Giesinger, J. M., Habets, E., Hammerlid, E., Helbostad, J., Hjermstad, M. J., Holzner, B., Johnson, C., Kemmler, G., King, M. T., Kaasa, S., Loge, J. H., … European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Group (2018). The EORTC CAT Core-The computer adaptive version of the EORTC QLQ-C30 questionnaire. European journal of cancer (Oxford, England : 1990), 100, 8–16. https://doi.org/10.1016/j.ejca.2018.04.016; PMID: 29936066

  15. Petersen, M. A., Aaronson, N. K., Conroy, T., Costantini, A., Giesinger, J. M., Hammerlid, E., Holzner, B., Johnson, C. D., Kieffer, J. M., van Leeuwen, M., Nolte, S., Ramage, J. K., Tomaszewski, K. A., Waldmann, A., Young, T., Zotti, P., Groenvold, M., & European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Group (2020). International validation of the EORTC CAT Core: a new adaptive instrument for measuring core quality of life domains in cancer. Quality of life research: an international journal of quality of life aspects of treatment, care and rehabilitation, 29(5), 1405–1417. https://doi.org/10.1007/s11136-020-02421-9; PMID: 31955374

  16. Reise SP, Revicki DA. Handbook of Item Response Theory Modeling: Applications to Typical Performance Assessment. New York: Routledge; 2015.

    Google Scholar 

  17. Blackwell CK, Tang X, Elliott AJ, Thomes T, Louwagie H, Gershon R, Schalet BD, Cella D. Developing a common metric for depression across adulthood: Linking PROMIS depression with the Edinburgh Postnatal Depression Scale. Psychol Assess. 2021 Jul;33(7):610–618. doi: https://doi.org/10.1037/pas0001009. Epub 2021 May 31. PMID: 34060864; PMCID: PMC8284177.

  18. Lee, M. K., Schalet, B. D., Cella, D [David], Yost, K. J., Dueck, A. C., Novotny, P. J., & Sloan, J. A. (2020). Establishing a common metric for patient-reported outcomes in cancer patients: Linking patient reported outcomes measurement information system (PROMIS), numerical rating scale, and patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). Journal of Patient-Reported Outcomes, 4(1), 106. https://doi.org/10.1186/s41687-020-00271-0; PMCID: PMC7728866

  19. Victorson D, Schalet BD, Kundu S, Helfand BT, Novakovic K, Penedo F, Cella D. Establishing a common metric for self-reported anxiety in patients with prostate cancer: Linking the Memorial Anxiety Scale for Prostate Cancer with PROMIS Anxiety. Cancer. 2019;125(18):3249–58. https://doi.org/10.1002/cncr.32189. (PMID: 31090933).

    Article  Google Scholar 

  20. World Health Organization. International classification of functioning, disability and health : ICF. Geneva: World Health Organization; 2001. ISBN 92 4 154542 9.

  21. Alghwiri AA, Almhdawi KA, Marchetti G. Are fatigue scales the same? A content comparison using the International Classification of Functioning, Disability and Health. Multiple sclerosis and related disorders. 2020;46: 102596. https://doi.org/10.1016/j.msard.2020.102596. (PMID: 33296990).

    Article  Google Scholar 

  22. Moshki, M., Khajavi, A., Vakilian, F., Minaee, S., & Hashemizadeh, H. (2019). The content comparison of health-related quality of life measures in heart failure based on the international classification of functioning, disability, and health: a systematic review. Journal of cardiovascular and thoracic research, 11(3), 167–175. https://doi.org/10.15171/jcvtr.2019.29; PMID: 31579455

  23. Nund RL, Brown B, Ward EC, Maclean J, Roe J, Patterson JM, Martino R. What Are We Really Measuring? A Content Comparison of Swallowing Outcome Measures for Head and Neck Cancer Based on the International Classification of Functioning, Disability and Health (ICF). Dysphagia. 2019;34(4):575–91. https://doi.org/10.1007/s00455-019-10005-0.

    Article  Google Scholar 

  24. Tschiesner, U., Rogers, S. N., Harréus, U., Berghaus, A., & Cieza, A. (2008). Content comparison of quality of life questionnaires used in head and neck cancer based on the international classification of functioning, disability and health: a systematic review. European archives of oto-rhino-laryngology: official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery, 265(6), 627–637. https://doi.org/10.1007/s00405-008-0641-9; PMID: 18392633

  25. Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, Filiberti A, Flechtner H, Fleishman SB, de Haes JC. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst. 1993;85(5):365–76. https://doi.org/10.1093/jnci/85.5.365. (PMID: 8433390).

    Article  CAS  Google Scholar 

  26. Kanapuru B, Singh H, Kim J, Kluetz P. Patient-reported outcomes (PRO) in cancer trials submitted to the FDA from 2012–2015. J Clin Oncol. 2017;35:e14024–e14024. https://doi.org/10.1200/JCO.2017.35.15_suppl.e14024.

    Article  Google Scholar 

  27. Smith AB, Cocks K, Parry D, Taylor M. Reporting of health-related quality of life (HRQOL) data in oncology trials: a comparison of the European Organization for Research and Treatment of Cancer Quality of Life (EORTC QLQ-C30) and the Functional Assessment of Cancer Therapy-General (FACT-G). Quality of life research: an international journal of quality of life aspects of treatment, care and rehabilitation. 2014;23(3):971–6. https://doi.org/10.1007/s11136-013-0534-2.

    Article  Google Scholar 

  28. Petersen MA, Groenvold M, Aaronson NK, Chie W-C, Conroy T, Costantini A, Fayers P, Helbostad J, Holzner B, Kaasa S, Singer S, Velikova G, Young T. Development of computerized adaptive testing (CAT) for the EORTC QLQ-C30 physical functioning dimensions. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation. 2011;20(4):479–90. https://doi.org/10.1007/s11136-010-9770-x.

    Article  Google Scholar 

  29. Petersen, M. A., Groenvold, M., Aaronson, N. K., Chie, W.-C., Conroy, T., Costantini, A., Fayers, P., Helbostad, J., Holzner, B., Kaasa, S., Singer, S., Velikova, G., & Young, T. (2010). Development of computerised adaptive testing (CAT) for the EORTC QLQ-C30 dimensions - general approach and initial results for physical functioning. European Journal of Cancer (Oxford, England: 1990), 46(8), 1352–1358. https://doi.org/10.1016/j.ejca.2010.02.011

  30. Stewart AL, Kamberg C. Physical Functioning Measures. In: Stewart AL, Ware JE, editors. Measuring Functioning and Well-Being: The Medical Outcomes Study Approach. Duke University Press; 1992. p. 86–101.

    Google Scholar 

  31. Ware J, Sherbourne C. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Medical Care. 1992;30(6):473–83.

    Article  Google Scholar 

  32. Ware J, Kosinski M, Dewey J. How to score version 2 of the SF-36 health survey. Quality Metric. Lincoln: Incorporated; 2000.

  33. Ware, J. E., Brook, R., Davies, A. R., Williams, K. N., Stewart, A., Rogers, W. H., Donald, C. A., & Johnston, S. A. (1980). Conceptualization and Measurement of Health for Adults in the Health Insurance Study: Vol. I, Model of Health and Methodology. RAND Corporation. https://www.rand.org/pubs/reports/R1987z1.html

  34. PROMIS Cooperative Group. (2020). A brief guide to the PROMIS® Physical Function instruments. https://www.healthmeasures.net/images/PROMIS/manuals/PROMIS_Physical_Function_Scoring_Manual.pdf

  35. Cella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., Reeve, B., Ader, D., Fries, J. F., Bruce, B., Rose, M., & PROMIS Cooperative Group (2007). The Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years. Medical care, 45(5 Suppl 1), S3–S11. https://doi.org/10.1097/01.mlr.0000258615.42478.55

  36. Bruce B, Fries JF, Ambrosini D, Lingala B, Gandek B, Rose M, Ware JE. Better assessment of physical function: Item improvement is neglected but essential. Arthritis Res Ther. 2009;11(6):R191. https://doi.org/10.1186/ar2890.

    Article  Google Scholar 

  37. Cella D, Tulsky DS, Gray G, Sarafian B, Linn E, Bonomi A, Silberman M, Yellen SB, Winicour P, Brannon J. The Functional Assessment of Cancer Therapy scale: Development and validation of the general measure. Journal of Clinical Oncology : Official Journal of the American Society of Clinical Oncology. 1993;11(3):570–9. https://doi.org/10.1200/JCO.1993.11.3.570.

    Article  CAS  Google Scholar 

  38. Webster K, Cella D, Yost K. The Functional Assessment of Chronic Illness Therapy (FACIT) Measurement System: Properties, applications, and interpretation. Health Qual Life Outcomes. 2003;1:79. https://doi.org/10.1186/1477-7525-1-79.

    Article  Google Scholar 

  39. Cieza A, Brockow T, Ewert T, Amman E, Kollerits B, Chatterji S, Ustün TB, Stucki G. Linking health-status measurements to the international classification of functioning, disability and health. J Rehabil Med. 2002;34(5):205–10. https://doi.org/10.1080/165019702760279189.

    Article  Google Scholar 

  40. Cieza A, Geyh S, Chatterji S, Kostanjsek N, Ustün B, Stucki G. Icf linking rules: An update based on lessons learned. J Rehabil Med. 2005;37(4):212–8. https://doi.org/10.1080/16501970510040263.

    Article  Google Scholar 

  41. Cieza A, Fayed N, Bickenbach J, Prodinger B. Refinements of the ICF Linking Rules to strengthen their potential for establishing comparability of health information. Disabil Rehabil. 2019;41(5):574–83. https://doi.org/10.3109/09638288.2016.1145258. (PMID: 26984720).

    Article  Google Scholar 

  42. Gamper E-M, Petersen MA, Aaronson N, Costantini A, Giesinger JM, Holzner B, Kemmler G, Oberguggenberger A, Singer S, Young T, Groenvold M. Development of an item bank for the EORTC Role Functioning Computer Adaptive Test (EORTC RF-CAT). Health Qual Life Outcomes. 2016;14:72. https://doi.org/10.1186/s12955-016-0475-x.

    Article  Google Scholar 

  43. Gundy CM, Fayers PM, Groenvold M, Petersen MA, Scott NW, Sprangers MA, Velikova G, Aaronson NK. Comparing higher order models for the EORTC QLQ-C30. Quality of life research: an international journal of quality of life aspects of treatment, care and rehabilitation. 2012;21(9):1607–17. https://doi.org/10.1007/s11136-011-0082-6.

    Article  Google Scholar 

  44. Tucker CA, Cieza A, Riley AW, Stucki G, Lai JS, Bedirhan Ustun T, Kostanjsek N, Riley W, Cella D, Forrest CB. Concept analysis of the patient reported outcomes measurement information system (PROMIS(®)) and the international classification of functioning, disability and health (ICF). Qual Life Res. 2014;23(6):1677–86. https://doi.org/10.1007/s11136-014-0622-y.

    Article  Google Scholar 

  45. Hahn, E. A., DeWalt, D. A., Bode, R. K., Garcia, S. F., DeVellis, R. F., Correia, H., Cella, D., & PROMIS Cooperative Group (2014). New English and Spanish social health measures will facilitate evaluating health determinants. Health psychology : official journal of the Division of Health Psychology, American Psychological Association, 33(5), 490–499. https://doi.org/10.1037/hea0000055Helbostad, J. L., Hølen, J. C., Jordhøy, M. S., Ringdal, G. I., Oldervoll, L., & Kaasa, S. (2009). A first step in the development of an international self-report instrument for physical functioning in palliative cancer care: A systematic literature review and an expert opinion evaluation study. Journal of Pain and Symptom Management, 37(2), 196–205. https://doi.org/10.1016/j.jpainsymman.2008.01.011

  46. Tucker CA, Escorpizo R, Cieza A, Lai JS, Stucki G, Ustun TB, Kostanjsek N, Cella D, Forrest CB. Mapping the content of the Patient-Reported Outcomes Measurement Information System (PROMIS®) using the International Classification of Functioning, Health and Disability. Qual Life Res. 2014;23(9):2431–8. https://doi.org/10.1007/s11136-014-0691-y.

    Article  Google Scholar 

  47. Kemmler G, Holzner B, Kopp M, Dünser M, Margreiter R, Greil R, Sperner-Unterweger B. Comparison of two quality-of-life instruments for cancer patients: the functional assessment of cancer therapy-general and the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-C30. J Clin Oncol. 1999;17(9):2932–40. https://doi.org/10.1200/JCO.1999.17.9.2932.

    Article  CAS  Google Scholar 

  48. Luckett T, King MT, Butow PN, Oguchi M, Rankin N, Price MA, Hackl NA, Heading G. Choosing between the EORTC QLQ-C30 and FACT-G for measuring health-related quality of life in cancer clinical research: Issues, evidence and recommendations. Ann Oncol. 2011;22(10):2179–90. https://doi.org/10.1093/annonc/mdq721.

    Article  CAS  Google Scholar 

  49. Kaat AJ, Schalet BD, Rutsohn J, Jensen RE, Cella D. Physical function metric over measure: An illustration with the Patient-Reported Outcomes Measurement Information System (PROMIS) and the Functional Assessment of Cancer Therapy (FACT). Cancer. 2018;124(1):153–60. https://doi.org/10.1002/cncr.30981.

    Article  Google Scholar 

  50. Leung C-K, Chang H-H, Hau K-T. Incorporation Of Content Balancing Requirements In Stratification Designs For Computerized Adaptive Testing. Educ Psychol Measur. 2003;63(2):257–70. https://doi.org/10.1177/0013164403251326.

    Article  Google Scholar 

  51. Fries JF, Witter J, Rose M, Cella D, Khanna D, Morgan-DeWitt E. Item response theory, computerized adaptive testing, and PROMIS: Assessment of physical function. J Rheumatol. 2014;41(1):153–8. https://doi.org/10.3899/jrheum.130813.

    Article  Google Scholar 

  52. Zheng Y, Chang C-H, Chang H-H. Content-balancing strategy in bifactor computerized adaptive patient-reported outcome measurement. Qual Life Res. 2013;22(3):491–9. https://doi.org/10.1007/s11136-012-0179-6.

    Article  Google Scholar 

  53. Tomey KM, Sowers MFR. Assessment of Physical Functioning: A Conceptual Model Encompassing Environmental Factors and Individual Compensation Strategies. Phys Ther. 2009;89(7):705–14. https://doi.org/10.2522/ptj.20080213.

    Article  Google Scholar 

  54. Howell D, Molloy S, Wilkinson K, Green E, Orchard K, Wang K, Liberty J. Patient-reported outcomes in routine cancer clinical practice: a scoping review of use, impact on health outcomes, and implementation factors. Ann Oncology : official journal of the European Society for Medical Oncology. 2015;26(9):1846–58. https://doi.org/10.1093/annonc/mdv181.

    Article  CAS  Google Scholar 

  55. Costa D, Mercieca-Bebber R, Rutherford C, Tait MA, King MT. How is quality of life defined and assessed in published research? Qual Life Res. 2021;30(8):2109–21. https://doi.org/10.1007/s11136-021-02826-0.

    Article  Google Scholar 

  56. Wong LH, Meeker JE. The promise of computer adaptive testing in collection of orthopaedic outcomes: an evaluation of PROMIS utilization. J Patient-Reported Outcomes. 2022;6(1):2. https://doi.org/10.1186/s41687-021-00407-w.

    Article  Google Scholar 

  57. Taylor WJ, McPherson KM. Using Rasch analysis to compare the psychometric properties of the Short Form 36 physical function score and the Health Assessment Questionnaire disability index in patients with psoriatic arthritis and rheumatoid arthritis. Arthritis Rheum. 2007;57(5):723–9. https://doi.org/10.1002/art.22770.

    Article  Google Scholar 

  58. Schalet BD, Lim S, Cella D, Choi SW. Linking Scores with Patient-Reported Health Outcome Instruments: A VALIDATION STUDY AND COMPARISON OF THREE LINKING METHODS. Psychometrika. 2021;86(3):717–46. https://doi.org/10.1007/s11336-021-09776-z.

    Article  Google Scholar 

Download references

Acknowledgements

EORTC Quality of Life Group

Emma Lidington3, Claire Piccinin4, Juan I. Arraras5, Mogens Groenvold6, Bernhard Holzner7, Marieke van Leeuwen8, Morten Aa. Petersen9, Heike Schmidt10, Teresa Young11, Johannes M. Giesinger7

3 Cancer Behavioural Science Unit, King’s College London, Guy’s Hospital, St Thomas Street, London SE1 9RT, United Kingdom

4 Quality of Life Department, EORTC, Avenue E. Mounier, 83/11, 1200 Brussels, Belgium

5 Medical Oncology Department, Hospital Universitario de Navarra, C/Irunlarrea 3, ES-31008 Pamplona, Spain

6 Palliative Care Research Unit, Department of Geriatrics and Palliative Medicine GP, Bispebjerg & Frederiksberg Hospital, University of Copenhagen, Copenhagen, Denmark

7 Department of Psychiatry, Psychotherapy, Psychosomatics, and Medical Psychology, Innsbruck Medical University, Anichstraße 35, A-6020 Innsbruck, Austria

8 Division of Psychosocial Research & Epidemiology, The Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam, The Netherlands

9 Palliative Care Research Unit, Bispebjerg/Frederiksberg Hospital, Bispebjerg bakke 23, DK-2400 Copenhagen, Denmark

10 University Clinic and Outpatient Clinic for Radiotherapy and Institute of Health and Nursing Science, Medical Faculty of Martin Luther University Halle-Wittenberg, Germany

11 Lynda Jackson Macmillan Centre, Mount Vernon Cancer Centre, Rickmansworth Rd, GB- HA6 2RN Northwood, Middlesex, United Kingdom

Funding

This study has been funded by a grant from the EORTC Quality of Life Group (#011 2016).

Author information

Authors and Affiliations

Authors

Consortia

Contributions

JMG, MAP, MG, JIA, MvL, TY conceived the study. FL, EL, PC and JMG generated the data. TS, FL, EL, PC and JMG analysed the data. All authors contributed to interpretation of data. TS and JMG drafted the manuscript. All authors revised the manuscript critically for important intellectual content. All authors have proofread and revised the manuscript and consent for publication.

Corresponding author

Correspondence to JM Giesinger.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file1

. Table S1. Number of third-level categories of ICF represented in the PRO measures under investigation

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Schurr, T., Loth, F., Lidington, E. et al. Patient-reported outcome measures for physical function in cancer patients: content comparison of the EORTC CAT Core, EORTC QLQ-C30, SF-36, FACT-G, and PROMIS measures using the International Classification of Functioning, Disability and Health. BMC Med Res Methodol 23, 21 (2023). https://doi.org/10.1186/s12874-022-01826-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12874-022-01826-z

Keywords