Patient self-appraisal of change and minimal clinically important difference on the European organization for the research and treatment of cancer quality of life questionnaire core 30 before and during cancer therapy
© Hong et al.; licensee BioMed Central Ltd. 2013
Received: 13 August 2012
Accepted: 13 March 2013
Published: 28 March 2013
Clinical interpretation of health related quality of life (HRQOL) scores is challenging. The purpose of this analysis was to interpret score changes and identify minimal clinically important differences (MCID) on the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-Core 30 (QLQ-C30) before (T1) and during (T2) cancer treatment.
Patients (N = 627) in stem cell transplant (SCT) and medical (MED) or radiation (RAD) oncology at two comprehensive cancer centers, enrolled in the Electronic Self-Report Assessment-Cancer study and completed the QLQ-C30 at T1 and T2. Perceived changes in five QOL domains, physical (PF), emotional (EF), social (SF), cognitive functioning (CF) and global quality of life (QOL), were reported using the Subject Significance Questionnaire (SSQ) at T2. Anchored on SSQ ratings indicating “improvement”, “the same”, or “deterioration”, means and effect sizes were calculated for QLQ-C30 score changes. MCID was calculated as the mean difference in QLQ-C30 score changes reflecting one category change on SSQ rating, using a two-piece linear regression model.
A majority of SCT patients (54%) perceived deteriorating global HRQOL versus improvement (17%), while approximately equal proportions of MED/RAD patients perceived improvement (25%) and deterioration (26%). Global QOL decreased 14.2 (SCT) and 2.0 (MED/RAD) units, respectively, among patients reporting “the same” in the SSQ. The MCID ranged 5.7-11.4 (SCT) and 7.2-11.8 (MED/RAD) units among patients reporting deteriorated HRQOL; ranged 2.7-3.4 units among MED/RAD patients reporting improvement. Excepting for the global QOL (MCID =6.9), no meaningful MCID was identified among SCT patients reporting improvement.
Cancer treatment has greater impact on HRQOL among SCT patients than MED/RAD patients. The MCID for QLQ-C30 score change differed across domains, and differed for perceived improvement and deterioration, suggesting different standards for self-evaluating changes in HRQOL during cancer treatment. Specifically, clinical attention can be focused on patients who report at least a 6 point decrease, and for patients who report at least a 3 point increase on QLQ-C30 domains.
The trial was registered with ClinicalTrials.gov: NCT00852852
KeywordsCancer treatment Health related quality of life Quality of life questionnaire-core Subject significance questionnaire Minimal clinically important differences
Health-related quality of life (HRQOL) is an important patient outcome measure following cancer treatment in randomized trials. HRQOL was shown to be an independent prognostic factor for response to treatment, progression-free survival, and survival [1, 2]. Significance of differences (or changes) in HRQOL are often interpreted with statistical hypothesis testing using p-values . However, a statistically significant difference is not synonymous with clinical meaningfulness. Clinical investigators are challenged to interpret important changes in HRQOL over time and to determine a minimal clinically important difference (MCID). Once established, a MCID is a useful benchmark for clinical researchers to assess effectiveness of an intervention and determine sample sizes for future clinical trials. Understanding the MCID may help clinicians address HRQOL related issues during cancer treatment.
The European Organization for the Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire Core 30 (QLQ-C30)  is a commonly used instrument for measuring HRQOL among cancer patients. Osoba et al. evaluated 375 patients with metastatic small cell lung cancer or breast cancer, and observed a mean change of 5–10, 10–20, >20 units for small, moderate, large changes, respectively, in QLQ-C30 scores . In a review of 14 cross-sectional studies, King et al. recommended that a change of 5 and 15 units was a relatively small and large difference, respectively . On the contrary, Grulke and colleagues evaluated trends in HRQOL scores before and after hematopoietic stem cell transplant (SCT) from 33 studies that involved 2,800 patients in England and Germany, and concluded that only a difference exceeding 15 units was clinically significant . Additionally, in a meta-analysis of 152 cross-sectional studies (15% were conducted in the US/Canada regions), Cocks et al. recommended a range of 9 to 19 points as the medium difference . Most of these studies analyzed data among European patients, and focused on patients with specific cancer types. To our knowledge, our analysis is the first to interpret and to identify MCIDs for the QLQ-C30 score changes focusing on American patients with cancer.
There are few analyses assessing potential differences in MCID between improvement and deterioration. Ringash et al  and Cella et al  analyzed the Functional Assessment of Cancer Therapy (FACT) and reported a larger magnitude in MCID for deterioration than for improvement. This is in contrast to a study using QLQ-C30 among patients treated for brain cancer, in which Maringwa and colleagues suggested no clear indications that the MCID differed between improvement and deterioration . Kvam et al. reported a MCID of 8 and 12 units in QLQ-C30 for improved and deteriorated HRQOL among patients with multiple myeloma . Both of the two studies focused on specific patient population. Using a unique approach of assembling expert opinions, Cocks et al. reported smaller estimates for improvement than for declines in a meta-analysis of 118 published longitudinal studies . It is not yet established whether the different magnitudes of MCID should be used in QLQ-C30 as clinically meaningful benchmark for improvement and deterioration.
One well-accepted definition for MCID is “the smallest difference in score in the domain of interest which patients perceived as beneficial and which would mandate, in the absence of troublesome side effects and excessive cost, a change in the patient’s management” , p. 408. Two approaches are commonly used to assess MCID. The distribution-based approach utilizes the statistical features, such as fractions of the standard deviation (SD). The anchor-based approach is preferred because it uses patient-derived ratings rather than statistical significance . In the current analysis, we used an anchored-based approach based on the methodology introduced by Osoba et al. in which patients were asked to rate their perceived change in HRQOL over time using the Subject Significance Questionnaire (SSQ) .
The objectives of this analysis were (a) to report and interpret HRQOL change measured by QLQ-C30, and (b) to determine the MCID for the QLQ-C30 change scores over time before and during cancer therapy among American patients with various types of cancer.
A total of 765 adult, ambulatory patients with any type of cancer, who started a new medical, radiation or stem-cell transplantation treatment at one of two comprehensive cancer centers (Seattle Cancer Care Alliance or the University Of Washington Medical Center) were enrolled into the Electronic Self-Report Assessment for Cancer (ESRA-C) intervention trial (NCT00852852). The study was approved by the Institutional Review Board of the Fred Hutchinson Cancer Research Center/University of Washington Cancer Consortium. The primary outcome was reported elsewhere .
Using touch-screen, notebook computers, patients completed e-versions of the QLQ-C30 pre-treatment (T1) and during treatment (T2). Most of the SCT patients answered the T2 assessment at the first, post-hospital discharge clinic visit. At T2, patients reported perceived changes in quality of life by completing a seven-point response category SSQ. Eighty-six percent (n = 660) completed the T2 assessment. Additional details of the full sample and study procedures have been reported previously .
Patients reported socidemographic characteristics at enrollment. Information on cancer type and incident or recurrent diagnosis was abstracted from medical records. The QLQ-C30  is a cancer-specific quality of life instrument with five functional subscale scales- physical (PF), role (RF), emotional (EF), social (SF) and cognitive (CF) functioning, plus global QOL. The QLQ-C30 summary scores for each domain were transformed to range from 0 to 100 according to published methods for version 3 . Higher functional and global QOL scores correspond to a higher level of functioning. For the current study, alpha coefficients for the subscales ranged from 0.66 (CF) to 0.87 (global QOL) at T1 and 0.70 (CF) to 0.89 (global QOL) at T2.
The five SSQ items correspond with the QLQ-C30 domains of PF, EF, SF, CF and global QOL. The SSQ queries patients about their perceived level of change in each of the domains using a seven-point scale ranging from (1) very much worse, (2) moderately worse, (3) a little worse, (4) about the same, (5) a little better, (6) moderately better, to (7) very much better. The SSQ instrument has been used as a calibration instrument to assess the magnitude of changes in HRQOL that were perceived and considered meaningful to patients as measured by validated instruments such as the QLQ-C30 [5, 15, 18]. We analyzed the PF, EF, SF CF, and global QOL domains in comparison to the corresponding SSQ items.
Demographic and clinical characteristics of 627 medical/radiation (MED/RAD) oncology and transplant (SCT) patients
SCT( n = 191)
MED/RAD (n = 436)
Race, minority or multiple
Some college or college graduate
Low annual household income (<=$35,000)
Study Group (Intervention)*
Incident cancer diagnosis
Head and Neck
Days between T1 and T2, days
Mean change (95% confidence interval) and scale interpretation for QLQ-C30 scores after treatment start
1.86 (−0.40, 4.13)
−11.76 (−16.26, -7.26)
−9.51 (−12.62, -6.40)
−19.19 (−22.26, -16.12)
−4.10 (−5.54, -2.67)
3.15 (1.56, 4.74)
−2.91 (−5.27, -0.55)
−3.40 (−5.11, -1.69)
The SSQ rating categories were scored from −3 (very much worse) to 3 (very much better) with 0 indicating “about the same.” As suggested by Osoba et al , a linear trend between QLQ-C30 change score and the SSQ rating was indication that the magnitude of QLQ-C30 score reflected the degree of change experienced by groups of patients. In this study we defined the MCID as the mean difference in QLQ-C30 score changes that reflected one category change measured by SSQ rating using linear regression. A two-piece linear model was used allowing for different slopes of improvement and deterioration in HRQOL, but was constrained by using the same intercept. Therefore, by definition, the slopes represent MCIDs and the intercept was the mean QLQ-C30 score change among patients perceiving “about the same” in the SSQ.
Table 1 displays demographic and clinical characteristics for the SCT and MED/RAD groups. As illustrated in Table 1, most study participants in both patients groups were white, married/partnered and had some college education.
QLQ-C30 scores and SSQ ratings
The mean QLQ-C30 scores were significantly lower at T2 than T1 for PF, SF, CF and the global QOL domains for both MED/RAD and SCT patients, while higher at T2 for EF among both patient groups. Table 2 lists the mean change (95% CI) in QLQ-C30 scores for each domain and global QOL. Based on the guidelines on longitudinal QOL change recommended by Cocks et al. , the decrease is considered medium in PF (−15.8), SF (−11.76), and CF (−9.51), large in global QOL (−19.19) among SCT patients; and is considered trivial in PF (−4.10), SF(−2.91), CF (−1.46) and global QOL (−3.40) among MED/RAD patients. On the other hand, the mean EF score increases observed in this study were considered trivial for SCT patients (1.86) and MED/RAD patients (3.15).
From the SSQ ratings of most subscales (Figure 1), more patients reported “about the same” than other response. More SCT patients perceived deteriorated HRQOL than improvement while on treatment; for example, 52% verse 16% on global QOL. MED/RAD patients perceived rates of improvement similar to those of deterioration; for example, 25% versus 26% on global QOL.
Association of QLQ-C30 score changes and SSQ ratings
Overall, the correlations between the QLQ-C30 score change and the SSQ rating categories ranged from 0.28 (SF) to 0.40 (global QOL) among MED/RAD patients, and from 0.25 (SF) to 0.40 (CF) among SCT patients. For patients who responded “about the same” on the SSQ, the mean change in QLQ-C30 for the global QOL domain deteriorated 14.2 and 2.0 units for SCT and MED/RAD patients, respectively (Figure 2). The direction in the mean QLQ-C30 change scores were aligned with the perceived change reported on the SSQ among MED/RAD patients; the mean QLQ-C30 score changes increased, from negative to positive, as corresponding SSQ ratings indicating better perceived change. This pattern was only observed among SCT patients reporting deteriorated HRQOL. Among SCT patients with improvement on the SSQ, the mean QLQ-C30 change scores were negative in most instances, indicating a deteriorating QLQ-C30 score at T2.
Effect sizes and standard deviations for QLQ-C30 change scores with the corresponding SSQ categories
SSQ rating categories
Very much worse
A little worse
About the same
A little better
Very much better
The relationship between the EORTC QLQ-C30 change scores and the SSQ rating categories during cancer treatment
In a large sample of patients with various cancer types treated at two comprehensive cancer centers, our results reveal several important observations. First, the SSQ was a feasible metric with which to conduct an anchor-based analysis of associations between perceived change and self-reported HRQOL change. Second, modest correlations were found between QLQ-C30 and SSQ, with most domain scores reflected worse QOL during active therapy as compared to pre-treatment. Third, and perhaps most notable, was the large discrepancy of the scoring of diminished physical function and global QOL on the QLQ-C30 among SCT patients who concurrently perceived no change or improvement in the corresponding SSQ items. However, about 50% patients reported “about the same” on the SSQ for most domains, indicating a perceived stability of HRQOL throughout treatment. Finally, we found differential MCID estimates among different domains as well as for improved HRQOL versus deteriorated HRQOL.
Our findings suggest cancer treatment has a negative impact on HRQOL among patients with cancer, and that impact is greater among transplant patients. Based on recent guidelines , the deterioration is regarded as medium to large among transplant patients for most domains. These findings support the universal understanding that cancer therapy results in multiple side effects and interferes with nearly all aspects of life. We observed that PF, SF and CF as well as global QOL deteriorated, while EF improved over time. This pattern has been documented in other longitudinal studies using the QLQ-C30 ; domain scores related to physical function diminished from pre-treatment to on- or immediately after treatment and emotional function improved . The initial anxiety of the diagnosis and treatment initiation period may have been ameliorated by subsequent familiarity and supportive psychosocial care provided by the clinical service teams. The greater magnitude of HRQOL deterioration among SCT patients at T2 (immediately after hospitalization) is supported by Grulke et al.’s findings that HRQOL is lowest while in the hospital, but returns to pre-transplant level one year after transplant .
In line with Cohen’s operational definition , both Osoba et al  and Cocks et al  have recommended thresholds of trivial (<0.2), small (0.2-0.5) and large (>0.5) effect sizes. However, we observed a larger magnitude of effect sizes when “worse” was perceived on the SSQ ratings. For example, most effect sizes were larger than 0.5 even when “a little worse” was reported. This is not surprising, as King previously reported that change in HRQOL observed before and during cancer treatment is often larger than those observed between two treatment arms . We also observed large standard deviations for the majority of instances, indicating diversity in patients’ health conditions and perceived changes during treatment. On the other hand, the effect sizes did not vary substantially between the rating of “a little” and “a lot” among the instances. Given these phenomena, the interpretation of difference in a given study requires more consideration and research.
The MCID from our study ranged 5.7-11.4 (SCT) and 7.2-11.8 (MED/RAD) among patients reporting deteriorated HRQOL; and 2.7-3.4 among MED/RAD patients reporting improvement, which are in similar magnitude as previously reported among European patients, with 6–12 points for breast cancer patients , and 5–14 points for brain cancer patients . Compared with the recent guidelines by Cocks et al  the range of MCID is in line with the thresholds for “small” changes which were referred as “subtle but nevertheless clinical relevant changes”. Thus, the findings are in agreement from the two studies. Consistent with previous findings [5, 6, 8, 11, 13], we observed the MCID of QLQ-C30 varied across domains and among different patient populations. King and colleagues  also reported different magnitudes in MCID among different patient groups, supporting differences in MCID between MED/RAD and SCT patients in our study.
Our results suggest a larger MCID was related to deterioration versus improvement among both MED/RAD and SCT patients. This phenomenon was previously observed in other QOL instrument (FACT) , as well as in the QLQ-C30 . In a recent meta-analysis on 118 longitudinal studies, Cocks et al. observed smaller estimates for improvement than for deterioration . Considering these available findings, it appears that patients may be more sensitive to favorable differences, thus, a smaller MCID should be used to interpret QOL improvement.
We also observed decreases in QLQ-C30 scores among patients reporting “about the same” in the SSQ for the PF and global QOL domains. This finding suggests a potential response shift in scoring of HRQOL. Response shift is known as the change in internal standards, values, and the conceptualization of HRQOL after the start of cancer treatment . Patients may report a better health condition even though their actual physical condition has deteriorated when they perceive a greater survival benefit from cancer treatment [21, 22]. Further exploration and conceptual work are necessary to better understand the effect of response shift on patient-reported HRQOL scores.
The generalizability of our findings to other samples may be limited; our sample was relatively homogenous in terms of race and education and was limited to patients treated at a comprehensive cancer center, and the time interval under study was specific to before and during cancer treatment. Only one anchor (SSQ) was included in the study and its stability has some discussion , thus the robustness of the identified MCID was checked by comparing with previous reports in the literature.
We conducted a systematic and comprehensive evaluation of change in HRQOL before and during treatment in a large sample of American patients with cancer. Our findings may provide relevant information for managing cancer patients’ HRQOL during active therapy. Our study suggests different MCID thresholds should be applied to interpret QLQ-C30 change from pre-treatment to during/post treatment among domains and between improved and deteriorated HRQOL. Specifically, clinical attention can be focused on patients who report at least a 6 point decrease, and for patients who report at least a 3 point increase on QLQ C-30 domains.
Written informed consent was obtained from the patient for the publication of this report and any accompanying images.
Health related quality of life
Minimal clinical important difference
Quality of Life Questionnaire-Core 30
Stem cell transplant
Subject significance questionnaire
Quality of life.
The study was supported by the National Institute of Nursing Research grant NR008726. The authors acknowledge Barbara Halpenny for constructive discussions, the time and effort of all study participants, the dedication of the research staff, the generous support from the clinicians and administrators at the study sites for the original ESRA-C study.
- Osthus AA, Aarstad AK, Olofsson J, et al: Health-related quality of life scores in long-term head and neck cancer survivors predict subsequent survival: a prospective cohort study. Clin Otolaryngol. 2011, 36: 361-8. 10.1111/j.1749-4486.2011.02342.x.View ArticlePubMedGoogle Scholar
- Svensson H, Hatschek T, Johansson H, et al: Health-related quality of life as prognostic factor for response, progression-free survival, and survival in women with metastatic breast cancer. 2011, Med OncolGoogle Scholar
- Wan Leung S, Lee TF, Chien CY, et al: Health-related quality of life in 640 head and neck cancer survivors after radiotherapy using EORTC QLQ-C30 and QLQ-H&N35 questionnaires. BMC Cancer. 2011, 11: 128-10.1186/1471-2407-11-128.View ArticlePubMedPubMed CentralGoogle Scholar
- Aaronson NK, Ahmedzai S, Bergman B, et al: The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst. 1993, 85: 365-76. 10.1093/jnci/85.5.365.View ArticlePubMedGoogle Scholar
- Osoba D, Rodrigues G, Myles J, et al: Interpreting the significance of changes in health-related quality-of-life scores. J Clin Oncol. 1998, 16: 139-44.PubMedGoogle Scholar
- King MT: The interpretation of scores from the EORTC quality of life questionnaire QLQ-C30. Qual Life Res. 1996, 5: 555-67. 10.1007/BF00439229.View ArticlePubMedGoogle Scholar
- Grulke N, Albani C, Bailer H: Quality of life in patients before and after haematopoietic stem cell transplantation measured with the European Organization for Research and Treatment of Cancer (EORTC) Quality of Life Core Questionnaire QLQ-C30. Bone Marrow Transplant. 2012, 47: 473-82. 10.1038/bmt.2011.107.View ArticlePubMedGoogle Scholar
- Cocks K, King MT, Velikova G, et al: Evidence-based guidelines for determination of sample size and interpretation of the European Organisation for the Research and Treatment of Cancer Quality of Life Questionnaire Core 30. J Clin Oncol. 2011, 29: 89-96. 10.1200/JCO.2010.28.0107.View ArticlePubMedGoogle Scholar
- Ringash J, O’Sullivan B, Bezjak A, et al: Interpreting clinically significant changes in patient-reported outcomes. Cancer. 2007, 110: 196-202. 10.1002/cncr.22799.View ArticlePubMedGoogle Scholar
- Cella D, Hahn EA, Dineen K: Meaningful change in cancer-specific quality of life scores: differences between improvement and worsening. Qual Life Res. 2002, 11: 207-21. 10.1023/A:1015276414526.View ArticlePubMedGoogle Scholar
- Maringwa J, Quinten C, King M, et al: Minimal clinically meaningful differences for the EORTC QLQ-C30 and EORTC QLQ-BN20 scales in brain cancer patients. Ann Oncol. 2011, 22: 2107-12. 10.1093/annonc/mdq726.View ArticlePubMedGoogle Scholar
- Kvam AK, Fayers PM, Wisloff F: Responsiveness and minimal important score differences in quality-of-life questionnaires: a comparison of the EORTC QLQ-C30 cancer-specific questionnaire to the generic utility questionnaires EQ-5D and 15D in patients with multiple myeloma. Eur J Haematol. 2011, 87: 330-7. 10.1111/j.1600-0609.2011.01665.x.View ArticlePubMedGoogle Scholar
- Cocks K, King MT, Velikova G, et al: Evidence-based guidelines for interpreting change scores for the European Organisation for the Research and Treatment of Cancer Quality of Life Questionnaire Core 30. Eur J Cancer. 2012, 48 (11): 1713-1721. 10.1016/j.ejca.2012.02.059.View ArticlePubMedGoogle Scholar
- Jaeschke R, Singer J, Guyatt GH: Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin Trials. 1989, 10: 407-15. 10.1016/0197-2456(89)90005-6.View ArticlePubMedGoogle Scholar
- Osoba D: Interpreting the meaningfulness of changes in health-related quality of life scores: lessons from studies in adults. Int J Cancer Suppl. 1999, 12: 132-7.View ArticlePubMedGoogle Scholar
- Berry DL, Blumenstein BA, Halpenny B, et al: Enhancing patient-provider communication with the electronic self-report assessment for cancer: a randomized trial. J Clin Oncol. 2011, 29: 1029-35. 10.1200/JCO.2010.30.3909.View ArticlePubMedPubMed CentralGoogle Scholar
- Fayers P, Aaronson N, Bjordal K, et al: EORTC QLQ-C30 Scoring Manual (ed 3rd). 2001, EORTC: BrusselsGoogle Scholar
- Rodrigues G, Bezjak A, Osoba D, et al: The relationship of changes in EORTC QLQ-C30 scores to ratings on the Subjective Significance Questionnaire in men with localized prostate cancer. Qual Life Res. 2004, 13: 1235-46.View ArticlePubMedGoogle Scholar
- Cohen J: Statistical power analysis for the behavioral sciences. 1988, Hillsdale: ErlbaumGoogle Scholar
- Frodin U, Borjeson S, Lyth J, et al: A prospective evaluation of patients’ health-related quality of life during auto-SCT: a 3-year follow-up. Bone Marrow Transplant. 2011, 46: 1345-52. 10.1038/bmt.2010.304.View ArticlePubMedGoogle Scholar
- Schwartz CE, Sprangers MA: Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research. Soc Sci Med. 1999, 48: 1531-48. 10.1016/S0277-9536(99)00047-7.View ArticlePubMedGoogle Scholar
- Tierney DK, Facione N, Padilla G, et al: Response shift: a theoretical exploration of quality of life following hematopoietic cell transplantation. Cancer Nurs. 2007, 30: 125-38. 10.1097/01.NCC.0000265002.79687.af.View ArticlePubMedGoogle Scholar
- Kamper SJ, Maher CG, Mackay G: Global rating of change scales: a review of strengths and weaknesses and considerations for design. The Journal of manual & manipulative therapy. 2009, 17 (3): 163-170.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2407/13/165/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.