Skip to main content
  • Research article
  • Open access
  • Published:

Disease severity-based evaluation of utility weights for lung cancer-related health states in Korea

Abstract

Background

Utility weight, a measure of health-related quality of life, is used in disease burden measurements and economic evaluations. In this study, we used the visual analogue scale (VAS) and standard gamble (SG) method to determine the utility weights of lung cancer health states in South Korea from a societal perspective.

Methods

Six hypothetical health states for lung cancer or a related health state reflective of disease severity were developed: 1) Stage I, 2) Stage II, 3) Stage IIIa, 4) Stage IIIB, 5) Stage IV, and 6) Pulmonary nodule. The description of each health state description was divided into four parts: diagnosis, symptoms, treatment, and progression and prognosis. A total of 515 representative adult Korean participants used a VAS and SG to evaluate these six health states via face-to-face computer-assisted interviews. The means, standard deviations, and median utility weights of the six health states were estimated by valuation method.

Results

The two valuation methods of the scenarios yielded the same mean utility rankings. Pulmonary nodule received the highest rank (VAS, 0.66 and SG, 0.83), whereas Stage 4 was assigned the lowest rank (VAS, 0.09 and SG, 0.31). For all health states, the mean utility weights calculated using the SG were greater than those calculated using the VAS. The differences between the utility weights obtained using the two valuation methods ranged from 0.14 (Stage I) to 0.22 (Stage IV). The two approaches tended to yield larger differences for more severe stages.

Conclusions

This study determined utilities for squamous cell lung cancer that will be useful for estimating the burden of lung cancer and for conducting economic evaluations of lung cancer interventions.

Peer Review reports

Background

In South Korea, 8.44% of the total disability-adjusted life years have been attributed to cancer. Currently, lung cancer is the most frequent malignancy, accounting for 14.05% of all cancer cases [1]. Although lung cancers are associated with symptoms such as cough, dyspnea, weight loss, and chest tightness, patients with very early-stage disease may be asymptomatic. In short, disease progression correlates inversely with the quality of life [2]. Furthermore, lung cancer has a higher mortality rate, compared to other diseases; accordingly, the years of life lost (YLL) is higher than the years lost to disability (YLD), and the YLL:YLD ratio is asymmetric [3].

Utility weight, an indicator of the health-related quality of life, is used in measurements of disease burdens and economic evaluations, and the results provide important evidence to support the decision-making processes of policy makers [4, 5]. However, the quantification of utility weight is a somewhat vague and non-objective process because of the target population [6]. Ideally, decision makers should have access to utility data specific to local populations [7]. A preference-based assessment, which can be categorized into direct and indirect methods, can be used to achieve this ideal [8].

Several methods can be used to elicit a health state preference. In the present study, we used the visual analogue scale (VAS) and standard gamble (SG) techniques. SG methods require concentration and in-depth cognitive functions from the respondents and professional interviewers [9, 10]. These methods use self-administered, multi-attribute health status classification system questionnaires and have been widely used [8]. The alternative method, VAS, is simple. However, the VAS anchors are often poorly defined, and may lead to several measurement biases, such as context and end-aversion bias. However, the VAS is a value but utility and thus might be used to compare preferences and explore methodological validity. Evidence suggests that limited and cautious use of the VAS is useful and appropriate [11].

This study, therefore, aimed to determine the utility weights of squamous cell lung cancer health states in South Korea from a societal perspective. These utility weights were determined to provide local population data to policy makers in South Korea, as well as internationally.

Methods

Health states

Two authors (Ock M and Jo MW) developed a draft of the lung cancer health state scenarios based on literature reviews and the education materials provided to patients at Asan Medical Center. One medical oncologist (Kim KP) and one radiation oncologist (Jung NH) reviewed and modified the draft. A total of six hypothetical health states reflecting disease severity were developed: 1) Stage I lung cancer (state 1), 2) Stage II lung cancer (state 2), 3) Stage IIIa lung cancer (state 3), 4) Stage IIIb lung cancer (state 4), 5) Stage IV lung cancer (state 5), and 6) Pulmonary nodule (state 6). The histological type of lung cancer was assumed to be squamous cell carcinoma. Each health state was divided into four parts with reference to previous studies [12,13,14]: diagnosis, symptoms, treatment, and progression and prognosis. Specifically, each health state included standard diagnostic procedures, typical symptoms and signs, standard treatment procedures (including surgery and radiotherapy), common side effects of treatment, and information about the 5-year survival rate. The full descriptions of the six health states are available in Additional File 1.

Study participants

The target population comprised adults aged ≥19 years who lived in Korea (except Jeju Island). This target population was defined in the June 2013 national resident registration data, documented by the Ministry of Administration and Security of South Korea. We recruited 515 representative individuals from this target population using a multi-stage stratified quota sampling based on region, sex, and age group.

Survey procedure

Participants were surveyed through face-to-face computer-assisted interviews. Before conducting the survey, the interviewers were educated about the purpose of the study and the descriptions of the six health states. They were also trained in two valuation methods: VAS and SG. The total education time was approximately 2.5 h. The sample script of the interview was available in Additional File 2.

Every participant was informed about the survey procedure and the purpose of the study, and those who provided informed consent were included in this survey. First, participants were requested to provide their age, sex, region, and educational level. Next, participants applied the VAS six times to the six health states, which were displayed in a random order. The participants also applied the VAS once more for the state of death. Next, the participants used the SG method to evaluate the six health states in random order. After performing the two valuations, the participants were asked about other socio-demographic factors and clinical information, including their monthly income, ambulatory care visits during the past 2 weeks, hospitalization during the past 12 months, and morbidity. The health state descriptions were printed on cards to facilitate participants with limited vision. The Institutional Review Board (IRB) of Asan Medical Center determined that this study was exempt from IRB review (approval number: S2016–0015).

Valuation methods

Two valuation methods were used in this study: VAS and SG. For the VAS, the participants rated the proposed health states on a scale from 0 to 100, which corresponded to the worst and best imaginable health states, respectively. For the SG, the participants were asked to select the better of two choices: either a health state or death. If the participant chose the proposed health state as the better option, he/she was asked to determine the point of indifference between two hypothetical options: remaining in the proposed health state for the remaining life time, or receiving treatment that might lead to either a full recovery of health (probability ‘p’) or immediate death (probability ‘1-p’). The probability ‘p’ increased or decreased by 5% according to the previous participants’ choice. The participants continued to select options until their preferences for the options became equal. The initial probability ‘p’ was 50%. If the participant selected death as a preferred state, the next SG question was presented. VAS and SG were different from EQ-5D, HUI and SF-6D. The later ones were indirect evaluation methods so it could be interpreted multiply. Especially, in the field of clinical setting, the direct evaluation methods were more preferred [15].

Data analysis

We performed descriptive analyses of socio-demographic factors and clinical information. Utility weights were determined using each valuation method. For the VAS, utility weights were calculated using the following formula: (VAS value of the health state – VAS value of death) / (100 – VAS value of death). For the SG, if the health state was selected as better than death, the final value of ‘p’ was recorded as the utility weight of the suggested health state. If the health state was selected as a worse than death, the utility was censored at 0.

The mean, standard deviation, and median utility weights of six health states were estimated by valuation method. We used Student’s t-test and an analysis of variance to compare the mean values of utilities according to the socio-demographic factors and clinical information. Furthermore, we used a linear mixed model to identify factors that influenced the utility weights. The utility weights obtained using the VAS and SG methods were regarded as dependent variables, and the socio-demographic factors, clinical information, and health states were treated as independent variables. All statistical analyses were performed using SPSS software (v21.0; SPSS, Inc., Chicago, IL, USA) and SAS software (v9.2; SAS Institute, Inc., Cary, NC, USA). P-values < 0.05 were considered statistically significant.

Results

A total of 515 participants completed full interviews. The mean age of the participants was 45.7 (SD: 13.9) years, and 48.9% were male. Among the participants, 13.2% have received ambulatory cares during the past 2 weeks, and 3.1% had been hospitalized within the previous 12 months. The clinical and demographic characteristics of the participants are shown in Table 1.

Table 1 Characteristics of the participants (N = 515)

The utility weights for the lung cancer scenarios are shown in Table 2. The ranks of the scenarios by mean utility were the same, regardless of the valuation method. Pulmonary nodule was assigned the highest rank, with a VAS value of 0.66 and SG value of 0.83, whereas Stage IV was assigned the lowest rank, with a VAS value of 0.09 and SG value of 0.31. For all health states, the mean utility calculated using the SG method was greater than that calculated using the VAS. The differences in utility weights between the two valuation methods ranged from 0.14 (Stage I) to 0.22 (Stage IV). Severe stages tended to be associated with greater differences between the two approaches.

Table 2 Utility weights of lung cancer states derived using the visual analogue scale and standard gamble

Tables 3 and 4 presents a comparison of the utility weights according to socio-demographic and clinical information. The mean utility weights derived from the SG method did not differ significantly according to sex, age, educational level, occupation, and ambulatory care visits during the past 2 weeks. However, participants with higher monthly incomes tended to score higher than those with lower incomes. In addition, significantly higher rates for Pulmonary nodule were observed among participants with no hospitalizations during the previous 12 months and those without comorbidities.

Table 3 Utility weights from VAS according to socio-demographic factors (N = 515)
Table 4 Utility weights from SG according to socio-demographic factors (N = 515)

Table 5 presents the associations of various factors with the utility weights obtained using the VAS and SG methods. In this table, we have listed the results from a multivariable linear regression analysis. The health states were the main relevant factors related to the utility weights. After adjusting for clinical and demographic characteristics, the utility weight for a more advanced stage lung cancer relative to a pulmonary nodule was 0.568 and 0.519 lower when the VAS and SG methods were used, respectively. Furthermore, disease stage correlated inversely with utility weight. In addition, participants with manual occupations had a significantly higher utility weight when compared to those with a non-manual occupation only when the VAS was used.

Table 5 Linear mixed model of factors influencing utility weight

Discussion

In this study, utility weights for six health states of lung cancer were determined using the VAS and SG methods by 515 participants from the general South Korean population. One strength of our study is the subject, namely the calculation of utility weight for lung cancer in an East Asian country. Few previous studies have evaluated the utility of lung cancer in general populations. However, some studies have recommended the use of utility weights from a general population [14, 16].

Nevertheless the strength, Froberg et al. found that differences in the measurement of social preference for health state vary among people involved in the measurement. The reason for this difference arises from the differences in knowledge or experience people have about the health state or disease. Therefore, in order to measure social value or preference properly, pre-training of health state or disease is required before. This can solve the problem that may arise from preconceived notions about the health state or disease that the public had in advance [17,18,19]. In this study, we developed the health descriptions for six health states of lung cancer, and explained them to the participants in the survey to improve understanding of health states.

Our study group used both VAS scale- and SG-based approaches to determine the utility weights for lung cancer-related health states. The SG approach measures respondents’ preferences under conditions of uncertainty and is based directly on the von Neumann–Morgenstern utility theory, which is considered the standard for modeling rational behavior in the context of uncertainty [20]. Although the VAS does not allow a trade-off between different health states, and is commonly considered to lack a theoretical basis when compared with choice-based methods such as SG and time trade-off (TTO) [21], it is easy to understand and use. Accordingly, the VAS is widely used in evaluation studies. Furthermore, no single method of evaluation is most appropriate under all circumstances [22]. However, the VAS tends to yield bias-prone utility weights and should not be used by itself [11]. Some studies have confirmed the context bias of this method [11] and identified the range frequency model developed by Parducci and Wedell as potentially useful for bias adjustment [23]. However, it is difficult to generalize this model [23]; therefore, to ensure the best outcome, the VAS should be used only as an introductory method during which respondents can become accustomed to the health states. The ordinal preferences can facilitate the subsequent SG analysis [11, 24].

We evaluated lung cancer-related health state preferences in a relatively large sample, using various scenarios and direct valuation methods. The lung cancer utility weights ranged from 0.09 (stage IV lung cancer) to 0.83 (pulmonary nodule); notably, more severe states received consistently lower values. A previous study [25] reported a utility weight of 0.626 for stable disease without additional symptoms and decreases of 0.069 with the addition of pain, 0.050 with dyspnea, and 0.046 with cough; the utility values ranged from 0.653 for stable disease with no toxicity to 0.473 for progressive disease [26].

Our utility weights are similar to those reported in a previous study [13]. A meta-regression analysis determined reference lung cancer utilities of 0.573, 0.772, and 0.823 for metastatic, mixed/not specified, and non-metastatic non-small cell lung cancer (NSCLC), respectively, using patients as respondents and the SG method with scale boundaries of death and perfect health [27]. Using the TTO, Swinburn et al. [28] elicited health state utility weights for the treatment outcomes of relapsed/refractory Hodgkin lymphoma and systemic anaplastic large-cell lymphoma in Thailand, Taiwan, and South Korea. The values assigned for stable disease were 0.30 (Thailand), 0.49 (Taiwan)m and 0.64 (South Korea), which were comparable to the stable disease values for Korea (0.71) and Taiwan (0.54) according to a study by Nafee et al. [7]. The utility weight for progressive disease approached that of “death” in Thailand (0.07), and was low in both Taiwan (0.23) and South Korea (0.32) [13]. The current values for progressive disease are in line with the range observed in our study.

Our study proved the association between utility values obtained with the VAS and SG. Health states were the most relevant factors regarding utility weight. After we adjusted for clinical and demographic characteristics, the utility weight for higher-stage lung cancer relative to pulmonary nodule was 0.568 lower with the VAS and 0.519 lower with the SG. In addition, respondents with manual occupations yielded significantly higher utility weights than did those with non-manual occupation only when using the VAS. In other words, the risk attitudes may differ among respondents in terms of lung cancer severity, compared to other conditions, and other patient characteristics might supersede the experience of a health state. Furthermore, other cancer patients also ranked social functioning as more important than physical functioning. The current study adapted the existing health state descriptions of metastatic breast cancer from a previous study [29] to describe patients receiving second-line treatment for NSCLC. The utility values were obtained by asking participants to value health state descriptions describing metastatic breast cancer, five grade III/IV toxicities (febrile neutropenia, stomatitis; diarrhea and vomiting; fatigue; hand-foot syndrome), and hair loss [29]. The utility scores reflect the values assigned by ordinary people to various health states representative of lung cancer scenarios.

This study had several limitations. We intentionally reduced the number of scenarios to minimize the cognitive burden placed on respondents. Accordingly, it may have been difficult for respondents to make fully informed decisions. Furthermore, we did not collect response integrity data and were therefore unable to analyze characteristics regarding non-respondents.

Conclusions

Our findings indicate that range of descriptions of lung cancer states can be feasibly evaluated in the South Korean population using either the VAS or SG method. Furthermore, the utility weights generated from this study could be used in economic evaluations of lung cancer interventions for both patients and the general population.

Abbreviations

NSCLC:

non-small cell lung cancer

SG:

Standard gamble

VAS:

Visual analog scale

YLD:

Years lost to disability

YLL:

Years of life lost

References

  1. Yoon J, Oh IH, Seo H, Kim EJ, Gong YH, Ock M, et al. Disability-adjusted life years for 313 diseases and injuries: the 2012 Korean burden of disease study. J Korean Med Sci. 2016;31(2):S146–57.

    Article  Google Scholar 

  2. Eton DT, Fairclough DL, Cella D, Yount SE, Bonomi P, Johnson DH, et al. Early change in patient-reported health during lung cancer chemotherapy predicts clinical outcomes beyond those predicted by baseline report: results from eastern cooperative oncology group study 5592. J Clin Oncol. 2003;21(8):1536–43.

    Article  Google Scholar 

  3. Kim EJ, Yoon SJ, Jo MW, Kim HJ. Measuring the burden of chronic diseases in Korea in 2007. Public Health. 2013;127(9):806–13.

    Article  Google Scholar 

  4. Ock M, Han JW, Lee JY, Kim SH, Jo MW. Estimating quality-adjusted life-year loss due to noncommunicable diseases in Korean adults through to the year 2040. Value Health. 2015;18(1):61–6.

    Article  Google Scholar 

  5. Han KT, Kim SJ, Lee SY, Park EC. Cost-effectiveness analysis of HPV vaccination: comparing the general population with socially vulnerable individuals. Asian Pac J Cancer Prev. 2014;15(19):8503–8.

    Article  Google Scholar 

  6. Knies S, Evers SM, Candel MJ, Severens JL, Ament AJ. Utilities of the EQ-5D: transferable or not? Pharmacoeconomics. 2009;27(9):767 7.

    Article  Google Scholar 

  7. Nafees B, Lloyd AJ, Dewilde S, Rajan N, Lorenzo M. Health state utilities in non–small cell lung cancer: an international study. Asia Pac J Clin Oncol. 2017;13(5):e195–203.

    Article  Google Scholar 

  8. Rashidi AA, Anis AH, Marra CA. Do visual analogue scale (VAS) derived standard gamble (SG) utilities agree with health utilities index utilities? A comparison of patient and community preferences for health status in rheumatoid arthritis patients. Health Qual Life Outcomes. 2006;4:25.

    Article  Google Scholar 

  9. Drummond MF, O'Brien B, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. 2nd ed. Oxford: Oxford Medical Publications; 1997.

    Google Scholar 

  10. Furlong W, Feeny D, Torrance GW, Barr R, Horsman J. Guide to design and development of health-state utility instrumentation, Working Paper No. 90-9. McMaster University, Centre for Health Economics and Policy Analysis; 1990.

  11. Torrance GW, Feeny D, Furlong W. Visual analog scales: do they have a role in the measurement of preferences for health states? Med Decis Mak. 2001;21(4):329–34.

    Article  CAS  Google Scholar 

  12. Ock M, Park JY, Son WS, Lee HJ, Kim SH, Jo MW. Estimation of utility weights for human papilloma virus-related health states according to disease severity. Health Qual Life Outcomes. 2016;14(1):163.

    Article  Google Scholar 

  13. Kim SH, Jo MW, Ock M, Lee HJ, Lee JW. Estimation of health state utilities in breast cancer. Patient Prefer Adherence. 2017;11:531–6.

    Article  Google Scholar 

  14. Lee JY, Ock M, Jo MW, Son WS, Lee HJ, Kim SH, et al. Estimating utility weights and quality-adjusted life year loss for colorectal cancer-related health states in Korea. Sci Rep. 2017;7(1):5571.

    Article  Google Scholar 

  15. Blinman P, King M, Norman R, Viney R, Stockler MR. Preferences for cancer treatments: an overview of methods and applications in oncology. Ann Oncol. 2012;23(5):1104–10.

    Article  CAS  Google Scholar 

  16. Hadorn DC. The role of public values in setting health care priorities. Soc Sci Med. 1991;32(7):773–81.

    Article  CAS  Google Scholar 

  17. Froberg DG, Kane RL. Methodology for measuring health-state preferences III : population and context effects. J Clin Epidemiol. 1989;42(6):585–92 25.

    Article  CAS  Google Scholar 

  18. Froberg DG, Kane RL. Methodology for measuring health-state preferences V : Progress and research agenda. J Clin Epidemiol. 1989;42(7):675–85 26.

    Article  CAS  Google Scholar 

  19. Ubel PA, Richardson J, Menzel P. Societal value, the person trade-off, and the dilemma of whose values to measure for cost-effectiveness analysis. Health Econ. 2000;9:127–36.

    Article  CAS  Google Scholar 

  20. Nafees B, Stafford M, Gavriel S, Bhalla S, Watkins J. Health state utilities for non small cell lung cancer. Health Qual Life Outcomes. 2008;6:84.

    Article  Google Scholar 

  21. Gafni A. The standard gamble method: what is being measured and how it is interpreted. Health Serv Res. 1994;29(2):207–24.

    CAS  PubMed  PubMed Central  Google Scholar 

  22. Dolan P, Sutton M. Mapping visual analogue scale health state valuations onto standard gamble and time trade-off values. Soc Sci Med. 1997;44(10):1519–30.

    Article  CAS  Google Scholar 

  23. Salomon JA, Murray CJ. A multi-method approach to measuring health-state valuations. Health Econ. 2004;13(3):281–90.

    Article  Google Scholar 

  24. Parducci A, Wedell DH. The category effect with rating scales: number of categories, number of stimuli, and method of presentation. J Exp Psychol Hum Percept Perform. 1986;12(4):496–516.

    Article  CAS  Google Scholar 

  25. Dolan P, Olsen JA, Menzel P, Richardson J. An inquiry into the different perspectives that can be used when eliciting preferences in health. Health Econ. 2003;12(7):545–51.

    Article  Google Scholar 

  26. Doyle S, Lloyd A, Walker M. Health state utility scores in advanced non-small cell lung cancer. Lung Cancer. 2008;62(3):374–80.

    Article  Google Scholar 

  27. Sturza J. A review and meta-analysis of utility values for lung cancer. Med Decis Mak. 2010;30(6):685–93.

    Article  Google Scholar 

  28. Swinburn P, Shingler S, Liu Y, Huang H, Acaster S. Health state utilities for relapsed/refractory Hodgkin lymphoma (HL) and systemic anaplastic large-cell lymphoma (sALCL). Amsterdam: Poster presentation at: 17th congress of the European Hematology Association; 2012. p. 14–7.

    Google Scholar 

  29. Lloyd A, Nafees B, Narewska J, Dewilde S, Watkins J. Health state utilities for metastatic breast cancer. Br J Cancer. 2006;95(6):683–90.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

The authors would like to thank Gallup Korea for help in conducting the survey. The authors are also grateful to those who participated in the survey.

Funding

This work was supported by a grant from the National R&D Program for Cancer Control, Ministry of Health and Welfare, Republic of Korea (Number of study: 1520140). This funding let us study, collect, analysis and interpret of data.

Availability of data and materials

All relevant data are within the paper and its supplemental files.

Author information

Authors and Affiliations

Authors

Contributions

MO, KK, NHJ, MWJ, HJL and SHK contributed to the conception and design of the study. MO, HJL and SHK participated in the acquisition of data, analysis of data. EJK, MO, HJL and MWJ contributed to the interpretation of data. EJK, MO, SHK and MWJ were involved in drafting the manuscript. All authors have read and approved the final manuscript.

Corresponding author

Correspondence to Min-Woo Jo.

Ethics declarations

Ethics approval and consent to participate

The Institutional Review Board (IRB) of Asan Medical Center determined that this study was exempt from IRB review (approval number: S2016–0015). Prior to enrollment, we explained the objectives and processes of this study to the participants and obtained verbal informed consent from them with verbal and written consents. We obtained verbal informed consent rather than written consent, because this study presented no more than minimal risk of harm to participants and the only record linking the participants and the study would be the consent document.

Consent for publication

Not available.

Competing interests

The authors declare that they have no competing interest. The datasets used and analysed during the current study are available from the corresponding author on reasonable request.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional files

Additional file 1:

Lung Cancer Scenarios: Compositions of Health States. (DOCX 18 kb)

Additional file 2:

Example: Pulmonary nodule utility study: Interview guide/questionnaire. (DOCX 15 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kim, EJ., Ock, M., Kim, Kp. et al. Disease severity-based evaluation of utility weights for lung cancer-related health states in Korea. BMC Cancer 18, 1081 (2018). https://doi.org/10.1186/s12885-018-4960-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12885-018-4960-y

Keywords