- Research article
- Open Access
- Open Peer Review
Disease severity-based evaluation of utility weights for lung cancer-related health states in Korea
BMC Cancer volume 18, Article number: 1081 (2018)
Utility weight, a measure of health-related quality of life, is used in disease burden measurements and economic evaluations. In this study, we used the visual analogue scale (VAS) and standard gamble (SG) method to determine the utility weights of lung cancer health states in South Korea from a societal perspective.
Six hypothetical health states for lung cancer or a related health state reflective of disease severity were developed: 1) Stage I, 2) Stage II, 3) Stage IIIa, 4) Stage IIIB, 5) Stage IV, and 6) Pulmonary nodule. The description of each health state description was divided into four parts: diagnosis, symptoms, treatment, and progression and prognosis. A total of 515 representative adult Korean participants used a VAS and SG to evaluate these six health states via face-to-face computer-assisted interviews. The means, standard deviations, and median utility weights of the six health states were estimated by valuation method.
The two valuation methods of the scenarios yielded the same mean utility rankings. Pulmonary nodule received the highest rank (VAS, 0.66 and SG, 0.83), whereas Stage 4 was assigned the lowest rank (VAS, 0.09 and SG, 0.31). For all health states, the mean utility weights calculated using the SG were greater than those calculated using the VAS. The differences between the utility weights obtained using the two valuation methods ranged from 0.14 (Stage I) to 0.22 (Stage IV). The two approaches tended to yield larger differences for more severe stages.
This study determined utilities for squamous cell lung cancer that will be useful for estimating the burden of lung cancer and for conducting economic evaluations of lung cancer interventions.
In South Korea, 8.44% of the total disability-adjusted life years have been attributed to cancer. Currently, lung cancer is the most frequent malignancy, accounting for 14.05% of all cancer cases . Although lung cancers are associated with symptoms such as cough, dyspnea, weight loss, and chest tightness, patients with very early-stage disease may be asymptomatic. In short, disease progression correlates inversely with the quality of life . Furthermore, lung cancer has a higher mortality rate, compared to other diseases; accordingly, the years of life lost (YLL) is higher than the years lost to disability (YLD), and the YLL:YLD ratio is asymmetric .
Utility weight, an indicator of the health-related quality of life, is used in measurements of disease burdens and economic evaluations, and the results provide important evidence to support the decision-making processes of policy makers [4, 5]. However, the quantification of utility weight is a somewhat vague and non-objective process because of the target population . Ideally, decision makers should have access to utility data specific to local populations . A preference-based assessment, which can be categorized into direct and indirect methods, can be used to achieve this ideal .
Several methods can be used to elicit a health state preference. In the present study, we used the visual analogue scale (VAS) and standard gamble (SG) techniques. SG methods require concentration and in-depth cognitive functions from the respondents and professional interviewers [9, 10]. These methods use self-administered, multi-attribute health status classification system questionnaires and have been widely used . The alternative method, VAS, is simple. However, the VAS anchors are often poorly defined, and may lead to several measurement biases, such as context and end-aversion bias. However, the VAS is a value but utility and thus might be used to compare preferences and explore methodological validity. Evidence suggests that limited and cautious use of the VAS is useful and appropriate .
This study, therefore, aimed to determine the utility weights of squamous cell lung cancer health states in South Korea from a societal perspective. These utility weights were determined to provide local population data to policy makers in South Korea, as well as internationally.
Two authors (Ock M and Jo MW) developed a draft of the lung cancer health state scenarios based on literature reviews and the education materials provided to patients at Asan Medical Center. One medical oncologist (Kim KP) and one radiation oncologist (Jung NH) reviewed and modified the draft. A total of six hypothetical health states reflecting disease severity were developed: 1) Stage I lung cancer (state 1), 2) Stage II lung cancer (state 2), 3) Stage IIIa lung cancer (state 3), 4) Stage IIIb lung cancer (state 4), 5) Stage IV lung cancer (state 5), and 6) Pulmonary nodule (state 6). The histological type of lung cancer was assumed to be squamous cell carcinoma. Each health state was divided into four parts with reference to previous studies [12,13,14]: diagnosis, symptoms, treatment, and progression and prognosis. Specifically, each health state included standard diagnostic procedures, typical symptoms and signs, standard treatment procedures (including surgery and radiotherapy), common side effects of treatment, and information about the 5-year survival rate. The full descriptions of the six health states are available in Additional File 1.
The target population comprised adults aged ≥19 years who lived in Korea (except Jeju Island). This target population was defined in the June 2013 national resident registration data, documented by the Ministry of Administration and Security of South Korea. We recruited 515 representative individuals from this target population using a multi-stage stratified quota sampling based on region, sex, and age group.
Participants were surveyed through face-to-face computer-assisted interviews. Before conducting the survey, the interviewers were educated about the purpose of the study and the descriptions of the six health states. They were also trained in two valuation methods: VAS and SG. The total education time was approximately 2.5 h. The sample script of the interview was available in Additional File 2.
Every participant was informed about the survey procedure and the purpose of the study, and those who provided informed consent were included in this survey. First, participants were requested to provide their age, sex, region, and educational level. Next, participants applied the VAS six times to the six health states, which were displayed in a random order. The participants also applied the VAS once more for the state of death. Next, the participants used the SG method to evaluate the six health states in random order. After performing the two valuations, the participants were asked about other socio-demographic factors and clinical information, including their monthly income, ambulatory care visits during the past 2 weeks, hospitalization during the past 12 months, and morbidity. The health state descriptions were printed on cards to facilitate participants with limited vision. The Institutional Review Board (IRB) of Asan Medical Center determined that this study was exempt from IRB review (approval number: S2016–0015).
Two valuation methods were used in this study: VAS and SG. For the VAS, the participants rated the proposed health states on a scale from 0 to 100, which corresponded to the worst and best imaginable health states, respectively. For the SG, the participants were asked to select the better of two choices: either a health state or death. If the participant chose the proposed health state as the better option, he/she was asked to determine the point of indifference between two hypothetical options: remaining in the proposed health state for the remaining life time, or receiving treatment that might lead to either a full recovery of health (probability ‘p’) or immediate death (probability ‘1-p’). The probability ‘p’ increased or decreased by 5% according to the previous participants’ choice. The participants continued to select options until their preferences for the options became equal. The initial probability ‘p’ was 50%. If the participant selected death as a preferred state, the next SG question was presented. VAS and SG were different from EQ-5D, HUI and SF-6D. The later ones were indirect evaluation methods so it could be interpreted multiply. Especially, in the field of clinical setting, the direct evaluation methods were more preferred .
We performed descriptive analyses of socio-demographic factors and clinical information. Utility weights were determined using each valuation method. For the VAS, utility weights were calculated using the following formula: (VAS value of the health state – VAS value of death) / (100 – VAS value of death). For the SG, if the health state was selected as better than death, the final value of ‘p’ was recorded as the utility weight of the suggested health state. If the health state was selected as a worse than death, the utility was censored at 0.
The mean, standard deviation, and median utility weights of six health states were estimated by valuation method. We used Student’s t-test and an analysis of variance to compare the mean values of utilities according to the socio-demographic factors and clinical information. Furthermore, we used a linear mixed model to identify factors that influenced the utility weights. The utility weights obtained using the VAS and SG methods were regarded as dependent variables, and the socio-demographic factors, clinical information, and health states were treated as independent variables. All statistical analyses were performed using SPSS software (v21.0; SPSS, Inc., Chicago, IL, USA) and SAS software (v9.2; SAS Institute, Inc., Cary, NC, USA). P-values < 0.05 were considered statistically significant.
A total of 515 participants completed full interviews. The mean age of the participants was 45.7 (SD: 13.9) years, and 48.9% were male. Among the participants, 13.2% have received ambulatory cares during the past 2 weeks, and 3.1% had been hospitalized within the previous 12 months. The clinical and demographic characteristics of the participants are shown in Table 1.
The utility weights for the lung cancer scenarios are shown in Table 2. The ranks of the scenarios by mean utility were the same, regardless of the valuation method. Pulmonary nodule was assigned the highest rank, with a VAS value of 0.66 and SG value of 0.83, whereas Stage IV was assigned the lowest rank, with a VAS value of 0.09 and SG value of 0.31. For all health states, the mean utility calculated using the SG method was greater than that calculated using the VAS. The differences in utility weights between the two valuation methods ranged from 0.14 (Stage I) to 0.22 (Stage IV). Severe stages tended to be associated with greater differences between the two approaches.
Tables 3 and 4 presents a comparison of the utility weights according to socio-demographic and clinical information. The mean utility weights derived from the SG method did not differ significantly according to sex, age, educational level, occupation, and ambulatory care visits during the past 2 weeks. However, participants with higher monthly incomes tended to score higher than those with lower incomes. In addition, significantly higher rates for Pulmonary nodule were observed among participants with no hospitalizations during the previous 12 months and those without comorbidities.
Table 5 presents the associations of various factors with the utility weights obtained using the VAS and SG methods. In this table, we have listed the results from a multivariable linear regression analysis. The health states were the main relevant factors related to the utility weights. After adjusting for clinical and demographic characteristics, the utility weight for a more advanced stage lung cancer relative to a pulmonary nodule was 0.568 and 0.519 lower when the VAS and SG methods were used, respectively. Furthermore, disease stage correlated inversely with utility weight. In addition, participants with manual occupations had a significantly higher utility weight when compared to those with a non-manual occupation only when the VAS was used.
In this study, utility weights for six health states of lung cancer were determined using the VAS and SG methods by 515 participants from the general South Korean population. One strength of our study is the subject, namely the calculation of utility weight for lung cancer in an East Asian country. Few previous studies have evaluated the utility of lung cancer in general populations. However, some studies have recommended the use of utility weights from a general population [14, 16].
Nevertheless the strength, Froberg et al. found that differences in the measurement of social preference for health state vary among people involved in the measurement. The reason for this difference arises from the differences in knowledge or experience people have about the health state or disease. Therefore, in order to measure social value or preference properly, pre-training of health state or disease is required before. This can solve the problem that may arise from preconceived notions about the health state or disease that the public had in advance [17,18,19]. In this study, we developed the health descriptions for six health states of lung cancer, and explained them to the participants in the survey to improve understanding of health states.
Our study group used both VAS scale- and SG-based approaches to determine the utility weights for lung cancer-related health states. The SG approach measures respondents’ preferences under conditions of uncertainty and is based directly on the von Neumann–Morgenstern utility theory, which is considered the standard for modeling rational behavior in the context of uncertainty . Although the VAS does not allow a trade-off between different health states, and is commonly considered to lack a theoretical basis when compared with choice-based methods such as SG and time trade-off (TTO) , it is easy to understand and use. Accordingly, the VAS is widely used in evaluation studies. Furthermore, no single method of evaluation is most appropriate under all circumstances . However, the VAS tends to yield bias-prone utility weights and should not be used by itself . Some studies have confirmed the context bias of this method  and identified the range frequency model developed by Parducci and Wedell as potentially useful for bias adjustment . However, it is difficult to generalize this model ; therefore, to ensure the best outcome, the VAS should be used only as an introductory method during which respondents can become accustomed to the health states. The ordinal preferences can facilitate the subsequent SG analysis [11, 24].
We evaluated lung cancer-related health state preferences in a relatively large sample, using various scenarios and direct valuation methods. The lung cancer utility weights ranged from 0.09 (stage IV lung cancer) to 0.83 (pulmonary nodule); notably, more severe states received consistently lower values. A previous study  reported a utility weight of 0.626 for stable disease without additional symptoms and decreases of 0.069 with the addition of pain, 0.050 with dyspnea, and 0.046 with cough; the utility values ranged from 0.653 for stable disease with no toxicity to 0.473 for progressive disease .
Our utility weights are similar to those reported in a previous study . A meta-regression analysis determined reference lung cancer utilities of 0.573, 0.772, and 0.823 for metastatic, mixed/not specified, and non-metastatic non-small cell lung cancer (NSCLC), respectively, using patients as respondents and the SG method with scale boundaries of death and perfect health . Using the TTO, Swinburn et al.  elicited health state utility weights for the treatment outcomes of relapsed/refractory Hodgkin lymphoma and systemic anaplastic large-cell lymphoma in Thailand, Taiwan, and South Korea. The values assigned for stable disease were 0.30 (Thailand), 0.49 (Taiwan)m and 0.64 (South Korea), which were comparable to the stable disease values for Korea (0.71) and Taiwan (0.54) according to a study by Nafee et al. . The utility weight for progressive disease approached that of “death” in Thailand (0.07), and was low in both Taiwan (0.23) and South Korea (0.32) . The current values for progressive disease are in line with the range observed in our study.
Our study proved the association between utility values obtained with the VAS and SG. Health states were the most relevant factors regarding utility weight. After we adjusted for clinical and demographic characteristics, the utility weight for higher-stage lung cancer relative to pulmonary nodule was 0.568 lower with the VAS and 0.519 lower with the SG. In addition, respondents with manual occupations yielded significantly higher utility weights than did those with non-manual occupation only when using the VAS. In other words, the risk attitudes may differ among respondents in terms of lung cancer severity, compared to other conditions, and other patient characteristics might supersede the experience of a health state. Furthermore, other cancer patients also ranked social functioning as more important than physical functioning. The current study adapted the existing health state descriptions of metastatic breast cancer from a previous study  to describe patients receiving second-line treatment for NSCLC. The utility values were obtained by asking participants to value health state descriptions describing metastatic breast cancer, five grade III/IV toxicities (febrile neutropenia, stomatitis; diarrhea and vomiting; fatigue; hand-foot syndrome), and hair loss . The utility scores reflect the values assigned by ordinary people to various health states representative of lung cancer scenarios.
This study had several limitations. We intentionally reduced the number of scenarios to minimize the cognitive burden placed on respondents. Accordingly, it may have been difficult for respondents to make fully informed decisions. Furthermore, we did not collect response integrity data and were therefore unable to analyze characteristics regarding non-respondents.
Our findings indicate that range of descriptions of lung cancer states can be feasibly evaluated in the South Korean population using either the VAS or SG method. Furthermore, the utility weights generated from this study could be used in economic evaluations of lung cancer interventions for both patients and the general population.
non-small cell lung cancer
Visual analog scale
Years lost to disability
Years of life lost
Yoon J, Oh IH, Seo H, Kim EJ, Gong YH, Ock M, et al. Disability-adjusted life years for 313 diseases and injuries: the 2012 Korean burden of disease study. J Korean Med Sci. 2016;31(2):S146–57.
Eton DT, Fairclough DL, Cella D, Yount SE, Bonomi P, Johnson DH, et al. Early change in patient-reported health during lung cancer chemotherapy predicts clinical outcomes beyond those predicted by baseline report: results from eastern cooperative oncology group study 5592. J Clin Oncol. 2003;21(8):1536–43.
Kim EJ, Yoon SJ, Jo MW, Kim HJ. Measuring the burden of chronic diseases in Korea in 2007. Public Health. 2013;127(9):806–13.
Ock M, Han JW, Lee JY, Kim SH, Jo MW. Estimating quality-adjusted life-year loss due to noncommunicable diseases in Korean adults through to the year 2040. Value Health. 2015;18(1):61–6.
Han KT, Kim SJ, Lee SY, Park EC. Cost-effectiveness analysis of HPV vaccination: comparing the general population with socially vulnerable individuals. Asian Pac J Cancer Prev. 2014;15(19):8503–8.
Knies S, Evers SM, Candel MJ, Severens JL, Ament AJ. Utilities of the EQ-5D: transferable or not? Pharmacoeconomics. 2009;27(9):767 7.
Nafees B, Lloyd AJ, Dewilde S, Rajan N, Lorenzo M. Health state utilities in non–small cell lung cancer: an international study. Asia Pac J Clin Oncol. 2017;13(5):e195–203.
Rashidi AA, Anis AH, Marra CA. Do visual analogue scale (VAS) derived standard gamble (SG) utilities agree with health utilities index utilities? A comparison of patient and community preferences for health status in rheumatoid arthritis patients. Health Qual Life Outcomes. 2006;4:25.
Drummond MF, O'Brien B, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. 2nd ed. Oxford: Oxford Medical Publications; 1997.
Furlong W, Feeny D, Torrance GW, Barr R, Horsman J. Guide to design and development of health-state utility instrumentation, Working Paper No. 90-9. McMaster University, Centre for Health Economics and Policy Analysis; 1990.
Torrance GW, Feeny D, Furlong W. Visual analog scales: do they have a role in the measurement of preferences for health states? Med Decis Mak. 2001;21(4):329–34.
Ock M, Park JY, Son WS, Lee HJ, Kim SH, Jo MW. Estimation of utility weights for human papilloma virus-related health states according to disease severity. Health Qual Life Outcomes. 2016;14(1):163.
Kim SH, Jo MW, Ock M, Lee HJ, Lee JW. Estimation of health state utilities in breast cancer. Patient Prefer Adherence. 2017;11:531–6.
Lee JY, Ock M, Jo MW, Son WS, Lee HJ, Kim SH, et al. Estimating utility weights and quality-adjusted life year loss for colorectal cancer-related health states in Korea. Sci Rep. 2017;7(1):5571.
Blinman P, King M, Norman R, Viney R, Stockler MR. Preferences for cancer treatments: an overview of methods and applications in oncology. Ann Oncol. 2012;23(5):1104–10.
Hadorn DC. The role of public values in setting health care priorities. Soc Sci Med. 1991;32(7):773–81.
Froberg DG, Kane RL. Methodology for measuring health-state preferences III : population and context effects. J Clin Epidemiol. 1989;42(6):585–92 25.
Froberg DG, Kane RL. Methodology for measuring health-state preferences V : Progress and research agenda. J Clin Epidemiol. 1989;42(7):675–85 26.
Ubel PA, Richardson J, Menzel P. Societal value, the person trade-off, and the dilemma of whose values to measure for cost-effectiveness analysis. Health Econ. 2000;9:127–36.
Nafees B, Stafford M, Gavriel S, Bhalla S, Watkins J. Health state utilities for non small cell lung cancer. Health Qual Life Outcomes. 2008;6:84.
Gafni A. The standard gamble method: what is being measured and how it is interpreted. Health Serv Res. 1994;29(2):207–24.
Dolan P, Sutton M. Mapping visual analogue scale health state valuations onto standard gamble and time trade-off values. Soc Sci Med. 1997;44(10):1519–30.
Salomon JA, Murray CJ. A multi-method approach to measuring health-state valuations. Health Econ. 2004;13(3):281–90.
Parducci A, Wedell DH. The category effect with rating scales: number of categories, number of stimuli, and method of presentation. J Exp Psychol Hum Percept Perform. 1986;12(4):496–516.
Dolan P, Olsen JA, Menzel P, Richardson J. An inquiry into the different perspectives that can be used when eliciting preferences in health. Health Econ. 2003;12(7):545–51.
Doyle S, Lloyd A, Walker M. Health state utility scores in advanced non-small cell lung cancer. Lung Cancer. 2008;62(3):374–80.
Sturza J. A review and meta-analysis of utility values for lung cancer. Med Decis Mak. 2010;30(6):685–93.
Swinburn P, Shingler S, Liu Y, Huang H, Acaster S. Health state utilities for relapsed/refractory Hodgkin lymphoma (HL) and systemic anaplastic large-cell lymphoma (sALCL). Amsterdam: Poster presentation at: 17th congress of the European Hematology Association; 2012. p. 14–7.
Lloyd A, Nafees B, Narewska J, Dewilde S, Watkins J. Health state utilities for metastatic breast cancer. Br J Cancer. 2006;95(6):683–90.
The authors would like to thank Gallup Korea for help in conducting the survey. The authors are also grateful to those who participated in the survey.
This work was supported by a grant from the National R&D Program for Cancer Control, Ministry of Health and Welfare, Republic of Korea (Number of study: 1520140). This funding let us study, collect, analysis and interpret of data.
Availability of data and materials
All relevant data are within the paper and its supplemental files.
Ethics approval and consent to participate
The Institutional Review Board (IRB) of Asan Medical Center determined that this study was exempt from IRB review (approval number: S2016–0015). Prior to enrollment, we explained the objectives and processes of this study to the participants and obtained verbal informed consent from them with verbal and written consents. We obtained verbal informed consent rather than written consent, because this study presented no more than minimal risk of harm to participants and the only record linking the participants and the study would be the consent document.
Consent for publication
The authors declare that they have no competing interest. The datasets used and analysed during the current study are available from the corresponding author on reasonable request.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.