Validity and reliability of the simplified Chinese patient-reported outcomes version of the common terminology criteria for adverse events
BMC Cancer volume 21, Article number: 860 (2021)
The psychometric properties of the simplified Chinese version of the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) have not been assessed. Therefore, we aimed to assess its validity, reliability, and responsiveness.
Patients and methods
A Chinese version of the PRO-CTCAE and the European Organization for Research and Treatment of Cancer Core Quality of Life Questionnaire (QLQ-C30) were distributed to 1580 patients from four cancer hospitals in China. Validity assessments included construct validity, measured by Pearson’s correlations and confirmatory factor analysis (CFA), and known-groups validity, measured by t-tests. The assessment of reliability included internal consistency, measured by Cronbach’s ɑ, and test-retest reliability, measured by the intraclass correlation (ICC). Responsiveness was assessed by standardized response means (SRMs).
Data from 1555 patients who completed the instruments were analyzed. The correlations were high between PRO-CTCAE items and parallel QLQ-C30 symptom scales (r > 0.60, p < 0.001), except for fatigue (severity: r = 0.49). Moreover, CFA showed the PRO-CTCAE structure was a good fit with the data (Root Mean Square Error of Approximation = 0.046). Known-groups validity was also confirmed. Cronbach’s ɑ of all item clusters were greater than 0.9 and the median test-retest reliability coefficients of the 38 items were 0.85 (range = 0.71–0.91). In addition, the SRMs of PRO-CTCAE items were greater than 0.8, indicating strong responsiveness.
The simplified Chinese version of the PRO-CTCAE showed good reliability, validity, and responsiveness.
Reporting adverse events (AEs) is mandatory in clinical cancer trials to ensure the safety of patients and identify toxic characteristics of treatments. The National Cancer Institute’s (NCI’s) Common Terminology Criteria for Adverse Events (NCI-CTCAE), which is commonly used in clinical settings, uses terminology consistent with the Medical Dictionary for Medical Affairs . The latest version (version 5.0) of the NCI-CTCAE, released in 2017, contains 837 items that consist of laboratory tests, symptoms, and clinical events, all of which use a 5-point scale that ranges from Grade 1 (mild) to Grade 5 (extremely severe) . The grade of an AE is usually reported by clinicians based on the NCI-CTCAE. However, there is substantial evidence that clinicians are inclined to underestimate the severity of AEs and might miss some of patients’ symptomatic AEs, compared to AEs reported by patients themselves [3,4,5,6]. It is very important to obtain information about AEs from the patient’s perspective to supplement symptomatic AEs reported by clinicians. Thus, the NCI developed a patient-centered reporting system to be a companion to the CTCAE, which is named the Patient-Reported Outcomes version of the CTCAE (PRO-CTCAE) [7, 8]. In light of the variability of AEs within and across trials, the PRO-CTCAE is a systematic measurement tool that can effectively capture the patient’s voice in reporting symptomatic AEs in cancer clinical trials. The PRO-CTCAE contains 124 items that measure 78 symptomatic AEs drawn from the more than 800 CTCAE items . Research has shown that the English version of the PRO-CTCAE has good psychometric properties , and it has been translated into more than 30 languages, including the 2019 simplified Chinese version, which was translated and linguistically validated through cognitive interviewing [10,11,12]. However, the psychometric properties of the simplified Chinese version of the PRO-CTCAE have not been assessed.
It is essential to know the psychometric properties of new clinical assessment tools to capture the latent phenomenon it is intended to measure. To limit the burden of participants, 38 items representing 22 symptomatic toxicities were regarded as “core item set” and selected for validation. And the aim of this study was to determine the validity, reliability, and responsiveness of the simplified Chinese version of the PRO-CTCAE in order to encourage the application of the PRO-CTCAE in clinical cancer trials in Mainland China.
Patients who were beginning or undergoing cancer treatment at four centers in China were recruited to participate in this study between September 2019 and January 2020. The centers included the Sun Yatsen University Cancer Center in Guangzhou, China (n = 1015), the Affiliated Hospital of Qingdao University in Shandong, China (n = 190), the Jinan Seventh People’s Hospital in Shandong, China (n = 240), and the First People’s Hospital of Tianmen in Hubei Province, China (n = 135). All the participants could speak, read, write, and understand Chinese and were 18 years of age or older.
There were no eligibility restrictions regarding disease site, current type of treatment, or type of clinical setting (inpatient or outpatient). Patients were excluded if they had a psychiatric disorder or cognitive impairment. The clinical characteristics that were collected included gender, age, education, ethnicity, marital status, diagnosis, type of treatment, and Eastern Cooperative Oncology Group Performance Status (ECOG PS). The Institutional Review Board at each site approved the study, and all the eligible patients provided informed consent.
To reduce the burden of participants, 38 items included in the original simplified Chinese version of PRO-CTCAE library, representing 22 symptomatic toxicities, were regarded as “core item set” and selected for validation (shown in Additional file 1: Table S1). They were selected because of their prevalence in different anti-cancer treatment modalities, using surveys created by the PRO-CTCAE researchers that assessed disease sites and a set of 12 “core” symptomatic AEs recommended by the NCI, in consultation with experts in the field [13, 14]. The PRO-CTCAE evaluates the patient’s experience of each AE during the past 7 days on one to three attributes. Please visit http://healthcaredelivery.cancer.gov/pro-ctcae/ for more information about the PRO-CTCAE and authorization to use it.
An anchor instrument should be used as a measurable criterion to evaluate the validity of a new scale. This study used the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-C30 (EORTC QLQ-C30) to evaluate the validity of the Chinese version of the PRO-CTCAE, based on expert advice and literature reviews. EORTC QLQ-C30 has been widely used as a gold standard in the validation and reliability of various language versions of PRO-CTCAE [9, 15,16,17]. The Chinese version of the EORTC QLQ-C30 was validated in Chinese patients who had cancers and was found to have good psychometric properties . The EORTC QLQ-C30 contains 30 items that are divided into five functional subscales, nine symptom subscales, a global health/quality of life (QOL) subscale, and financial difficulty. The reference period is the past 7 days.
All eligible patients who were beginning or undergoing cancer therapies were given relevant information by the site staff before they provided informed consent to participate. Participants were assigned to cohorts with different questionnaire schedules depending upon their treatment schedules, to minimize additional clinical visits. Cohort A was asked to finish both the PRO-CTCAE and EORCT-QLQ C30 during Visit 1 to analyze the validity and internal consistency of the PRO-CTCAE. Patients in Cohort B who had a planned visit in Cohort A and also had a return visit one day after their first visit (Visit 1b) were asked to complete the PRO-CTCAE a second time to analyze its test-retest reliability. Cohort C, who were in Cohort A but still had another visit within 1–2 weeks after the first visit (Visit 2) were asked to complete the PRO-CTCAE again in order to run responsiveness analyses. All the questionnaires were completed independently by the participants using paper and pencil. Site staff checked the scales after patients submitted them. If a scale had missing data, the scale was immediately given back to the participant to complete it. All scores on the PRO-CTCAE items and the EORTC QLQ-C30 subscales were transformed into a 0–100 scale, with greater function scores and global health scores indicating better QOL, and greater symptom scores indicating worse symptoms .
All the statistical analyses were conducted using SPSS 26.0 and Amos 22.0 statistical software program (IBM, USA). A p < 0.05 was set as the criterion for statistical significance.
Analysis of validity
Validity refers to the ability of a scale to measure what it is designed to measure. Convergent validity, which assumes conceptually related items on a new instrument and an established instrument should have substantially high correlations, was evaluated using Pearson’s correlations between parallel items on the PRO-CTCAE and QLQ-C30. Correlation coefficients of 0.1, 0.3, and 0.5, respectively, are considered to be small, medium, and large correlations . Construct validity was also estimated with confirmatory factor analysis (CFA) using structural equation modeling (SEM). The CFA model fit was assessed by the following goodness-of-fit indices: the Root Mean Square Error of Approximation (RMSEA) and the 90% RMSEA confidence interval (CI); the Comparative Fit Index (CFI); and the Incremental Fit Index (IFI). A RMSEA of ≤0.05 and ≤ 0.08 indicate good and acceptable fit, respectively, and a CFI > 0.9, and IFI > 0.9 indicate acceptable fit [21, 22]. Besides, convergent validity was evaluated by the averaged variance extracted (AVE), where an AVE > 0.5 was considered acceptable. Composite reliability (CR) values > 0.7 indicated good reliability . Discriminant validity was assessed using Pearson’s correlations between various domains and the AVE. When the correlations between the dimensions were smaller than the square root of the AVE, it indicated good discriminant validity. The factor loadings should be larger than 0.5 . Finally, known-groups validity was tested comparing the scores on the PRO-CTCAE items, that would be expected to be greater or smaller in one group of patients versus another group of patients, according to their diagnosis, treatment modality, or other clinical characteristic.
Analysis of reliability
Reliability refers to the internal consistency of the scores of items on a scale and the repeatability of scores from one administration of a scale to another administration of it. Internal consistency was assessed by Cronbach’s ɑ, where an ɑ should > 0.8. Test-retest reliability was evaluated by the intraclass correlation coefficient (ICC) using a two-way random model. The ICC is considered high when it is 0.7 or greater .
Analysis of responsiveness
Responsiveness refers to the ability to change responding to an effective intervention, which was evaluated by testing (paired t-tests) the difference between PRO-CTCAE items on the first visit (pre-treatment) and second visit (post-treatment) . The duration applied to examine the responsiveness of the PRO-CTCAE was within 1–2 weeks, which was determined based on the literature , experience and expectation that symptomatic AEs would change after anti-tumor treatment. According to expert consultation and patient’s chief complaint, significant changes were observed in most AEs within 1–2 weeks after chemotherapy or radiotherapy. Standardized response means (SRMs), which were used as responsiveness indices, were computed by dividing the absolute difference between the mean scores by the standard deviation. Values of SRM equal to 0.20, 0.50, and 0.80, respectively are considered small, medium, and large responsiveness .
A total of 1580 eligible patients who were undergoing or initiating cancer therapies were enrolled in the study between September 2019 and January 2020. Of these, 98.42% completed both the PRO-CTCAE and the EORTC QLQ-C30 during Visit 1, for a total sample of 1555 patients (see Fig. 1). The characteristics of the 1555 respondents are summarized in Table 1. Their median age was 51 (range = 18–80) years, 62.4% were male, 20.1% had ECOG PS 2–4, and 48.7% received concurrent chemoradiotherapy.
During their first visit, nearly all the patients (99.4%) had a score greater than 0 on at least one item, and 92.54% had a score of 2. Extensive symptoms were reported, with the occurrence of a median (range) of 19 (0–38) symptoms. The detailed distribution of item scores is presented in Fig. 2.
The Pearson’s correlations of the PRO-CTCAE items and QLQ-C30 domain are presented in Fig. 3. All of the PRO-CTCAE items were significantly related to, and in the expected direction with the QLQ-C30 domains (all p < 0.05). The PRO-CTCAE symptoms that are likely to affect certain types of functioning tended to be strongly associated with the conceptually related QLQ-C30 functioning scales. For example, the PRO-CTCAE items describing anxiety and sadness had the highest correlations with the QLQ-C30 emotional functioning scale (Pearson’s ∣r∣ > 0.60, p < 0.001) (Additional file 1: Table S2). In addition, the similar symptom items/scales between the PRO-CTCAE and the QLQ-C30 had large correlations, with all the r > 0.60, except for fatigue (severity: r = 0.49, 95% CI: 0.45–0.53, p < 0.001) (Additional file 1: Table S3). Correspondingly, the correlations of conceptually related items between the two scales were much larger than the correlations of the unrelated items, which indicated good item convergent validity.
CFA showed that the hypothesized model had favorable goodness-of-fit indices: RMSEA = 0.046 (90% CI = 0.044–0.048), χ2/df = 4.327, IFI = 0.964, and CFI = 0.964. The results for convergent validity are presented in Table 2. The factor loadings of the items were higher than 0.65, the CR value for each subscale was more than 0.90, and the AVE values ranged from 0.58 to 0.90. The correlation matrix of the domains in the analysis of discriminant validity are shown in Additional file 1: Table S4. The correlations between the dimensions varied between 0.02 and 0.61, which were smaller than the square root of the AVE. These CFA results indicated that all the domains had satisfactory convergent and discriminant validity.
The analysis of known-groups validity used t-tests to compare the PRO-CTCAE scores based on diagnosis, PS, and treatment. As shown in Fig. 4, a majority of PRO-CTCAE items (24 of 38 items), especially radiotherapy-related items, were observed higher scores in patients with nasopharyngeal carcinoma (NPC) or head and neck cancer (HNC) compared with those of cancers from other sites (p < 0.05). Compared with patients received concurrent chemoradiotherapy, patients accepted single treatment modality had lower mean item scores (23 of 38 items, p < 0.05). And patients with PS 2–4 had higher scores than those with PS 0–1 in 22 PRO-CTCAE items, such as pain (severity and interference, p < 0.001).
As shown in Additional file 1: Table S5, the Cronbach’s ɑ of all item clusters on the scale was greater than 0.9. The test-retest reliability results for the 165 participants who completed the PRO-CTCAE twice (one day apart) are presented in Table 3. The median ICC of 38 items on the scale was 0.85 (range = 0.71–0.91). Thus, the Cronbach’s ɑs and ICCs indicated that the scale had good reliability.
Based on questionnaires of 618 patients, the mean change in PRO-CTCAE scores was statistically significant, increasing for 25 of the 38 items (p < 0.05), and decreasing for 2 of the 38 items: hoarseness (S) (p < 0.001) and diarrhea (F) (p = 0.042). The SRMs of 14 PRO-CTCAE items were greater than 0.8, indicating strong responsiveness. On the other hand, some items had small SRM values (< 0.2), reflecting weak responsiveness, e.g., concentration, anxiety (“anxious”), and sadness (“sad”) (see Additional file 1: Table S6).
This large-scale multicenter study to assess the core item set of the simplified Chinese language PRO-CTCAE demonstrated that it generally had excellent psychometric properties with respect to reliability, validity, and responsiveness. This is the first study that has quantitatively evaluated this core item set of the simplified Chinese version of the scale, and our findings support the incorporation of it into AE reporting in future cancer clinical trials.
The assessment of validity, which should include convergent and discriminant validity, is critically important for evaluating a new PRO measure . To establish convergent validity, the analyses should demonstrate that measures that are presumed to be related are actually related; to establish discriminant validity, the analyses should demonstrate that measures that are presumed to be unrelated are actually unrelated. The current study’s correlation analysis indicated that the scale’s convergent validity was good, with most of the parallel items of the PRO-CTCAE and QLQ-C30 scales being highly correlated. An exception to these findings was that large correlations were observed between decreased appetite and items that were not conceptually related, including nausea/vomiting and fatigue. These findings may be explained by the fact that patients with cancer typically experience multiple symptoms, and one of these symptoms might trigger the other symptoms in a cluster . While QLQ-C30 items reflect the frequency of a symptom, PRO-CTCAE evaluates the patient’s experience of each AE on one to three attributes of frequency, severity, interference, amount, presence / absence. Thus, the severity of fatigue in PRO-CTCAE may have relatively small correlations with frequency of fatigue in QLQ C-30. Subsequently, CFA model was used to assess the construct validity. The results of CFA also indicated that all the domains had satisfactory convergent and discriminant validity. CFA demonstrated that the dimensions of the scale were consistent with their original concepts, and the structural model had an excellent fit, which confirmed the construct validity of the PRO-CTCAE.
In addition, the results of known-group validity (or clinical validity) showed that the scores on the PRO-CTCAE items differed significantly based on different types of cancer, PS scores, and treatment groups. Patients diagnosed with NPC or HNC tended to have higher PRO-CTCAE scores, especially on items related to radiation reactions, since most patients with NPC or HNC receive radiotherapy. However, the scores of emotion-associated items, such as anxiety, did not differ significantly across different groups, probably because of the variety and complexity of emotional experiences .
Responsiveness is divided into internal and external responsiveness , and our analysis of internal responsiveness showed that those PRO-CTCAE items reflecting acute AEs had larger SRMs, while other items had smaller SRMs. Some PRO-CTCAE items, such as concentration, had stable scores, and the interval we used (1–2 weeks) may have been too short to make significant change in scores.
Similar to our results, studies of other language versions of the PRO-CTCAE have demonstrated that it has good measurement properties [9, 15,16,17]. For example, validation of the original English version of PRO-CTCAE showed good test-retest reliability, with an ICC of 0.76, and good validity, with strong correlations between related PRO-CTCAE items and QLQ-C30 domains, as well as significant changes after treatment . In addition, Hagelstein et al., who studied a core item set of the German version of the PRO-CTCAE, reported that the Cronbach’s ɑ of seven of the nine item clusters was above 0.9, and the version’s validity was demonstrated by PCA, Multitrait-multimethod matrix (MTMM), and known groups analyses .
The current study included a diverse sample, which helps make our results generalizable. First, a wide range of types of cancer, including less common ones, enhanced the diversity of the sample. Second, the proportion of patients in the sample with poor PS (ECOG PS ≥2) makes our findings on the simple Chinese PRO CTCAE applicable to patients with severe symptoms. Moreover, the centers involved in the study were located across China, including Northern China and Southern China and urban and rural areas, reflecting a diversity of geography, race, education, and economic circumstances.
We acknowledge that there are some limitations with the current study. Considering patient compliance, we did not include all PRO-CTCAE items for validation, which was consistent with validation of PRO-CTCAE in other languages [9, 15, 16]. To minimize respondent burden and to avoid missing data, the psychometric analysis was confined to 38 selected items, and the results should not be extrapolated to the entire Chinese language item-library of the PRO-CTCAE. Thus, future studies that examine the other cancer-specific PRO-CTCAE items are warranted. All the PRO information used in this study was collected by paper and pencil. However, that acceptable equivalence has been found between the web, paper, and automated telephone interactive voice-response administration of the English version of the PRO-CTCAE . Finally, because half of the patients in this study were in an endemic area for NPC, there was over-representation of patients with the nine symptoms related to “radiation reaction” in the study. A large number of cases and a wider range of types of cancer from diverse areas of China would offset this sampling bias.
In conclusion, this large-scale, multicenter study demonstrated that the simplified Chinese version of the PRO-CTCAE has good reliability, validity, and responsiveness, and that it can be used to supplement the AE reports of clinicians in cancer clinical trials in Mainland China.
Availability of data and materials
The data and materials are available from the corresponding author on reasonable request.
Average Variance Extracted
Confirmatory Factor Analysis
- ECOG PS:
Eastern Cooperative Oncology Group Performance Status
head and neck cancer
patient-reported outcomes version of the common terminology criteria for adverse events
Quality of Life Questionnaire
Standardized Response Means.
Trotti A, Colevas AD, Setser A, Basch E. Patient-reported outcomes and the evolution of adverse event reporting in oncology. J Clin Oncol. 2007;25(32):5121–7. https://doi.org/10.1200/JCO.2007.12.4784.
US NCI CTCAE [https://ctep.cancer.gov/protocolDevelopment/electronic_applications/ctc.htm] Accessed on 30 August 2019.
Basch E. Patient-reported outcomes in drug safety evaluation. Ann Oncol. 2009;20(12):1905–6. https://doi.org/10.1093/annonc/mdp542.
Basch E, Iasonos A, McDonough T, Barz A, Culkin A, Kris MG, et al. Patient versus clinician symptom reporting using the National Cancer Institute common terminology criteria for adverse events: results of a questionnaire-based study. The Lancet Oncology. 2006;7(11):903–9. https://doi.org/10.1016/S1470-2045(06)70910-X.
Di Maio M, Gallo C, Leighl NB, Piccirillo MC, Daniele G, Nuzzo F, et al. Symptomatic toxicities experienced during anticancer treatment: agreement between patient and physician reporting in three randomized trials. J Clin Oncol. 2015;33(8):910–5. https://doi.org/10.1200/JCO.2014.57.9334.
Basch E. The missing voice of patients in drug-safety reporting. N Engl J Med. 2010;362(10):865–9. https://doi.org/10.1056/NEJMp0911494.
US NCI PRO-CTCAE [http://healthcaredelivery.cancer.gov/pro-ctcae/] Accessed on 30 August 2019.
Basch E, Reeve BB, Mitchell SA, Clauser SB, Minasian LM, Dueck AC, et al. Development of the National Cancer Institute's patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). J Natl Cancer Inst. 2014;106(9):dju244.
Dueck AC, Mendoza TR, Mitchell SA, Reeve BB, Castro KM, Rogak LJ, et al. Validity and reliability of the US National Cancer Institute's patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). JAMA Oncol. 2015;1(8):1051–9. https://doi.org/10.1001/jamaoncol.2015.2639.
Miyaji T, Iioka Y, Kuroda Y, Yamamoto D, Iwase S, Goto Y, et al. Japanese translation and linguistic validation of the US National Cancer Institute's patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). J Patient Rep Outcomes. 2017;1(1):8. https://doi.org/10.1186/s41687-017-0012-7.
Hay JL, Atkinson TM, Reeve BB, Mitchell SA, Mendoza TR, Willis G, et al. Cognitive interviewing of the US National Cancer Institute's patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). Qual Life Res. 2014;23(1):257–69. https://doi.org/10.1007/s11136-013-0470-1.
Kkf C, Mitchell SA, Chan N, Ang E, Tam W, Kanesvaran R. Linguistic validation of the simplified Chinese version of the US National Cancer Institute's patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). BMC Cancer. 2020;20(1):1153. https://doi.org/10.1186/s12885-020-07631-5.
Reeve BB, Mitchell SA, Dueck AC, Basch E, Cella D, Reilly CM, et al. Recommended Patient-Reported Core Set of Symptoms to Measure in Adult Cancer Treatment Trials. JNCI. 2014;106(7):dju129.
Rolstad S, Adler J, Ryden A. Response burden and questionnaire length: is shorter better? A review and meta-analysis. Value Health. 2011;14(8):1101–8. https://doi.org/10.1016/j.jval.2011.06.003.
Hagelstein V, Ortland I, Wilmer A, Mitchell SA, Jaehde U. Validation of the German patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). Ann Oncol. 2016;27(12):2294–9. https://doi.org/10.1093/annonc/mdw422.
Kawaguchi T, Azuma K, Sano M, Kim S, Kawahara Y, Sano Y, et al. The Japanese version of the National Cancer Institute's patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE): psychometric validation and discordance between clinician and patient assessments of adverse events. J Patient Rep Outcomes. 2017;2(1):2.
Yoon J, Sim SH, Kang D, Han G, Kim Y, Ahn J, et al. Reliability and validity of the Korean language version of the U.S. National Cancer Institute's patient-reported outcomes common terminology criteria for adverse events. J Pain Symptom Manag. 2020;59(5):1082–8 e1086. https://doi.org/10.1016/j.jpainsymman.2020.01.015.
Wan C, Meng Q, Yang Z, Tu X, Feng C, Tang X, et al. Validation of the simplified Chinese version of EORTC QLQ-C30 from the measurements of five types of inpatients with cancer. Ann Oncol. 2008;19(12):2053–60. https://doi.org/10.1093/annonc/mdn417.
Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, et al. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst. 1993;85(5):365–76. https://doi.org/10.1093/jnci/85.5.365.
Cohen J. Statistical power analysis for the behavioral sciences. Hillsdale: Lawrence Erlbaum Associates; 1988.
Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1–55. https://doi.org/10.1080/10705519909540118.
Woo JP. The concept and understanding of structural equation model. Seoul: Hannarae; 2012.
CFaDF L. Evaluating structural equation models with unobservable variables and measurement error. J Mark Res. 1981;18(1):39–50. https://doi.org/10.1177/002224378101800104.
Hair JF, Black W. C., Babin, B. J., and Anderson, R. E: multivariate data analysis, 8th edn. London: Cengage Learning EMEA; 2018.
Nunnally JCBI. Psychometric Theory. 3rd ed. New York: McGraw-Hill: Sage; 1994.
Janice A, Husteda RJC, Vern T. Farewellc, Dafna D. Gladmand: methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol. 2000;53(3):459–68.
Husted JA, Cook RJ, Farewell VT, Gladman DD. Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol. 2000;53(5):459–68. https://doi.org/10.1016/S0895-4356(99)00206-1.
American Educational Research Association (AERA) APAA, National Council on Measurement in Education (NCME): Standards for Educational and Psychological Testing. In., vol. 2014. Washington: American Educational Research Association 2014.
Dong ST, Butow PN, Costa DS, Lovell MR, Agar M. Symptom clusters in patients with advanced cancer: a systematic review of observational studies. J Pain Symptom Manag. 2014;48(3):411–50. https://doi.org/10.1016/j.jpainsymman.2013.10.027.
Werner-Seidler A, Hitchcock C, Hammond E, Hill E, Golden AM, Breakwell L, et al. Emotional complexity across the life story: elevated negative emodiversity and diminished positive emodiversity in sufferers of recurrent depression. J Affect Disord. 2020;273:106–12. https://doi.org/10.1016/j.jad.2020.04.060.
Knoerl R, Gray E, Stricker C, Mitchell SA, Kippe K, Smith G, et al. Electronic versus paper-pencil methods for assessing chemotherapy-induced peripheral neuropathy. Support Care Cancer. 2017;25(11):3437–46. https://doi.org/10.1007/s00520-017-3764-y.
This work was supported by grants from the National Natural Science Foundation of China (81930072; 81803052; 81672988), Key-Area Research and Development Program of Guangdong Province (2019B020230002), and the Sun Yat-Sen University Clinical Research 5010 Program (2017-FXY-114).
Ethics approval and consent to participate
This study was performed in line with the principles of the Declaration of Helsinki. Approval was granted by Sun Yat-sen University Cancer Center Institutional Review Board (Date.2020-04-01 /No.B2020–027-01). Participants provided written informed consent at enrolment.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Item clusters of the PRO-CTCAE. Table S2. Criteria-related validity: Pearson’s correlation coefficients between PRO-CTCAE items and QLQ-C30 functional domains (N = 1555). Table S3. Criteria-related validity: Pearson correlation coefficients between similar symptom items on the PRO-CTCAE and QLQ-C30 (N = 1555). Table S4. Correlation matrix of factors (N = 1555). Table S5. Cronbach’s alpha of each dimension of the simple Chinese PRO-CTCAE (N = 1555). Table S6. Responsiveness of the Chinese PRO-CTCAE (N = 618)
About this article
Cite this article
Yang, SS., Chen, L., Liu, Y. et al. Validity and reliability of the simplified Chinese patient-reported outcomes version of the common terminology criteria for adverse events. BMC Cancer 21, 860 (2021). https://doi.org/10.1186/s12885-021-08610-0