This article has Open Peer Review reports available.
The development of the Canberra symptom scorecard: a tool to monitor the physical symptoms of patients with advanced tumours
© Barresi et al; licensee BioMed Central Ltd. 2003
Received: 27 August 2003
Accepted: 17 December 2003
Published: 17 December 2003
Patients with advanced (incurable) tumours usually experience a diverse burden of symptoms. Although many symptom assessment instruments are available, we examined whether these addressed tumour-related symptoms.
We reviewed existing symptom assessment instruments and found a number of deficiencies such as instruments being too long or burdensome, too short, or measuring quality of life rather than tumour-related symptoms. Others focused on emotional, rather than physical symptoms. Therefore, we decided to devise a new symptom instrument. A list of 20 symptoms common in patients with advanced tumours generated from the literature and existing instruments, was ranked according to prevalence by 202 Australian clinicians. Following clinicians' responses, the list was revised and two severity assessment scales (functional severity and distress severity) added. The resultant 18-item list was assessed in 44 outpatients with advanced tumours.
Patient responses indicated that a shorter questionnaire of 11 items, reflecting three main symptom clusters, provided a good representation of physical symptoms. An additional symptom that is an important predictor of survival was added, making a 12-item questionnaire, which was entitled "The Canberra Symptom Scorecard" (CSS). For symptom severity, the distress severity scale was more appropriate than the functional severity scale.
The CSS focuses on tumour-related physical symptoms. It is about to be assessed in patients with advanced tumours receiving palliative treatments, when it will also be validated against existing instruments.
Few metastatic tumours are curable and the principal aim of treatment is to improve patients' tumour-related symptoms to maximise quality of life (QoL). A number of QoL and symptom assessment instruments [1–15] has been developed for use in patients with advanced tumours (Table 1 – see additional file 1). These are usually completed by the patient, and predominantly are used as outcome measures in clinical trials [15–22]. In clinical practice, clinicians usually assess symptoms in a less formal fashion, although there are instruments, such as the Edmonton symptom assessment system (ESAS)  that are used on a regular basis, in some practices.
Most appraisals of existing symptom assessment instruments have concluded that they are relevant and acceptable for QoL assessment in patients with advanced tumours [1, 9–13, 15, 16, 18, 20–25]. On the other hand, a number of limitations has been identified in existing instruments: many of the instruments are too lengthy to be administered regularly (e.g. the adapted symptom distress scale (ASDS), the functional assessment of cancer therapy scale-general (FACT-G), the McGill quality of life questionnaire (MQOL), the Memorial symptom assessment scale (MSAS), and the Rotterdam symptom checklist (RSCL)) [6, 7, 11, 12, 14] or they provide only limited benefit in the assessment of symptoms in the more seriously ill patients (e.g. ESAS, RSCL, the patient evaluated problem scores (PEPS)) [20, 21, 24]. Further, the instrument may fail to measure the patient's experience (e.g. the support team assessment schedule (STAS)) [9, 10], or the reference period is either absent or too short (MQOL) [22, 25]. Those that measure QoL rather than tumour-related symptoms (e.g. FACT-G, the EORTC quality of life questionnaire (QLQ-C30), MQOL) tend to be too broad and less relevant for measuring symptoms [7, 11]. In contrast, other instruments are too short to be comprehensive (e.g. PEPS) , or there is doubt that the coverage of symptoms is appropriate (e.g. the M.D. Anderson symptom inventory (MDASI)) . There is also inconsistency between the severity assessment scales used by different instruments, typically either indicating the impairment of functioning (e.g. FACT-G) , or the distress caused by a symptom or symptoms (e.g. ESAS, the symptom distress scale (SDS), modified SDS, ASDS, MQOL) [1, 3–6, 11], or both (e.g. MDASI, RSCL) [13, 14].
Because of these limitations, we decided to investigate the optimal coverage of symptoms necessary and the most appropriate severity assessment scale in an effort to identify an optimal symptom assessment instrument for patients with advanced tumours.
In this study, we explored patient and clinician prevalence rankings of tumour-related symptoms in outpatients with advanced tumours. Based on these relationships, we identified the shortest list of symptoms that covered the major clusters of tumour-related symptoms best for this population. We also examined two different severity assessment scales for each symptom to assess variation between the scales, and whether more than one type of severity assessment scale was needed.
The common symptoms in advanced tumours
A list of 33 of the most frequent symptoms experienced by patients with advanced tumours was compiled from a review of the literature [26, 27] and existing symptom assessment instruments. After interviews on symptom prevalence with 14 patients with advanced tumours and with three clinicians involved in the management of patients with advanced tumours from The Canberra Hospital, the list was reduced to 20 symptoms.
Assessing the initial 20-item symptom list
The 20-item symptom list was circulated to Medical Oncologists, Radiation Oncologists and Palliative Care Physicians around Australia who were invited to comment on the 20 symptoms included in the list and to rank the symptoms according to prevalence in patients with advanced tumours. Clinicians were identified by their membership of the special society for their subspecialty. Two versions of the symptom list were generated using different ordering and one of the versions was randomly attached to each invitation. Space was also made available for clinicians to add up to three additional symptoms that they believed should also be included. Of the 522 clinicians contacted, 202 (38.7%) responded, with 184 clinicians ranking all 20 symptoms. These responses were analysed and the number of symptoms included in the list was reduced further.
Assessing the revised symptom list in patients with advanced tumours
Between April and June 2001, the revised symptom list was assessed in 44 outpatients with advanced tumours attending the Medical Oncology Unit or the Department of Radiation Oncology, at the Canberra Hospital. The oncologists were given details of the study and enrolled eligible patients in a sequential fashion. Eligibility criteria required that patients were aged 18 years or older, had an advanced (incurable) tumour, and were receiving palliative treatment(s). In addition, patients were required to have an ECOG performance status of 0–3, adequate English language skills to complete the questionnaire, no serious concomitant medical or psychiatric condition, and to give written informed consent to participate. The majority of patients completed the questionnaire on their own, but assistance was available from the research staff, if required.
Demographic and Clinical Characteristics of Patients in the Study.
Outpatients, n = 44 (%)
Median age (range)
60 (39–81) years
English as first language
ECOG performance status 0–1
Primary Tumour Site
Non small cell lung cancer
Small cell lung cancer
Non Hodgkin's lymphoma
CNS (glioblastoma multiforme)
Patients' assessments were used to provide a comparison with the clinicians' prevalence ranking of symptoms, and to identify the preferred scale for assessing symptom severity (Table 3 – see additional file 2).
SPSS v10.0 was used to analysis the data. In addition to descriptive statistics, the analysis contained an examination of the prevalence of symptoms among the patients with advanced tumours, and a series of multivariate analyses to obtain a final set of symptoms for inclusion in the CSS. Multi-dimensional scaling was used to examine the relative (Euclidean) distances between symptoms, based on clinicians' prevalence rankings. Spearman's rho correlations were used to determine the relationship between the patients' and clinicians' symptom prevalence rankings.
Linear regression (ordinary least squares) analyses were used to determine the most appropriate scale for assessment of symptom severity (distress versus functional impairment). Composite measures of the two scales were constructed for all the symptoms to assess the explanatory power of each scale, using adjusted variance (R2) for the sample size. Data reduction analysis (principal component) was employed using the preferred scale to identify symptom clusters. Components required eigenvalues over 1 and were varimax rotated, to produce the best cluster fit. Stepwise ordinary least squares regression analyses were used to identify symptoms that were redundant within a cluster. Composite measures of the symptoms were constructed for the clusters to assess the explanatory power of each symptom, using adjusted R2s. Entry into the models was based on a probability 0.05, and a probability of 0.10 for removal.
The project was conducted in accordance with the declaration of Helsinki and was approved by the ACT Department of Health and Community Care Human Research Ethics Committee.
Common symptoms in advanced tumours: the initial list
A list of 20 of the most common symptoms in patients with advanced tumours was generated as described earlier. The symptoms included in this list were: Lack of energy, tiredness, lack of appetite, pain, constipation, nausea, dry mouth, depression, anxiety, difficulty sleeping, tenseness, vomiting, shortness of breath, lack of sexual interest, irritability, nervousness, heartburn, dizziness, sore muscles, and numbness or tingling of the hands or feet.
Prevalence rankings of symptoms by clinicians from around Australia
Clinicians' highest three frequencies of rankings for each symptom (percentage of clinicians giving the ranking in brackets1) and mean rank (SD).
1st Ranking (%)
2nd Ranking (%)
3rd Ranking (%)
Mean Rank (SD)
Lack of energy
Lack of appetite
Shortness of breath
Lack of sexual interest
Numbness or tingling of the hands or feet
A second dimension was evident in the clinicians' rankings (demonstrated in Figure 1 by the spread of symptoms along the vertical axis). Physical symptoms tended to be in the lower half of the graph while emotional symptoms tended to be in the upper half of the graph, suggesting that clinicians were not only focusing on symptom prevalence, but also the underlying cause (i.e. physical versus emotional).
Based on the analysis of prevalence rankings and comments received from clinicians, modifications were made to the initial 20-item symptom list. First, coughing and problems remembering things were added to the list. Second, we agreed with comments made by clinicians that the symptoms contained in the list should be predominantly tumour-related. Thus, we excluded anxiety, lack of sexual interest, nervousness and irritability, leaving a total of 18 symptoms. The exclusion of these four symptoms was not intended to indicate they were less important, but rather in acknowledgement that other assessment tools are available for these symptoms. Nevertheless, depression and tenseness were retained in the list to provide a guide to the prevalence of emotional symptoms.
Prevalence rankings of symptoms by patients at the canberra hospital
Percentage of patients that experienced each symptom and the favoured severity scale for each symptom, based on variance explained1 (N = 44).
% With symptom
Favoured severity scale
% Variance explained
Lack of energy
Problems remembering things
Shortness of breath
Lack of appetite
Weak or sore muscles
Numbness or tingling of the hands or feet
Severity assessment scales
In general, the results from the two severity assessment scales were highly correlated. However, problems remembering things, shortness of breath, and numbness or tingling of the hands or feet had relatively smaller correlations between the two scales (0.58, 0.55, and 0.57, respectively). The distress severity scale explained most of the variance for 14 of the 18 symptoms (Table 5), although the impairment of functioning scale was more important for heartburn, shortness of breath, weak or sore muscles and dry mouth. As the distress severity scale explained over 90% of the variance for the majority of symptoms, the impairment of functioning severity scale was discarded in favour of the distress severity scale.
Using the distress severity scale, four significant symptom clusters (components from the principal components analysis) were found. The four symptom clusters were described as predominantly gastrointestinal (GI) symptoms (but also including pain and cognitive function), neurological/emotional symptoms, tension, and respiratory symptoms. These four clusters accounted for 69% of the variance of the varimax rotated sums of squares loadings.
Selected results from stepwise ordinary least squares regressions showing the percentage of variance explained for each symptom associated with the cluster symptom measure1.
Cluster 1 GI/pain/cogn
Cluster 2 Neural/emot
Cluster 3 Tension
Cluster 4 Respiratory
Lack of appetite
Shortness of breath
Shortness of breath
Lack of energy
Problems remembering things
Symptom clusters and symptoms in the canberra symptom scorecard
4 Lack of appetite
6 Problems remembering things
8 Problems sleeping
9 Weak or sore muscles
10 Lack of energy
11 Shortness of breath
Using these 12 symptoms, we have devised a new 12-item symptom instrument ('The Canberra Symptom Scorecard') that incorporates a single distress severity scale. Included is space for patients to insert up to three additional symptoms not included in the instrument. The Canberra Symptom Scorecard is about to be assessed in centres in Australia and overseas in patients with advanced (incurable) tumours receiving palliative treatments. As part of this next step in the development of The Canberra Symptom Scorecard, it will be validated against selected existing instruments.
The findings of this study suggest that the initial 20-item symptom list provided a reasonable representation of the symptoms experienced by patients with advanced tumours (Table 2). However, the comments received from the clinicians yielded two additional symptoms (problems remembering things and coughing) that proved to be highly prevalent in the patients with incurable tumours surveyed (39% and 23% respectively). The other important suggestion provided by the clinicians was to focus on physical symptoms due to the tumour rather than emotional symptoms, since other instruments assess these better. Consequently, we reduced the list to 18 symptoms that focused predominantly on physical problems.
The high prevalence rates for all 18 symptoms in the 44 outpatients with incurable tumours surveyed further supported the coverage (Table 4). However, these high rates made it difficult to identify individual symptoms that could be eliminated from the list, as we had aimed to identify only those symptoms essential for routine measurement.
We were able to reduce the number of symptoms further, while maintaining good coverage, by exploring symptom clusters. Eleven symptoms were found to explain adequately the variation within the three clusters that covered the physical symptoms (Table 6). However, we added lack of appetite to the symptom list, making a final list of 12 symptoms. Our findings are consistent with those of Watson et al  who also identified similar broad clusters of physical symptoms in cancer patients, using a 30-item version of the RSCL. We believe that these three clusters (Table 7) encompass the most important symptoms in patients with advanced tumours.
Using this final list of 12 symptoms as a guide, we reassessed existing symptom assessment instruments and found that some did not address all the symptoms we recommend (e.g. ESAS, MDASI), while others covered too many symptoms, making them too lengthy for regular administration (e.g. ASDS, MQOL, MSAS, RSCL). For example, the core list of 13 symptoms of the MDASI  is limited in the assessment of neurological symptoms but contains a considerable number of symptoms related to emotional problems. In our opinion, the usefulness of assessing emotional (or psychological) symptoms this way is questionable. The CSS does not include assessment of emotional or psychological symptoms, as it concentrates on physical symptoms related to the tumour. If assessment of emotional symptoms is also required, we recommend that another suitable instrument be used.
In summary, despite a relatively large number of available symptom assessment instruments, little research has been undertaken to determine the adequate coverage of symptom clusters appropriate for patients with advanced tumours, and consequently the minimum list of symptoms needed to measure these clusters. In the present study, we undertook such an investigation that yielded three important symptom clusters and their associated symptoms. Comparing our final list and existing symptom lists, we found major symptoms were missing from shorter lists most likely to be considered for routine measurement in clinical practice. As a result, we recommend that modifications need to be made to existing instruments to address these limitations, and that further consideration be given to issues around the measurement of physical symptoms and psychological symptoms.
Based on our findings, we have identified a brief set of symptoms covering the common physical symptoms experienced by outpatients with advanced tumours. From this we have developed a symptom assessment instrument called 'The Canberra Symptom Scorecard' (CSS) that comprehensively covers the important and common symptoms associated with advanced (incurable) tumours. We believe that this instrument should help clinicians to monitor these symptoms in outpatients undergoing palliative treatment(s), such as palliative chemotherapy, palliative radiotherapy or symptomatic treatments. It is about to be assessed in patients with advanced tumours receiving palliative treatments in centres in Australia and overseas, and, as part of this assessment, it will be validated against existing instruments. We believe that this investigation should establish the validity and usefulness of the CSS in patients with advanced tumours receiving palliative treatments aimed at improving patients' symptoms.
We reviewed existing symptom assessment instruments and found a number of deficiencies such as existing instruments being too long or burdensome, too short, or measuring quality of life, rather than tumour-related physical symptoms. Others sacrificed important physical symptoms for emotional symptoms that may be assessed better using psychological instruments. Therefore, we devised a new symptom instrument ("The Canberra Symptom Scorecard", (CSS)). This is a short 12-item symptom questionnaire that focuses on the physical symptoms important in patients with advanced tumours. It appears suitable for outpatients with advanced (incurable) tumours receiving palliative treatments and is about to be assessed in such patients, both in Australia and overseas when it will also be validated against existing instruments.
We would like to thank The Canberra Hospital Private Practice Fund for providing a research grant that supported this investigation. We would also like to thank all the clinicians and patients who participated in the study and those clinicians who referred patients into the study.
- Bruera E, Kuehn N, Miller MJ, Selmser P, Macmillan K: The Edmonton symptom assessment system (ESAS): a simple method for the assessment of palliative care patients. J Palliat Care. 1991, 7: 6-9.PubMedGoogle Scholar
- Hollen PJ, Gralla RJ, Kris MG, Potanovich LM: Quality of life assessment in individuals with lung cancer: testing the lung cancer symptom scale (LCSS). Eur J Cancer. 1993, 29A (Suppl 1): S51-S58.View ArticlePubMedGoogle Scholar
- Holmes S: Use of a modified symptom distress scale in assessment of the cancer patient. Int J Nurs Stud. 1989, 26: 69-79.View ArticlePubMedGoogle Scholar
- McCorkle R, Young K: Development of a symptom distress scale. Cancer Nurs. 1978, 1: 373-378.View ArticlePubMedGoogle Scholar
- McCorkle R, Quint-Benoliel J: Symptom distress, current concerns and mood disturbance after diagnosis of life-threatening disease. Soc Sci Med. 1983, 17: 431-438. 10.1016/0277-9536(83)90348-9.View ArticlePubMedGoogle Scholar
- Rhodes VA, Watson PM, Johnson MH: Development of reliable and valid measures of nausea and vomiting. Cancer Nurs. 1984, 7: 33-41.View ArticlePubMedGoogle Scholar
- Cella DF, Tulsky DS, Gray G, Sarafian B, Linn E, Bonomi A, Silberman M, Yellen SB, Winicour P, Brannon J: The functional assessment of cancer therapy scale: development and validation of the general measure. J Clin Oncol. 1993, 11: 570-579.PubMedGoogle Scholar
- Higginson IJ, McCarthy M: Validity of the support team assessment schedule: do staffs' ratings reflect those made by patients or their families?. Palliat Med. 1993, 7: 219-228.View ArticlePubMedGoogle Scholar
- Higginson IJ, McCarthy M: A comparison of two measures of quality of life: their sensitivity and validity for patients with advanced cancer. Palliat Med. 1994, 8: 282-290.View ArticlePubMedGoogle Scholar
- Lo RS, Ding A, Chung TK, Woo J: Prospective study of symptom control in 133 cases of palliative care inpatients in Shatin hospital. Palliat Med. 1999, 13: 335-340. 10.1191/026921699677451150.View ArticlePubMedGoogle Scholar
- Cohen SR, Mount BM, Strobel MG, Bui F: The McGill quality of life questionnaire: a measure of quality of life appropriate for people with advanced disease. A preliminary study of validity and acceptability. Palliat Med. 1995, 9: 207-219.View ArticlePubMedGoogle Scholar
- Portenoy RK, Thaler HT, Kornblith AB, Lepore JM, Friedlander-Klar H, Kiyasu E, Sobel K, Coyle N, Kemeny N, Norton L, et al: The Memorial symptom assessment scale: an instrument for the evaluation of symptom prevalence, characteristics and distress. Eur J Cancer. 1994, 30A: 1326-1336.View ArticlePubMedGoogle Scholar
- Cleeland CS, Mendoza TR, Wang XS, Chou C, Harle MT, Morrissey M, Engstrom MC: Assessing symptom distress in cancer patients: the M.D. Anderson symptom inventory. Cancer. 2000, 89: 1634-1646. 10.1002/1097-0142(20001001)89:7<1634::AID-CNCR29>3.0.CO;2-V.View ArticlePubMedGoogle Scholar
- De Haes JC, van Knippenberg FC, Neijt JP: Measuring psychological and physical distress in cancer patients: structure and application of the Rotterdam Symptom Checklist. Br J Cancer. 1990, 62: 1034-1038.View ArticlePubMedPubMed CentralGoogle Scholar
- Richards MA, Ramirez AJ: Quality of life: the main outcome measure of palliative care. Palliat Med. 1997, 11: 89-92.View ArticlePubMedGoogle Scholar
- Kramer JA, Curran D, Piccart M, de Haes JC, Bruning P, Klijn J, Van Hoorebeeck I, Paridaens R: Identification and interpretation of clinical and quality of life prognostic factors for survival and response to treatment in first-line chemotherapy in advanced breast cancer. Eur J Cancer. 2000, 36: 1498-1506. 10.1016/S0959-8049(00)00144-1.View ArticlePubMedGoogle Scholar
- Kramer JA, Curran D, Piccart M, de Haes JC, Bruning PF, Klijn JG, Bontenbal M, van Pottelsberghe C, Groenvold M, Paridaens R: Randomised trial of paclitaxel versus doxorubicin as first-line chemotherapy for advanced breast cancer: quality of life evaluation using the EORTC QLQ-C30 and the Rotterdam symptom checklist. Eur J Cancer. 2000, 36: 1488-1497. 10.1016/S0959-8049(00)00134-9.View ArticlePubMedGoogle Scholar
- Hardy JR, Edmonds P, Turner R, Rees E, A'Hern R: The use of the Rotterdam symptom checklist in palliative care. J Pain Symptom Manage. 1999, 18: 79-84. 10.1016/S0885-3924(99)00050-0.View ArticlePubMedGoogle Scholar
- Lee WR, McQuellon RP, McCullough DL: A prospective analysis of patient-reported quality of life after prostate brachytherapy. Semin Urol Oncol. 2000, 18 (2): 145-151.Google Scholar
- Kearsley JH, Schonfeld C, Sheehan M: Quality-of-life assessment during palliative radiotherapy. Australas Radiol. 1998, 42: 354-359.View ArticlePubMedGoogle Scholar
- Rees E, Hardy J, Ling J, Broadley K, A'Hern R: The use of the Edmonton symptom assessment scale (ESAS) within a palliative care unit in the U.K. Palliat Med. 1998, 12: 75-82. 10.1191/026921698674135173.View ArticlePubMedGoogle Scholar
- Pratheepawanit N, Salek MS, Finlay IG: The applicability of quality-of-life assessment in palliative care: comparing two quality-of-life measures. Palliat Med. 1999, 13: 325-334. 10.1191/026921699670560921.View ArticlePubMedGoogle Scholar
- Bruera E, Neumann C, Brenneis C, Quan H: Frequency of symptom distress and poor prognostic indicators in palliative cancer patients admitted to a tertiary palliative care unit, hospices, and acute care hospitals. J Palliat Care. 2000, 16: 16-21.PubMedGoogle Scholar
- Rathbone GV, Horsley S, Goacher J: A self-evaluated assessment suitable for seriously ill hospice patients. Palliat Med. 1994, 8: 29-34.View ArticlePubMedGoogle Scholar
- Cohen SR, Mount BM, Bruera E, Provost M, Rowe J, Tong K: Validity of the McGill quality of life questionnaire in the palliative care setting: a multi-centre Canadian study demonstrating the importance of the existential domain. Palliat Med. 1997, 11: 3-20. 10.1046/j.1365-2036.11.s1.2.x.View ArticlePubMedGoogle Scholar
- Donnelly S, Walsh D: The symptoms of advanced cancer. Semin Oncol. 1995, 22 (2 Suppl 3): 67-72.PubMedGoogle Scholar
- Walsh D, Donnelly S, Rybicki L: The symptoms of advanced cancer: relationship to age, gender, and performance status in 1,000 patients. Support Care Cancer. 2000, 8: 175-179. 10.1007/s005200050281.View ArticlePubMedGoogle Scholar
- Carroll BT, Kathol RG, Noyes R Jr, Wald TG, Clamon GH: Screening for depression and anxiety in cancer patients using the hospital anxiety and depression scale. Gen Hosp Psychiatry. 1993, 15: 69-74.View ArticlePubMedGoogle Scholar
- Watson M, Law GP, Maguire B, Robertson B, Greer S, Bliss M, Ibbotson T: Further development of a quality of life measure for cancer patients: the Rotterdam symptom checklist (revised). Psychooncology. 1992, 1: 35-44.View ArticleGoogle Scholar
- Morita T, Tsunoda J, Inoue S, Chihara S, Ishimoto O, Hisaoka N, Itoh M: Prediction of survival of terminally ill cancer patients – a prospective study. Gan to Kagaku Ryoho. 1998, 25: 1203-1211.PubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2407/3/32/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.