Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Validation of the flemish CARES, a quality of life and needs assessment tool for cancer care

BMC Cancer volume 16, Article number: 696 (2016) Cite this article

Abstract

Background

The Cancer Rehabilitation Evaluation System (CARES) is a quality of life (QOL) and needs assessment instrument of US origin that was developed in the 90’s. Since November 2012 the copyright and user fee were abolished and the instrument became publicly available the present study aims to reinvestigate the psychometric properties of the CARES for the Flemish population in Belgium.

Methods

The CARES was translated into Flemish following a translation-back translation process. A sample of 192 cancer patients completed the CARES, concurrent measures, and questions on socio-demographic and medical data. Participants were asked to complete the CARES a second time 1 week later, followed by some questions on their experiences with the instrument. Internal consistency, test-retest reliability, content validity, construct validity, concurrent validity and feasibility of the CARES were subsequently assessed.

Results

The Flemish CARES version demonstrated excellent reliability with high internal consistency (range .87–.96) and test-retest ratings (range .70–.91) for all summary scales. Factor analysis replicated the original factor solution of five higher order factors with factor loadings of .325–.851. Correlations with other instruments ranging from |.43|–|.75| confirmed concurrent validity. Feasibility was indicated by the low number of missing items (mean 2.3; SD 5.0) and positive feedback of participants on the instrument.

Conclusions

The Flemish CARES has strong psychometric properties and can as such be a valid tool to assess cancer patients’ QOL and needs in research, for example in international comparisons. The positive feedback of participants on the CARES support the usefulness of this tool for systematic assessment of cancer patients’ well-being and care needs in clinical practice.

Trial registration

ClinicalTrials.gov: NCT02282696 (July 16, 2014).

Peer Review reports

Background

Cancer is a disease with a huge impact on patients and their relatives, going far beyond the physical aspects. Together with the rise of more successful therapeutic approaches and the increased life expectancy, the psychological and social aspects of care receive more attention as part of a holistic view of health care. Health care, and certainly cancer care, therefore requires a more integrated approach as a response to the fragmented delivery of health and social services [1]. Together with more integration, health is moving towards a more patient-centered approach. This is a process evolution as patient-centered care is an important dimension of quality of care [2]. Individualized, more integrated care plans and clinical care pathways are developed to improve outcomes for cancer patients, with an increasing emphasis on quality of life (QOL) [3].

To integrate the psychosocial approach into cancer care, the implementation of routine psychosocial screening and needs assessment is recommended by international cancer systems and in guidelines [4–9]. However, not all patients with a positive screen for distress or decreased QOL are interested in professional support [10]. In some cases programs involving systematic or routine screening for distress lead to a considerable number of unaccepted referrals [11, 12]. In contrast to QOL or distress screening, needs assessment not only focuses on identifying patients’ unresolved concerns and problems, but furthermore explores whether or not there is a desire extra help [13]. This not only gives guidance from the patients’ perspective for more integrated and holistic care plans, but also allows for the more effective and efficient use of resources. [10].

The Cancer Rehabilitation Evaluation System (CARES) is a self-administered QOL and needs assessment instrument that can be used for research or clinical purposes [14–20]. The instrument covers a broad range of topics relevant to the QOL disruption many cancer patients experience. The CARES consists of 139 items meant to reflect the multidimensional burden of cancer and its treatment can cause to patients and their relatives. The items can be scored broadly using the six summary scales medical interaction, physical, psychosocial, marital and sexual wellbeing and miscellaneous items; or in a more detailed manner grouped under 31 subscales. However, not all items apply to all patients and therefore patients can complete a minimum of 93 items or a maximum of 132 items. Patients can rate each item, formulated as problem statement, on a five-point scale, zero representing “not at all” (no problem) and four representing “very much” (severe problem). For every applicable problem statement patients are asked to answer the question “Do you want help?” by ticking the box ‘yes’ or ‘no’.

The psychometric robustness of the CARES and its’ earlier development versions called the Cancer Inventory of Problem Situations (CIPS) are well documented and positively evaluated [17, 18]. With high Crohnbachs alpha’s (α = 0.87–0.94) and high test-retest correlations (r = 0.84–0.95) for the summary scales and CARES total the instrument demonstrates excellent reliability. The validity of the CARES was also rigorously tested. Results from post-administration interviews supported the content validity of the instrument [18, 21]. An extensive evaluation of concurrent validity was conducted with the Symptom Checklist-90 (SCL-90) [22], Dyadic Adjustment Scale (DAS) [23], Karnofsky Performance status Scale (KPS) [24, 25] and a visual analogue scale [26] for QOL before and after cancer, resulting in moderate to high correlations. In two studies investigating the feasibility of the CARES for patients, the participants on average needed 18 to 20 min to complete the CARES. The majority of them thought the questionnaire reflected relevant day-to-day problems of cancer patients; they understood the instructions well and found questions easy to understand and not offensive [18]. Despite this good quality the widespread use of the CARES and it’s short form was limited by copyright and a user fee that the developers chose to impose. Since November 2012 this is no longer the case [27].

Due to the combination of feasibility for patients, psychometrical robustness and the wide representation of life domains that can be disrupted by a cancer diagnosis and the side effects associated with treatment, the CARES was chosen for further research on QOL and care needs in Belgium. However, time perspective, culture and language are important for the ecological dimension and validity of an instrument [28]. Careful translation and validation of an instrument are extremely important for the data to be valid [29, 30]. Consequently, a validation study on the CARES was conducted in the Flemish-speaking part of Belgium. The thorough validation-exercise is described in this article.

Methods

The protocol of this study, including a priori hypotheses and criteria, is described in detail in a previous publication [31]. The procedures used the general principles of scale development according to classical test theory.

Participants

There are no general criteria for the sample size in a validation study, but a sample size of at least 50–100 is generally recommended [32]. Sample sizes in the validation research of the original CARES varied for each psychometric quality from 22 to 1047 [18]. In this validation study of the CARES, the objective was set to include at least 150 participants.

A heterogeneous sample of cancer patients was recruited in several departments of four Flemish hospitals from March 2014 to February 2015. Non-palliative cancer patients aged between 25 and 60 years with a primary diagnosis of Stage I, II or III cancer [33], were included. The age restriction was chosen in the belief that these adult cancer patients have a psychosocial context which is clearly different from that of younger and older patients by means of significant relationships with children, partners, parents and the work context. There were no exclusion criteria with regards to sex, performance status or topology of the cancer. Patients were excluded from the sample if they lacked basic proficiency in Dutch, had cognitive problems or a history of major neurological disease.. Patients signed an informed consent form before participation.

Questionnaires

Participants had to complete two questionnaire bundles, within an interval of 1 week.

Data collected with the first questionnaire bundle included socio-demographic characteristics, medical characteristics, the CARES and seven concurrent instruments to assess concurrent validity.

Flemish CARES version

The Flemish CARES version was produced through a forward-backward translation process with two sworn translators and an expert group.

In the ongoing study missing response categories for items 18 and 80 in the CARES were noticed, causing structural (non-random) missing answers (55.7 % of the analyzed questionnaires). A second and corrected version was printed and replaced the first (44.3 % of the analyzed questionnaires). To avoid possible bias, items 18 and 80 were excluded from analysis.

Karnofsky Performance status Scale (KPS) [24, 25, 34]: The KPS is an 11-point scale to evaluate the physical and daily functioning of a patient, ranging from 0 (completely dependent, not able to care for oneself) to 100 (fully active, not dependent and capable of normal activity without limitations).

Hospital Anxiety and Depression Scale (HADS) [35, 36]: The HADS was developed to identify symptoms of anxiety and depression in medically ill patients. The questionnaire contains 14 items with four response categories, ranging from 0–3. Higher scores on the two subscales (each consisting of 7 items) indicate a higher level of anxiety or depression and the total score of the HADS (score-ranges from 0–42) can be used as a global measure of psychological distress [37].

Social Support List-Interactions and Discrepancies (SSL-I and-D) [38–40]: The SSL is a questionnaire with 75 items, 41 on experienced social interaction and 34 on experienced social discrepancies. In the first part of the questionnaire participants indicate how frequently certain social interactions occur on a 4-point Likert scale from 1 (‘seldom or never’) to 4 (‘very often’), with higher scores representing higher levels of social support. A second part of the SLL indicates the social discrepancies participants experience ranging from 1 (‘I would like it to happen more often’) to 4 (‘it happens too often’). Higher scores on the SSL-D indicate a greater lack of social support.

Maudsley Marital Questionnaire (MMQ) [41–43]: The MMQ contains three scales exploring Marital (10 items), Sexual (five items) and General Life (five items) adjustment. The items of the MMQ are scored on a 9-point Likert scale (ranging from 0 to 8). The wording of response categories differs for each item depending on the nature of the question.

European Organisation of Research and Treatment for Cancer Quality of Life Questionnaire Core 30 (EORTC-QLQ-C30) [44]: The EORTC QLQ-C30 is a cancer-targeted quality of life instrument, incorporating five functional scales (physical, role, cognitive, emotional and social) and three symptom scales (fatigue, pain and nausea, and vomiting). Items are scored on a 4-point Likert scale from 1 (‘not at all’) to 4 (‘very much’). The last two items on global health and quality-of-life have an 8-point Likert scale, ranging from 1 (‘very poor’) to 7 (‘excellent’).

Distress Thermometer (DT) together with a Problem List (PL) [45–47]: Patients are asked to rate their overall distress on a visual analogue scale (presented as a thermometer) from 0 (‘no distress’) to 10 (‘extreme distress’). The DT is accompanied by a Problem List, which includes 35 items that address 5 life domains (practical, family/social, emotional, spiritual, and physical problems). Participants indicate if the stated problems apply to them. At the end of the survey participants are asked if they want to talk to a professional about their problems.

Care Needs Questionnaire [48]: The Care Needs Questionnaire was developed by Pauwels and Van Hoof to assess the care needs of cancer patients regarding specific themes during reintegration: physical functioning, psychological functioning, self and body image, sexuality, relationship with partner, relationship with others and work and social security related aspects. For each theme, participants are asked whether they wish to receive information or support, how they prefer to receive information and support, and to what extent this need already has been met. Each of the questions are answered on a 3-and 4-point Likert scale with different wording.

The second questionnaire bundle, filled in a week after the first one, contained the CARES and supplementary questions on patients’ experiences with the CARES in relation to the importance and breadth of issues assessed, length of time to complete, and format of survey administration.

Study procedure

Eligible patients were selected by the medical team according to the inclusion and exclusion criteria [49]. On the basis of team organization and time availability, two alternative procedures to invite patients to participate in the study were used (Fig. 1).

Fig. 1
figure 1

Study procedure

Full size image

In the ‘face-to-face procedure’, a member of the medical team explained the study briefly and invited the patient to participate. If the patient agreed, he/she immediately received a study package with the informed consent form, a ‘what to do’-scheme, the first questionnaire bundle and a stamped and addressed envelope to return the questionnaire.

In the ‘post procedure’, eligible patients got sent an identical study package by post, plus a letter explaining the study. One week later participants had to complete the second questionnaire bundle and send it back in another stamped and addressed envelope provided.

If the questionnaire was not sent back, the participants recruited via the face-to-face procedures were contacted by a team member. Participants invited through the post procedure were sent a reminder and second questionnaire package after 1 month. The researcher contacted participants by phone or by e-mail when returned questionnaires had a large number of missing responses or if the second questionnaire was not received in the expected timeframe. Since ethical standards limit the number of participant contacts, there was a maximum of two attempts to contact a participant.

Data analysis

The Statistical Package for Social Sciences (SPSS; Chicago, IL) version 22.0 was used for statistical analyses of the data.

Descriptive statistics were used to analyze socio-demographic and medical data, as well as the data gathered with the supplementary questions from the second questionnaire bundle.

The reliability of the CARES was explored by the internal consistency of summary scales, with the aim to find a Cohen’s Alpha of at least .70 [50, 51]. Test-retest reliability was investigated by computing Spearman’s rho correlations between the summary scale scores and total-CARES scores of the first and second CARES administration, requiring a correlation ≥ .70 [50, 52].

Principal component analysis (PCA) and inter correlations of summary scales were computed to evaluate construct validity. Due to the complexity of the CARES, number of items and items only applicable for a subgroup of the sample, one general factor analysis on all the individual items was not possible in this small sample. PCA with varimax rotation was used in two subsequent analyses to assess the underlying factor pattern of the Flemish CARES. A first PCA was carried out on the individual items of the five summary scales to explore the CARES subscales. A higher order (second-order) factor analysis on the 26 subscales was conducted to explore the five summary scales. As in previous CARES-research items and subscales with a factor loading higher than .30 were seen as loading on a factor [17, 18].

Spearman’s rho correlations were computed to evaluate concurrent validity of the CARES global score and the summary scales with the seven concurrent instruments. Correlations were judged low, moderate and high, when their absolute values were respectively < .30, from .30–.50 and ≥ .50 [53].

Results

Sample characteristics

With 197 of the 325 invited patients returning completed questionnaires the response rate was 61 %. Of these, 85 % (168/197) of the respondents returned both the first and second questionnaire. After exclusion of participants due to incorrect recruitment according to the age (n = 4) and language-criterion (n = 1), a large number of uncompleted questions (n = 2), a missing first questionnaire (n = 2), anonymous returned questionnaire (n = 1) or return outside the time interval of data inclusion (n = 11); data of 176 eligible patients (54 % of the invited patients) was available for analysis.

The mean age of participants was 50.5 years (range 30–60); 30.7 % were men and the vast majority were in a significant relationship (86.9 %) and had children (median: 2, range: 1–4). These and further socio-demographic characteristics are displayed in Table 1.

Table 1 Socio-demographic and medical characteristics participants and non-responders
Full size table

The sample was characterized by a wide variation in cancer diagnoses: respectively, breast (55.7 %), colorectal (11.9 %), prostate (6.3 %), head-neck (4 %), testes (2.8 %), lung (1.7 %), malign melanoma (1.7 %), brain (1.7 %), esophagus (1.7 %), liver-gall-bladder (1.1 %), cervix (1.1 %), uterus body (1.1 %), ovarian (1.1 %), kidney (1.1 %), bladder (0.6 %), thyroid (0.6 %), stomach (0.6 %) and bone cancer (0.6 %). Further medical data are shown in Table 1.

Age, type and date of diagnosis and treatment (s) of non-participants were collected anonymously to explore the representativeness of the research sample (Table 1). As compared with participants, the group of non-responders was heterogeneous with respect to cancer diagnosis: within 16 different types of diagnoses, the four most common were: breast (34.4 %), colorectal (12.3 %), malign melanoma (9.8 %) and prostate cancer (5.7 %).

Feasibility

CARES item characteristics

The mean number of missing answers on the QOL-items in participants’ CARES completion was 2.3 (SD 5.0). Telephone follow-up with participants revealed that missing answers were mainly due to the accidental skipping of items or participants’ not deeming an item (s) to be applicable to them. Examples of reasons given are as follows: “I am a widow and I don’t have sex anymore, so I didn’t answer on the statement ‘I do not feel sexually attractive’”; “I don’t own a car so I couldn’t answer the question on having difficulty with driving”; “I couldn’t answer the question ‘I have difficulty preparing meals’, because my wife is the one that cooks at home, I never do”. Outliers of 66 and 58 missing answers are found on item 18 and 80. This was due to missing response categories in the first printed version of the questionnaire.

The mean number of missing answers on the Help-items of the CARES was 12.4 (SD 21.5)-considerably higher than the number of missing values on corresponding QOL-items. Participants answered the Help-questions by marking the response categories in three different ways: by marking each ‘yes’ or ‘no’ for each Help-question individually; by circling the words ‘yes’ or ‘no’ on the top of the column; or by circling the whole column of yes-or no-responses on the page. Only 49 participants (27.8 %) had no missing answers on the help-items (93–132 items). Both concurrent needs assessment measures had a lower number of missing values. For the one single help-question joining the DT and PL only four participants (2.3 %) did not complete the help-question. For the Care Needs Questionnaire only four to 10 participants (2.3–5.7 %) did not complete the life domain specific help-question.

Patients’ experiences in completing the CARES

On average participants needed 31 min (SD = 24.209) to complete the CARES. Ninety percent felt this to be acceptable, 10 % thought this was too long and too time consuming. Participants in this study had to complete the CARES on paper. Seventy-three percent preferred this option while 21 % would have preferred an electronic version. The reasons mentioned for preferring paper were as follows: easier for concentration; limited burden on the eyes; the ability to fill in anywhere; the lack of familiarity with the computer. On the other hand, reasons for preferring an electronic version for the computer or tablet included environmental concerns, the completion time of a screening and easier processing of results.

Reliability

Internal consistency and test-retest reliability

To explore the reliability of the CARES total, sub- and summary scales, alpha coefficients were calculated (Table 2). The mean for all subscales was .79 (range .21–.94). For the five summary scales of the CARES the mean of alpha coefficients was .92 (range.87–.96).

Table 2 Reliability ratings and factor pattern for the flemish CARES (N = 176)
Full size table

The average timespan between the first and second CARES completion of participants was 12.62 days (SD 9.3). Spearman’s rho correlations between the two completions were computed to explore test-retest reliability. For all subscales high correlations were found ranging from .53 to .89 with an average of .76. Test-retest correlations for the five summary scales were all high, with an average of .85 (Table 2). The CARES total scores had a high correlation of .92. These reliability ratings demonstrate an excellent test-retest reliability of the Flemish CARES.

Validity

Content validity

The majority of participants rated all life domains addressed in the CARES to be important to very important in a QOL and needs assessment tool (Table 3). Most of them (90 %) evaluated the content of the CARES to be complete. The three main areas where deficiencies were cited were the feeling of loneliness in the disease experience, financial concerns due to the disease and treatment and the lack of questions addressing the coping of patients’ loved ones.

Table 3 Participants’ evaluation of the content of the CARES (N = 159)
Full size table

Concurrent validity

Spearman rho correlations for CARES total, summary scores and convergent measures were in the expected directions (Additional file 1). The KPS and CARES physical scale have a large negative correlation (r = -.67). HADS scores and the CARES psychosocial scale are strongly positive related (r = .75 and r = .64). From the SSL only the D-subscale had a significant moderate correlation with the Psychosocial CARES summary scale (r = .43). The Marital and Sexual CARES summary scales are moderate to strongly positive related to the MMQ-M (r = .48) respectively MMQ-S (r = .55). Also the large correlations of the CARES Total score with the EORTC-QLQ-C30 (r =−.56 and r =−.53) and DT (r = .63) confirm the concurrent validity of the CARES.

Construct validity

There are intercorrelations of .32–.60 between CARES summary scales, indicating that these measure related but different dimensions of concerns and care needs. The summary scales all have a high correlation with the CARES Total, indicating an important role in the quality of life disruption measured by the CARES (Additional file 1).

To ensure that the data were suitable for factor analysis standard diagnostic tests were run each time. Both the Kaiser-Meyer-Olkin (KMO) test of sampling adequacy criterion (KMO ≥ .6) and Bartlett’s test of sphericity criterion (p < .05) were fulfilled and indicated factorability of the data.

Firstly, the CARES subscales were explored. For the items of the physical summary scale six factors were found. Medical interaction-items loaded on three factors, psychosocial-items on nine, marital-items on four and the items of the sexual summary scale on two factors (Additional file 2).

Secondly, the summary scales were explored. Based on Kaiser’s criterion (eigenvalue ≥1) seven factors were distinguished with the PCA, explaining a total of 65.5 % of the variance. However, based on Catell’s scree test, only the first five factors should be retained to get a good fitted model of factors explaining the variance in our data set. Subsequently a PCA with varimax rotation and fixed number of five factors was conducted resulting in the factor solution visualized in Table 2. The resulting factor solution approximately corresponds to the subdivision of the CARES in the five summary scales: physical, interaction with the medical team, marital, psychosocial and sexual.

Discussion

This study explored the validity of the Flemish CARES version, resulting in a positive evaluation of the instrument.

The small number of missing answers on CARES’ QOL-items indicates that the items were clear to the vast majority of participants, which supports the feasibility of the instrument for wider application or use among Flemish cancer patients. Participants also reported positive experiences with the content and completion time of the CARES. The number of missing answers on the Help-items of the CARES is relatively higher. The question is raised whether if it is relevant to have a help-question for each QOL-item. Possibly circling requires a great effort of participants, resulting in a larger number of missing answers, while domain specific help-questions could be sufficient to reveal patients supportive care needs. The smaller number of missing answers on the concurrent needs assessment instruments, may indicate that a simplified help-questioning could be more feasible. For example the 93–132 help-items could be reduced to several life domain specific help-questions presented each time after a group of QOL-items. Although this aspect could use some improvement, the majority of the participants are in favor of the use of a QOL and needs assessment tool like the CARES in clinical practice.

The CARES provides a total score and five domain specific scores, which all demonstrated high reliability. The two subscales with low alpha coefficients ‘Overprotection by Partner’ (α = .56) and ‘Neglect of care by partner’ (α = .21) are scales with only two items. Having fewer items in a scale is known to have a lowering effect on the alpha coefficient. These reliability ratings correspond to those of the original CARES.

The results of the PCA confirm the existence of five distinguishable components of QOL measured with the Flemish CARES, similar to the physical, medical interaction, relational, psychosocial and sexual summary scale of the original instrument. However, some subscales have double loadings. PCA should be reproduced as soon as a larger research sample is available.

Concurrent validity of the CARES and its’ summary scales with several instruments was confirmed with moderate to high correlations. This implies that the CARES could be used to obtain a comprehensive summary of patients’ overall QOL and care needs from their own perspective instead of having to combine several other patient reported outcome tools.

Limitations of this study should be noted. Rules-of-thumb for the number of subjects included in factor analysis vary from four to 10 subjects per item of the questionnaire [32]. With 176 participants our research sample is rather limited. However, the factor pattern of the original instrument was already known and even with our relatively small number of participants the original factor solution could be replicated. The CARES was developed for cancer patients in general, though the representativeness of our sample could be questioned. To pursue representativeness, recruitment was performed in several departments of the participating hospitals. This resulted in a heterogeneous sample of 25–60 years aged cancer patients, with breast, colorectal, prostate and head-neck cancer as most common cancer types. This matches the national statistics [54], and characteristics of our group of non-responders. Non-responders seem to have undergone less invasive treatment (Table 1). However, there is a lack of further information, for example on ‘time since diagnosis’, to make a detailed comparison. The selection of patients aged between 25–60 years to capture the adult population of cancer patients, was an inherent limitation as it limited the generalizability of results since approximately three-quarters of cancers are diagnosed in people aged over 60 years. The utility and validity of the Flemish CARES should further be explored in patients aged older than 60 years, before the instrument is implemented in clinical practice.

While this study demonstrates rigor of the Flemish CARES version across key psychometric properties, we must acknowledge that other indices were not explored, e.g. known groups comparison, predictive validity, responsiveness. Consequently, future studies that focus on these aspects could strengthen the evidence of the validity of the Flemish CARES version.

Conclusions

This study confirms the Flemish CARES version to be a comprehensive and feasible QOL and needs assessment instrument with good psychometric properties. Consequently, the Flemish CARES can be used in further research to assess QOL and care needs. Further translational research studies are needed to explore how the use of such a tool can be implemented efficiently in clinical practice to contribute to quality patient-centered care.

Abbreviations

CARES:

Cancer rehabilitation evaluation system

CEBAM:

Belgian center for evidence-based medicine

CIPS:

Cancer inventory of problem situations

DAS:

Dyadic adjustment scale

DT:

Distress thermometer

EORTC-QLQ-C30:

European organisation of research and treatment for cancer quality of life questionnaire core 30

HADS:

Hospital anxiety and depression scale

KMO:

Kaiser-meyer-olkin

KPS:

Karnofsky performance status scale

M:

Mean

MMQ-M:

Maudsley marital questionnaire

PCA:

Principal component analysis

QOL:

Quality of life

SD:

Standard deviation

References

  1. Kodner DL, Spreeuwenberg C. Integrated care: meaning, logic, applications, and implications--a discussion paper. Int J Integr Care. 2002;2:1568–4156.

    Article  Google Scholar 

  2. Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington: National Academy Press; 2001.

    Google Scholar 

  3. Warrington L, Absolom K, Velikova G. Integrated care pathways for cancer survivors-a role for patient-reported outcome measures and health informatics. Acta Oncol. 2015;54:1–9.

    Article  Google Scholar 

  4. Accreditation Canada. Omentum program 2009 standards: cancer care and oncology services (ver 2). Ottawa: Accreditation Canada; 2008.

    Google Scholar 

  5. Breitbart W, Rosenfeld B, Pessin H, Applebaum A, Kulikowski J, Lichtenthal WG. Meaning-centered group psychotherapy: an effective intervention for improving psychological well-being in patients with advanced cancer. J Clin Oncol. 2015;33(7):749–54.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Holland J, Watson M, Dunn J. The IPOS new International Standard of Quality Cancer Care: integrating the psychosocial domain into routine care. Psychooncology. 2011;20(7):677–80.

    Article  PubMed  Google Scholar 

  7. Meyer LA, Nick AM, Shi Q, Wang XS, Williams L, Brock T, Iniesta MD, Rangel K, Lu KH, Ramirez PT. Perioperative trajectory of patient reported symptoms: a pilot study in gynecologic oncology patients. Gynecol Oncol. 2015;136(3):440–5.

    Article  PubMed  PubMed Central  Google Scholar 

  8. National Comprenhensive Cancer Network: Distress management (v.1.2008) [http://www.nccn.org/professionals/physician_gls/f_guidelines.asp]. Accessed Aug 2013.

  9. Institute of Medicine. Cancer Care for the Whole Patient: Meeting Psychosocial Health Needs. Washington, DC: The National Academies Press; 2008. doi:10.17226/11993.

  10. Merckaert I, Libert Y, Messin S, Milani M, Slachmuylder JL, Razavi D. Cancer patients’ desire for psychological support: prevalence and implications for screening patients’ psychological needs. Psychooncology. 2010;19(2):141–9.

    Article  PubMed  Google Scholar 

  11. Carlson LE, Groff SL, Maciejewski O, Bultz BD. Screening for distress in lung and breast cancer outpatients: a randomized controlled trial. J Clin Oncol. 2010;28(33):4884–91.

    Article  PubMed  Google Scholar 

  12. Bauwens S, Baillon C, Distelmans W, Theuns P. Systematic screening for distress in oncology practice using the Distress Barometer: the impact on referrals to psychosocial care. Psychooncology. 2014;23(7):8004–844.

    Article  Google Scholar 

  13. Sanson-Fisher R, Girgis A, Boyes A, Bonevski B, Burton L, Cook P. The unmet supportive care needs of patients with cancer. Supportive Care Review Group. Cancer. 2000;88(1):226–37.

    Article  CAS  PubMed  Google Scholar 

  14. Ganz PA, Schag CC, Heinrich RL. The psychosocial impact of cancer on the elderly: a comparison with younger patients. J Am Geriatr Soc. 1985;33(6):429–35.

    Article  CAS  PubMed  Google Scholar 

  15. Ganz PA, Schag CA, Cheng HL. Assessing the quality of life--a study in newly-diagnosed breast cancer patients. J Clin Epidemiol. 1990;43(1):75–86.

    Article  CAS  PubMed  Google Scholar 

  16. Heinrich RL, Schag CC, Ganz PA. Living with cancer: the cancer inventory of problem situations. J Clin Psychol. 1984;40(4):972–80.

    Article  CAS  PubMed  Google Scholar 

  17. Schag CA, Heinrich RL, Aadland RL, Ganz PA. Assessing problems of cancer patients: psychometric properties of the cancer inventory of problem situations. Health Psychol. 1990;9(1):83–102.

    Article  CAS  PubMed  Google Scholar 

  18. Schag CA, Heinrich RL. Cancer Rehabilitation Evaluation System (CARES) Manual. Los Angeles: CARES Consultants; 1989.

    Google Scholar 

  19. Schag CA, Heinrich RL. Development of a comprehensive quality of life measurement tool: CARES. Oncology. 1990;4(5):135–8. discussion 147.

    CAS  PubMed  Google Scholar 

  20. Meyerowitz BE, Heinrich RL, Schag CC. A competency-based approach to coping with cancer. In: Bradley L, Burish TG, editors. Coping with Chronic Disease: Research and Applications. New York: Academic; 1983.

    Google Scholar 

  21. Schag CC, Heinrich RL, Ganz PA. The Cancer inventory of problem situations: an instrument for assessing cancer patients’ rehabilitation needs. J Psychosoc Oncol. 1983;1:11–24.

    Article  Google Scholar 

  22. Deragotis LR. SCL-90-R. Manual-I. Baltimore: John Hopkins University School of Medicine; 1977.

    Google Scholar 

  23. Spanier GB. Measuring dyadic adjustment. New scales for assessing the quality of marriage and similar dyads. J Marriage Fam. 1976;38(1):15–28.

    Article  Google Scholar 

  24. Schag CC, Heinrich RL, Ganz PA. Karnofsky performance status revisited: reliability, validity, and guidelines. J Clin Oncol. 1984;2(3):187–93.

    CAS  PubMed  Google Scholar 

  25. Karnofsky DA, Burchenal JH. The clinical evaluation of chemotherapeutic agents in cancer. In: Macleod CM, editor. Evaluation of Chemotherapeutic Agents. New York: Columbia University Press; 1949.

    Google Scholar 

  26. Gough IR, Furnival CM, Schilder L, Grove W. Assessment of the quality of life of patients with advanced cancer. Eur J Cancer Clin Oncol. 1983;19(8):1161–5.

    Article  CAS  PubMed  Google Scholar 

  27. Ganz PA. Cancer Rehabilitation Evaluation System (CARES) and CARES-SF now publicly available. J Clin Oncol. 2012;30(32):4046–7.

    Article  PubMed  Google Scholar 

  28. Gjersing L, Caplehorn JR, Clausen T. Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations. BMC Med Res Methodol. 2010;10(1):1–10.

    Article  Google Scholar 

  29. Harkness JA S-GA. Questionnaires in translation. In: JA H, editor. ZUMA Nachrichten Spezial No 3 Cross-Cultural Survey Equivalence. Mannheim: ZUMA; 1998.

    Google Scholar 

  30. Harkness JA, Pennell B-E, Schoua-Glusberg A. Survey Questionnaire Translation and Assessment. In: Presser S, Rothgeb JM, Couper MP, Lessler JT, Martin E, Martin J, Singer E, editors. Methods for Testing and Evaluating Survey Questionnaires. New York: Wiley; 2004.

    Google Scholar 

  31. Schouten B, Van Hoof E, Vankrunkelsven P, Schrooten W, Bulens P, Buntinx F, Mebis J, Vandijck D, Cleemput I, Hellings J. Assessing cancer patients’ quality of life and supportive care needs: Translation-revalidation of the CARES in Flemish and exhaustive evaluation of concurrent validity. BMC Health Serv Res. 2016;16(1):86.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Terwee CB, Bot SD, De Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, De Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.

    Article  PubMed  Google Scholar 

  33. Sobin LH, Wittekind CH. TNM Classification of Malignant Tumours. 6th ed. Hoboken: Wiley; 2002.

    Google Scholar 

  34. Mor V, Laliberte L, Morris JN, Wiemann M. The Karnofsky Performance Status Scale. An examination of its reliability and validity in a research setting. Cancer. 1984;53(9):2002–7.

    Article  CAS  PubMed  Google Scholar 

  35. Spinhoven P, Ormel J, Sloekers PP, Kempen GI, Speckens AE, Van Hemert AM. A validation study of the Hospital Anxiety and Depression Scale (HADS) in different groups of Dutch subjects. Psychol Med. 1997;27(2):363–70.

    Article  CAS  PubMed  Google Scholar 

  36. Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67(6):361–70.

    Article  CAS  PubMed  Google Scholar 

  37. Mitchell AJ, Meader N, Symonds P. Diagnostic validity of the Hospital Anxiety and Depression Scale (HADS) in cancer and palliative settings: a meta-analysis. J Affect Disord. 2010;126(3):335–48.

    Article  PubMed  Google Scholar 

  38. Van Sonderen E. The measurement of social support with the Social Support List-Interactions (SSL-I) and the Social Support List-Discrepancies (SSL-D). Dutch manual. Groningen: Noordelijk Centrum voor Gezondheidsvraagstukken; 1993.

    Google Scholar 

  39. Bridges KR, Sanderman R, Van Sonderen E. An English language version of the social support list: preliminary reliability. Psychol Rep. 2002;90(3 Pt 1):1055–8.

    Article  PubMed  Google Scholar 

  40. Van Sonderen E. Het meten van sociale steun met de Sociale Steun Lijst-Interacties (SSL-I) en Sociale Steun Lijst-Discrepanties (SSL-D): een handleiding. Tweede herziene druk. Groningen: UMCG /Rijksuniversiteit Groningen, Research Institute SHARE; 2012.

    Google Scholar 

  41. Arrindell WA, Boelens W, Lambert H. On the psychometric properties of the Maudsley Marital Questionnaire (MMQ): Evaluation of self-ratings in distressed and ‘normal’ volunteer couples based on the Dutch version. Pers Individ Dif. 1983;4(3):293–306.

    Article  Google Scholar 

  42. Arrindell WA, Schaap C. The Maudsley Marital Questionnaire (MMQ): an extension of its construct validity. Br J Psychiatry. 1985;147:295–9.

    Article  CAS  PubMed  Google Scholar 

  43. Orathinkal J, Vansteenwegen A, Enright RD, Stroobants R. Further validation of the Dutch version of the Enright Forgiveness Inventory. Community Ment Health J. 2007;43(2):109–28.

    Article  PubMed  Google Scholar 

  44. Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, Filiberti A, Flechtner H, Fleishman SB, De Haes JC, et al. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst. 1993;85(5):365–76.

    Article  CAS  PubMed  Google Scholar 

  45. Tuinman MA, Gazendam-Donofrio SM, Hoekstra-Weebers JE. Screening and referral for psychosocial distress in oncologic practice: use of the Distress Thermometer. Cancer. 2008;113(4):870–8.

    Article  PubMed  Google Scholar 

  46. Holland JC, Andersen B, Breitbart WS, Dabrowski M, Dudley MM, Fleishman S, Foley GV, Fulcher C, Greenberg DB, Greiner CB, et al. Distress management. J Natl Compr Canc Netw. 2007;5(1):66–98.

    PubMed  Google Scholar 

  47. Bauwens S, Baillon C, Distelmans W, Theuns P. The ‘Distress Barometer’: validation of method of combining the Distress Thermometer with a rated complaint scale. Psychooncology. 2009;18(5):534–42.

    Article  CAS  PubMed  Google Scholar 

  48. Pauwels EE, Charlier C, De Bourdeaudhuij I, Lechner L, Van Hoof E. Care needs after primary breast cancer treatment. Survivors’ associated sociodemographic and medical characteristics. Psychooncology. 2013;22(1):125–32.

    Article  PubMed  Google Scholar 

  49. Schouten B, Hellings J, Vankrunkelsven P, Vanhaecht K. Screening Cancer Patients’ Distress and Care Needs: Translation and Validation of the Cancer Rehabilitation Evaluation System (CARES) for the Flemish Population in Belgium [abstract]. Psychooncology. 2013;22:305–6.

    Google Scholar 

  50. Nunnally JC, Bernstein IH. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994.

    Google Scholar 

  51. Terwee CB, Dekker FW, Wiersinga WM, Prummel MF, Bossuyt PM. On assessing responsiveness of health-related quality of life instruments: guidelines for instrument evaluation. Qual Life Res. 2003;12(4):349–62.

    Article  CAS  PubMed  Google Scholar 

  52. Bartko JJ. The intraclass correlation coefficient as a measure of reliability. Psychol Rep. 1966;19(1):3–11.

    Article  CAS  PubMed  Google Scholar 

  53. Burns N, Grove SK. The practice of nursing research. 4th ed. Philadelphia: US: WB. Saunders; 2001.

    Google Scholar 

  54. BelgianCancerRegistry. Cancer Prevalence in Belgium 2010. Brussels: Belgian Cancer Registry; 2014.

    Google Scholar 

Download references

Acknowledgements

We thank the medical departments and patients for their collaboration and participation in this study. We want to acknowledge Aisha Andrewin, for editing the manuscript for language.

Funding

This study is part of a PhD-project that is supported by Limburg Sterk Merk (LSM). This funding body played no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

Availability of data and materials

The datasets during and/or analysed during the current study available from the corresponding author on reasonable request.

Authors’ contributions

BS is responsible for study conceptualization and design, data collection, study coordination, data analysis and drafting the protocol. JH participated in study conceptualization and design and in drafting the protocol. EVH and PV contributed to the design of the study and revised the protocol. WS was involved in refining plans for data analysis and revising the protocol. PB, FB, JM, and DV provided critical revisions to the protocol. All authors read and approved the final manuscript.

Competing interests

The authors declare not to have any competing interests.

Consent for publication

All participants consent to aggregated data to be presented in publications; no individual data was presented.

Ethics approval and consent to participate

All ethical committees of the participating hospitals (Ethical Review Commission Jessaziekenhuis; Committee Medical Ethics Ziekenhuis Oost-Limburg; Ethical Committee AZ Vesalius; Ethical Committee Mariaziekenhuis Noord-Limburg) and the university (Medical Ethical Committee Hasselt University) reviewed the research protocol and study materials. The leading ethical committee (ERC Jessaziekenhuis) collected the feedback and granted approval on 26th of February 2014 (BE24320149544).

Author information

Authors and Affiliations

  1. Faculty of Medicine and Life Sciences, Hasselt University, Martelarenlaan 42, 3500, Hasselt, Belgium

    Bojoura Schouten, Johan Hellings, Jeroen Mebis, Dominique Vandijck & Ward Schrooten

  2. AZ Delta, Rode-Kruisstraat 20, 8800, Roeselare, Belgium

    Johan Hellings

  3. Department of Experimental and Applied Psychology, Faculty of Psychological and Educational Sciences, Free University of Brussels, Pleinlaan 2, 1050, Elsene, Belgium

    Elke Van Hoof

  4. Department of Public health and Primary Care, Faculty of Medicine, KU Leuven, Kapucijnenvoer 33, PB 7001, 3000, Leuven, Belgium

    Patrick Vankrunkelsven & Frank Buntinx

  5. Belgian Center for Evidence-Based Medicine (CEBAM), Kapucijnenvoer 33-blok J, 3000, Leuven, Belgium

    Patrick Vankrunkelsven

  6. Jessaziekenhuis, Stadsomvaart 11, 3500, Hasselt, Belgium

    Paul Bulens & Jeroen Mebis

  7. Faculty of Medicine and Health Sciences, Ghent University, De Pintelaan 185, 9000, Ghent, Belgium

    Dominique Vandijck

  8. ICURO, Guimardstraat 1, 1040, Brussel, Belgium

    Dominique Vandijck

  9. Centre Hospitalier de Cayenne, Rue des Flamboyants, B.P 6006, 97306, Cayenne Cedex, France

    Ward Schrooten

Authors
  1. Bojoura Schouten
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Johan Hellings
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Elke Van Hoof
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Patrick Vankrunkelsven
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Paul Bulens
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Frank Buntinx
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jeroen Mebis
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Dominique Vandijck
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Ward Schrooten
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bojoura Schouten.

Additional files

Additional file 1:

CARES Validity Ratings. (DOC 45 kb)

Additional file 2:

Factor solutions exploring CARES subscales. (DOC 167 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Schouten, B., Hellings, J., Van Hoof, E. et al. Validation of the flemish CARES, a quality of life and needs assessment tool for cancer care. BMC Cancer 16, 696 (2016). https://doi.org/10.1186/s12885-016-2728-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12885-016-2728-9

Keywords

BMC Cancer

ISSN: 1471-2407

Contact us