Values and options in cancer care (VOICE): study design and rationale for a patient-centered communication and decision-making intervention for physicians, patients with advanced cancer, and their caregivers
- Michael Hoerger1, 2, 3, 10Email author,
- Ronald M Epstein1, 2, 3, 4,
- Paul C Winters4,
- Kevin Fiscella3, 4,
- Paul R Duberstein1, 2,
- Robert Gramling1, 4,
- Phyllis N Butow5,
- Supriya G Mohile3,
- Paul R Kaesberg6,
- Wan Tang7,
- Sandy Plumb4,
- Adam Walczak5,
- Anthony L Back8,
- Daniel Tancredi9,
- Alison Venuti4,
- Camille Cipri9,
- Gisela Escalera9,
- Carol Ferro4,
- Don Gaudion4,
- Beth Hoh4,
- Blair Leatherwood9,
- Linda Lewis9,
- Mark Robinson9,
- Peter Sullivan4 and
- Richard L Kravitz6, 9
© Hoerger et al.; licensee BioMed Central Ltd. 2013
Received: 25 February 2013
Accepted: 26 March 2013
Published: 9 April 2013
Communication about prognosis and treatment choices is essential for informed decision making in advanced cancer. This article describes an investigation designed to facilitate communication and decision making among oncologists, patients with advanced cancer, and their caregivers.
The Values and Options in Cancer Care (VOICE) Study is a National Cancer Institute sponsored randomized controlled trial conducted in the Rochester/Buffalo, NY and Sacramento, CA regions. A total of 40 oncologists, approximately 400 patients with advanced cancer, and their family/friend caregivers (one per patient, when available) are expected to enroll in the study. Drawing upon ecological theory, the intervention uses a two-pronged approach: oncologists complete a multifaceted tailored educational intervention involving standardized patient instructors (SPIs), and patients and caregivers complete a coaching intervention to facilitate prioritizing and discussing questions and concerns. Follow-up data will be collected approximately quarterly for up to three years.
The intervention is hypothesized to enhance patient-centered communication, quality of care, and patient outcomes. Analyses will examine the effects of the intervention on key elements of physician-patient-caregiver communication (primary outcomes), the physician-patient relationship, shared understanding of prognosis, patient well-being, and health service utilization (secondary outcomes).
Clinical Trials Identifier: NCT01485627
Crafting care that is concordant with the patient’s wishes in the context of serious illness requires clear, patient-centered communication . Most patients with advanced cancer (>80%) want frank yet sensitive discussions with their physicians about prognosis and treatment choices, and want to be involved and informed about decisions regarding their care, regardless of whether they wish to assume responsibility for making major health care decisions . Yet, few actually have these discussions . Consequently, patients often overestimate prognoses, underestimate disease severity, and have unrealistic expectations for cure [2–5]. Having frank, sensitive discussions is associated with more realistic prognostic estimates and decisions that are better aligned with patients’ wishes [3, 5–8]. When these discussions occur before patients are critically ill, patients report greater well-being and have fewer unwanted aggressive interventions in the last weeks of life, with no detrimental effect on survival [3, 5, 9].
The VOICE (Values and Options In Cancer Care) Study is a randomized controlled trial of a patient-centered communication intervention for oncologists, patients with advanced cancer, and their caregivers. Initial study findings are expected to be published in 2013, with follow-up complete in 2015. This article describes the empirical and theoretical rationale for the study, the tailored education and coaching communication intervention, the study measures and administration procedures, the planned analytic approach, and potential implications of this research.
VOICE targets important gaps in cancer communication research. Since the SUPPORT study , in which an ICU-based nurse intervention failed to influence care for critically ill patients with dire prognoses, there has been insufficient progress in improving clinical communication in the context of serious illness. The 2007 NCI monograph, Patient-centered Communication and Cancer Care, the Institute of Medicine , the American Society for Clinical Oncology, and the National Priorities Partnership all call for improvements in communication with patients who have serious and life-limiting illnesses, citing the effects of good communication on quality of care and quality of life.
Poor communication is common in advanced cancer, leading to healthcare decisions that are inadequately informed by patients’ preferences. Physicians often misjudge patients’ treatment preferences, desire for information, needs, and level of understanding [2, 12]. Despite evidence that individuals with advanced cancer and their caregivers benefit from being informed about prognosis and treatment choices [1, 2, 13], physicians often intentionally overestimate survival  and avoid discussing prognosis until the patient has symptoms or there are no other treatments to offer, leading to inflated patient expectations about survival and the benefits of cytotoxic treatment [4, 15]. Patients who have not discussed prognosis and treatment choices with their physicians are 3 to 8 times more likely to receive aggressive treatments in the last week of life [3, 5], reducing physical and emotional quality of life and perhaps longevity . Additionally, patients often alter their treatment choices when adequately informed . Furthermore, although physicians and patients find prognostic discussions stressful, concealing the truth can be more harmful . Indeed, evidence suggests that these discussions neither appear to cause harm nor diminish hope [18, 19].
Communication about prognosis and treatment choices is essential for informed decision making in advanced cancer. Our intervention is designed to promote patient-centeredness , which is defined by the Institute of Medicine  as “care that is respectful of and responsive to individual patient preferences, needs, and values.” The intervention targets four key communication skills: Engaging patients and their caregivers to participate in consultations and decisions regarding the patient’s care, Responding to patients’ concerns, Informing patients about treatment choices, and Framing prognosis using balanced information about best and worst case scenarios. In other settings, these skills have been associated with improvements in psychological well-being, quality of life, symptoms, adherence to treatment, patient satisfaction, and caregiver bereavement, as well as reductions in racial and ethnic disparities [1, 12, 22–24]. If our hypotheses are supported, patients and their caregivers will be better informed, less psychologically distressed, and better able to participate in discussions about prognosis and treatment choices. As a result, they will be more likely to make decisions that lead to improved quality of life, a greater sense of peace, and better quality of death.
VOICE was designed to test an innovative synergistic intervention for improving communication between patients with advanced cancer and oncologists. Nearly all communication intervention studies have been individually focused on either patient or clinician behavior, or have used third parties to broker communication . Such efforts have been insufficient to improve shared understanding and patient well-being. Interventions designed to help patients with serious illnesses to ask questions and express concerns have been more effective when physicians also encourage active patient participation [22, 26, 27]. Brief physician training can improve some aspects of communication, such as empathy. More intensive interventions have been necessary to reach broader communication goals [12, 27, 28]. Mindful that it may be challenging for physicians to set aside 2–3 days from a busy practice to complete training workshops, the VOICE intervention provides brief, highly-skilled and individually-tailored training embedded within the oncology practice. Further, previous research and pilot work undertaken for this trial have noted physician frustration and patient dissatisfaction when assertive patients encounter physicians who are not adequately prepared [12, 22]. This suggests the need to intervene simultaneously with patients and physicians. Our trial, based on ecological theory, is the first rigorous test of an intervention that intercedes at the level of the physician-patient-caregiver relationship.
Ecological theory has successfully predicted that (a) assertive patient behaviors such as making requests, asking questions, and expressing opinions generally promote physicians’ patient-centered behaviors [29, 32, 34], (b) physicians’ facilitative behaviors such as addressing patients’ concerns and helping patients to participate in care reinforce patient assertiveness [13, 35], and (c) when caregivers are present in consultations, they can align the efforts of clinicians and patients towards common communication goals and help patients to understand and use relevant information [36, 37]. Ecological theory also partially explains paradoxical results in which some outcomes, such as patient satisfaction and physician frustration, worsen when patients are trained to communicate assertively and physicians are unprepared for change [22, 34]. Because of these findings, our outcome measures consider both individual communication behaviors and mutual interactions.
Importantly, ecological theory has been informed by experimental research on how Framing affects patient understanding and decision-making [38, 39]; as well as how Informing patients about treatment options, Responding to emotional concerns, and Engaging patients by exploring assumptions and beliefs [40–42] help patients to be more active participants in care [43, 44]. Ecological theory emphasizes that patients’ desire for information should be considered by first asking patients what they wish to know and in what format, providing desired information, then checking understanding, a paradigm known as the “Ask-Tell-Ask” approach . Bidirectional exchange of tailored and desired information thus leads to better shared understanding, prepares patients to be involved in decisions, and promotes trust that important information is not being withheld [17, 26].
Drawing upon this ecological framework, the VOICE intervention is designed to help physicians, patients with advanced cancer, and caregivers to communicate more effectively about issues likely to influence decision making. In doing so, this investigation brings together research on communication and medical decision making, which have historically been two separate approaches addressing common issues but without a common frame of reference. Moreover, the intervention targets patients diagnosed with incurable cancer before they become critically ill, anticipating the need for information and strong patient-physician relationships as the illness progresses. We hypothesize that, relative to care as usual, the intervention will improve physician-patient-caregiver communication about prognosis and treatment choices (Aim 1a), improve the physician-patient relationship and increase shared understanding of prognosis (Aim 1b), improve patient well-being (Aim 2), and affect health services utilization by both reducing the number of aggressive interventions that may undermine the quality of life in the last weeks of life and increasing the use of guideline-concordant palliative care and hospice services (Aim 3).
The study is a cluster RCT conducted in multiple oncology practices and cancer centers in the Rochester/Buffalo, NY and Sacramento, CA regions, designed to evaluate the effects of a theory-based intervention to improve communication between oncologists and patients with advanced cancer and their caregivers. The methods were developed in collaboration with Phyllis Butow, Martin Tattersall, Adam Walczak and colleagues, who are conducting a parallel study in Sydney, Australia called Conversations with Your Doctor: Making the Most of Medical Consultations. That study incorporates similar interventions but a different study design. The VOICE RCT incorporates many elements of effectiveness studies, such as broad eligibility criteria, usual-care controls, tailored interventions, patient-oriented outcome measures, and intention-to-treat analyses. The study design and all consent forms have the approval of the Institutional Review Boards at each institution.
Phase 2 is the cluster RCT. Physicians are the unit of randomization and are randomly assigned to the intervention or control condition. Up to seven Phase 2 patients (and caregivers) are recruited per physician. Patients and their caregivers are randomly assigned by proxy: patients of physicians in the intervention condition are assigned to the intervention, and patients of physicians in the control condition are assigned to the control group. Patients complete measures at study entry, participate in the intervention or control condition, agree to have an oncology office visit audio recorded, and complete follow-up measures immediately after the office visit, approximately 2–4 days after the office visit, and every 3 months for up to 3 years or until death. Caregivers, where available, also participate in the study and complete measures periodically, including measures one-month post-mortem.
Following completion of Phase 2, data analysis will ensue. After the study has closed, physicians from the control group will be offered the opportunity to receive the intervention, both as an incentive to participate and to further their professional development. In addition to the primary VOICE trial, additional studies are using the procedures described here to examine patient, caregiver, and oncologist emotional processes  that drive decision making, and the effect of the intervention on caregiver bereavement outcomes. Prior research  suggests that improvements in end-of-life care can mitigate bereavement-related morbidity.
Selection of study sites
In the Rochester region, oncologists (n = 25) were recruited from academic and private practices in western New York; recruitment is complete. In the Sacramento region, all oncologists are recruited from the UC Davis Comprehensive Cancer Center (n = 14), and recruitment is nearly complete. One Rochester physician withdrew from the study prior to any data collection due to lack of time. We anticipate a total of 40 oncologists.
Eligibility, recruitment, consent, and randomization
Inclusion and exclusion criteria for oncologists, patients, and caregivers
● Currently in clinical practice at participating institutions
● Non-physicians and physicians who are not oncologists
● Oncologist that cares for patients with solid tumors
● Oncologists who exclusively care for patients with hematological malignancies
● Not planning to leave the practice during the next 6 months
● Currently a patient of an enrolled physician
● Anticipating bone marrow transplantation or diagnosed with leukemia or lymphoma
● Age 21 years or older
● Diagnosis of Stage III or IV solid (non-hematological) cancer a
● Unable to complete orally-administered surveys in English
● Able to understand spoken English (study personnel to read materials to low literacy patients)
● Hospitalized or in hospice care at recruitment or for baseline measures
● Caregiver of a patient currently enrolled in the study
● Unable to complete orally-administered surveys in English
● Age 21 years or older
● Supported the patient primarily through a professional role (e.g., clergy)
● Able to understand spoken English (study personnel to read materials to low literacy caregivers)
Medical oncologists who care for patients with solid (non-hematologic) cancers are solicited for participation through presentations about the study at grand rounds and faculty meetings, or through personal contacts via cancer center directors or project investigators. Interested oncologists then meet with study personnel (e.g., project manager, research assistant, or research oncologist) to achieve a clear understanding of all study components, provide written consent, and complete the baseline surveys. The consent document seeks each oncologist’s agreement to (a) guide recruitment efforts among their patients by determining eligibility, (b) participate in an educational program to enhance their communication skills, (c) audiotape one clinic encounter per enrolled patient, and (d) complete brief surveys at baseline, after each audio-recorded office visit, and the study conclusion. Oncologists are told “the purpose of this study is to assess the impact of brief educational interventions on clinical care and outcomes of patients with cancer and their caregivers. Outcomes of interest include communication between patients, caregivers, and physicians, as well as patient well-being and health services utilization.” Oncologists receive $600 for completing surveys and identifying eligible patients for the study.
Research assistants identify all patients by working closely with participating oncologists and their clinic staff to review clinic rosters in detail to ascertain that all potentially eligible patients are identified. Depending on the site and differing IRB requirements, potentially eligible patients are either (a) approached by physicians or practice nurses and then by the research assistant or (b) sent a letter, a study brochure, and an opt-out card. Patients approached by physicians or clinic staff are asked if they would be willing to speak to a research assistant to learn more about the study. Patients who receive recruitment materials by mail are contacted via phone by a research assistant if an opt-out card is not returned to the research office within 7 days. The research assistant provides them with study information, and gives them time to deliberate about participation and ask questions. The screening and consent process continues until the research assistant feels that the potential participant fully understands all aspects of study involvement. The research assistant then schedules a time to meet and obtains written consent from those who voluntarily wish to enroll, using IRB-approved consent forms. Patients are reminded that they can opt out at any time. All patients are asked to complete baseline surveys and to give permission to have one of their oncology office visits audio recorded. The research assistant orally administers the baseline surveys as well as other study materials as needed. If consent documentation and baseline survey measures are completed in separate visits, eligibility criteria are reviewed immediately prior to survey administration to ensure continued eligibility.
Phase 1 patients complete two sets of orally-administered surveys, one before and one after the audio-recorded office visit with their oncologist. Phase 2 patients (a) have one audio-recorded office visit with their oncologist, (b) complete surveys prior to and immediately after their office visit, then 2–4 days after the office visit, and every three months for up to three years, and (c) give permission for research staff to access their medical records to ascertain their use of health services such as emergency department visits, hospital admissions, cancer treatments, and community-based nursing services. The initial survey takes up to 60 minutes with later surveys taking anywhere from 10 to 30 minutes. Patients receive $15 for each set of surveys, for a maximum of $30 in Phase 1 and $180 in Phase 2.
All patients are asked to identify a “family member, partner, friend or someone else who is involved with your health care issues, for example, someone who you talk to about personal issues including medical decisions or who comes to doctor appointments with you. This person may also help with routine day-to-day activities, like transportation or paperwork.” The term “caregiver” is used to describe these persons for scientific purposes, and patients are not required to self-identify individuals as such. Patients are asked to identify up to three potential caregivers, rank them in order of the likelihood that they will attend oncology office visits, and provide permission to contact the primary caregiver (or others caregivers, if needed) and provide them with a study brochure.
Once identified, the research assistant independently approaches the caregiver in person or by telephone and asks if they would be willing to participate and provide written consent. Caregivers often accompany patients at the time of the patient consent. The research assistant reviews the consent form in detail with the caregiver and advises them that they can opt out of the study at any time. Caregivers are told the same study details as the patients and complete surveys at approximately the same time intervals as the patients. Caregivers are asked for permission to be contacted in the event that the patient dies within three years of enrollment in order to meet with a research assistant (or speak on the telephone if preferred) to complete a survey. The survey is completed approximately one month after the death of the patient. The research assistant responds to caregivers’ questions until it is clear that the caregiver has full comprehension of the consent form and their involvement in the study. Caregivers receive $15 for each set of surveys, for a maximum of $30 in Phase 1 and $180 in Phase 2.
A stratified block-randomization scheme is used to assure balanced assignment by clinic site and cancer focus. Oncologists are grouped into a site according to their health center, clinic, or practice of employment. Within each site, oncologists are randomly assigned approximately evenly across the treatment and control conditions. Sites with a single oncologist are grouped with a similar site for randomization purposes. Oncologists are also categorized by their cancer focus, including breast-cancer oncology (≥50% of patients have diagnoses of breast cancer) and non-breast cancer oncology groups. Within these areas of focus, oncologists are randomly assigned approximately evenly across the treatment and control conditions. This accounts for any biases that may be introduced by the low prevalence of breast cancer in men and the potential that breast cancer patients may be more “activated” than patients with other cancers. For each site/focus combination in the study, separate sequences of random numbers have been generated for use in assigning oncologists to the intervention and control groups. To preserve blinding, assignment to the treatment or control conditions is maintained by the study statistician and not explicitly revealed to transcriptionists or coders of the audio-recorded office visits.
For the initial baseline surveys, a time is arranged to meet with the patient and caregiver, either together or separately, in a private area based on the participant’s comfort and preference. This may include a meeting room in the cancer center, the infusion suite, the participant’s home, or a local coffee shop with private areas. Once both the patient and caregiver have completed these surveys, the research assistant answers any questions and reviews the next steps of the study, the audio-recorded office visit and post-visit survey. For that visit, the research assistant usually meets the patient and caregiver in the physician’s waiting room and accompanies them to the clinic room, turns on and places two audio recorders in the room, and leaves. If another person attends the visit, the research assistant obtains verbal permission to record them. The research assistant collects the recorders after the office visit and meets with the patient and caregiver to administer brief surveys. This completes Phase 1. In Phase 2, the scenario is identical, except that the patients and caregivers in the intervention arm receive a 1-hour coaching session prior to the office visit. After the audio-recorded office visit, the patient completes a survey, and the research assistant explains to the patient and caregiver that they will be contacted in 2–4 days by phone to answer some additional questions. The patient and caregiver are also called three months after the audio-recorded visit to complete surveys and every three months thereafter for up to three years.
Description of the intervention and control conditions
Oncologists randomized to the intervention arm participate in a multifaceted tailored educational intervention involving standardized patients instructors (SPIs). Patients and caregivers complete a coaching intervention to facilitate prioritizing and discussing questions and concerns.
Oncologist training Oncologists completing the intervention meet with SPIs for two in-office educational outreach sessions , including a 60-minute training session and a 45-minute booster session . At the first session, the SPIs show them a 15-minute DVD created by the study investigators specifically for this project, which presents actual clinical examples to outline key skills in discussing prognosis and treatment choices with patients with advanced cancer and their caregivers. Oncologists receive a copy of the DVD to keep and receive a 1-page summary of evidence-based guidelines for communication in advanced cancer . They are also given a Communication Guide “reminder” card prompting them to discuss topics, such as prognosis and symptoms that appear on the patients’ Question Prompt List, such as prognosis and symptoms (see below, QPL).
Oncologist communication behaviors targeted in the tailored educational intervention
Description of intervention
Oncologists are coached to (a) clarify the patient’s concerns early in the visit  – this corrects the tendency to address the first concern mentioned at the expense of more important issues , (b) acknowledge the Question Prompt List (QPL) to increase its effectiveness , (c) encourage questions, and (d) encourage participation in healthcare decision making [26, 54, 55].
Emotional expression and empathy are uncommon in oncology consultations [51, 56, 57]; therefore, oncologists are coached to respond to the emotional components of patients’ concerns with empathy and support.
Based on recent studies [58, 59], oncologists are coached to use an “Ask-Tell-Ask” protocol – asking patients about their wishes regarding information about prognosis and treatment choices, providing desired information in a desired format, and then checking patient understanding.
Based on recent studies [6, 58], oncologists are trained to present information for both optimistic or “best case” and pessimistic or “worst case” scenarios. Balanced information appears to better align patients’ and physicians’ efforts by reducing bias introduced by one-sided presentation of data.
Patient and caregiver coaching Patients and caregivers completing the intervention meet with a coach trained to facilitate health communication. During the coaching session, the coach gives each patient and caregiver a Question Prompt List (QPL), which is organized in a booklet called My Cancer Care. The QPL includes questions about diagnosis, prognosis, treatment options, symptom management, transitions in care, self-care, and family needs. Sample questions include, “What are the pros and cons of further treatment for my cancer?” and “How can I help my family and children understand what is happening?” The QPL was developed in Australia, adapted for the United States, and piloted simultaneous in both countries . Using the QPL as a guide, patients are coached to (a) identify and prioritize 2–3 personally relevant questions on the list, (b) ask these questions during the visit, (c) ask their oncologist for clarification when they do not understand, (d) express desire to participate more actively in discussions about prognosis and treatment choices, and (e) prepare for the future [22, 26, 54, 61]. These skills promote the same goals as the physician intervention. The coach makes follow-up phone calls at monthly intervals for up to three months to reinforce the coaching intervention and address patients’ concerns . The coaches include a nurse and social workers with healthcare backgrounds, similar to prior studies ; they do not provide disease-specific information. All Rochester and UC-Davis coaches participate in local training, video conferences, and a 3-day intensive training, using methods and materials similar to our previous studies . All intervention sessions are audio-recorded and progress notes are written after each of the 3 coaching follow-up telephone calls. The coaches hold weekly conference calls to fine-tune, discuss, and review their coaching sessions.
The control group involves care as usual. Oncologists as well as patients/caregivers meet with the research assistants to complete the same surveys as intervention participants but receive no training.
The audio-recorded office visits for all participants are coded for each of the four domains of communication behaviors hypothesized to be affected by the intervention: Engaging, Responding, Informing, and Framing (see Table 2). The Active Patient Participation Coding (APPC)  scheme is used to measure Engaging communication behaviors, such as patient assertive behaviors and oncologist facilitative behaviors, that promote patient participation in the decision-making process. The Verona VR-CoDES system  is used to code for sequences of Responding to emotion, such as patient expression of emotional cues and concerns and oncologist responses to these expressions of emotion. The Prognostic and Treatment Choices (PTCC)  system is used to code Informing behaviors, such as the oncologist addressing patients’ wishes for information regarding prognosis and treatment choices. The Optimism/Pessimism subscale of the Framing of Prognostic Information (FPI)  system is used to code Framing behaviors, such as oncologists’ balance in expressions of optimistic and pessimistic perspectives about “what to expect.” Several exploratory measures assess the level of patient and caregiver question asking [26, 54] and the degree of shared decision making [66, 67].
Patient survey measures
Survey measures completed by patients in the RCT
2-4 day follow-up
Gender, age, race/ethnicity, SES, relationship status, religion
HCCQ + MUIS + IPS
Patient Communicational Self-Efficacy
Topics discussed in recent medical encounters
Preferred Decision Role
Actual Decision Role
Preferences for experimental treatments, life support, palliative care
MQOL + FACT-G
Estimate of prognosis
Several scales relate to patient attitudes, values and beliefs. Patients’ Preferred Decision Role is measured with the Control Preferences Scale , which is compared to an adapted version assessing patients’ Actual Decision Role in oncology office visits. The Treatment Preferences survey measures preferences for experimental treatments, life support, and palliative care, in the event that no further anti-cancer treatments would be helpful. Illness Acceptance is measured with the Peaceful Acceptance subscale of the PEACE . Prognostic Forecasting is measured using items  assessing patients’ beliefs about their chances of living two years and chances of being cured.
Finally, Well-being is measured with the Global Quality of Life, Psychological Well-being, and Existential Well-being subscales of the McGill Quality of Life (MQOL)  survey as well as the Physical Well-being and Social/Family Well-being subscales of the Functional Assessment of Cancer Therapy – General (FACT-G)  survey.
Each of these surveys has been tailored to improve clarity and relevance, reduce respondent burden, and reflect American English. Most of these measures have been piloted with patients in Phase 1 and refined as needed to reduce ceiling and floor effects or further improve item wording.
Caregiver survey measures
Survey measures completed by caregivers in the RCT
2-4 Day follow-up
Gender, age, race/ethnicity, SES, relationship with patient
Caregiver Communicational Self-Efficacy
Patient Treatment Preferences
Caregiver’s beliefs about patient preferences for experimental treatments, life support, palliative care
Patient Illness Acceptance
MQOL + FACT-G
Estimate of patient’s prognosis
Patient Quality of Death
Qualitative questions + QOLND + QOD-LTC-C
Oncologist survey measures
Survey measures completed by physicians
Age, race/ethnicity, gender, training background, practice characteristics
Skills in discussing prognosis and end-of-life care
Decision Making Skills
Comfort with decision making across varying levels of patient involvement
Patient Disease Status
Cancer site, progression, treatment planning
Patient Treatment Preferences
Physician’s beliefs about patient preferences for experimental treatments, life support, palliative care
Patient Illness Acceptance
Physician’s estimate of prognosis, and beliefs about patient’s estimate of prognosis
Medical chart abstraction
The death of participating patients is ascertained by checking in regularly with participating oncologists, through scheduled follow-up sessions with patients and caregivers, by reviewing death notices (obituaries) in the local press, and by periodically reviewing electronic health records. Once a death is identified, study staff identify all emergency department visits or hospital overnight stays occurring in the last 30 days before death and abstract the corresponding medical records for the following data elements: (1) date of death, (2) dates and circumstances of attendance at a hospital, emergency department, and intensive care unit, (3) use of intubation, cardiopulmonary resuscitation (CPR), hemodialysis, permanent enternal feeding tube, and chemotherapy, (4) involvement of hospice and palliative care services, and (5) completion of Do Not Resuscitate/Do Not Intubate (DNR/DNI) forms and Advanced Directives. Outpatient records are abstracted to identify any chemotherapy agent given in the last 14 days before death and any new chemotherapeutic regimen started in the last 30 days before death, the absence of which indicate higher quality end-of-life care .
Both the oncologist and patient/caregiver components of the intervention are monitored for fidelity. For the oncologist training sessions, all audio recordings are reviewed by all SPI trainers. For the patient/caregiver component, audio recordings are reviewed for each coach’s first five coaching sessions, every subsequent session until >95% fidelity, and at least every fifth session thereafter, including in-person and phone sessions. To assess fidelity and ensure standardization of survey administration procedures, each research assistant’s first five sessions are monitored by direct observation and reinforced every 4–6 months during data collection. In addition, audio-recordings of qualitative survey items are reviewed thereafter as needed.
Sample size determination
This is a stratified cluster randomized study, with the physician as the unit of randomization. Based on prior studies, we have made the following assumptions: physician attrition 0-3%, patient attrition <5% for audio-recordings, and 10%, 30% and 35% for the 2–4 day, 3-month, and 6-month post-visit patient surveys [78, 79], 80% patient mortality during 3-year follow up, availability of 85% of caregivers for post-death interviews [3, 24], availability of 90% of medical records for audit [3, 5, 80], no differential attrition between the intervention and control groups, and an intraclass correlation coefficient (ICC) of .10 or less for within-physician clustering on patient and caregiver survey measures [81, 82].
Prior work found that activation training increases physician communication behaviors two to three fold [26, 28, 29]. This equates to an effect size of 2.0 standard deviation (SD) units. Thus, for our primary outcome (Aim 1a), we expect a 2.0 SD improvement across each communication measure; 0.5 SD is clinically significant. Power is based on a single measurement of communication during the oncology office visit. With at least 19 oncologists in each group, 7 patients per oncologist, and an ICC of .10, the minimum detectable effect size is 0.50 SD.
For our survey outcomes (Aims 1b & 2), we rely on observational data  indicating effect sizes of 0.40 to 0.70 SD for the relationship between communication and patient well-being. With an intervention we would expect these differences to be larger. The power analysis takes advantage of a repeated-measures design . For patient data, we assume one pre-intervention measure and two post-intervention measures, and an average correlation among repeated measures of .50. Our proposed sample size is sufficient to detect an effect size of 0.40 SD with power of .80. For our utilization outcomes, we rely on data that suggest 3- to 8-fold differences in use of aggressive treatments during the final week of life between patients who have had discussions compared to those who have not [3, 5]. Thus, the study will be adequately powered, even considering attrition.
Planned analytic approach
This is a cluster-randomized trial, where our primary communication outcomes (Aim 1a) are measured at the level of the physician-patient dyad and our secondary outcomes (Aims 1b, 2, & 3) are measured at the level of the patient. Analyses are based on published guidelines for group (cluster) RCTs , in this case, clustering at the site and physician level. Prior to hypothesis testing, preliminary analyses will examine whether random assignment produced comparable groups in terms of patient disease status, patient well-being, and pre-RCT (Phase 1) physician communication styles. Any confounders will be included in remaining analyses. Hypothesis testing will involve comparisons of the two randomized groups. Since the patients are nested within oncologists, methods for panel data will be applied, and random effects for physicians may be added to account for the within-physician correlations of each dyad. We will use both generalized estimating equations (GEE) and generalized linear mixed-effects models (GLMM). The primary outcomes (Aim 1a) are unlikely to require substantial attention to attrition, since measurement occurs shortly after randomization, and will not require methods for repeated measures. Hierarchical linear models with nested random coefficients will be applied where secondary outcomes that are measured repeatedly (Aims 1b, 2, & 3). As missing values are likely, we will examine the nature of the missing data and use weighted GEE (WGEE), or multiple imputation and sensitivity analyses, if necessary. In assessing significance across multiple tests, we will use procedures to control the false discovery rate (FDR) at 5% within sets of related analyses .
The VOICE Study is a multi-site randomized controlled trial designed to facilitate communication about prognosis and healthcare decision making among oncologists, patients with advanced cancer, and their caregivers (defined as family, friends, or other non-professionals who are involved in their care). The investigation is unique in bringing together research on patient-centered communication and medical decision making, intervening with both physicians and patients/caregivers, and its upstream focus, targeting patients with advanced cancer before they are critically ill.
The proposed intervention anticipates future needs. In the future, patients with advanced cancer will have more complex and numerous treatment options, including biologicals, genetically-tailored therapies, and new devices. This complexity will present challenges for physicians in providing the best possible quality of care for incurable conditions while maintaining realistic hope. Thus, the need for effective communication in the context of incurable cancer will increase. Furthermore, effective communication is integral to current health reform efforts. Programs to enhance communication will potentially be met favorably by health systems, insurers, and federal agencies who value the patient-physician relationship and by the public who value having control over their own care. The proposed intervention is also scalable for dissemination using new technologies. Currently, a trained Standardized Patient Instructor (SPI) and coach can visit dozens of practices at a reasonable cost, and training materials and question prompt lists can be adapted for the Web and embedded in electronic health records. In the future, increasing bandwidth will permit adaptation of the SPI and coaching interventions to live web-SP technology [87, 88], offering live training to clinicians and patients regardless of location.
There have been several meaningful challenges in implementing VOICE. In order to recruit physicians, it has been important to contact senior physicians within each practice to garner support for the study and work closely with nursing and office staff in order to minimize the burden of physician participation. To maintain the fidelity of the intervention, well-trained supervisors of SPIs and coaches are needed, who can provide timely and meaningful feedback to those implementing the intervention based on a detailed review of audio recordings of intervention sessions. Measurement issues also required attention, as several scales needed to be adapted (a) from British or Australian English to American English, (b) to improve the consistency of response scales to reduce cognitive load, (c) to increase the number of response options to mitigate ceiling and floor effects in our sample, and (d) to reduce the number of items to prevent respondent burden in a sample of seriously ill participants. Inclusion and exclusion criteria also warranted attention; for example, a patient with two malignancies, one hematologic and one solid, was excluded because the hematologic malignancy was active and progressing.
The pragmatic design of the intervention should facilitate dissemination of the program if proven effective. The main challenges of the study have been related to implementation issues (e.g., SPI and coach training and monitoring) and study design issues (e.g., respondent burden, IRB issues, and opt-out cards). The former presented few difficulties, and the study design challenges would not be present if the program were to be widely disseminated.
This study was funded by R01CA140419 from the National Cancer Institute. Dr. Hoerger was also supported during the project period by T32MH018911 from the National Institute of Mental Health. We are grateful for the contributions of our research study staff, including Kristen Greenlee, Donna Makowski, Tina Slee, and Ted Wun. We are also grateful for the support and cooperation from the physicians and office staff of the 8 oncology practices (comprising 14 locations) participating in the study. Finally, we wish to thank Martin Tattersall, MD, at the University of Sydney for his mentorship and guidance in the development of the original concept for this study.
- Epstein RM, Street RL: Patient-centered communication in cancer care: Promoting healing and reducing suffering. 2007, Bethesda, MD: National Cancer Institute, NIHGoogle Scholar
- Parker SM, Clayton JM, Hancock K: A systematic review of prognostic/end-of-life communication with adults in advanced stages of a life-limiting illness: Patient/caregiver preferences for the content, style, and timing of information. J Pain Symptom Manage. 2007, 34: 81-93. 10.1016/j.jpainsymman.2006.09.035.View ArticlePubMedGoogle Scholar
- Wright AA, Zhang B, Ray A: Associations between end-of-life discussions, patient mental health, medical care near death, and caregiver bereavement adjustment. J Am Med Assoc. 2008, 300: 1665-1673. 10.1001/jama.300.14.1665.View ArticleGoogle Scholar
- Weeks JC, Catalano PJ, Cronin A: Patients’ expectations about effects of chemotherapy for advanced cancer. N Engl J Med. 2012, 367: 1616-1625. 10.1056/NEJMoa1204410.View ArticlePubMedPubMed CentralGoogle Scholar
- Weeks JC, Cook EF, O’Day SJ: Relationship between cancer patients’ predictions of prognosis and their treatment preferences. J Am Med Assoc. 1998, 279: 1709-1714. 10.1001/jama.279.21.1709.View ArticleGoogle Scholar
- Robinson TM, Alexander SC, Hays M: Patient-oncologist communication in advanced cancer: predictors of patient perception of prognosis. Support Care Cancer. 2008, 16: 1049-1057. 10.1007/s00520-007-0372-2.View ArticlePubMedPubMed CentralGoogle Scholar
- Mack JW, Nilsson M, Balboni T: Peace, equanimity, and acceptance in the cancer experience (PEACE): validation of a scale to assess acceptance and struggle with terminal illness. Cancer. 2008, 112: 2509-2517. 10.1002/cncr.23476.View ArticlePubMedGoogle Scholar
- Mack JW, Weeks JC, Wright AA: End-of-life discussions, goal attainment, and distress at the end of life: predictors and outcomes of receipt of care consistent with preferences. J Clin Oncol. 2010, 28: 1203-1208. 10.1200/JCO.2009.25.4672.View ArticlePubMedPubMed CentralGoogle Scholar
- Temel JS, Greer JA, Muzikansky A: Early palliative care for patients with metastatic non-small-cell lung cancer. N Engl J Med. 2010, 363: 733-742. 10.1056/NEJMoa1000678.View ArticlePubMedGoogle Scholar
- Haidet P, Hamel MB, Davis RB: Outcomes, preferences for resuscitation, and physician-patient communication among patients with metastatic colorectal cancer. SUPPORT investigators. Study to understand prognoses and preferences for outcomes and risks of treatments. Am J Med. 1998, 105: 222-229. 10.1016/S0002-9343(98)00242-3.View ArticlePubMedGoogle Scholar
- Institute of Medicine: Assessing and improving value in cancer care: Workshop summary. 2009, Washington, DC: The National Academy PressGoogle Scholar
- Lewin SA, Skea ZC, Entwistle V: Interventions for providers to promote a patient-centred approach in clinical consultations. Cochrane Database Syst Rev. 2001, CD003267-Google Scholar
- Clayton JM, Hancock KM, Butow PN: Clinical practice guidelines for communicating prognosis and end-of-life issues with adults in the advanced stages of a life-limiting illness, and their caregivers. Med J Aust. 2007, 186: S77, S9, S83–108Google Scholar
- Lamont EB, Christakis NA: Prognostic disclosure to patients with cancer near the end of life. Ann Intern Med. 2001, 134: 1096-1105. 10.7326/0003-4819-134-12-200106190-00009.View ArticlePubMedGoogle Scholar
- Keating NL, Landrum MB, Rogers SO: Physician factors associated with discussions about end-of-life care. Cancer. 2010, 116: 998-1006. 10.1002/cncr.24761.View ArticlePubMedPubMed CentralGoogle Scholar
- Epstein RM, Peters E: Beyond information: exploring patients’ preferences. J Am Med Assoc. 2009, 302: 195-197. 10.1001/jama.2009.984.View ArticleGoogle Scholar
- Fallowfield LJ, Jenkins VA, Beveridge HA: Truth may hurt but deceit hurts more: communication in palliative care. Palliat Med. 2002, 16: 297-303. 10.1191/0269216302pm575oa.View ArticlePubMedGoogle Scholar
- Hagerty RG, Butow PN, Ellis PM: Communicating prognosis in cancer care: a systematic review of the literature. Ann Oncol. 2005, 16: 1005-1053. 10.1093/annonc/mdi211.View ArticlePubMedGoogle Scholar
- Hagerty RG, Butow PN, Ellis PM: Communicating with realism and hope: incurable cancer patients’ views on the disclosure of prognosis. J Clin Oncol. 2005, 23: 1278-1288. 10.1200/JCO.2005.11.138.View ArticlePubMedGoogle Scholar
- Epstein RM, Franks P, Fiscella K: Measuring patient-centered communication in patient-physician consultations: theoretical and practical issues. Soc Sci Med. 2005, 61: 1516-1528. 10.1016/j.socscimed.2005.02.001.View ArticlePubMedGoogle Scholar
- Institute of Medicine Committee on Quality of Health Care in America: Crossing the quality chasm: A new health system for the 21st century. 2001, Washington, D.C: National Academy PressGoogle Scholar
- Kinnersley P, Edwards A, Hood K: Interventions before consultations for helping patients address their information needs. Cochrane Database Syst Rev. 2007, CD004565-Google Scholar
- Kalauokalani D, Franks P, Oliver JW: Can patient coaching reduce racial/ethnic disparities in cancer pain control? Secondary analysis of a randomized controlled trial. Pain Med. 2007, 8: 17-24. 10.1111/j.1526-4637.2007.00170.x.View ArticlePubMedGoogle Scholar
- Lautrette A, Darmon M, Megarbane B: A communication strategy and brochure for relatives of patients dying in the ICU. N Engl J Med. 2007, 356: 469-478. 10.1056/NEJMoa063446.View ArticlePubMedGoogle Scholar
- Connors AF, Dawson NV, Desbiens NA: A controlled trial to improve care for seriously ill hospitalized patients. The study to understand prognoses and preferences for outcomes and risks of treatments (SUPPORT). The SUPPORT Principal Investigators. JAMA. 1995, 274: 1591-1598. 10.1001/jama.1995.03530200027032.View ArticleGoogle Scholar
- Clayton JM, Butow PN, Tattersall MH: Randomized controlled trial of a prompt list to help advanced cancer patients and their caregivers to ask questions about prognosis and end-of-life care. J Clin Oncol. 2007, 25: 715-723. 10.1200/JCO.2006.06.7827.View ArticlePubMedGoogle Scholar
- Post DM, Cegala DJ, Miser WF: The other half of the whole: teaching patients to communicate with physicians. Fam Med. 2002, 34: 344-352.PubMedGoogle Scholar
- Cegala DJ, Lenzmeier Broz S: Physician communication skills training: a review of theoretical backgrounds, objectives and skills. Med Educ. 2002, 36: 1004-1016. 10.1046/j.1365-2923.2002.01331.x.View ArticlePubMedGoogle Scholar
- Street RL, Makoul G, Arora NK, Epstein RM: How does communication heal? Pathways linking clinician-patient communication to health outcomes. Patient Educ Couns. 2009, 74: 295-301. 10.1016/j.pec.2008.11.015.View ArticlePubMedGoogle Scholar
- Plsek P: Redesigning health care with insights from the science of complex adaptive systems. Crossing the quality chasm: A new health system for the 21st century. 2001, Washington, DC: National Academy Press, 309-322.Google Scholar
- Cegala DJ, Post DM: The impact of patients’ participation on physicians’ patient-centered communication. Patient Educ Couns. 2009, 77: 202-208. 10.1016/j.pec.2009.03.025.View ArticlePubMedGoogle Scholar
- Street RL, Gordon H, Haidet P: Physicians’ communication and perceptions of patients: is it how they look, how they talk, or is it just the doctor?. Soc Sci Med. 2007, 65: 586-598. 10.1016/j.socscimed.2007.03.036.View ArticlePubMedPubMed CentralGoogle Scholar
- Street RL: Information-giving in medical consultations: the influence of patients’ communicative styles and personal characteristics. Soc Sci Med. 1991, 32: 541-548. 10.1016/0277-9536(91)90288-N.View ArticlePubMedGoogle Scholar
- Street RL, Slee C, Kalauokalani DK: Improving physician-patient communication about cancer pain with a tailored education-coaching intervention. Patient Educ Couns. 2010, 80: 42-47. 10.1016/j.pec.2009.10.009.View ArticlePubMedGoogle Scholar
- Dimoska A, Tattersall MH, Butow PN: Can a “prompt list” empower cancer patients to ask relevant questions?. Cancer. 2008, 113: 225-237. 10.1002/cncr.23543.View ArticlePubMedGoogle Scholar
- Shields CG, Epstein RM, Fiscella K: Influence of accompanied encounters on patient-centeredness with older patients. J Am Board Fam Pract. 2005, 18: 344-354. 10.3122/jabfm.18.5.344.View ArticlePubMedGoogle Scholar
- Powell R, Butow P, Bu S: Good things come in threes? Patient, family, and health professional experiences of triadic communication and decision making in cancer consultations. Psychooncology. 2011, 20: 98-99. 10.1002/pon.1713.View ArticleGoogle Scholar
- Peters E, Dieckmann N, Dixon A: Less is more in presenting quality information to consumers. Med Care Res Rev. 2007, 64: 169-190. 10.1177/10775587070640020301.View ArticlePubMedGoogle Scholar
- Peters E, McCaul KD, Stefanek M, Nelson W: A heuristics approach to understanding cancer risk perception: contributions from judgment and decision-making research. Ann Behav Med. 2006, 31: 45-52. 10.1207/s15324796abm3101_8.View ArticlePubMedGoogle Scholar
- Peters E, Lipkus I, Diefenbach MA: The functions of affect in health communications and in the construction of health preferences. J Commun. 2006, 56: S140-S162. 10.1111/j.1460-2466.2006.00287.x.View ArticleGoogle Scholar
- Reyna VF: A theory of medical decision making and health: fuzzy trace theory. Med Decis Making. 2008, 28: 850-865. 10.1177/0272989X08327066.View ArticlePubMedPubMed CentralGoogle Scholar
- Peters E, Hibbard J, Slovic P, Dieckmann N: Numeracy skill and the communication, comprehension, and use of risk-benefit information. Health Aff. 2007, 26: 741-748. 10.1377/hlthaff.26.3.741.View ArticleGoogle Scholar
- Maly RC, Frank JC, Marshall GN: Perceived efficacy in patient-physician interactions (PEPPI): validation of an instrument in older persons. J Am Geriatr Soc. 1998, 46: 889-894.View ArticlePubMedGoogle Scholar
- Bandura A: Health promotion by social cognitive means. Health Educ Behav. 2004, 31: 143-164. 10.1177/1090198104263660.View ArticlePubMedGoogle Scholar
- Clayton JM, Butow PN, Arnold RM, Tattersall MH: Fostering coping and nurturing hope when discussing the future with terminally ill cancer patients and their caregivers. Cancer. 2005, 103: 1965-1975. 10.1002/cncr.21011.View ArticlePubMedGoogle Scholar
- Hoerger M: Coping strategies and immune neglect in affective forecasting: direct evidence and key moderators. Judgm Decis Mak. 2012, 7: 86-96.PubMedPubMed CentralGoogle Scholar
- Goldstein MG, Niaura R, Willey C: An academic detailing intervention to disseminate physician-delivered smoking cessation counseling: smoking cessation outcomes of the physicians counseling smokers project. Prev Med. 2003, 36: 185-196. 10.1016/S0091-7435(02)00018-X.View ArticlePubMedGoogle Scholar
- Bransford JD, Brown A, Cocking RR: How people learn: Brain, mind, experience, and school. 2000, Wasington DC: National Academy PressGoogle Scholar
- Epstein RM, Shields CG, Franks P: Exploring and validating patient concerns: relation to prescribing for depression. Ann Fam Med. 2007, 5: 21-28. 10.1370/afm.621.View ArticlePubMedPubMed CentralGoogle Scholar
- Fiscella K, Meldrum S, Franks P: Patient trust: is it related to patient-centered behavior of primary care physicians?. Medical Care. 2004, 42: 1049-1055. 10.1097/00005650-200411000-00003.View ArticlePubMedGoogle Scholar
- Butow PN, Brown RF, Cogar S: Oncologists’ reactions to cancer patients’ verbal cues. Psychooncology. 2002, 11: 47-58. 10.1002/pon.556.View ArticlePubMedGoogle Scholar
- Mauksch LB, Hillenburg L, Robins L: The establishing focus protocol: training for collaborative agenda setting and time management in the medical interview. Fam Syst Health. 2001, 19: 147-157.View ArticleGoogle Scholar
- Marvel MK, Epstein RM, Flowers K, Beckman HB: Soliciting the patient’s agenda: have we improved?. JAMA. 1999, 281: 283-287. 10.1001/jama.281.3.283.View ArticlePubMedGoogle Scholar
- Brown RF, Butow PN, Dunn SM, Tattersall MH: Promoting patient participation and shortening cancer consultations: a randomised trial. Br J Cancer. 2001, 85: 1273-1279. 10.1054/bjoc.2001.2073.View ArticlePubMedPubMed CentralGoogle Scholar
- Butow P, Devine R, Boyer M: Cancer consultation preparation package: changing patients but not physicians is not enough. J Clin Oncol. 2004, 22: 4401-4409. 10.1200/JCO.2004.66.155.View ArticlePubMedGoogle Scholar
- Morse DS, Edwardsen EA, Gordon HS: Missed opportunities for interval empathy in lung cancer communication. Arch Intern Med. 2008, 168: 1853-1858. 10.1001/archinte.168.17.1853.View ArticlePubMedPubMed CentralGoogle Scholar
- Ryan H, Schofield P, Cockburn J: How to recognize and manage psychological distress in cancer patients. Eur J Cancer Care. 2005, 14: 7-15.View ArticleGoogle Scholar
- Back AL, Arnold RM, Baile WF: Efficacy of communication skills training for giving bad news and discussing transitions to palliative care. Arch Intern Med. 2007, 167: 453-460. 10.1001/archinte.167.5.453.View ArticlePubMedGoogle Scholar
- Back AL, Arnold RM, Baile WF: Approaching difficult communication tasks in oncology. CA Cancer J Clin. 2005, 55: 164-177. 10.3322/canjclin.55.3.164.View ArticlePubMedGoogle Scholar
- Walczak A, Mazer B, Butow P: A question prompt list for patients with advanced cancer in the final year of life: development and cross-cultural evaluation. Palliat Med. in pressGoogle Scholar
- Oliver JW, Kravitz RL, Kaplan SH, Meyers FJ: Individualized patient education and coaching to improve pain control among cancer outpatients. J Clin Oncol. 2001, 19: 2206-2212.PubMedGoogle Scholar
- Cox K, Wilson E: Follow‐up for people with cancer: nurse‐led services and telephone interventions. J Adv Nurs. 2003, 43: 51-61. 10.1046/j.1365-2648.2003.02672.x.View ArticlePubMedGoogle Scholar
- Kravitz RL, Tancredi DJ, Grennan T: Cancer health empowerment for living without pain (Ca-HELP): effects of a tailored education and coaching intervention on pain and impairment. Pain. 2011, 152: 1572-1582. 10.1016/j.pain.2011.02.047.View ArticlePubMedGoogle Scholar
- Del Piccolo L, De Haes H, Heaven C: Development of the verona coding definitions of emotional sequences to code health providers’ responses (VR-CoDES-P) to patient cues and concerns. Patient Educ Couns. 2011, 82: 149-155. 10.1016/j.pec.2010.02.024.View ArticlePubMedGoogle Scholar
- Shields CG, Coker CJ, Poulsen SS: Patient-centered communication and prognosis discussions with cancer patients. Patient Educ Couns. 2009, 77: 437-442. 10.1016/j.pec.2009.09.006.View ArticlePubMedPubMed CentralGoogle Scholar
- Elwyn G, Edwards A, Mowle S: Measuring the involvement of patients in shared decision-making: a systematic review of instruments. Patient Educ Couns. 2001, 43: 5-22. 10.1016/S0738-3991(00)00149-X.View ArticlePubMedGoogle Scholar
- Elwyn G, Hutchings H, Edwards A: The OPTION scale: measuring the extent that clinicians involve patients in decision‐making tasks. Health Expect. 2005, 8: 34-42. 10.1111/j.1369-7625.2004.00311.x.View ArticlePubMedGoogle Scholar
- Mack JW, Block SD, Nilsson M: Measuring therapeutic alliance between oncologists and patients with advanced cancer: the human connection scale. Cancer. 2009, 115: 3302-3311. 10.1002/cncr.24360.View ArticlePubMedPubMed CentralGoogle Scholar
- Gremigni P, Sommaruga M, Peltenburg M: Validation of the health care communication questionnaire (HCCQ) to measure outpatients’ experience of communication with hospital staff. Patient Educ Couns. 2008, 71: 57-64. 10.1016/j.pec.2007.12.008.View ArticlePubMedGoogle Scholar
- Mishel MH: The measurement of uncertainty in illness. Nurs Res. 1981, 30: 258-263.View ArticlePubMedGoogle Scholar
- Sutherland HJ, Llewellyn-Thomas HA, Lockwood GA: Cancer patients: their desire for information and participation in treatment decisions. J R Soc Med. 1989, 82: 260-263.PubMedPubMed CentralGoogle Scholar
- Degner LF, Sloan JA: Decision making during serious illness: what role do patients really want to play?. J Clin Epidemiol. 1992, 45: 941-950. 10.1016/0895-4356(92)90110-9.View ArticlePubMedGoogle Scholar
- Cohen SR, Mount BM, Strobel MG, Bui F: The McGill quality of life questionnaire: a measure of quality of life appropriate for people with advanced disease. A preliminary study of validity and acceptability. Palliat Med. 1995, 9: 207-219. 10.1177/026921639500900306.View ArticlePubMedGoogle Scholar
- Cella DF, Tulsky DS, Gray G: The functional assessment of cancer therapy scale: development and validation of the general measure. J Clin Oncol. 1993, 11: 570-579.PubMedGoogle Scholar
- Balboni TA, Paulk ME, Balboni MJ: Provision of spiritual care to patients with advanced cancer: associations with medical care and quality of life near death. J Clin Oncol. 2010, 28: 445-452. 10.1200/JCO.2009.24.8005.View ArticlePubMedGoogle Scholar
- Munn JC, Zimmerman S, Hanson LC: Measuring the quality of dying in long-term care. J Am Geriatr Soc. 2007, 55: 1371-1379. 10.1111/j.1532-5415.2007.01293.x.View ArticlePubMedGoogle Scholar
- Goodman D, Fisher E, Chang C: Quality of end-of-life cancer care for Medicare beneficiaries: Regional and hospital-specific analyses. Dartmouth Atlas of Health Care Report Hanover. 2010, NH: Dartmouth College, 1-51.Google Scholar
- Pirl WF, Muriel A, Hwang V: Screening for psychosocial distress: a national survey of oncologists. J Support Oncol. 2007, 5: 499-504.PubMedGoogle Scholar
- Velikova G, Booth L, Smith AB: Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. J Clin Oncol. 2004, 22: 714-724. 10.1200/JCO.2004.06.078.View ArticlePubMedGoogle Scholar
- Currow DC, Ward AM, Plummer JL: Comfort in the last 2 weeks of life: relationship to accessing palliative care services. Support Care Cancer. 2008, 16: 1255-1263. 10.1007/s00520-008-0424-2.View ArticlePubMedGoogle Scholar
- Bensing JM, Roter DL, Hulsman RL: Communication patterns of primary care physicians in the United States and the Netherlands. J Gen Intern Med. 2003, 18: 335-342. 10.1046/j.1525-1497.2003.10735.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Levinson W, Roter D: Physicians’ psychosocial beliefs correlate with their patient communication skills. J Gen Intern Med. 1995, 10: 375-379. 10.1007/BF02599834.View ArticlePubMedGoogle Scholar
- Curtis JR, Patrick DL, Engelberg RA: A measure of the quality of dying and death. Initial validation using after-death interviews with family members. J Pain Symptom Manage. 2002, 24: 17-31. 10.1016/S0885-3924(02)00419-0.View ArticlePubMedGoogle Scholar
- Frison L, Pocock SJ: Repeated measures in clinical trials: analysis using mean summary statistics and its implications for design. Stat Med. 1992, 11: 1685-1704. 10.1002/sim.4780111304.View ArticlePubMedGoogle Scholar
- Murray DM, Varnell SP, Blitstein JL: Design and analysis of group-randomized trials: a review of recent methodological developments. Am J Public Health. 2004, 94: 423-432. 10.2105/AJPH.94.3.423.View ArticlePubMedPubMed CentralGoogle Scholar
- Garcia L: Controlling the false discovery rate in ecological research. Trends Ecol Evol. 2003, 18: 553-554. 10.1016/j.tree.2003.08.011.View ArticleGoogle Scholar
- Clever SL, Novack DH, Cohen DG, Levinson W: Evaluating surgeons’ informed decision making skills: pilot test using a videoconferenced standardised patient. Med Educ. 2003, 37: 1094-1099. 10.1046/j.1365-2923.2003.01713.x.View ArticlePubMedGoogle Scholar
- Novack DH, Cohen D, Peitzman SJ: A pilot test of WebOSCE: a system for assessing trainees’ clinical skills via teleconference. Med Teach. 2002, 24: 483-487. 10.1080/0142159021000012504.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2407/13/188/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.