- Study protocol
- Open Access
- Open Peer Review
Care coordination for complex cancer survivors in an integrated safety-net system: a study protocol
BMC Cancervolume 18, Article number: 1204 (2018)
The growing numbers of cancer survivors challenge delivery of high-quality survivorship care by healthcare systems. Innovative ways to improve care coordination for patients with cancer and multiple chronic conditions (“complex cancer survivors”) are needed to achieve better care outcomes, improve patient experience of care, and lower cost. Our study, Project CONNECT, will adapt and implement three evidence-based care coordination strategies, shown to be effective for primary care conditions, among complex cancer survivors. Specifically, the purpose of this study is to: 1) Implement a system-level EHR-driven intervention for 500 complex cancer survivors at Parkland; 2) Test effectiveness of the strategies on system- and patient-level outcomes measured before and after implementation; and 3) Elucidate system and patient factors that facilitate or hinder implementation and result in differences in experiences of care coordination between complex patients with and without cancer.
Project CONNECT is a quasi-experimental implementation study among 500 breast and colorectal cancer survivors with at least one of the following chronic conditions: diabetes, hypertension, chronic lung disease, chronic kidney disease, or heart disease. We will implement three evidence-based care coordination strategies in a large, county integrated safety-net health system: 1) an EHR-driven registry to facilitate patient transitions between primary and oncology care; 2) co-locating a nurse practitioner trained in care coordination within a complex care team; 3) and enhancing teamwork through coaching. Segmented regression analysis will evaluate change in system-level (i.e. composite care quality score) and patient-level outcomes (i.e. self-reported care coordination). To evaluate implementation, we will merge quantitative findings with structured observations and physician and patient interviews.
This study will result in an evaluation toolkit identifying key model elements, barriers, and facilitators that can be used to guide care coordination interventions in other safety-net settings. Because Parkland is a vanguard of safety-net healthcare nationally, findings will be widely applicable as other safety-nets move toward increased integration, enhanced EHR capability, and experience with growing patient diversity. Our proposal recognizes the complexity of interventions and scaffolds evidence-based strategies together to meet the needs of complex patients, systems of care, and service integration.
ClinicalTrials.gov, NCT02943265. Registered 24 October 2016.
Nearly 70% of the 13 million people living with cancer are “complex cancer survivors,” i.e., those also dealing with other chronic conditions [1, 2]. Further, the prevalence of complex cancer survivors is expected to continue growing [3,4,5,6,7]. Poor, under- and uninsured individuals have the highest burdens of multiple chronic conditions and this is also similarly reflected among cancer survivors [8,9,10,11,12,13,14,15,16,17,18]. Complex cancer survivors need highly coordinated care to ensure optimal outcomes for their cancers, co-existing chronic conditions, and overall quality of life. However, following initial cancer treatment, needs of complex cancer survivors are not well met, resulting in poor health outcomes . Management of a new cancer diagnosis often interrupts existing chronic disease care because patients undergo intensive cancer care for an extended period during which attention to their other conditions may wane. Further, patients with cancer often continue to be followed by oncologists and other specialists [19,20,21,22] with little or no care coordination with primary care clinicians. As a result, care is fragmented  and the providers siloed, [24,25,26] resulting in suboptimal care quality .
Effective care coordination organizes patient care activities and provider information-sharing to facilitate shared-care and appropriate service delivery [21, 24, 28,29,30]. Interventions to improve care coordination have been tested in primary care settings for conditions such as diabetes, hypertension, and depression [31,32,33,34] and shown to be efficacious in improving health care delivery and patient outcomes. However, few studies to date have targeted complex cancer survivors to improve care coordination between oncology and primary care . With the increasing number of cancer survivors (18 million by year 2022) , we urgently need to identify innovative ways to improve care coordination for patients with cancer and multiple chronic conditions to achieve the triple aim of better care outcomes, better patient experience of care, and lower cost [35, 36].
To address this need, our proposed study, Project CONNECT, will adapt and implement care coordination strategies, shown to be effective for primary care conditions, among complex cancer survivors in a large, county integrated safety-net health system. The evidence–based care coordination strategies include: 1) an EHR-driven registry to facilitate patient transitions between primary care and oncology care; 2) co-locating a nurse practitioner trained in care coordination within a complex care team; 3) and enhancing teamwork through coaching. We will evaluate the effectiveness of the intervention on system- and patient-level outcomes and elucidate system and patient factors that facilitate or hinder implementation using mixed methods.
The aims of this study are
Implement a system-level EHR-driven intervention for 500 complex cancer survivors at Parkland, combining three evidence-based care coordination strategies.
Test effectiveness of the strategies on system-and patient-level outcomes using a rigorous, quasi-experimental design with outcomes measured before and after implementation.
Elucidate system and patient factors that facilitate or hinder implementation and result in differences in experiences of care coordination between complex patients with and without cancer.
Project CONNECT is a quasi-experimental implementation study and a mixed-method evaluation.
The study will be conducted at Parkland Health and Hospital System (Parkland), the public, integrated safety-net system for Dallas County. Parkland disproportionately serves under- and uninsured racial and ethnic minority populations that bear high burdens of multiple chronic conditions. The Parkland system includes 12, community-oriented primary care clinics staffed with board-certified family practitioners, internists, advanced practice providers, and nurses whose demographic background align with neighborhood characteristics (60% of physicians are African American, Hispanic, or Asian, 54% female, > 50% bilingual) . The Parkland primary care clinics have been NCQA-accredited Level 3 patient-centered medical homes (PCMH) since 2015. Centralized on the hospital campus, the Parkland cancer program is accredited by the American College of Surgeons Commission on Cancer and participates in the Texas Cancer Registry and actively engaged in quality improvement initiatives, for example, partnering with the Centers for Medicare and Medicaid Innovation in the Oncology Care Model since 2016.
The study includes 500 patients diagnosed with (a) Stage I-III breast or colorectal cancers and (b) diagnosed with one or more of the following chronic conditions: diabetes, hypertension, chronic lung disease, chronic kidney disease, or chronic heart disease.
We will implement a system-level EHR-driven intervention for 500 complex cancer survivors at Parkland, combining three evidence-based care coordination strategies:
EHR-based registry to facilitate patient transitions between primary care and oncology
To facilitate transitions between oncology and primary care, we will develop an EHR-based registry and workflow  using the Epic Reporting Workbench to identify eligible patients and deliver team-based coordinated care (Fig. 1). The Oncology and Primary Care Medical Directors will provide clinical expertise to develop the EHR registry and associated workflow and will also champion implementation of the care coordination strategies. During Year 1, Parkland will educate clinicians and staff about the proposed system change and inform primary care physicians on the ways that the health system seeks to address this need through new patient pathways and access. This training will be included in one of each primary care clinic’s monthly training modules.
Co-locate a nurse coordinator trained in care coordination
Oncology will designate a full-time registered nurse (“nurse coordinator”) with competencies in care coordination  as a key member of the patients’ care team . The nurse coordinator will be tasked primarily in clinical care coordination, continuity/transition management [41,42,43], and assisting patient self-management. [39, 44, 45] The nurse coordinator will review a list of patients from the registry who have initiated cancer treatment in ambulatory oncology using the EHR algorithm and confirm eligibility for this research (Fig. 1). We will confirm the algorithm’s ability to identify Stage I-III complex patients via chart review audit of 50 patients. For cancer survivors established within community primary care, the nurse coordinator will first notify the primary care physician of the survivor’s completion of initial cancer treatment and transition to the cancer survivorship phase. Patients diagnosed with cancers referred in or diagnosed through the emergency department (ED) will be assigned directly to the nurse coordinator who will establish a primary care provider and home within the Parkland system. In-person meetings at the start of cancer treatment will be established by the nurse coordinator when patients begin to attend oncology visits.
At the end of active cancer treatment, the nurse coordinator will initiate an EHR-driven treatment summary and follow-up guidelines, encourage continual interaction with primary care, and recommend transition to the care team post-treatment. S/he will systematically track patients to ascertain completion of initial cancer treatment and, each week, coordinate appointments and lab tests between primary and specialty clinics. Once appointments are made with the primary care physician and social worker, the nurse coordinator will track upcoming appointment results via the EHR-driven registry. Eligible patients will be seen again at treatment end by the nurse coordinator for a transition review. At the visit, the nurse coordinator will synthesize patients’ medical and cancer history, and educate them on follow-up for cancer recurrence, self-management for chronic diseases, and long-term effects of their cancer treatment . The nurse coordinator will also coordinate appropriate specialty care referrals, including smoking cessation, and health behaviors/psychosocial counseling resources already available at Parkland. Information and education will be culturally and literacy-level appropriate, per Parkland standards, as a healthcare provider for diverse and vulnerable communities.
Enhance teamwork through coaching and technical assistance
An external practice facilitator will provide coaching and technical assistance to enhance team-based care [46,47,48]. Ongoing support from expert quality improvement trainers is critical to successfully implement and sustain system changes . Prior to implementation launch, the coach will meet with the nurse coordinator in-person to start the rapport-building process and establish goals and expectations for the coordinator/coach relationship. Then, during the implementation phase, the nurse coordinator and coach will hold regular (30 min, weekly) meetings aimed at providing motivational work and direct recommendations to challenges as they arise, as well as providing specific guidance to identify and assess patients, clarify team member roles, facilitate communication, manage care transitions, and monitor or adjust work flow . The external coach will draw on the principles of process improvement cycles (e.g. Plan-Do-Study-Act), appreciative inquiry, and other coaching strategies over the course of the study to help the nurse coordinator and larger team learn continuously from on-the-ground implementation [50,51,52].
We used the empirically informed Primary Care Practice Change Model, developed by Cohen and colleagues, to guide our mixed-methods evaluation design . Built on principles of complex adaptive systems theory [53,54,55,56] and drawing from results of prior primary care system-level interventions, the model emphasizes the role of multi-level factors influencing implementation. Specifically, it identifies four key elements: internal motivators, external motivators, resources and opportunities for change . These elements can act independently but, because system resources and opportunities are highly interconnected, a change in one can reverberate across the system . For example, resources available to Parkland to support change (e.g. leadership and relationships among practice members) may influence the extent to which clinicians and staff adapt work flow to implement the new EHR-driven strategy to link survivors with primary care. Coupled with availability of a new care coordinator within a dedicated complex care team, this may improve care within the system. Similarly, motivated staff may identify new ways to foster implementation of the strategies. Using provider interviews and structured observations, we will examine how and why motivation of clinic members influences implementation. Using mixed-methods, we will track how these different elements inside and outside the system interact to influence change , and support or hamper sustainability of the intervention strategies [58,59,60,61]. We will identify system- and patient-level factors influencing implementation of the care coordination strategies to systematically pinpoint barriers amenable to ongoing quality improvement and to enable subsequent dissemination to other safety-net settings .
Gathering qualitative and quantitative data before, during, and after implementation will enable us to assess the factors that influence implementation at the system- and patient-levels [56, 63]. Using an intervention mixed methods approach to evaluation will enable us to observe how contextual factors shift during the course of the study [57, 64], to systematically pinpoint facilitators as well as barriers amenable to ongoing quality improvement and to generate transportable lessons for dissemination . To inform real-world implementation intervention, it is important to: (a) describe how the system-level strategies are implemented; (b) elucidate contextual factors affecting implementation at system- and patient-levels; and (c) identify alternate explanations for observed effects on outcomes to generate counterfactual inference.
Table 1 provides an overview of hypotheses, design (sample), data collection time points and outcome measures used.
System-level data collection
Electronic health records (EHR) extraction
We will extract Epic EHR data to evaluate whether patients are meeting quality of care guidelines for multiple chronic conditions and follow-up National Comprehensive Cancer Network (NCCN) guidelines for cancer surveillance. A composite care quality score will be calculated for each patient as the percentage of eligible recommended services received and clinical targets met. We will also measure rates of ED utilization and hospitalizations (secondary outcomes) for ambulatory care-sensitive chronic conditions at the same time points as the primary outcomes [65, 66]. Data will be extracted 12 and 24 months before implementation and 12, 24, and 36 months during implementation.
Further, we will extract EHR data to characterize (1) visit patterns with the nurse coordinator; (2) the extent to which care coordination, disease management and referrals to specialty providers and receipt of referrals occur; (3) patients who do not receive appropriate follow-up services; (4) missed appointments or loss-to follow-up; and (5) processes related to care coordination. We will measure clinical care coordination performed by the nurse coordinator, including: number of referrals to other specialists; number of specialist appointments attended; and number of visit notes sent back to care team members’ Epic EHR inbox.
Quiet observation of daily clinical work with opportunistic discussion with staff at the primary care clinics, oncology clinics, and the complex care team will describe usual care prior to and document how workflow changes after strategies are implemented [67, 68]. Adapted from anthropological participant observation, this method lends itself to multiple levels of observation and analysis [69,70,71,72]. Research staff will conduct 40 h of structured observation prior to implementation and at 3 and 6 months post-implementation.
Providers (n = 30), sampled based on their involvement in cancer survivor follow-up care and chronic disease management, will be invited to interviews assessing their perspectives on patient uptake and other challenges and opportunities. The principal investigators will develop interview guides, train and supervise the team in conducting interviews. Patients and providers completing the interview will be offered an incentive for their time and effort.
Patient-level data collection
Surveys will be administered three times by phone at completion of active cancer treatment (baseline) and twice thereafter at 6 and 12 months. Patient surveys assess care coordination using the Picker Patient Perception of Care Scale [73,74,75], key patient-reported confounding variables (age, race/ethnicity, insurance, income, education, employment and marital status), and potential mediators and moderators (attitudes towards follow-up care, patient activation, self-efficacy, emotional and social support, health literacy, and health-related quality of life) using validated instruments [17, 76,77,78,79,80,81,82] (Table 2). Prior to fielding surveys, we will conduct 15 cognitive interviews (with patients who will be excluded from the larger project) to ensure measures not already validated in Spanish are adapted for language, literacy and cultural appropriateness.
Open-ended patient interviews (n = 70) will be conducted at baseline and throughout the 6 to 12 months post implementation of the complex care team. Both survey respondents, as well as a subset of non-respondents, will be invited to participate in a telephone interview with research staff trained in qualitative methods. Interviews will elucidate the experience of coordination for patients with multiple chronic conditions and enable us to see how cancer may create additional needs or perceptions by asking patients to talk about their experiences and communication with their provider teams. A subset of non-cancer patients with multiple chronic conditions will also be interviewed for additional comparison. Patients completing the interview will be offered a gift card for their time and effort.
We will use segmented logistic regression and linear mixed regression models to assess effect of care coordination strategies on system and patient outcomes. To evaluate system-level hypotheses, we will first use chi-square tests to compare proportion of eligible patients meeting guidelines at 12 and 24 months before implementation to proportion of patients meeting guidelines 12, 24 and 36 months after system-level strategies are in place. We will then use segmented logistic regression models  to identify the time point at which observed trend in proportion of patients meeting guidelines (trajectory rate) markedly changes. We will then test trend for proportion of patients meeting guidelines before implementation of system-level strategies.
Preliminary Parkland data indicate 40% of colorectal cancer survivors (2008–10) met guidelines for cancer surveillance and chronic disease outcomes. To demonstrate a minimum increase of 10% in the primary outcome after implementation of system-level strategies as compared to before implementation, a sample of 170 patients at each time point will provide 80% power at the 0.05 significance level based on the chi-square test for comparing proportions. We have many more patients than needed; as system-level outcomes will be evaluated using EHR data, we will include all eligible patients and conduct subgroup and sensitivity analyses to better characterize effects.
For patient-level hypotheses, we will use linear mixed models to estimate effects on change in scores. Through specification of fixed effects, the mixed model allows for control of confounding variables, and can account for sources of natural heterogeneity by adding random effects that are unique to a particular individual. We will test different covariance matrices for random effects and will choose the matrix yielding the smallest Akaike information criterion or largest restricted maximum likelihood estimate. Residual analyses and plots will examine adequacy of the final model. Retrospective data might be missing. If data are missing at random (MAR), a linear mixed regression model is appropriate to address the issues of repeated measures and missing data in longitudinal studies. If the missing data are not missing at random (NMAR), we will explore the missing data pattern and a technique such as pattern mixture model will be used to adjust for NMAR bias.
Preliminary data show mean care coordination score without intervention is 81.1 (standard deviation = 17.6) [84,85,86]. Assuming intra-subject correlation of 0.7 and minimum detectable standardized effect size of 0.25 (standardized effect size = effect size/standard deviation), we will need 402 patients to attain 80% power at α = 0.05 using proposed mixed-effects linear regression analyses. To accommodate 20% attrition, we will recruit 476 patients- below the 500 available in a 4-year span.
We will combine qualitative and quantitative methods in a convergent interactive analytic design to examine interdependencies between conceptual model elements. Further, we will conduct observations at multiple time points to assess the gradual nature of implementing system change , staggering data collection over time, enabling each method to cross-inform our overall strategy . For instance, interim analyses indicating successful implementation will inform provider interviews to elicit contextual data regarding factors contributing to increases in receipt of guideline-appropriate care . Triangulating such data strengthens validity and decreases deficiencies or biases that might arise from any single method [89,90,91]. Our multi-disciplinary research team minimizes researcher bias by bringing together experts with differing perspectives to review and critique synthesis and interpretation of qualitative findings. By examining “factors that affect interpretation of what happened during the study (internal validity)  and consider what others need to know to transport the study elsewhere (external validity),”  our study will generate the evidence base for care coordination among complex cancer survivors and facilitate dissemination.
We will use NVivo 9.0 (QSR International, AUS) to collate and analyze qualitative data. Use of this software makes the analytic process transparent so that investigators can track evolving analyses . Research staff will transcribe field notes from structured observations and gather existing protocols and documents relating to care of complex patients to enter into the database. We will triangulate across diverse data sources, to understand how providers adapt the strategies to suit the Parkland context [56, 67]. To focus our analysis of model elements and their interdependencies, we will develop a matrix of key concepts, populating cells with observational data and inserting brief excerpts of raw text to substantiate claims or interpretations. This analytic step facilitates cross-case comparisons (e.g. pre- and post-implementation, or between patient types) and in-depth explorations of specific concepts . Through monthly meetings, we will test emergent themes and interpretation against the knowledge base of our study team . We will review coding agreement and resolve discrepancies through consensus [96, 97].
Prior research has not addressed multiple-disease management models; the field has largely focused instead on single cancer sites or individual diseases [21, 98,99,100,101]. Our proposal recognizes the complexity of interventions and scaffolds three evidence-based strategies together to meet the needs of complex patients, systems of care, and service integration. The 2013 IOM report on high-quality cancer care calls explicitly for translation of evidence into practice and research on complex cancer survivors . Our study evaluates proven intervention strategies among cancer survivors of different types contending with other multiple chronic conditions.
Although ~ 11% of cancer survivors are uninsured , little research has been conducted in this population who bear a disproportionate burden of multiple chronic conditions, including cancer [26, 103,104,105,106]. Similarly, care coordination strategies have mainly been implemented in healthcare systems with insured populations [107,108,109]. Safety-nets have important policy significance : the Affordable Care Act used Medicaid expansion as a primary mechanism for extending coverage to the uninsured [10, 110]. Because community providers may not accept Medicaid, most of the new beneficiaries will likely obtain care from safety-net providers [111,112,113]. Finally, because Texas declined Medicaid expansion, this Dallas/Fort Worth-based study is relevant to ~ 20 non-expansion states.
Strengths and limitations
A potential limitation of our study is the inability to evaluate using a randomized controlled trial and differential participation of survivors. However, quasi-experimental designs are uniquely suited to evaluate health services system-level interventions implemented in real-world settings [114, 115]. By incorporating additional design features such as data collection at multiple time points and a mixed-methods evaluation, we strengthen the rigor and validity of our findings by addressing history, maturation, and permit counterfactual inference [57, 92, 116]. By including two cancer types, we can evaluate potential differential effects of each care coordination strategies for different groups of survivors with multiple comorbidities. Furthermore, the use of patient-reported outcome measures makes our research patient-centered  and provides data on patient-level variables influencing outcomes of system-level interventions .
Our intervention and mixed-methods design will result in an evaluation toolkit identifying key model elements, barriers and facilitators that can be used to guide care coordination interventions in other safety-net settings. Because Parkland is a vanguard of safety-net healthcare nationally, findings will be widely applicable as other safety-nets move toward increased integration, enhanced EHR capability, and experience with growing patient diversity . Through leadership in America’s Essential Hospitals, the national association of public hospitals and health systems, Parkland will be well-positioned to provide educational programs for leaders of more than 260 member institutions and disseminate best practices in care coordination, management of multiple chronic conditions and cancer survivorship to the nation’s safety-net systems.
Electronic health record
Missing at random
National Comprehensive Cancer Network
National Committee for Quality Assurance
Not missing at random
Patient-centered medical home
Patient health questionnaire
Patient satisfaction with logistical aspects of navigation
Parry C, Kent EE, Mariotto AB, Alfano CM, Rowland JH. Cancer survivors: a booming population. Cancer Epidemiol Biomark Prev. 2011;20(10):1996–2005.
Cho H, Mariotto AB, Mann BS, Klabunde CN, Feuer EJ. Assessing non-Cancer-related health status of US Cancer patients: other-cause survival and comorbidity prevalence. Am J Epidemiol. 2013;178(3):339–49.
Fast Stats: An interactive tool for access to SEER cancer statistics. Surveillance Research Program, National Cancer Institute. https://seer.cancer.gov/faststats.
Hewitt M, Greenfield S, Stovall E. From cancer patient to cancer survivor: lost in translation. Washington: National Academies Press; 2005.
Oeffinger KC, McCabe MS. Models for delivering survivorship care. J Clin Oncol. 2006;24(32):5117–24.
Miller S. Handbook of cancer control and behavioral science: a resource for researchers, practitioners, and policy makers. Washington: American Psychological Association; 2009.
Anderson G. Chronic care: making the case of ongoing care. Robert Wood Johnson Foundation: Princeton; 2010.
Cunningham P, Felland L, Stark L. Safety-net providers in some US communities have increasingly embraced coordinated care models. Health Aff. 2012;31(8):1698–707.
Quinn MT, Gunter KE, Nocon RS, Lewis SE, Vable AM, Tang H, et al. Undergoing transformation to the patient centered medical home in safety net health centers: perspectives from the front lines. Ethn Dis. 2013;23(3):356–62.
Ku L, Shin P, Regenstein M, Mead H. Promoting the integration and coordination of safety-net health care providers under health reform: Key issues. Issue Brief (Commonwealth Fund). 2011;22:1–13.
Anderson R, Pickens S. Supporting cancer services. Tex Med. 2010;106(9):27–34.
Anderson RJ, Boumbulian PJ, Pickens SS. The role of U.S. public hospitals in urban health. Acad Med Spec Themes: Urban Health. 2004;79(12):1162–8.
Agency for Healthcare Research and Quality. National Healthcare Disparities Report. Rockville: US Dept HHS; 2012.
National Cancer Institute NIH. N.C.I. Fact Sheet: Cancer Health Disparities [Webpage]. Bethesda: National Institutes of Health; 2008. [updated 03/29/2018. Available from: https://www.cancer.gov/about-cancer/understanding/disparities].
Palmer NRA, Kent EE, Forsythe LP, Arora NK, Rowland JH, Aziz NM, et al. Racial and Ethnic Disparities in Patient-Provider Communication, Quality-of-Care Ratings, and Patient Activation Among Long-Term Cancer Survivors. J Clinical Oncol. 2014;32(36):4087–94.
Schootman M, Deshpande A, Pruitt S, Aft R, Jeffe D. National estimates of racial disparities in health status and behavioral risk factors among long-term cancer survivors and non-cancer controls. Cancer Causes Control. 2010;21(9):1387–95.
Paskett ED, Alfano CM, Davidson MA, Andersen BL, Naughton MJ, Sherman A, et al. Breast cancer survivors' health-related quality of life. Cancer. 2008;113(11):3222–30.
Singh G, Jemal A. Socioeconomic and racial/ethnic disparities in Cancer mortality, incidence, and survival in the United States, 1950-2014: over six decades of changing patterns and widening inequalities. J Environ Public Health 2017;2017:19. https://doi.org/10.1155/2017/2189372.
Chen CI, Kuan CF, Miser J, Fang YA, Lam C, Chiu WT, et al. Comorbidity as an independent risk factor in patients with Cancer: an 8-year population-based study. Asia Pac J Public Health. 2015;27(2):NP590–9. https://doi.org/10.1177/1010539513481491.
Adams E, Boulton M, Rose PW, Lund S, Richardson A, Wilson S, et al. A qualitative study exploring the experience of the partners of cancer survivors and their views on the role of primary care. Support Care Cancer. 2012;20(11):2785–94.
Hudson MM, Landier W, Ganz PA. Impact of survivorship-based research on defining clinical care guidelines. Cancer Epidemiol Biomark Prev. 2011;20(10):2085–92.
Adams E, Boulton M, Rose P, Lund S, Richardson A, Wilson S, et al. Views of cancer care reviews in primary care: a qualitative study. Br J Gen Pract. 2011;61(585):173–82.
Skolarus TA, Zhang Y, Hollenbeck BK. Understanding fragmentation of prostate cancer survivorship care. Cancer. 2012;118(11):2837–45.
O’Malley AS, Reschovsky JD. Referral and consultation communication between primary care and specialist physicians: finding common ground. Arch Intern Med. 2011;171(1):56–65.
Stange KC. The problem of fragmentation and the need for integrative solutions. Ann Fam Med. 2009;7(2):100–3.
McCabe MS, Bhatia S, Oeffinger KC, Reaman GH, Tyne C, Wollins DS, et al. American Society of Clinical Oncology statement: achieving high-quality cancer survivorship care. J Clin Oncol. 2013;31(5):631–40.
Roy CL, Poon EG, Karson AS, Ladak-Merchant Z, Johnson RE, Maviglia SM, et al. Patient safety concerns arising from test results that return after hospital discharge. Ann Intern Med. 2005;143(2):121–8.
McDonald K, Schultz E, Albin L, Piñeda N, Lonhart J, Sundaram V, et al. Care coordination measures atlas. Rockville: Agency for Healthcare Research and Quality; 2011. [Available from: https://innovations.ahrq.gov/qualitytools/care-coordination-measures-atlas]
Enthoven AC. Integrated delivery systems: the cure for fragmentation. Am J Manag Care. 2009;15(10 Suppl):S284–90.
Care Coordination. Content last reviewed August 2018. Agency for Healthcare Research and Quality, Rockville, MD. http://www.ahrq.gov/professionals/prevention-chronic-care/improve/coordination/index.html.
Rothman AA, Wagner EH. Chronic illness management: what is the role of primary care? Ann Intern Med. 2003;138(3):256–61.
Vouri SM, Shaw RF, Waterbury NV, Egge JA, Alexander B. Prevalence of achievement of A1c, blood pressure, and cholesterol (ABC) goal in veterans with diabetes. J Manag Care Pharm. 2011;17(4):304–12.
Unützer J, Katon W, Callahan CM, et al. Collaborative care management of late-life depression in the primary care setting: a randomized controlled trial. JAMA. 2002;288(22):2836–45.
Coleman K, Austin BT, Brach C, Wagner EH. Evidence on the chronic care model in the new millennium. Health Aff. 2009;28(1):75–85.
Stiefel M, Nolan K. Measuring the triple aim: a call for action. Popul Health Manag. 2013;16(4):219–20.
Berwick DM, Nolan TW, Whittington J. The triple aim: care, health. And Cost Health Affairs. 2008;27(3):759–69.
Pickens S, Boumbulian P, Anderson RJ, Ross S, Phillips S. Community-oriented primary Care in Action: a Dallas story. Am J Public Health. 2002;92(11):1728–32.
O’Malley AS, Draper K, Gourevitch R, Cross DA, Scholle SH. Electronic health records and support for primary care teamwork. J Am Med Inform Assoc. 2015;22(2):426–34
Haas S, Ann Swan B, Haynes T. Developing ambulatory care registered nurse competencies for care coordination and transition management. Nurs Econ. 2013;31(1):44–3.
Shaw EK, Howard J, West DR, Crabtree BF, Nease DE Jr, Tutt B, et al. The role of the champion in primary care change efforts: from the state networks of Colorado ambulatory practices and partners (SNOCAP). J Am Board Fam Med. 2012;25(5):676–85.
Craig C, Eby D, Whittington J. Care coordination model: better care at lower cost for people with multiple health and social needs. Cambridge: Institute for Healthcare Improvement; 2011.
Coleman E, Parry C, Chalmers S, Min S. The care transitions intervention: results of a randomized controlled trial. Arch Intern Med. 2006;166(17):1822–8.
Wagner EH. Improving care for complex patients: the role of the R.N. care manager. Seattle: The MacColl Center for Health Care Innovation at the Group Health Research Institute; 2012.
Von Korff M, Gruman J, Schaefer J, Curry SJ, Wagner EH. Collaborative Management of Chronic Illness. Ann Intern Med. 1997;127(12):1097–102.
Heijmans M, Waverijn G, Rademakers J, van der Vaart R, Rijken M. Functional, communicative and critical health literacy of chronic disease patients and their importance for self-management. Patient Educ Couns. 2015;98(1):41–8.
Balasubramanian BA, Chase SM, Nutting PA, Cohen DJ, Strickland PA, Crosson JC, et al. Using learning teams for reflective adaptation (ULTRA): insights from a team-based change management strategy in primary care. Ann Fam Med. 2010;8(5):425–32.
Balasubramanian BA, Cohen DJ, Clark EC, Isaacson NF, Hung DY, Dickinson LM, et al. Practice-level approaches for behavioral counseling and patient health behaviors. Am J Prev Med. 2008;35(5 Suppl):S407–13.
MacColl Center for Health Care Innovation at Group Health Research Institute. Coach Medical Home: Coaching Curricula: MacColl Center for Health Care Innovation, Commonwealth Fund, Qualis Health; 2013/ [Available from: http://www.coachmedicalhome.org/coaching-curricula].
Grace SM, Rich J, Chin W, Rodriguez HP. Flexible implementation and integration of new team members to support patient-centered care. Healthcare. 2014;2(2):145–51.
Riggall VK, Smith CM. Creating a sustainable, interprofessional-team training program: initial results. Clin Nurse Spec. 2015;29(3):147–55.
Plonien C, Williams M. Stepping up teamwork via TeamSTEPPS. AORN J. 2015;101(4):465–70.
Vertino KA. Evaluation of a TeamSTEPPS initiative on staff attitudes toward teamwork. J Nurs Adm. 2014;44(2):97–102.
Cohen D, McDaniel RR Jr, Crabtree BF, Ruhe MC, Weyer SM, Tallia A, et al. A practice change model for quality improvement in primary care practice. J Healthc Manag. 2004;49(3):155–68 discussion 69-70.
McDaniel RR, Jordan ME, Fleeman BF. Surprise, surprise, surprise! A complexity science view of the unexpected. Health Care Manag Rev. 2003;28(3):266–78.
McDaniel R, Driebe DJ. Complexity science and health care management. Adv Health Care Manag. 2001;2:11–36.
Ruhe MC, Carter C, Litaker D, Stange KC. A systematic approach to practice assessment and quality improvement intervention tailoring. Qual Manag Health Care. 2009;18(4):268–77.
Stange KC, Glasgow RE. Contextual Factors: The importance of considering and reporting on context in research on the patient-centered medical home. Rockville MD: Agency for Healthcare Research & Quality; 2013 May 2013. Contract No.: AHRQ No.13–0045-EF.
Crabtree BF, Miller WL, Stange KC. Understanding practice from the ground up. J Fam Pract. 2001;50(10):881–7.
Crabtree BF, Miller WL, Aita VA, Flocke SA, Stange KC. Primary care practice organization and preventive services delivery: a qualitative analysis. J Fam Pract. 1998;46(5):403–9.
Miller WL, Crabtree BF, McDaniel R, Stange KC. Understanding change in primary care practice using complexity theory. J Fam Pract. 1998;46(5):369–76.
Miller WL, McDaniel RR Jr, Crabtree BF, Stange KC. Practice jazz: understanding variation in family practices using complexity science. J Fam Pract. 2001;50(10):872–8.
Oeffinger KC, van Leeuwen FE, Hodgson DC. Methods to assess adverse health-related outcomes in cancer survivors. Cancer Epidemiol Biomark Prev. 2011;20(10):2022–34.
Reid RJ, Fishman PA, Yu O, Ross TR, Tufano JT, Soman MP, et al. Patient-centered medical home demonstration: a prospective, quasi-experimental, before and after evaluation. Am J Manag Care. 2009;15(9):e71–87.
Allen D. Understanding context for quality improvement: artefacts, affordances and socio-material infrastructure. Health. 2013;17(5):460–77.
Xing J, Goehring C, Mancuso D. Care coordination program for Washington state Medicaid enrollees reduced inpatient hospital costs. Health Aff. 2015;34(4):653–61.
Bayliss EA, Ellis JL, Shoup JA, Zeng C, McQuillan DB, Steiner JF. Effect of continuity of care on hospital utilization for seniors with multiple medical conditions in an integrated health care system. Ann Fam Med. 2015;13(2):123–9.
Cohen DJ, Crabtree BF, Etz RS, Balasubramanian BA, Donahue KE, Leviton LC, et al. Fidelity Versus Flexibility: Translating Evidence-Based Research into Practice. Am J Prev Med. 2008;35(5, Supplement):S381–S9.
Jaén CR, Crabtree BF, Palmer RF, Ferrer RL, Nutting PA, Miller WL, et al. Methods for evaluating practice change toward a patient-centered medical home. Ann Fam Med. 2010;8(Suppl 1):S9–S20.
Stacey CL, Henderson S, MacArthur KR, Dohan D. Demanding patient or demanding encounter?: a case study of a cancer clinic. Soc Sci Med. 2009;69(5):729–37.
Dohan D. Managing indigent care: a case study of a safety-net emergency department. Health Serv Res. 2002;37:361–76.
Sinding C. Using institutional ethnography to understand the production of health care disparities. Qual Health Res. 2010;20(12):1656–63.
Wind G. Negotiated interactive observation: doing fieldwork in hospital settings. Anthropol Med. 2008;15(2):79–89.
Jenkinson C, Coulter A, Bruster S. The picker patient experience questionnaire: development and validation using data from in-patient surveys in five countries. Int J Qual Health Care. 2002;14(5):353–8.
Jenkinson C, Coulter A, Reeves R, Bruster S, Richards N. Properties of the picker patient experience questionnaire in a randomized controlled trial of long versus short form survey instruments. J Public Health Med. 2003;25(3):197–201.
Rathert C, Williams ES, McCaughey D, Ishqaidef G. Patient perceptions of patient-centred care: empirical test of a theoretical model. Health Expect. 2015;18(2):199–209. https://doi.org/10.1111/hex.12020.
Gustafson DH, Hawkins R, McTavish F, Pingree S, Chen WC, Volrathongchai K, et al. Internet-based interactive support for Cancer patients: are integrated systems better? J Commun. 2008;58(2):238–57.
Jeppesen KM, Coyle JD, Miser WF. Screening questions to predict limited health literacy: a cross-sectional study of patients with diabetes mellitus. Ann Fam Med. 2009;7(1):24–31.
Sarkar U, Fisher L, Schillinger D. Is self-efficacy associated with diabetes self-management across race/ethnicity and health literacy? Diabetes Care. 2006;29(4):823–9.
Stiggelbout AM, de Haes JC, Vree R, van de Velde CJ, Bruijninckx CM, van Groningen K, et al. Follow-up of colorectal cancer patients: quality of life and attitudes towards follow-up. Br J Cancer. 1997;75(6):914–20.
Hung DY, Glasgow RE, Dickinson LM, Froshaug DB, Fernald DH, Balasubramanian BA, et al. The chronic care model and relationships to patient health status and health-related quality of life. Am J Prev Med. 2008;35(5 Suppl):S398–406.
Lerman CE, Brody DS, Caputo GC, Smith DG, Lazaro CG, Wolfson HG. Patients' perceived involvement in care scale: relationship to attitudes about illness and medical care. J Gen Intern Med. 1990;5(1):29–33.
Bishop WP, Lee SJC, Skinner CS, Jones TM, McCallister K, Tiro JA. Validity of single-item screening for limited health literacy in English and Spanish speakers. Am J Public Health. 2016;106(5):889–92.
Pastor R, Guallar E. Use of two-segmented logistic regression to estimate change-points in epidemiologic studies. Am J Epidemiol. 1998;148(7):631–42.
Borowsky SJ, Nelson DB, Fortney JC, Hedeen AN, Bradley JL, Chapko MK. VA Community-based outpatient clinics - performance measures based on patient perceptions of care. Med Care. 2002;40(7):578–86.
Cleary PD, Edgmanlevitan S, Roberts M, Moloney TW, Mcmullen W, Walker JD, et al. Patients evaluate their hospital-care - a National Survey. Health Aff. 1991;10(4):254–67.
Wolf A, Olsson LE, Taft C, Swedberg K, Ekman I. Impacts of patient characteristics on hospital care experience in 34,000 Swedish patients. BMC Nurs. 2012;11:8.
Crabtree BF, Nutting PA, Miller WL, McDaniel RR, Stange KC, Jaen CR, et al. Primary care practice transformation is hard work: insights from a 15-year developmental program of research. Med Care. 2011;49(Suppl):S28–35.
Simons L, Lathlean J, Squire C. Shifting the focus: sequential methods of analysis with qualitative data. Qual Health Res. 2008;18(1):120–32.
Farmer T, Robinson K, Elliott SJ, Eyles J. Developing and implementing a triangulation protocol for qualitative Health Research. Qual Health Res. 2006;16(3):377–94.
Thurmond VA. The point of triangulation. J Nurs Scholarsh. 2001;33(3):253–8.
Mays N, Pope C. Rigour and qualitative research. BMJ. 1995;311(6997):109–12.
Cook TD, Shadish WR, Wong VC. Three conditions under which experiments and observational studies produce comparable causal estimates: new findings from within-study comparisons. J Policy Anal Manag. 2008;27(4):724–50.
Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods. 2006;5:1–11.
Miles MB, Huberman AM. Qualitative data analysis. 2nd ed. Newbury Park: Sage; 1994.
Morse JM. Constructing qualitatively derived theory: concept construction and concept typologies. Qual Health Res. 2004;14(10):1387–95.
Cohen DJ, Crabtree BF. Evaluative criteria for qualitative research in health care: controversies and recommendations. Ann Fam Med. 2008;6(4):331–9.
Bradley EH, Curry LA, Devers KJ. Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv Res. 2007;42(4):1758–72.
Tinetti ME, Bogardus ST Jr, Agostini JV. Potential pitfalls of disease-specific guidelines for patients with multiple conditions. N Engl J Med. 2004;351(27):2870–4.
Bickell NA, Young GJ. Coordination of care for early-stage breast cancer patients. J Gen Intern Med. 2001;16(11):737–42.
Alsamarai S, Yao X, Cain HC, Chang BW, Chao HH, Connery DM, et al. The Effect of a Lung Cancer Care Coordination Program on Timeliness of Care. Clin Lung Cancer. 2013;14(5):527–34. https://doi.org/10.1016/j.cllc.2013.04.004.
Hershman DL, Greenlee H, Awad D, Kalinsky K, Maurer M, Kranwinkel G, et al. Randomized controlled trial of a clinic-based survivorship intervention following adjuvant therapy in breast cancer survivors. Breast Cancer Res Treat. 2013;138(3):795–806.
Institute of Medicine. Delivering High-Quality Cancer Care: Charting a new course for a system in crisis. Washington: National Academies Press; 2013.
Nekhlyudov L, Greene SM, Chubak J, Rabin B, Tuzzio L, Rolnick S, et al. Cancer research network: using integrated healthcare delivery systems as platforms for cancer survivorship research. J Cancer Surviv. 2013;7(1):55–62.
Guidry JJ, Torrence W, Herbelin S. Closing the divide: diverse populations and cancer survivorship. Cancer. 2005;104(S11):2577–83.
Chubak J, Tuzzio L, Hsu C, Alfano CM, Rabin BA, Hornbrook MC, et al. Providing care for cancer survivors in integrated health care delivery systems: practices, challenges, and research opportunities. J Oncol Pract. 2012;8(3):184–9.
Pollack LA, Hawkins NA, Peaker BL, Buchanan N, Risendal BC. Dissemination and translation: a frontier for Cancer survivorship research. Cancer Epidemiol Biomark Prev. 2011;20(10):2093–8.
Wagner E, Austin B, Davis C, Hindmarsh M, Schaefer J, Bonomi A. Improving chronic illness care: translating evidence into action. Health Aff (Millwood). 2001;20(6):64–78.
Liss DT, Chubak J, Anderson ML, Saunders KW, Tuzzio L, Reid RJ. Patient-reported care coordination: associations with primary care continuity and specialty care use. Ann Fam Med. 2011;9(4):323–9.
MacPhail LH, Neuwirth EB, Bellows J. Coordination of diabetes care in four delivery models using an electronic health record. Med Care. 2009;47(9):993–9.
Long A, Bailit M. Health reform and the patient-centered medical home: policy provisions and expectations of the patient protection and affordable care act. Seattle: Qualis Health and Bailit Health Purchasing; 2010.
Witgert K, Hess C. Including safety-net providers in integrated delivery systems: issues and options for policymakers. Issue Brief Commonw Fund. 2012;20:1–18.
Neuhausen K, Spivey M, Kellermann AL. State Politics and the Fate of the Safety Net. New England Journal of Medicine. 2013;369(18):1675–7. https://doi.org/10.1056/NEJMp1310572.
Graves JA. Medicaid expansion opt-outs and uncompensated care. N Engl J Med. 2012;367(25):2365–7.
Maciejewski ML, Curtis LH, Dowd B. Study design elements for rigorous quasi-experimental comparative effectiveness research. J Comp Eff Res. 2013;2(2):159–73.
Harris AD, McGregor JC, Perencevich EN, Furuno JP, Zhu J, Peterson DE, et al. The use and interpretation of quasi-experimental studies in medical informatics. J Am Med Inf Assoc. 2006;13(1):16–23.
Shadish WR, Cook TD, Campbell DT. Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin Boston: New York; 2002.
Bayliss EA, Balasubramianian BA, Gill JM, Stange KC. Perspectives in primary care: implementing patient-centered care coordination for individuals with multiple chronic medical conditions. Ann Fam Med. 2014;12(6):500–3.
Kotronoulas G, Kearney N, Maguire R, Harrow A, Di Domenico D, Croy S, et al. What is the value of the routine use of patient-reported outcome measures toward improvement of patient outcomes, processes of care, and health service outcomes in Cancer care? A systematic review of controlled trials. J Clin Oncol. 2014;32(14):1480–501.
Hacker K, Santos P, Thompson D, Stout SS, Bearse A, Mechanic RE. Early experience of a safety net provider reorganizing into an accountable care organization. J Health Polit Policy Law. 2014;39(4):901–17.
We would like to thanks Ms. Jessica Austin for her editorial assistance.
This study is funded by a research grant from the National Cancer Institute (R01CA203856).
Availability of data and materials
Ethics approval and consent to participate
Protocol was approved by the University of Texas Southwestern Medical Center IRB (STU# 102015–090) and the Office of Research Administration, Parkland Health & Hospital System. UT Southwestern is the IRB of record for Parkland Health and Hospital System.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.