- Study protocol
- Open Access
Using digital health to facilitate compliance with standardized pediatric cancer treatment guidelines in Tanzania: protocol for an early-stage effectiveness-implementation hybrid study
BMC Cancer volume 20, Article number: 254 (2020)
In high-income countries (HICs), increased rates of survival among pediatric cancer patients are achieved through the use of protocol-driven treatment. Compared to HICs, differences in infrastructure, supportive care, and human resources, make compliance with protocol-driven treatment challenging in low- and middle-income countries (LMICs). For successful implementation of protocol-driven treatment, treatment protocols must be resource-adapted for the LMIC context, and additional supportive tools must be developed to promote protocol compliance. In Tanzania, an LMIC where resource-adapted treatment protocols are available, digital health applications could promote protocol compliance through incorporation of systematic decision support algorithms, reminders and alerts related to patient visits, and up-to-date data for care coordination. However, evidence on the use of digital health applications in improving compliance with protocol-driven treatment for pediatric cancer is limited. This study protocol describes the development and evaluation of a digital health application, called mNavigator, to facilitate compliance with protocol-driven treatment for pediatric cancer in Tanzania.
mNavigator is a digital case management system that incorporates nationally-approved and resource-adapted treatment protocols for two pediatric cancers in Tanzania, Burkitt lymphoma and retinoblastoma. mNavigator is developed from an open-source digital health platform, called CommCare, and guided by the Consolidated Framework for Implementation Research. From July 2019–July 2020 at Bugando Medical Centre in Mwanza, Tanzania, all new pediatric cancer patients will be registered and managed using mNavigator as the new standard of care for patient intake and outcome assessment. Pediatric cancer patients with a clinical diagnosis of Burkitt lymphoma or retinoblastoma will be approached for participation in the study evaluating mNavigator. mNavigator users will document pre-treatment and treatment details for study participants using digital forms and checklists that facilitate compliance with protocol-driven treatment. Compliance with treatment protocols using mNavigator will be compared to historical compliance rates as the primary outcome. Throughout the implementation period, we will document factors that facilitate or inhibit mNavigator implementation.
Study findings will inform implementation and scale up of mNavigator in tertiary pediatric cancer facilities in Tanzania, with the goal of facilitating protocol-driven treatment.
The study protocol was registered in ClinicalTrials.gov (NCT03677128) on September 19, 2018.
In high-income countries (HICs), protocol-driven treatment has led to substantial improvements in survival among pediatric cancer patients by reducing uncertainty in clinical decision-making, creating uniformity in the approach to diagnosis and treatment, and ensuring consistency across providers [1,2,3,4]. However, over 85% of the 400,000 children newly diagnosed with cancer each year live in low- and middle-income countries (LMICs) where differences in infrastructure, supportive care, and human resources limit implementation of protocol-driven treatment . These challenges in LMICs necessitate protocol adaptation for available resources to achieve successful implementation of protocol-driven treatment. Yet, in many LMIC settings where resource-adapted protocols are available, suboptimal protocol compliance contributes to treatment abandonment, further exacerbating the 60% survival disparity gap between HICs and LMICs. The use of supportive tools can facilitate compliance with protocol-driven treatment by standardizing clinical decision-making, and incorporation of decision support, checklists, and improved data use. However, in LMICs, instances of, and evidence on the effectiveness of such supportive tools is lacking.
Digital health applications have been used as tools to support providers with implementation of standardized protocols for the integrated management of childhood illnesses in Tanzania, HIV care in South Africa, and antenatal care in Nigeria [5,6,7,8,9,10,11]. In the case of integrated management of childhood illnesses, provider compliance with the digital protocol increased by up to 30% compared to the use of a paper-based protocol . In addition to the impact on protocol-driven treatment, digital health applications have been applied in low-resource settings to facilitate task shifting, improve work planning and coordination between providers, as well as enhance the performance of health workers [12,13,14,15]. These data support the use of digital health applications to improve compliance with protocol-driven treatment [16,17,18].
The goal of this early-stage effectiveness-implementation hybrid study is to develop a digital case management system, called mNavigator, to facilitate protocol-driven treatment for pediatric cancer, and evaluate its preliminary effectiveness in a tertiary care setting in Tanzania. Currently, resource-adapted treatment protocols for two pediatric cancers, Burkitt lymphoma and retinoblastoma, are approved for use at all pediatric cancer centers by the Tanzanian Ministry of Health, Community Development, Gender, Elderly and Children. However, compliance with these treatment protocols is low in pediatric cancer centers in Tanzania, making this an ideal LMIC setting for testing a digital health system for supporting protocol compliance. To our knowledge, mNavigator is the first digital case management system leveraging mobile devices and being developed for improving protocol compliance in pediatric cancer in LMICs.
The elements of the mNavigator system are reported below consistent with the Template for Intervention Description and Replication (TIDieR) checklist (see Table 1), the SPIRIT checklist for protocols (Additional file 1 Table S1), and the World Health Organization trial registration dataset (Additional file 1 Table S2).
This early-stage effectiveness-implementation hybrid study has two primary aims:
Aim 1. To develop mNavigator by adapting an open-source digital health case management platform, CommCare, to incorporate protocol-driven treatment for pediatric cancer.
Aim 2. To evaluate the effectiveness of mNavigator for improving provider compliance with protocol-driven treatment for pediatric cancer and reducing treatment abandonment.
A secondary aim of the study is to understand factors that facilitate or inhibit the implementation of mNavigator in tertiary care settings for pediatric cancer.
The study will be implemented at Bugando Medical Centre (BMC) in Mwanza, Tanzania. BMC serves a catchment area of 15 million people and is one of three tertiary cancer centers in Tanzania that treat pediatric cancer patients. In 2019, the oncology unit at BMC comprises 2 medical oncologists, 1 radiation oncologist, 1 junior medical officer, 10 nurses, 2 pediatric patient navigators, and 1 clinic coordinator. Annually, approximately 150 new pediatric patients are diagnosed with cancer at BMC. The Tanzanian Ministry of Health Community Development, Gender, Elderly and Children collaborated with representatives from each of the three tertiary pediatric cancer centers in Tanzania to develop a protocol–treatment consensus for two of the most common national pediatric cancer diagnoses -- Burkitt lymphoma (BL) and retinoblastoma (Rb). These diagnoses constitute 35% of children with cancer presenting to BMC. Despite the introduction of these guidelines, provider compliance with these guidelines is less than 20%. (Kristin Schroeder, Personal communication).
Materials specific to intervention development are described below.
Treatment protocols: International pediatric cancer consortiums have developed resource-adapted treatment protocols specifically for use in LMICs [19,20,21,22]. The study uses resource-adapted treatment protocols for Burkitt lymphoma and retinoblastoma, which have already been approved for use at three pediatric cancer centers by the Tanzanian Ministry of Health Community Development, Gender, Elderly and Children .
Software and subscription plan: mNavigator will be developed using CommCare, a highly validated, HIPAA-compliant, open-source digital health platform developed by Dimagi Inc. [24, 25] This extensible and modular platform includes an existing module for tracking individuals through a continuum of service delivery that can be customized for the proposed application to manage pediatric cancer care . The CommCare platform has two core components: a mobile application and CommCareHQ. CommCare mobile application runs on a mobile phone or tablet, and is built on a decision and logic-processing platform that can support oncology providers and staff by providing critical data-quality checks based on patient data and calculations at each point of service throughout treatment. CommCareHQ is a cloud-based system, which allows application development, data management and reporting. The application builder enables complex branching logic and data validation suitable for the implementation of a standardized protocol. The application works offline, making its use highly feasible in settings with low connectivity. Access to the CommCare platform is via a subscription plan with tiered pricing. For this study, the Pro plan was purchased ($500/month).
Training: All study staff participating in the development of mNavigator completed two online training modules on the Dimagi Academy website (CommCare fundamentals and CommCare application building) prior to accessing CommCare HQ.
CommCare accounts: Each study staff member created an account to log in to CommCare HQ. Account creation and access controls are managed centrally by an admin user.
Hardware: mNavigator will be deployed on Android tablets. For this study, mNavigator was deployed on Samsung Galaxy Tab. A devices. Since the system is hosted on Dimagi’s servers and included in the subscription service, additional hardware related to data storage was not needed for this study or for future routine clinical use.
A list of resources is described in Additional file 1 Table S3. Resources are described as existing (available irrespective of study status) or study-supported (potentially not sustainable post-study).
mNavigator comprises four key modules:
Pre-diagnosis module: This includes data entry forms that enable registration of new patients, collection of socio-demographic data and clinical history, entry of laboratory and imaging results at presentation, and assignment of a working diagnosis.
Burkitt lymphoma (BL) module: This includes data entry forms specific to patients diagnosed with Burkitt lymphoma to document cancer staging, planned treatment (including details of the dose and timing of for each chemotherapy cycle), end of therapy evaluation, and follow up visit planning. Throughout the forms in this module, Burkitt lymphoma treatment guidelines are incorporated as prompts for data entry, computation of relevant lab values, adjustment of chemotherapy regimen, scheduling of chemotherapy cycles, and post-treatment follow up.
Retinoblastoma (Rb) module: This module is similar to the Burkitt module, except that it is specific to patients diagnosed with retinoblastoma and incorporates the specific treatment guidelines for retinoblastoma.
Non-BL/Rb module: This module includes data entry forms for patients who are not diagnosed with Burkitt lymphoma or retinoblastoma. The forms do not track the treatment of the patients or incorporate treatment guidelines. Rather, they enable tracking of patient demographics and outcomes.
Four users (1 junior physician, 2 patient navigators, and 1 clinic coordinator) will be trained to use mNavigator at BMC. In addition to the physician, one patient navigator has medical training as a clinical officer. The remaining two users have training in social work. All four have worked in the oncology department for at least 2 years and were chosen as the intended users of mNavigators since they are currently responsible for coordinating clinical care for pediatric cancer patients at BMC, and hence, frequently interact with patients and their families at the hospital. They are comfortable with smartphone technology (they own and use personal smartphones) and, as part of current job responsibilities, are knowledgeable with accessing online databases in cloud based systems.
Mode of delivery
The users will access mNavigator on an Android tablet (Samsung Galaxy Tab. A). To access mNavigator, users will log into the CommCare application then select mNavigator from a menu of applications. CommCare supports offline log in and data collection.
The users will use mNavigator during one-on-one interactions with patients and their caregivers. At the first interaction with each cancer patient, the users will register the patient. During subsequent interactions, users will:
Enter pre-diagnostic labs and imaging tests.
Assign patients based on physician preliminary clinical evaluation to BL, Rb, or non-BL/Rb cohorts for further assessment.
Complete and review pre-treatment staging and laboratory checklists for patients with preliminary Rb or BL diagnosis to facilitate protocol compliance.
Deliver cancer educational information in video format.
Review treatment guidelines with decision support algorithms to facilitate care coordination between mNavigator users and prescribing physicians.
Enter information on changes in treatment plan, including referrals to outside hospitals, second line treatment, or palliation.
Follow-up with patients to record health related outcomes (on treatment, off therapy, relapsed disease, etc.) and vital status.
Theoretical framework for intervention development and evaluation
Our intervention development is guided by the Consolidated Framework for Implementation Research (CFIR) and our evaluation is informed by CFIR and RE-AIM [27, 28]. This study will address characteristics of the:
Outer setting (e.g., patients’ needs and resources, diagnosis delays, test availability);
Inner setting (e.g., compatibility of the protocols with the existing workflows at BMC, organizational readiness to change),
Individuals (e.g., providers’ self-efficacy for using the protocols, acceptability of intervention), and
Intervention (e.g., using evidence-based protocols; low complexity of intervention design) in this project.
Details of how the study will address the characteristics listed above are presented in Additional file 1 Table S4.
Study activities are summarized in Table 2. The implementation process using CFIR comprises four iterative steps: Plan, Engage, Execute, Reflect and evaluate. As described below, these four iterative steps are incorporated throughout mNavigator development and evaluation.
Study phase 1: intervention development
The four study activities during mNavigator development are:
Workflow mapping and form development,
Form programming in CommCare
Workflow mapping: During this stage, a pediatric cancer expert (KS) and a digital health expert (LV) led the development of workflow diagrams for mNavigator. The workflow diagrams were created using LucidChart Pro (www.lucidchart.com), and reflected the current clinical workflows at BMC as well as the nationally-approved, resource-adapted protocols for Burkitt lymphoma and retinoblastoma. Workflow diagrams were updated based on feedback from other study team members. Workflows attempted to capture all steps that mNavigator users would go through with pediatric cancer patients, beginning from patient registration and ending in an outcome form. As an illustration, the draft workflow for retinoblastoma staging is shown in Fig. 1. KS and LV developed a list of forms to document workflow steps and patient information. Over fifty forms were built out using Microsoft Word by KS and refined with input from study team members to mimic the eventual data entry prompts (including question type, skip logic, display logic, calculations, etc.) in mNavigator.
Form programming: A three-member programming team (LV, YR, KG) programmed the forms in the mNavigator application using CommCareHQ form builder. A dedicated project manager from Dimagi Inc. was assigned to the project as part of a 6-month advisory services contract. The project manager worked closely with the researchers to navigate any programming issues, assist with programming complex logic or calculations, and provide other consultation as necessary for mNavigator development. For each form, one programmer was assigned to be the primary builder, while a second programmer reviewed the build and made any necessary adjustments. Any modifications to the forms were discussed by the team before being implemented on CommCare. Figure 2 shows screenshots of the draft mNavigator user interface.
Program Quality Assurance: A quality assurance plan was implemented to check mNavigator for comprehensiveness of patient scenarios and clinical workflows, accuracy of clinical recommendations, and alignment with treatment guidelines. Steps in the quality assurance plan included:
Development of fictitious personas to simulate patients and most common workflow pathways, and test programmed decision logic. Details of personas included socio-demographic characteristics, clinical history, cancer diagnosis and staging, and treatment plan.
Testing the app for errors in flow or output using personas. Details of the personas were entered into mNavigator to assess the application flow, as well as to assess if calculations and recommendations being made are correct based on the standardized treatment protocol. An example of a correct application flow was for mNavigator to assign a patient to the Burkitt lymphoma module when a diagnosis of Burkitt lymphoma was entered in the diagnosis form. Any errors or areas for improvement were documented as detailed notes or checklists and used to inform revisions.
Testing the app for errors in flow or output using historical patient data. mNavigator was further evaluated using historical patient data to assess the application flow, as well as to assess if calculations and recommendations being made are correct based on the standardized treatment protocol. Any errors or areas for improvement were documented as notes.
Usability testing: Research staff introduced approximately 15 BMC personnel to mNavigator during a study launch event in July 2019. Attendees were BMC health professionals who provide routine clinical care for pediatric cancer patients including patient navigators, clinical coordinators, health providers and other clinical staff as well as non-clinical staff and other key stakeholders whose buy-in was necessary for the successful implementation of mNavigator. One BMC staff member with database management and information technology skills was trained on how to further customize, deploy and manage mNavigator. A post-usability survey with the four mNavigator users was used to assess system usability (using the System Usability Scale), relative advantage over standard of care, acceptability and satisfaction. Additional feedback on system features received during the study launch was also documented as notes.
Phase 2: intervention evaluation
Training and usability testing will be followed by supported implementation and evaluation (early-stage effectiveness-implementation trial).
mNavigator will be used as the standard of care for patient intake and outcome tracking of pediatric cancer patients at BMC. All pediatric cancer patients at BMC will be registered and tracked in mNavigator. For research purposes, research staff (e.g., research coordinator, mNavigator users, etc.) will consent caregivers of any patients who receive a clinical diagnosis of Rb or BL for tracking their treatment information. Data for only those providing informed consent will be used in the research study (with the exception of historical data). For consenting patients, mNavigator will be used for treatment management with a typical treatment duration of 3 months for patient with BL and 4 months for patient with Rb.
There will be mixed methods data collection including semi-structured qualitative interviews and a quantitative survey including validated measures such as Organizational Readiness for Implementing Change (ORIC) .
Quantitative data collection
To measure compliance with standardized pediatric oncology protocols, we will use personal and clinical data points routinely collected as part of clinical visits along with the data entered into mNavigator.
We will compare treatment protocol compliance between BL/Rb retrospective patients (treated between 2015 and 19 when standardized treatment protocols for BL and Rb were introduced at BMC, but before introduction of mNavigator) and BL/Rb prospective patients (treated using mNavigator). To collect retrospective medical record data, trained research staff will abstract medical data into mNavigator from paper records for patients diagnosed with BL and Rb between 2015 and 19. Items abstracted will include as many data points available in paper records that are included in mNavigator.
To assess factors that may facilitate or inhibit implementation of the system and inform scale-up and design of future studies, we will periodically conduct observations, or use surveys and/or checklists to collect data related to the following areas:
Technical functionality (such as content, time to complete forms)
Technical stability (network connectivity, server downtime, failure and errors; issues with quality of data and system, device damage)
Fidelity and quality of system implementation. These data will help us assess and describe the fidelity of the intervention (how mNavigator was used in practice and whether protocol steps were followed
Qualitative data collection
We will invite mNavigator users to complete a 30–45 min in-depth interviews to discuss system acceptance and usability, and satisfaction. Using the validated ORIC measure, we may also revisit the degree of change in readiness and commitment over time to use mNavigator and change in efficacy, a belief in the capacity at BMC to implement mNavigator.
We will also reach out to parents or caregivers of pediatric oncology patients to conduct in-depth qualitative interviews to explore factors that may contribute to treatment abandonment (barriers and facilitators to initiating or completing treatment). Participants will be able to choose to complete the interview in Swahili or English. Interviews will be transcribed verbatim. Those interviews conducted in Swahili will be translated into English.
We will document activities contributing to increased research capacity at BMC. Examples of research capacity include: (a) technology transfer and research capacity for implementation of digital health interventions among BMC investigators through collaborations with Duke and Dimagi Inc.; (b) continued development of research management capacity through weekly conference calls between project coordinators regarding budget management, quality assurance oversight, and local staff leadership. We will also document the process of training and ongoing support provided to mNavigator users.
Data validation and audit
Data validation is built into mNavigator in the form of required responses, checks for response length and format, and decision support. The study PI (KS) and the junior medical officer will complete full audits of the first 5 enrolled BL and/or Rb patients whose treatment is tracked using mNavigator. Subsequently, they will audit records of 1 in every 10 patients. Any errors in mNavigator programming will be fixed on an ongoing basis.
The following two groups of participants will be identified and screened for eligibility.
BMC health professionals and staff: We will approach BMC personnel, both who will directly use mNavigator and/or those whose work will be impacted by mNavigator, to offer enrollment in the study to help test the usability of the mNavigator system or provide general feedback prior to implementation and during implementation. BMC personnel will include health professionals who provide routine clinical care for pediatric cancer patients such as patient navigators, clinical coordinators, health providers and other clinical staff as well as non-clinical staff and other key stakeholders whose buy-in will be necessary for the successful implementation of mNavigator. Health professionals and staff will be identified to participate in this study based on the following inclusion criteria:
Must be a health provider or staff working at BMC who provide care or support clinical care for cancer patients at BMC (medical oncologists, radiation oncologists, nurses, patient navigators, clinical coordinators, among others), or other key stakeholder.
Must be 18 years or older at the time of informed consent.
Parents or caregivers and their child who is a BMC pediatric oncology patient with diagnosis of BL or Rb
As part of standard of care for patient intake, mNavigator will be used to register new BMC pediatric oncology patients yearly. Over the course of 1 year, patients with a diagnosis of BL or Rb will be followed for the duration of treatment (typically 3 months for BL and 4 months for Rb) using mNavigator. Eligible participants are:
Patients with suspected or known diagnosis of either BL and Rb
Patients younger than 18 years of age at enrollment
Since all patients enrolled in the study will be children younger than 18 years old at the time of diagnosis, written consent will be obtained from parent, guardian or caregiver (see Additional file 2 for example consent). Assent will be sought for children who are 6 years old or older. Patients who turn 18 years of age during active study participation will be re-consented as adults. After explaining the purpose of the study, as well as the process, consent will be obtained in writing or verbally (with thumbprint in the presence of a literate witness), depending on participant’s literacy. Comprehension of the information provided will be ensured by asking potential participants if they completely understand the project aim and process. Research staff will also ask participants to repeat, in their own words, what they understand about the research study and how we are asking them to participate. These methods to ensure comprehension and avoid unintentional coercion will be taught to research staff prior to conducting any consents.
Sample size and recruitment
Sample size estimates are based on the patient volume at BMC. Based on prior experience, approximately 150 new pediatric patients present each year for cancer management at BMC. Of these, approximately 50 patients are anticipated to have a diagnosis of BL or Rb. All new patients will be registered in mNavigator, and all patients with BL and Rb who provide informed consent will be tracked in the system for treatment management. Historical data is anticipated to be available for approximately 200 BL and Rb patients from 2015 to 2019 (i.e., 50 records/year). All available historical data will be used in the comparator arm. Similarly, approximately 15 health professionals at BMC are identified as individuals directly or indirectly impacted by mNavigator, all of whom will be approached for study participation. All prospective participants will be approached in person to provide study information and invite participation.
To ensure thematic saturation of qualitative data and that diverse perspectives are heard, we will complete an interview with parents of at least 12 BL and 12 Rb patients. Interviews may be recorded using an encrypted digital device.
Study outcomes are summarized in Tables 3 and 4. Measurement of study outcomes is guided by the RE-AIM framework. In mNavigator, we will collect data points that will allow us to measure outcomes in the following domains:
Reach – e.g., proportion of eligible patients for whom protocol was used.
Effectiveness – e.g., proportion of cases that abandoned care, with treatment completion and time from hospital presentation to confirmed diagnosis
Adoption – e.g., proportion of providers who use the protocol, provider acceptability and satisfaction with mNavigator content, ease of delivery and credibility
Implementation/Compliance – e.g., proportion of protocol steps completed per patient
Maintenance (measured in future studies)
Quantitative analysis plan
Descriptive statistical measures (e.g., frequencies, means, proportions, etc.) will be generated using STATA (v15 or higher) to describe basic socio-demographic and clinical profiles of study participants. A compliance score will be generated based on the proportion of protocol steps completed. Difference-in-difference (DID) estimation will be used to track longitudinal differences in compliance from baseline to end line at BMC. For secondary outcomes, logistic regression will be used to assess provider characteristics associated with protocol compliance and completion of critical steps in the checklist. Patient characteristics at BMC will be compared using χ2 tests (binary variable) and t-tests (continuous variables).
Qualitative analysis plan
For observations and in-depth interviews conducted with health providers and staff, we will use applied thematic analysis on the observation notes and interview transcripts. Electronic files may be uploaded into QSR NVivo software (v12 or higher) that supports coding and finer level re-coding of text data that enables researchers to explore how concepts fit by developing and modifying a hierarchical coding index. Thematic analysis will be conducted via an iterative process of data collection and analysis that utilizes four interrelated steps: reading, coding, data display, and data reduction. The team will use a codebook of a priori, structural codes consistent with CFIR and based on the observation and interview guides. A second round of coding, i.e. content coding, will be conducted to identify additional themes, ideas, or concepts. Twenty percent of transcripts will be coded by two team members to assess inter-rater reliability. Discussions will be held to resolve coding discrepancies. We may generate summaries of interviews and look across interviews for commonly named problems and solutions related to mNavigator. Data from the observations will be summarized as workflow diagrams, tables or other visual or narrative summaries to describe domains that help assess reach, effectiveness, adoption, implementation, and technical functionality and stability .
To our knowledge, mNavigator is the first digital health case management system specifically developed to improve health provider compliance with pediatric cancer treatment protocols in a low-resource setting.
The study has several strengths. First, mNavigator bolsters current standard of care by facilitating compliance with clinical best practices, promoting care coordination, and allowing simultaneous, ongoing quality of care evaluation. Currently at cancer centers in Tanzania, there is no mechanism to facilitate or monitor implementation of protocol-driven treatment in real time. Static paper-based medical records further prevent proactive actions to reduce treatment abandonment in pediatric cancer patients. A digital case management system such as mNavigator can dynamically identify and highlight instances of poor protocol compliance, errors in diagnosis or treatment, or patients lost to follow-up as compared to paper-based systems, which would require greater investments of human resources and time. By supporting allied health workers (nurses and patient navigator) in documenting patient cancer diagnosis and treatment data in mNavigator, patient-specific treatment plans are generated by the system which allows the implementation of treatment protocols via algorithms, checklists and alerts. As such, mNavigator promotes task shifting of lower-priority clinical tasks (e.g., measuring patients height/weight, data entry etc.) to ensure that the limited supply of highly trained physicians are used as efficiently as possible. This could reduce the clinical workflow burden for trained physicians and increase protocol compliance, reduce diagnostic delays, and improve quality of patient care.
Second, mNavigator seeks to strengthen health system capacity as the foundation for strategies targeting patient-centered barriers to pediatric cancer treatment abandonment. While patient-centered barriers contribute to treatment abandonment, reducing these barriers alone is inadequate if health system inefficiencies prevent the provision of quality and timely services to those who access healthcare. We posit that, by targeting health system inefficiencies first, we can more effectively set the stage for reducing patient-centered barriers, including via use of patient-facing digital health strategies (e.g., health education, engagement in care between treatment visits, appointment reminders etc.). This health system focus is innovative for treatment abandonment since most current efforts focus solely on patient-level barriers without regard to resource-constraints that are common to health systems in LMICs.
Third, our study leverages specific advantages of mobile technologies in LMICs. While tethered systems (e.g., desktops) can support much of the functionality proposed in the study, the higher costs of purchasing and maintaining desktops, and the need for constant power supply make them less feasible in LMICs where financial resources and reliable electricity are often scarce. In contrast, the affordability and exponential growth in ownership and mobile broadband subscriptions, makes mobile devices the information and communication technology of choice in LMICs . There are currently two desktops in the oncology division at BMC which are used for research projects (not patient management), but 100% of the staff have smart phones, meaning a digital case management system can be broadly implemented across different cadres of providers using mobile devices. The ability to collect and manage data offline through digital health platforms optimized for LMICs, and touch screen interface, are other unique advantages over desktops. The portability of mobile devices, which can be temporarily used offline, allows providers to access case data and treatment guidelines throughout the hospital, at home, or at satellite clinics, increasing opportunities for appropriate protocol use. This has implications for future studies targeting outreach activities at BMC where at-risk pediatric cancer patients may be identified for follow up in community-settings.
Finally, it mitigates concerns related to scalability of mHealth interventions by: adapting a validated, open-source mobile platform to reduce risks in the system development lifecycle and improve generalizability; using a theory-driven implementation science approach to improve contextual relevance and acceptability; and, building clinical, research, and digital health capacity at Tanzanian cancer centers, so that this and future digital interventions can be supported locally. BMC would serve as a pilot site with potential for expansion and multisite clinical research infrastructure development across Tanzania. In doing so, this study addresses criticisms of digital health systems related to poor contextual relevance, custom closed-source systems that lack inter-operability, and failure to develop appropriate local human resource capacity needed for system longevity.
Study limitations include the small sample size of mNavigator users as well as the prospective and historical patients proposed to be included in the evaluation. Since study implementation is limited to one site (BMC) based on budget and other resources available, the study sample size is limited by the availability of individuals who can participate in the study. The decision to use historical, instead of contemporary controls is also motivated by the same constraints.
Results from the evaluation of mNavigator will inform implementation and evaluation of the system in other tertiary pediatric cancer facilities in Tanzania, with the goal to facilitate protocol-driven treatment. Study findings will inform core components and elements of mNavigator, which can be adapted for use in different settings.
Availability of data and materials
The data that support the findings of this study are available from the Bugando Medical Centre (BMC) but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available.
Bugando medical centre
Consolidated framework for implementation research
Health insurance portability and accountability act
Low- and middle-income countries
Organizational readiness for implementing change
Reach, effectiveness, adoption, implementation and maintenance framework
Template for intervention description and replication
O’Leary M, Krailo M, Anderson JR, Reaman GH. Progress in childhood Cancer: 50 years of research collaboration, a report from the Children’s oncology group. Semin Oncol. 2008;35(5):484–93.
Ayres C, Griffith H. Consensus guidelines. Health Care Manag Rev. 2008;33(4):300–7.
Byrnes M, Schuerer D, Schallom M, Sona C, Mazuski J, Taylor B, et al. Implementation of a mandatory checklist of protocols and objectives improves compliance with a wide range of evidence-based intensive care unit practices. Crit Care Med. 2009;37(10):2775–81.
Ribeiro RC, Steliarova-Foucher E, Magrath I, Lemerle J, Eden T, Forget C, et al. Baseline status of paediatric oncology care in ten low-income or mid-income countries receiving my child matters support: a descriptive study. Lancet Oncol. 2008;9(8):721–9.
Mitchell M, Hedt-Gauthier BL, Msellemu D, Nkaka M, Lesh N. Using electronic technology to improve clinical care – results from a before-after cluster trial to evaluate assessment and classification of sick children according to integrated Management of Childhood Illness (IMCI) protocol in Tanzania. BMC Med Inform Decis Mak. 2013;13(1):95.
Mitchell M, Hedt BL, Eshun-Wilson I, Fraser H, John M-A, Menezes C, et al. Electronic decision protocols for ART patient triaging to expand access to HIV treatment in South Africa: a cross sectional study for development and validation. Int J Med Inf. 2012;81(3):166–72.
Shao AF, Rambaud-Althaus C, Samaka J, Faustine AF, Perri-Moore S, Swai N, et al. New algorithm for managing childhood illness using Mobile technology (ALMANACH): a controlled non-inferiority study on clinical outcome and antibiotic use in Tanzania. PLoS One. 2015;10(7):e0132316.
Shao AF, Rambaud-Althaus C, Swai N, Kahama-Maro J, Genton B, D’Acremont V, et al. Can smartphones and tablets improve the management of childhood illness in Tanzania? A qualitative study from a primary health care worker’s perspective. BMC Health Serv Res. 2015;15(1):135.
Ginsburg AS, Delarosa J, Brunette W, Levari S, Sundt M, Larson C, et al. mPneumonia: development of an innovative mHealth application for diagnosing and treating childhood pneumonia and other childhood illnesses in low-resource settings. PLoS One. 2015;10(10):e0139625.
McNabb M, Chukwu E, Ojo O, Shekhar N, Gill CJ, Salami H, et al. Assessment of the quality of antenatal care services provided by health workers using a Mobile phone decision support application in northern Nigeria: a pre/post-intervention study. PLoS One. 2015;10(5):e0123940.
Sondaal SFV, Browne JL, Amoakoh-Coleman M, Borgstein A, Miltenburg AS, Verwijs M, et al. Assessing the effect of mHealth interventions in improving maternal and neonatal Care in low- and Middle-Income Countries: a systematic review. PLoS One. 2016;11(5):e0154664.
Free C, Phillips G, Watson L, Galli L, Felix L, Edwards P, et al. The effectiveness of Mobile-health technologies to improve health care service delivery processes: a systematic review and meta-analysis. PLoS Med. 2013;10(1):e1001363.
DeRenzi B, Borriello G, Jackson J, Kumar VS, Parikh TS, Virk P, et al. Mobile phone tools for field-based health care Workers in low-Income Countries. Mt Sinai J Med J Transl Pers Med. 2011;78(3):406–18.
Kaonga NN, Labrique A, Mechael P, Akosah E, Ohemeng-Dapaah S, Sakyi Baah J, et al. Using Social Networking to Understand Social Networks: Analysis of a Mobile Phone Closed User Group Used by a Ghanaian Health Team. J Med Internet Res [Internet]. 2013;15(4). Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3636324/. Accessed 9 May 2019.
Källander K, Tibenderana JK, Akpogheneta OJ, Strachan DL, Hill Z, ten Asbroek AHA, et al. Mobile health (mHealth) approaches and lessons for increased performance and retention of community health Workers in low- and Middle-Income Countries: a review. J Med Internet Res. 2013;15(1):e17.
Brouard B, Bardo P, Bonnet C, Mounier N, Vignot M, Vignot S. Mobile applications in oncology: is it possible for patients and healthcare professionals to easily identify relevant tools? Ann Med. 2016;48(7):509–15.
Panayi ND, Mars MM, Burd R. The promise of digital (mobile) health in cancer prevention and treatment. Future Oncol. 2013;9(5):613–7.
Duregger K, Hayn D, Morak J, Ladenstein R, Schreier G. An mHealth system for toxicity monitoring of paediatric oncological patients using Near Field Communication technology. 2015 37th Annu Int Conf IEEE Eng Med Biol Soc (EMBC). 2015:6848–51.
Israels T, Renner L, Hendricks M, Hesseling P, Howard S, Molyneux E. SIOP PODC: Recommendations for supportive care of children with cancer in a low-income setting. Pediatr Blood Cancer. 2013;60(6):899–904.
Israels T, Moreira C, Scanlan T, Molyneux L, Kampondeni S, Hesseling P, et al. SIOP PODC: clinical guidelines for the management of children with Wilms tumour in a low income setting. Pediatr Blood Cancer. 2013;60(1):5–11.
Chantada G, Luna-Fineman S, Sitorus RS, Kruger M, Israels T, Leal-Leal C, et al. SIOP-PODC recommendations for graduated-intensity treatment of retinoblastoma in developing countries. Pediatr Blood Cancer. 2013;60(5):719–27.
Ngoma T, Adde M, Durosinmi M, Githang’a J, Aken’Ova Y, Kaijage J, et al. Treatment of Burkitt lymphoma in equatorial Africa using a simple three-drug combination followed by a salvage regimen for patients with persistent or recurrent disease. Br J Haematol. 2012;158(6):749–62.
BLNationalTretmentGuidelines_Sept09.pdf [Internet]. [cited 2019 Aug 16]. Available from: https://imaworldhealth.org/wp-content/uploads/2014/06/BLNationalTretmentGuidelines_Sept09.pdf.
The CommCare Evidence Base and Overview [Internet]. [cited 2020 Feb 24]. Available from: https://www.dimagi.com/toolkits/commcare-evidence-base/.
CommCare by Dimagi | Data Collection App [Internet]. [cited 2019 May 11]. Available from: https://www.dimagi.com/commcare/.
Barnes JA, Abramson JS, Scott JA, Sohani AR. Case 35-2013. N Engl J Med. 2013;369(20):1946–57.
Keith RE, Crosson JC, O’Malley AS, Cromp D, Taylor EF. Using the consolidated framework for implementation research (CFIR) to produce actionable findings: a rapid-cycle evaluation approach to improving implementation. Implement Sci. 2017;12(1):15.
Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.
Shea CM, Jacobs SR, Esserman DA, Bruce K, Weiner BJ. Organizational readiness for implementing change: a psychometric assessment of a new measure. Implement Sci IS. 2014;9:7.
Colonna SV, Higgins AK, Alvarez J, Saville BR, Lawrence J, Abramson VG. Analysis of risk of recurrence by subtype in ≤ 1-cm breast tumors. Clin Breast Cancer. 2016;16(3):223–31.
The authors acknowledge Jensen Daniels (JD), Dimagi Inc., for supporting the development and quality assurance of mNavigator. The authors thank Hillary Sued, Franco Afusisye, Robert Gisiri, Judith Mafwimbo, Mastidia Maximilian and Jacqueline Kamanga at Bugando Medical Centre for supporting mNavigator development and implementation. The authors are grateful to Dr. Hayden Bosworth (Duke Department of Population Health Sciences) and Dr. John Bartlett (Duke Global Health Institute) for providing feedback on earlier drafts of this manuscript. The authors acknowledge Eric Monson (Duke Data and Visualization Services) for his help in formatting the tables presented in the manuscript.
Research reported in this publication was supported by the National Cancer Institute of the National Institutes of Health under Award Number R21CA217268 and LV's effort for manuscript development was supported by the National Center for Advancing Translational Sciences of the National Institutes of Health under Award Number 1KL2TR002554. A grant proposal describing the study protocol was peer-reviewed by the National Institutes of Health. The content of this manuscript is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The funding bodies had no role in the design of the study or in the writing of the manuscript.
Ethics approval and consent to participate
The study protocol is approved by institutional review boards in the United States of America (Duke University Health System, Pro00094010) and Tanzania (Catholic University Health and Allied Services (CUHAS), CREC/292/2018; Lake Zone branch of the National Institute for Medical Research, MR/53/100/566; and the National Health Research Ethics Review Sub-Committee (NatHREC), NIMR/HQ/R.8a/Vol.IX/3096). Changes to the protocol will be communicated via protocol amendment by the study principal investigators. Documentation of informed consent will be obtained from all participants over the age of 18. Patients under the age of 18 will provide assent, while documentation of informed consent will be obtained from their parents or legal guardians.. For historical patients, the institutional review boards have approved a waiver of consent.
Consent for publication
Written consent for publication will be obtained from study participants.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
: SPIRIT 2013 Checklist: Recommended items to address in a clinical trial protocol and related documents*. Table S2: WHO Trial Registration Data Set. Table S3 Available resources. Table S4 Application of Consolidated Framework for Implementation Research Constructs to the development and implementation of mNavigator.
Example informed consent form for caregivers of children approached for participation in the study.
About this article
Cite this article
Vasudevan, L., Schroeder, K., Raveendran, Y. et al. Using digital health to facilitate compliance with standardized pediatric cancer treatment guidelines in Tanzania: protocol for an early-stage effectiveness-implementation hybrid study. BMC Cancer 20, 254 (2020). https://doi.org/10.1186/s12885-020-6611-3
- Digital health
- Pediatric cancer
- Protocol-driven treatment
- Treatment abandonment
- Burkitt lymphoma
- Low- and middle-income countries
- Healthcare provider decision support
- Client health records