Skip to main content
Download PDF

A real-time electronic symptom monitoring system for patients after discharge following surgery: a pilot study in cancer-related surgery

BMC Cancer volume 20, Article number: 543 (2020) Cite this article

Abstract

Background

Advances in peri-operative care of surgical oncology patients result in shorter hospital stays. Earlier discharge may bring benefits, but complications can occur while patients are recovering at home. Electronic patient-reported outcome (ePRO) systems may enhance remote, real-time symptom monitoring and detection of complications after hospital discharge, thereby improving patient safety and outcomes. Evidence of the effectiveness of ePRO systems in surgical oncology is lacking. This pilot study evaluated the feasibility of a real-time electronic symptom monitoring system for patients after discharge following cancer-related upper gastrointestinal surgery.

Methods

A pilot study in two UK hospitals included patients who had undergone cancer-related upper gastrointestinal surgery. Participants completed the ePRO symptom-report at discharge, twice in the first week and weekly post-discharge. Symptom-report completeness, system actions, barriers to using the ePRO system and technical performance were examined. The ePRO surgery system is an online symptom-report that allows clinicians to view patient symptom-reports within hospital electronic health records and was developed as part of the eRAPID project. Clinically derived algorithms provide patients with tailored self-management advice, prompts to contact a clinician or automated clinician alerts depending on symptom severity. Interviews with participants and clinicians determined the acceptability of the ePRO system to support patients and their clinical management during recovery.

Results

Ninety-one patients were approached, of which 40 consented to participate (27 male, mean age 64 years). Symptom-report response rates were high (range 63–100%). Of 197 ePRO completions analysed, 76 (39%) triggered self-management advice, 72 (36%) trigged advice to contact a clinician, 9 (5%) triggered a clinician alert and 40 (20%) did not require advice. Participants found the ePRO system reassuring, providing timely information and advice relevant to supporting their recovery. Clinicians regarded the system as a useful adjunct to usual care, by signposting patients to seek appropriate help and enhancing their understanding of patients’ experiences during recovery.

Conclusion

Use of the ePRO system for the real-time, remote monitoring of symptoms in patients recovering from cancer-related upper gastrointestinal surgery is feasible and acceptable. A definitive randomised controlled trial is needed to evaluate the impact of the system on patients’ wellbeing after hospital discharge.

Peer Review reports

Background

Major abdominal surgery for upper gastrointestinal (UGI) cancer is a significant life event with a hospital stay of usually more than a week and a high risk of complications. For example, up to 5% of patients die within 30 days of surgical resection for oesophageal cancer. As many as 30–45% of UGI, hepatobiliary and cancer surgery patients require community care or experience complications post-discharge [1,2,3], including wound infections, sepsis and respiratory failure [4,5,6,7] requiring hospital treatment. Recovery from surgery for these procedures often takes many months. Symptoms such as fatigue, nausea and pain are frequent and severe [2], and patients report significant deficits to many aspects of their health-related quality of life (HRQL), including marked reductions in physical, social and role function [8, 9].

Advances in Enhanced Recovery After Surgery (ERAS) protocols mean that patients are increasingly discharged from hospital sooner. While earlier discharge may be feasible and safe [10,11,12], shorter hospital stays are associated with reductions in the provision of patient information and symptom self-management advice [13]. As a result, patients recovering at home may experience unsatisfactory pain management and increased anxiety [13]. Furthermore, ERAS protocols are not standardised and do not routinely encompass the post-discharge recovery period, meaning that follow-up care is often fragmented [13, 14]. Patients may be followed-up through telephone calls from nurse specialists, but this practice is likely to vary between hospitals. Once at home, detection of problems and complications relies on the patient’s ability to distinguish between expected and concerning symptoms and to access appropriate clinical services. However, patients may be uncertain about when to contact a health professional outside of routine clinical appointments, which can delay them seeking help [15, 16]. Late detection of complications after discharge can lead to poor outcomes, impaired HRQL and increased emergency department admissions [17].

Incorporating patient-reported outcome (PRO) measures into routine clinical practice has been shown to enhance symptom monitoring and the detection of complications in cancer patients [18, 19]. Electronic platforms to collect PROs (ePRO) are an efficient means of capturing PRO data after patients have left hospital. Specifically, ePRO systems that use clinically-derived algorithms to interpret patient-reported symptom data in the context of their clinical characteristics (e.g. disease stage, surgical procedure, recovery pathway) may provide patients with pertinent self-management advice to support their recovery [20,21,22,23]. For optimal performance, full integration of ePROs with electronic hospital records (EHR) and clinical information systems can also provide clinicians with access to ‘real-time’ ePRO data. This enables prompt clinical intervention [24, 25] and allows clinicians to consider patient-reported symptoms alongside other clinical data to optimally plan appropriate care. This has been shown to enhance quality of care and communication [26, 27] and improve patients’ satisfaction with care [18].

Several ePRO systems, developed for patients undergoing chemotherapy [22, 28,29,30,31,32], have been shown to improve HRQL [22, 29,30,31, 33] and survival [29]. Few studies, however, have evaluated the effectiveness of ePRO systems in patients undergoing surgery for cancer. The aim of this pilot study was to examine the feasibility of a full-scale definitive randomised controlled trial (RCT) designed to evaluate the impact of a real-time, remote electronic monitoring (ePRO) system on patients’ wellbeing after discharge following cancer-related UGI surgery.

Specific study objectives were to: (i) explore participant eligibility and recruitment; (ii) examine participant ePRO symptom-report response rates and data completeness; (iii) examine the frequency of patient-reported symptoms and ePRO system actions; (iv) explore patient and clinician perspectives on using the ePRO system; (v) evaluate the technical performance of the ePRO system; (vi) pilot potential outcome measures for use in a future main trial.

Methods

Development of the ePRO surgery system

The ePRO surgery system was developed initially in the example context of cancer-related UGI surgery. The system was developed in close collaboration with multiple key stakeholder groups, including patients, patient representatives and health care professionals (HCPs) (i.e. cancer nurse specialists (CNS), dietitians and surgeons) responsible for routine’ post-discharge care. The development of the ePRO system and the electronic hosting platform has been described in full elsewhere [34,35,36]. The IT elements, developed in the eRAPID study [36], include a patient website with secure login function, web-based symptom-report questionnaire software (QTool) and a web application interface for secure transfer of data to EHR, enabling clinicians to view symptom-reports. Clinically-derived algorithms were programmed into the self-report scoring system, allowing severity specific tailored self-management advice to be provided to patients and email notifications sent to nominated clinicians.

ePRO system clinically derived algorithms to guide patient management by symptom severity

The system uses clinically derived algorithms to stratify patients’ ePRO symptom-report responses into three levels of symptom severity with each triggering a different ‘level’ of action within the ePRO system (Table 1), and is described in detail elsewhere [34]. For symptoms indicative of a complication, an email alert is sent to the CNS team. For potentially concerning symptoms, participants are advised to call an HCP. For expected symptoms, the ePRO system provides participants with self-management advice. The ePRO symptom-report comprised 35 questions selected from validated European Organisation for Research and Treatment of Cancer (EORTC) questionnaires. Items were selected for their relevance to symptoms and complications experienced by patients after cancer-related UGI surgery (including oesophageal, gastric and hepato-pancreato biliary cancer) [34] and focus on severity in the preceding week (e.g. During the past week, have you had pain? Possible responses are: not at all; a little; quite a bit or very much). Symptom domains included EORTC domains physical function, nausea, vomiting, eating and digestive problems, jaundice, fever and pain [34]. Graphs displaying scores for each symptom are produced within the ePRO system, enabling patients and clinicians to monitor symptom occurrence and severity over the course of patients’ recovery. Following their development, refinement and testing of the algorithms triggering the ePRO system feedback and alerts was also undertaken as part of earlier work [34]. Specifically, questionnaire data from 27 participants (18 male, mean age 63 years) who reported clinically significant symptoms was compared, firstly, with advice provided by a CNS or study research nurse during audio-recorded routine telephone consultations and weekly telephone interviews and, secondly, with any subsequent clinical events or outcomes of participants (e.g. such as re-intervention, re-admission to hospital, visit to GP or primary healthcare providers). The latter were identified from hospital readmission alerts, hospital EHR, and patients’ reports of accessing healthcare services reported during weekly follow-up telephone interviews. Refinement and iteration of the algorithms continued until it was considered that no further changes were required.

Table 1 Guided patient management by symptom severity within the ePRO system
Full size table

Design and setting

This mixed methods prospective pilot study was conducted at two National Health Service (NHS) hospital trusts in England. Feasibility of the fully functional ePRO system accessible via EHRs was examined at Bristol Royal Infirmary, University Hospitals Bristol NHS Foundation Trust (Centre 1). Integration of electronic monitoring systems into hospital EHRs can be problematic and the extent of integration variable. As such, the feasibility and applicability of the system at a second site (Heartlands Hospital, University Hospitals Birmingham, Centre 2) where integration was not possible was explored. In the version of the ePRO system tested at Centre 2, clinicians could not access patients’ symptom-reports via EHRs. Data from Centre 2 were therefore analysed separately, with a focus on examining participant recruitment, ePRO symptom-report response rates and data completeness. Consecutive patients at both centres were recruited and invited to complete online symptom-reports at the point of hospital discharge, twice in the first week post-discharge and weekly for 8 weeks thereafter. Recruitment rates, online symptom-report completion rates and activation of clinical algorithms were monitored. Patients were interviewed weekly and additional outcomes related to health status were collected on paper. The CNS teams at both centres received Level 3 alerts via automatic emails, and in Centre 1 the lead CNS was interviewed weekly.

Participant sampling and recruitment

Consecutive patients who had undergone cancer-related UGI surgery (including oesophageal, gastric or hepato-pancreato biliary cancer) at Centre 1 between August 2017 and March 2018 and Centre 2 between November 2017 and October 2018 were screened for study eligibility by a hospital research nurse reviewing inpatient clinic lists. Patients were considered eligible if they had undergone cancer-related UGI surgery, were ready for hospital discharge to their home, had access to a computer/mobile device and the internet at home, were 18 or over and were fluent in English. Patients were approached for recruitment by a research nurse immediately prior to hospital discharge (e.g. while on the hospital ward). Eligible patients were given a participant information leaflet and the opportunity to ask questions, and those wishing to participate were asked to provide written informed consent. Demographic and clinical details were recorded. Participants were provided with unique login details and use of the ePRO system was demonstrated by the research nurse, during which participants completed the baseline (pre-discharge) ePRO symptom-report and paper version of the additional measures (e.g. EQ-5D and Fact-G).

Data collection

Recruitment, response rates and data completeness were recorded. An overview of data collected at assessment timepoints at each site is provided in Table 2.

Table 2 Data collection at baseline and post-discharge assessment timepoints
Full size table

Participant eligibility and recruitment

Screening logs were completed to examine the number of participants eligible, approached, recruited and withdrawn from the study. Rates and reasons for non-eligibility, declining participation and participant withdrawal were monitored.

ePRO symptom-report response rates and data completeness

Participants were instructed to complete the online ePRO symptom-report twice in the first week post-discharge (day two-three and day five-seven) and then weekly for 8 weeks. These timepoints were selected to reflect clinically relevant timepoints for monitoring of patients during their recovery post-discharge following UGI surgery [34]. However, participants were told that they could complete the symptom-report at additional timepoints if they wished (e.g. if they experienced new symptoms). Automated reminders (by text message and/or email depending on participants’ preferences) were sent when participants were due to complete the ePRO symptom-report.

Frequency of reported symptoms and ePRO system actions

In order to determine the suitability of the actions and advice generated by the ePRO system, the frequency, severity and type of reported symptoms and actions generated at each timepoint were examined.

Patient and clinician perspectives

Participant interviews

Members of the research team (AP, HR, MS) conducted weekly semi-structured telephone interviews with participants to coincide with ePRO symptom-report timepoints, generally shortly after questionnaire completion. Interviews focused on participants’ views of using the ePRO system and any responses they had had to ePRO system actions. For example, if a participant reported a potentially concerning symptom that had generated a Level 2 action, the patient was asked whether they had contacted an HCP as advised, and any subsequent outcomes resulting from such HCP contact were documented. The purpose of the weekly and end of study interviews was not to discuss patients’ symptoms or provide advice regarding managing or seeking treatment for problematic symptoms. Instead, the interviews were undertaken to examine participants’ perspectives on the usefulness of the ePRO system and feedback from the perspective of examining the feasibility and usability of the system. The interview guides were adapted from pilot work to develop the ePRO system [34] and are provided in Additional file 1. Reasons for not adhering to ePRO system actions/advice were also recorded. Participants generating Level 1 self-management advice for expected symptoms were asked for their views on the advice and its relevance and usefulness. A purposive sample of approximately 10%, to include patients who reported a range of clinical symptoms, were also interviewed at the end of the study to explore their experiences of using the ePRO system. All interviews were audio-recorded.

Hospital readmissions

Clinical data were collected from hospital EHR for Centre 1 participants who had been readmitted to hospital with complications during their recovery. These data were compared with interview data to establish whether participants had completed a corresponding symptom-report and any actions that may have been generated.

Clinician interviews

The lead CNS in Centre 1 was interviewed weekly by telephone by a study researcher (HR) to determine the frequency, nature and relevance of any clinical contact they had received from participants as a direct result of ePRO system actions. End-of-study interviews were also conducted with the lead CNS and the hospital dietitian responsible for the care of participants. These explored the practicality and usefulness of the ePRO system in the context of routine clinical care.

Technical performance

Technical functionality of the ePRO system was monitored throughout the study, including integration with EHR, failed logins and delivery of email clinician alerts and participant text/email reminders.

Piloting of potential outcome measures for a main trial

Participants were mailed paper copies of the EuroQol EQ-5D-5 L [37] and Functional Assessment of Cancer Therapy – General (FACT-G) [38] questionnaires to complete at baseline (pre-discharge) and at weeks four and eight post-discharge. The EQ-5D-5 L is a standardised, validated measure of health status that is used in the clinical and economic evaluation of healthcare and population health surveys. It provides a single index value and descriptive profile that contributes to a health economic evaluation across five dimensions: mobility, self-care, usual activities, pain/discomfort and anxiety/depression. The five response levels range from ‘no problems’ to ‘extreme problems’. The EQ-5D also includes a visual analogue scale relating to subjective overall health status. The FACT-G is a cancer specific measure that is widely used in research studies, measuring four domains of HRQL: physical wellbeing, social or family wellbeing, emotional wellbeing and functional wellbeing. Cumulative scores range from 0 to 108 with higher scores indicating better HRQL. Questionnaire response rates and data completeness were examined to explore their feasibility for use as potential outcome measures in a future RCT.

Methods for collecting health resource use data were explored. Patients were asked to complete a health resource use questionnaire [35] at the end of the study (9 weeks post-discharge). The questionnaire included items to record use of prescription and non-prescription medication and other costs associated with patients’ recovery from surgery. Patients were also contacted weekly by the study researcher to record the frequency and reasons for contact with HCPs (e.g. general practitioner (GP), community nurse, etc).

Data analyses

Summary descriptive statistics were used to examine participant screening, recruitment, demographic and clinical characteristics. Symptom-report response rates, data completeness and reasons for non-completion were summarised. Descriptive statistics also summarised symptom-report response rates and data completeness, frequency and severity of symptoms reported and any actions generated. Audio-recordings of interviews with participants and clinicians were listened to by a researcher (HR) and those containing data of relevance to the study objectives were transcribed verbatim (targeted transcription). Textual data were analysed in accordance with the principles of thematic analysis [39], in which codes were generated and applied to sections of text. Codes were reviewed and refined through discussion with the study team. Thematic analysis is a widely-used methods of qualitative analysis involving the identification and interpretation of underlying themes and concepts within the wider context of the data. The interview topic guide was iterated following discussion with the study team as data collection and participant recruitment proceeded. Analysis was conducted until thematic saturation was reached, whereby existing themes ceased to evolve and no new themes were identified [40]. Here we report the main themes within the context of a wider mixed methods study.

Results

Participant eligibility and recruitment

One hundred and nine patients were screened for eligibility at Centre 1, of which 41 (38%) were eligible and invited to participate, and 29 (71%) consented. (Fig. 1). Patients who agreed to take part were similar to those who declined in terms of demographics (participants: 66% male, refusers: 50% male) or age (participants: mean age 64, range 43–81 years, refusers: mean age 59, range 30–74 years). Reasons for ineligibility included participants not undergoing their planned surgical procedure (17, 25%), having no home access to a computer/mobile device or internet (15, 22%) (Fig. 1). Seven (24%) Centre 1 participants withdrew from the study due to feeling too tired or unwell or a prolonged re-admission to hospital. Approximately half (n = 15, 52%) of patients had undergone oesophago-gastric resection procedures, with an average hospital stay of 12 days. Participant demographic details are provided in Table 3. In Centre 2, 20 patients were screened for eligibility, of which 11 consented to participate. All 11 participants had undergone oesophago-gastric resection procedures (Table 3). Two (18%) Centre 2 participants withdrew from the study.

Fig. 1
figure 1

Recruitment details for Centre 1 Bristol participants. a including: not undergoing planned procedure (n = 17), discharged home unexpectedly early or not discharged to home (n = 4), missed due to administration errors (n = 2), patient was under 18 (n = 1). b including: no home access to a PC/internet (n = 15), discharged home unexpectedly early or not discharged to home (n = 11), not fluent in English (n = 3), missed due to administration errors (n = 2), unable to comply with follow up (n = 3)

Full size image
Table 3 Participant baseline clinical and demographic details
Full size table

ePRO symptom-report response rates and data completeness

Response rates of active participants (i.e. participants who had not withdrawn from the study) in Centre 1 for the ePRO symptom-report exceeded 70% at all timepoints (range 72–93%), excluding day two-three post-discharge (55%). Between 30/08/2017 and 17/04/2018, 29 participants completed the ePRO symptom-report a total of 197 times (median 9, range = 1–11). Most common reported reasons for non-completion included participants starting chemotherapy (12%) and not wanting to complete the symptom-report at that timepoint (10%) (see Table 4). In Centre 2, ePRO symptom-report response rates exceeded 60% at all timepoints (range 63–100%), except for week eight (50%). Between 10/11/2017 and 22/11/2018, participants completed the ePRO symptom-report a total of 63 times (median 7, range 1–10). Reasons for non-completion were not recorded.

Table 4 Response rates and reasons for non-completion of ePRO questionnaire
Full size table

Frequency of reported symptoms and ePRO system actions

Frequencies of symptoms reported by Centre 1 participants and associated actions triggered by the ePRO system are shown in Table 5. Of the nine Level 3 email alerts to clinicians, seven (78%) were generated in the first 3 weeks following discharge from hospital (Fig. 2). Over half (n = 43, 60%) of the 72 Level 2 actions (participant advice to call an HCP) were triggered within the first 2 weeks post-discharge, with a further 15% (n = 11) triggered after 6 weeks post-discharge. Most (n = 48, 63%) of the 76 Level 1 actions (self-management advice) were triggered after 3 weeks post-discharge, the majority of which were triggered at weeks four and five. Of the 40 forty Level 0 feedback (no participant advice required), 27 (68%) instances were triggered after 5 weeks post-discharge.

Table 5 Frequency of reported symptoms and ePRO system actions by patients at Centre 1 (n = 29)
Full size table
Fig. 2
figure 2

Total levels of feedback generated by timepoint

Full size image

An additional eight Level 3 alerts were generated from the baseline data completion prior to patients being discharged. These data were removed from the dataset post-hoc following consultation with clinicians, as they were deemed irrelevant due to patients still being in hospital.

In Centre 2 one Level 3 alert was triggered at week three, and 14 (70%) of the 20 Level 2 actions were triggered in the first 3 weeks post-discharge. Most (n = 25, 69%) of the 36 Level 1 self-management advice were triggered after 3 weeks post-discharge, while five (83%) of the six Level 0 feedback (83%) were triggered after 4 weeks post-discharge.

Symptoms triggering level 3 actions (alert to CNS)

Level 3 alerts (automated email to CNS team) were triggered nine times (4.6% of all completions) by a total of three (10%) participants in Centre 1 (see Table 5). Telephone interviews with participants demonstrated that when they made direct contact with the CNS team as instructed by the system they reported positively on their experience:

PT 1237: “It was great. It was reassuring…And it’s what I need actually…I can’t just phone my GP…I’m not even on my own GP’s list because I’ve been transferred [to a different geographical region] temporarily.”

Most Level 3 alerts (n = 7, 78%) were generated for pain symptoms. Six of the seven pain alerts were from a single participant due to a pre-existing chronic pain condition, and were therefore not related to recovery from surgery. Weekly telephone interviews revealed that no action was taken by the CNS team relating to these alerts, as the participant was already receiving appropriate treatment from another care team.

The remaining two non-pain related Level 3 alerts were generated by a single participant reporting symptoms of fever and chills due to a complication following surgery. Although an alert was generated, no further action was taken by the participant or the CNS team, in accordance with Level 3 advice because these symptoms had already been treated prior to ePRO system completion:

PT 1184: “Because I’ve been completing the form on a Friday, if there’s been any circumstances where I’ve needed to contact someone it’s probably been earlier in the week and action’s already been taken…We were already dealing with [fever symptoms]. Probably already [contacted HCP].”

This demonstrates the need for a further minor refinement to the Level 3 and 2 algorithms to ensure that erroneous symptoms relating to underlying health conditions and relevant symptoms that are already being well-managed do not trigger alerts to clinicians.

Symptoms triggering level 2 actions (advice to contact an HCP)

In total, 72 Level 2 actions (advice to contact an HCP) were triggered by 24 (83%) participants in Centre 1 and were most frequently related to wound problems (44%) and appetite loss (36%). Additional symptoms generating Level 2 advice included fever (24%), physical function (13%) and nausea or vomiting (11%). Figure 3 illustrates the distribution of the most frequent symptoms generating Level 2 advice by recovery timepoint.

Fig. 3
figure 3

Frequency of Level 2 Advice generated by timepoint. 1Higher scores indicate worse symptoms. 2Higher scores in physical function indicate better physical function

Full size image

Of the 72 Level 2 actions triggered, corresponding weekly telephone interview data were available for 36 (50%) of these events from 17 participants.

Adherence to level 2 action advice to contact an HCP

In most instances (23/36, 64%), participants adhered to the Level 2 advice to only contact an HCP if their symptoms were new or previously unreported. In eight (35%) cases, all participants with new symptoms followed advice to contact an HCP, of which four participants contacted the CNS team and four contacted a GP. Contacting an HCP resulted in four participants receiving advice and/or reassurance about their symptoms, three undergoing clinical investigations or interventions (e.g. blood tests, appointments), and one receiving a prescription for antibiotics for a wound infection:

PT 1213: “The second time [called GP following Level 2 advice] I was feeling so tired and [GP] sent me for a blood test and found I’m low on something and I’m on four tablets a day now.”

In 15 cases (65%), participants appropriately followed advice not to contact an HCP because their symptoms were already being appropriately managed and/or they had upcoming clinical appointments:

PT 1205: “I was already in contact with people about [symptoms], so the questionnaire told me to do that anyway, but I was already doing it. Had I not been doing it, it would have helped me, but I was doing it anyway.”

Participants described how receiving advice to contact an HCP was reassuring, as until that point they had been uncertain whether their symptoms required clinical input or further intervention:

PT 1242: “I’ve been thinking, should I ring the nurse about constipation or should I not?...Sometimes you feel you shouldn’t ring your nurse, you know. Silly really because that’s what the nurse is there for isn’t it.”

Non-adherence to level 2 action advice to contact an HCP

Of the 13 (36%) instances when participants did not adhere to Level 2 advice, reasons for not contacting an HCP included feeling that their symptoms did not warrant reporting (n = 6), for example, because they already had an HCP appointment scheduled:

PT 1224: “It [ePRO] said that I’ve been having problems with my wound, and it said that I ought to see somebody within 48 hours. Well as I had an appointment…this morning at [the hospital] I didn’t see any need to call anybody.”

Other reasons included participants forgetting that they had received the Level 2 advice (n = 6, 46%), or stating an unwillingness to contact an HCP (n = 1).

Symptoms triggering level 1 symptom (self-management advice)

Level 1 self-management advice was triggered a total of 76 times (39% of completions) by 22 (76%) participants in Centre 1 post-discharge. Typically, advice was provided for three symptoms (median = 2.5, range = 1–6) per Level 1 action triggered. Advice was generated most frequently for fatigue (n = 58) and/or pain (n = 27). Additional symptoms generating Level 1 advice included physical function (n = 22), nausea or vomiting (n = 20) and constipation (n = 20). Figure 4 illustrates the frequency and distribution of the six most frequent symptoms triggering Level 1 advice at each timepoint.

Fig. 4
figure 4

Frequency of Level 1 self-management advice generated by timepoint. 1Higher scores indicate worse symptoms. 2Higher scores in physical function indicate better physical function

Full size image

Level 0 feedback for minimal symptoms (no action required)

Level 0 feedback was generated a total of 40 times (20% of completions) by approximately one third of participants in Centre 1 (n = 9, 31%) (Fig. 2).

Hospital re-admissions

Five participants were re-admitted to hospital during the study for complications relating to fevers/infections (n = 3), nausea & vomiting (n = 1) and bile leak (n = 1). These participants completed the ePRO symptom-report a total of 14 times within 7 days of re-admissions. These completions resulted in two Level 3 events (14%), nine Level 2 events (64%) and one Level 1 event (7%), indicating that, in the majority of instances, the ePRO system produced appropriate advice based on complication-related symptoms reported by patients. While it is not possible to provide exact numbers, there were several instances where participants were re-admitted to hospital for complications related to post-operative infections without having completed the ePRO system. In these instances, participants recognised the severity of their symptoms and contacted the care team without the need for prompting from voluntary completion of the ePRO system.

Patient and clinician perspectives

Participant interviews

One hundred and nine (63%) of a potential 173 weekly telephone interviews were completed. All 29 participants were interviewed at least once following discharge. The main reasons for non-completion were participants being unavailable or non-contactable. The key themes identified from targeted transcriptions of 35 weekly telephone interviews and three end-of-study interviews with 16 participants are reported below.

Reassurance from ePRO system advice

Most participants reported positively on their experience of using the ePRO system. Participants described how they found the Level 1 symptom self-management advice to be valuable because it provided reassurance about how to manage their symptoms while at home. Participants cited the benefit of receiving confirmation that their symptoms were typical for their stage of recovery as the main reason for finding the ePRO system reassuring:

PT 1230: “It’s all about a bit of reassurance really. The minute you get a bit of reassurance, everything else seems a bit easier.”

PT 1242: “The system’s good at telling you what’s normal, or not even normal, but that other people have this [experience of symptoms].”

Additionally, participants valued being provided with new symptom management advice to help them better manage their own symptoms:

PT 1182: “Things like not drinking too much coffee tea and alcohol, which I hadn’t thought of before, I didn’t think that would affect the issue but apparently it does, so I’ll abide by that advice.”

Some participants acknowledged that the advice provided by the ePRO system was similar to advice they had originally received from their care teams. Participants found the ePRO system advice useful for reminding them to follow advice they may have forgotten and reinforced the guidance they had received from HCPs:

PT 1226: “[The same advice] had been mentioned earlier on in the process, I think when I had my initial consultation…and it just reminded me of all those things…And I found them very useful, although they weren’t adding anything new, again they were reassuring.”

Participants also stated that the reassurance they gained from the ePRO system contributed to overcoming feelings of isolation and uncertainty following discharge from hospital:

PT 1188: “I mean you get monitored so much in the hospital…And then you come out and there’s nothing at all. It’s like a sudden drop off a cliff really. And your first week and that you go well, am I OK? You know they’ve been checking for all this time.”

Participants discussed the graphs produced by the ePRO system, which displayed their individual symptom-report scores over the course of the study and described these as useful for tracking their progress over time. Participants spoke about the reassurance they gained from being able to objectively see that their symptoms were improving:

PT 1205: “It was telling me that I was getting better I think, which is what I was hoping for. That was quite informative I thought, looking at the graphs at the end, that was quite good.”

Relevance of ePRO advice

Participants discussed ePRO advice as being relevant to their symptoms and addressing their concerns about symptom management. For many participants the advice generated accurately reflected their symptom experiences:

PT 1182: “I think it covered the two main [symptoms] that I was bothered about.”

Participants described the benefit of receiving relevant symptom self-management advice tailored specifically to them and found this helpful:

PT 1208: “At the end you get to read up about what the suggestions are to cope with the different things I might have raised and that’s always very helpful…and aimed specifically at me.”

Clinician interviews

The majority of ePRO-initiated clinician contact (e.g. contact from participants following triggering of a Level 2 action or clinician alert following a Level 3 action) was considered timely and appropriate, and clinicians reported that they did not think any concerning symptoms had been ‘missed’ by participants who received ePRO advice to contact them. In some cases, these directly informed the clinical management of patients. On several occasions, for example, clinicians’ arranged GP or hospital appointments for patients who had been advised to call them. The majority of ePRO-initiated clinician contact (e.g. contact from participants following triggering of a Level 2 action or clinician alert following a Level 3 action) was considered timely and appropriate:

Clinician 1: “I’m not sure he would have thought to ring us, as his first port of call. And we were able to sort of triage what the problem was and make sure he spoke to the right person.”

Similar to patients, clinicians regarded the ePRO system as useful for providing patients with reassurance about how to manage their symptoms appropriately. Additionally, clinicians found the ePRO symptom-reports provided a valuable insight into understanding participants’ experiences of recovery and monitoring symptoms in the context of ongoing recovery. This insight was found to be particularly relevant for facilitating telephone consultations with participants:

Clinician 2: “I found [the ePRO symptom-report system] particularly useful on the phone because when you’re speaking to a patient on the phone, all the visual cues are lacking… you can run through all of the things you’d normally speak to them about, but then you can also say, oh…your such and such [symptom-report on the ePRO system] was a little bit concerning. And it can help to guide the conversation but, it can also make sure that things aren’t overlooked, because often, particularly in a telephone conversation they can be.”

The CNS team commented that being able to access ePRO symptom reports via the hospital EHRs was appropriate and useful. However, they acknowledged that use of the ePRO system may be influenced by existing complexities of hospital systems and limited access to computers:

Clinician 1: “It’s just like in clinic sometimes we can’t always access a computer to look at [patient results] before [patients] come in.”

Technical performance

Between 25/08/2017 and 15/03/2018, there was one incident of unplanned downtime between the ePRO system and EHRs which resulted in clinicians being unable to view ePRO symptom reports via EHRs. There was one incident where a participant was unable to access the ePRO system at baseline due to an administrative error. Both issues were resolved within one and 5 days respectively. Due to a University of Bristol IT server update there was a five-day period of downtime in the participant email/text message reminder system. This resulted in four participants having their reminder messages delayed by up to 5 days.

Piloting of potential outcome measures for a main trial

Completed FACT-G and EQ-5D questionnaires were returned by 19 (66%) and 20 (69%) of participants at week four post-discharge and 15 (52%) at week eight. Fifteen (52%) health resource use forms were returned.

Discussion

The findings from this pilot study indicate that this novel electronic system for the real-time, remote monitoring of symptoms and problems in patients recovering from cancer-related UGI surgery is feasible and acceptable to both patients and clinicians. Adherence to the routine symptom report completions was good and patients described the ePRO system as reassuring and a valuable support to the self-management of their symptoms, particularly when they were uncertain if those symptoms required clinical intervention. Clinicians regarded the system as a useful adjunct to the routine clinical management of patients. The system detected symptoms indicative of adverse events, including numerous concerning symptoms that prompted contact with HCPs. Appropriate alerts were provided to clinicians and the system identified severe complications associated with hospital re-admissions. The system also worked well in a less-experienced hospital that had not been involved in the developmental work. It is therefore recommended that the ePRO system is further evaluated in the context of a clinical effectiveness study to inform full implementation into the healthcare system.

Studies of other ePRO systems have typically focused on evaluating the feasibility of PRO data collection alone, rather than their real-time integration of ePRO data into routine post-discharge clinical management [41,42,43,44]. A recent RCT of 344 patients in the Netherlands concluded that use of a “personalised” e-Health programme improved rates of return to normal activities compared to usual care following general or gynaecological surgery for benign conditions [45]. This programme was not integrated into hospital EHR and alerts to contact a health professional were sent only to patients reporting a delayed recovery, and not to clinicians. Patient feedback was based only on data relating to resumption of daily activities inputted by patients a priori and tailored only to patient demographic factors (e.g. surgical procedure, sex). The nature and severity of symptoms experienced by patients was also not measured. The functionality to provide individually-tailored advice based on symptom severity has been identified as particularly important for the effectiveness of ePRO systems [46,47,48]. Similarly, the incorporation of clinician alerts to ePRO systems can increase clinician involvement in patient care and improve patient outcomes [25, 29]. However, some clinicians may not act upon alerts generated by symptom-report systems [15], possibly due to perceived disruption to usual workflow pathways [49] or uncertainty over how to respond. To overcome these issues, the ePRO surgery system reported in this study not only alerts clinicians to concerning symptoms but also provides guidance about responding to alerts and has been developed with clinician input and incorporation into existing clinical pathways [21, 50, 51].

ERAS protocols lack standardisation around the timing and nature of clinical follow-up for patients following cancer-related UGI surgery [52], with most clinical contact occurring shortly after hospital discharge. However, in the current study, nearly half of all self-management advice and advice to contact an HCP was triggered in the latter period of recovery, up to 2 months post-discharge. This information is useful to inform assessment time points in a future RCT. It also highlights an unmet healthcare need for the routine monitoring of symptoms and the provision of advice after the acute phase of patients’ recovery has passed. This study supports previous research indicating that it would be beneficial to extend current ERAS protocols to encompass the real-time monitoring of symptoms over a prolonged period post-discharge [53].

In current practice, patients must accurately recall relevant symptom-management information after their discharge from hospital, which is generally delivered verbally prior to treatment [54]. Recall may be impaired by pain, fatigue, sleep deprivation [55] and cognitive dysfunction associated with critical care [56]. ePROM platforms that systematically deliver individually-tailored patient information have been associated with increased information retention [57] and improved patient outcomes [54, 58, 59]. Patients reported that the capacity for the ePRO surgery system to monitor symptoms in real-time and provide individually tailored advice on demand enabled them to proactively and promptly manage their symptoms. The benefit and impact of this can further be investigated within a main trial. In addition, clinicians perceived a key advantage of the ePRO surgery system to be the automated signposting of patients experiencing problems to appropriate sources of healthcare. Clinicians did, however, identify potential barriers to using the ePRO surgery system relating to integration with hospital IT systems and EHR such as periods of system downtime, replicating findings from other studies [42, 49, 50, 60, 61]. For successful implementation in clinical practice, developers of ePRO systems should ensure enough time and resources are dedicated to IT integration and ongoing support of live systems. Widespread adoption of hospital-integrated ePRO systems is also dependent upon patients having access to IT resources at home. Approximately one fifth of patients approached to take part in this study were not eligible because they did not have access to a computer, laptop, mobile device or the internet at home. This reflects internet usage trends of UK households of those aged 65 and over [62]. Incorporating electronic systems into usual care pathways will require attention to providing additional monitoring of patients who are unable to use the systems.

The ePRO surgery system has been developed and tested in a diverse group of patients. Mixed methods were used to evaluate system functioning, adherence to the study protocol, quality and completeness of data and patients’ and clinicians’ views towards acceptability of using the system alongside usual care. Symptom self-report items originated or were informed by established, validated measures used widely in studies of cancer patients. Participant refusal rates are in keeping with other similar pilot studies [63] and studies of surgical patients [64,65,66] and likely reflect in part how unwell participants were feeling soon after major cancer surgery when they were approached about recruitment to the study. It is possible that patients who declined to participate may have been feeling more unwell than those who took part. However, patients must have reached a certain stage in their recovery to have been considered by the healthcare team as fit to be discharged, which is the point at which patients were approached about participation. Furthermore, there did not appear to be any major differences between patients who did and did not take part. The impact of the timing of approaching patients and how to safely monitor patients who decline to use the ePRO system are important points to consider should the system be implemented in routine clinical practice in the future. Self-report completion rates and adherence to the ePRO surgery system protocol were good, demonstrating that weekly completion of the ePRO symptom-report and duration of follow-up period were feasible and acceptable. Participants received weekly and end of study data-collection telephone interview from a researcher. While these calls were not intended to discuss patients’ symptoms or provide advice regarding managing or seeking treatment for problematic symptoms, it is possible that receiving this weekly contact may have influenced ePRO questionnaire completion rates. While several participants withdrew from the study because they felt too unwell, this was expected due to the nature of the patient group and the major surgery they had experienced. Data completion was lowest at the earliest timepoint post-discharge when patients were likely to be experiencing the most frequent and severe symptoms. It is important that consideration is given to instances when patients feel too unwell to access the system. It may therefore be beneficial to incorporate a mechanism in the system whereby non-response at critical time points is regarded as an indicator of potentially concerning symptoms and a clinician alert is triggered. Clinicians at Centre 2 were unable to access patients’ symptom reports via EHRs, preventing pooling of data with that from Centre 1, which may have limited clinicians’ engagement with the ePRO system. There are also further refinements that may improve the system’s performance, including removing the pre-discharge Level 3 alert for symptoms indicative of a complication, and amending the wording of symptom-report items to ensure symptoms that have already been resolved or are due to unrelated underlying conditions do not trigger clinician alerts.

Conclusion

A real-time, hospital-integrated symptom monitoring system has been developed to optimise the prompt and effective management of symptoms and complications experienced by patients after discharge following abdominal cancer-related surgery. Following the findings from this pilot study indicating that the ePRO surgery system is feasible and acceptable to patients and clinicians, a definitive RCT to evaluate the impact of the system on patients’ physical wellbeing is warranted.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request. Full interview transcripts are not available to protect participant anonymity.

Abbreviations

CNS:

Cancer nurse specialists

EHR:

Electronic health record(s)

EORTC:

European Organisation for Research and Treatment of Cancer questionnaire

ePRO:

Electronic patient reported outcome

ePROM:

Electronic patient reported outcome measure

eRAPID:

Electronic patient self-Reporting of Adverse-events: Patient Information and aDvice

ERAS:

Enhanced recovery after surgery

GP:

General practitioner

HCP:

Healthcare professional

HRQL:

Health-related quality of life

NHS:

National Health Service

PRO:

Patient-reported outcome

PROM:

Patient-reported outcome measure

RCT:

Randomised controlled trial

SD:

Standard deviation

UGI:

Upper gastrointestinal

References

  1. Adam U, Makowiec F, Riediger H, Schareck WD, Benz S, Hopt UT. Risk factors for complications after pancreatic head resection. Am J Surg. 2004;187(2):201–8.

    Article  PubMed  Google Scholar 

  2. Audit NO-GC. An audit of the care received by people with Oesophago-gastric Cancer in England and Wales 2017 annual report. In: National Oesophago-Gastric Cancer Audit; 2017.

    Google Scholar 

  3. DeOliveira ML, Winter JM, Schafer M, Cunningham SC, Cameron JL, Yeo CJ, Clavien PA. Assessment of complications after pancreatic surgery: a novel grading system applied to 633 patients undergoing pancreaticoduodenectomy. Ann Surg. 2006;244(6):931–7 discussion 937-939.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Balentine CJ, Naik AD, Robinson CN, Petersen NJ, Chen GJ, Berger DH, Anaya DA. Association of high-volume hospitals with greater likelihood of discharge to home following colorectal surgery. JAMA Surg. 2014;149(3):244–51.

    Article  PubMed  Google Scholar 

  5. Li LT, Barden GM, Balentine CJ, Orcutt ST, Naik AD, Artinyan A, Sansgiry S, Albo D, Berger DH, Anaya DA. Postoperative transitional care needs in the elderly an outcome of recovery associated with worse long-term survival. Ann Surg. 2015;261(4):695–701.

    Article  PubMed  Google Scholar 

  6. Lightner AM, Glasgow RE, Jordan TH, Krassner AD, Way LW, Mulvihill SJ, Kirkwood KS. Pancreatic resection in the elderly. J Am Coll Surg. 2004;198(5):697–706.

    Article  PubMed  Google Scholar 

  7. Sacks GD, Lawson EH, Dawes AJ, Gibbons MM, Zingmond DS, Ko CY. Which patients require more care after hospital discharge? An analysis of post-acute care use among elderly patients undergoing elective surgery. J Am Coll Surg. 2015;220(6):1113–21 e1112.

    Article  PubMed  Google Scholar 

  8. Blazeby JM, Sanford E, Falk SJ, Alderson D, Donovan JL. Health-related quality of life during neoadjuvant treatment and surgery for localized esophageal carcinoma. Cancer. 2005;103(9):1791–9.

    Article  PubMed  Google Scholar 

  9. Reynolds JV, McLaughlin R, Moore J, Rowley S, Ravi N, Byrne PJ. Prospective evaluation of quality of life in patients with localized oesophageal cancer treated by multimodality therapy or surgery alone. Br J Surg. 2006;93(9):1084–90.

    Article  CAS  PubMed  Google Scholar 

  10. Giacopuzzi S, Weindelmayer J, Treppiedi E, Bencivenga M, Ceola M, Priolo S, Carlini M, de Manzoni G. Enhanced recovery after surgery protocol in patients undergoing esophagectomy for cancer: a single center experience. Dis Esophagus. 2017;30(4):1–6.

    Article  CAS  PubMed  Google Scholar 

  11. Pisarska M, Malczak P, Major P, Wysocki M, Budzynski A, Pedziwiatr M. Enhanced recovery after surgery protocol in oesophageal cancer surgery: systematic review and meta-analysis. PLoS One. 2017;12(3):e0174382.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  12. van Dam RM, Hendry PO, Coolsen MM, Bemelmans MH, Lassen K, Revhaug A, Fearon KC, Garden OJ, Dejong CH, Enhanced Recovery After Surgery G. Initial experience with a multimodal enhanced recovery programme in patients undergoing liver resection. Br J Surg. 2008;95(8):969–75.

    Article  PubMed  Google Scholar 

  13. Mitchell M. Home recovery following day surgery: a patient perspective. J Clin Nurs. 2015;24(3–4):415–27.

    Article  PubMed  Google Scholar 

  14. Mitchell AP, Hirsch BR, Abernethy AP. Lack of timely accrual information in oncology clinical trials: a cross-sectional analysis. Trials. 2014;15:92.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Mooney KH, Beck SL, Friedman RH, Farzanfar R, Wong B. Automated monitoring of symptoms during ambulatory chemotherapy and oncology providers' use of the information: a randomized controlled clinical trial. Support Care Cancer. 2014;22(9):2343–50.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Warrington L, Holch P, Kenyon L, Hector C, Kozlowska K, Kenny AM, Ziegler L, Velikova G. An audit of acute oncology services: patient experiences of admission procedures and staff utilisation of a new telephone triage system. Support Care Cancer. 2016;24(12):5041–8.

    Article  PubMed  Google Scholar 

  17. Khuri SF, Henderson WG, DePalma RG, Mosca C, Healey NA, Kumbhani DJ, Participants in the VANSQIP. Determinants of long-term survival after major surgery and the adverse effect of postoperative complications. Ann Surg. 2005;242(3):326–41 discussion 341-323.

    PubMed  PubMed Central  Google Scholar 

  18. Kotronoulas G, Kearney N, Maguire R, Harrow A, Di Domenico D, Croy S, MacGillivray S. What is the value of the routine use of patient-reported outcome measures toward improvement of patient outcomes, processes of care, and health service outcomes in cancer care? A systematic review of controlled trials. J Clin Oncol. 2014;32(14):1480–501.

    Article  PubMed  Google Scholar 

  19. Velikova G. Use of electronic quality of life applications in cancer research and clinical practice. Expert Rev Pharmacoecon Outcomes Res. 2004;4(4):403–11.

    Article  PubMed  Google Scholar 

  20. Kreuter MW, Wray RJ. Tailored and targeted health communication: strategies for enhancing information relevance. Am J Health Behav. 2003;27(Suppl 3):S227–32.

    Article  PubMed  Google Scholar 

  21. Monitoring and evaluating digital health interventions: a practical guide to conducting research and assessment. Geneva: World Health Organization; 2016. Licence: CC BY-NC-SA 3.0 IGO.

  22. Ruland CM, Maffei RM, Borosund E, Krahn A, Andersen T, Grimsbo GH. Evaluation of different features of an eHealth application for personalized illness management support: cancer patients' use and appraisal of usefulness. Int J Med Inform. 2013;82(7):593–603.

    Article  PubMed  Google Scholar 

  23. Slev VN, Mistiaen P, Pasman HR, Verdonck-de Leeuw IM, van Uden-Kraan CF, Francke AL. Effects of eHealth for patients and informal caregivers confronted with cancer: a meta-review. Int J Med Inform. 2016;87:54–67.

    Article  PubMed  Google Scholar 

  24. Basch E, Bennett A, Pietanza MC. Use of patient-reported outcomes to improve the predictive accuracy of clinician-reported adverse events. J Natl Cancer Inst. 2011;103(24):1808–10.

    Article  PubMed  Google Scholar 

  25. Cleeland CS, Wang XS, Shi Q, Mendoza TR, Wright SL, Berry MD, Malveaux D, Shah PK, Gning I, Hofstetter WL, et al. Automated symptom alerts reduce postoperative symptom severity after cancer surgery: a randomized controlled clinical trial. J Clin Oncol. 2011;29(8):994–1000.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Bennett AV, Jensen RE, Basch E. Electronic patient-reported outcome systems in oncology clinical practice. CA Cancer J Clin. 2012;62(5):337–47.

    Article  PubMed  Google Scholar 

  27. Velikova G, Booth L, Smith AB, Brown PM, Lynch P, Brown JM, Selby PJ. Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. J Clin Oncol. 2004;22(4):714–24.

    Article  PubMed  Google Scholar 

  28. Andikyan V, Rezk Y, Einstein MH, Gualtiere G, Leitao MM Jr, Sonoda Y, Abu-Rustum NR, Barakat RR, Basch EM, Chi DS. A prospective study of the feasibility and acceptability of a web-based, electronic patient-reported outcome system in assessing patient recovery after major gynecologic cancer surgery. Gynecol Oncol. 2012;127(2):273–7.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Basch E, Deal AM, Kris MG, Scher HI, Hudis CA, Sabbatini P, Rogak L, Bennett AV, Dueck AC, Atkinson TM, et al. Symptom monitoring with patient-reported outcomes during routine cancer treatment: a randomized controlled trial. J Clin Oncol. 2016;34(6):557–65.

    Article  CAS  PubMed  Google Scholar 

  30. Borosund E, Cvancarova M, Moore SM, Ekstedt M, Ruland CM. Comparing effects in regular practice of e-communication and web-based self-management support among breast cancer patients: preliminary results from a randomized controlled trial. J Med Internet Res. 2014;16(12):e295.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Kearney N, McCann L, Norrie J, Taylor L, Gray P, McGee-Lennon M, Sage M, Miller M, Maguire R. Evaluation of a mobile phone-based, advanced symptom management system (ASyMS) in the management of chemotherapy-related toxicity. Support Care Cancer. 2009;17(4):437–44.

    Article  CAS  PubMed  Google Scholar 

  32. Moradian S, Krzyzanowska MK, Maguire R, Morita PP, Kukreti V, Avery J, Liu G, Cafazzo J, Howell D. Usability evaluation of a mobile phone-based system for remote monitoring and management of chemotherapy-related side effects in cancer patients: mixed-methods study. JMIR Cancer. 2018;4(2):e10932.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Cowan RA, Suidan RS, Andikyan V, Rezk YA, Einstein MH, Chang K, Carter J, Zivanovic O, Jewell EJ, Abu-Rustum NR, et al. Electronic patient-reported outcomes from home in patients recovering from major gynecologic cancer surgery: a prospective study measuring symptoms and health-related quality of life. Gynecol Oncol. 2016;143(2):362–6.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Avery KNL, Richards HS, Portal A, Reed T, Harding R, Carter R, Bamforth L, Absolom K, O'Connell Francischetto E, Velikova G, et al. Developing a real-time electronic symptom monitoring system for patients after discharge following cancer-related surgery. BMC Cancer. 2019;19(1):463.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Holch P, Pini S, Henry AM, Davidson S, Routledge J, Brown J, Absolom K, Gilbert A, Franks K, Hulme C, et al. eRAPID electronic patient self-reporting of adverse-events: patient information and aDvice: a pilot study protocol in pelvic radiotherapy. Pilot Feasibility Stud. 2018;4:110.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Holch P, Warrington L, Bamforth LCA, Keding A, Ziegler LE, Absolom K, Hector C, Harley C, Johnson O, Hall G, et al. Development of an integrated electronic platform for patient self-report and management of adverse events during cancer treatment. Ann Oncol. 2017;28(9):2305–11.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  37. Brooks RG, Jendteg S, Lindgren B, Persson U, Bjork S. EuroQol: health-related quality of life measurement. Results of the Swedish questionnaire exercise. Health Policy. 1991;18(1):37–48.

    Article  CAS  PubMed  Google Scholar 

  38. Cella DF, Tulsky DS, Gray G, Sarafian B, Linn E, Bonomi A, Silberman M, Yellen SB, Winicour P, Brannon J, et al. The functional assessment of cancer therapy scale: development and validation of the general measure. J Clin Oncol. 1993;11(3):570–9.

    Article  CAS  PubMed  Google Scholar 

  39. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.

    Article  Google Scholar 

  40. Green JT, N. Qualitative Medthods for Health Research. London: Sage; 2004.

    Google Scholar 

  41. Gurland B, Alves-Ferreira PC, Sobol T, Kiran RP. Using technology to improve data capture and integration of patient-reported outcomes into clinical care: pilot results in a busy colorectal unit. Dis Colon Rectum. 2010;53(8):1168–75.

    Article  PubMed  Google Scholar 

  42. Malhotra K, Buraimoh O, Thornton J, Cullen N, Singh D, Goldberg AJ. Electronic capture of patient-reported and clinician-reported outcome measures in an elective orthopaedic setting: a retrospective cohort analysis. BMJ Open. 2016;6(6):e011975.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Palmen LN, Schrier JC, Scholten R, Jansen JH, Koeter S. Is it too early to move to full electronic PROM data collection?: a randomized controlled trial comparing PROM's after hallux valgus captured by e-mail, traditional mail and telephone. Foot Ankle Surg. 2016;22(1):46–9.

    Article  PubMed  Google Scholar 

  44. Roberts N, Bradley B, Williams D. Use of SMS and tablet computer improves the electronic collection of elective orthopaedic patient reported outcome measures. Ann R Coll Surg Engl. 2014;96(5):348–51.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  45. van der Meij E, Anema JR, Leclercq WKG, Bongers MY, Consten ECJ, Koops SES, van de Ven PM, Terwee CB, van Dongen JM, Schaafsma FG, et al. Personalised perioperative care by e-health after intermediate-grade abdominal surgery: a multicentre, single-blind, randomised, placebo-controlled trial. Lancet. 2018;392(10141):51–9.

    Article  PubMed  Google Scholar 

  46. Berry DL, Nayak MM, Abrahm JL, Braun I, Rabin MS, Cooley ME. Clinician perspectives on symptom and quality of life experiences of patients during cancer therapies: implications for eHealth. Psychooncology. 2017;26(8):1113–9.

    Article  PubMed  Google Scholar 

  47. Kuijpers W, Groen WG, Aaronson NK, van Harten WH. A systematic review of web-based interventions for patient empowerment and physical activity in chronic diseases: relevance for cancer survivors. J Med Internet Res. 2013;15(2):e37.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Leykin Y, Thekdi SM, Shumay DM, Munoz RF, Riba M, Dunn LB. Internet interventions for improving psychological well-being in psycho-oncology: review and recommendations. Psychooncology. 2012;21(9):1016–25.

    Article  PubMed  Google Scholar 

  49. Nordan L, Blanchfield L, Niazi S, Sattar J, Coakes CE, Uitti R, Vizzini M, Naessens JM, Spaulding A. Implementing electronic patient-reported outcomes measurements: challenges and success factors. BMJ Qual Saf. 2018;27(10):852–6.

    Article  PubMed  Google Scholar 

  50. Absolom K, Gibson A, Velikova G. Engaging Patients and Clinicians in Online Reporting of Adverse Effects During Chemotherapy for Cancer: The eRAPID System (Electronic Patient Self-Reporting of Adverse Events: Patient Information and aDvice). Med Care. 2019;57(Suppl 5 Suppl 1):S59–65.

    Article  PubMed  Google Scholar 

  51. Hughes EF, Wu AW, Carducci MA, Snyder CF. What can I do? Recommendations for responding to issues identified by patient-reported outcomes assessments used in clinical practice. J Support Oncol. 2012;10(4):143–8.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Dorcaratto D, Grande L, Pera M. Enhanced recovery in gastrointestinal surgery: upper gastrointestinal surgery. Dig Surg. 2013;30(1):70–8.

    Article  PubMed  Google Scholar 

  53. Francis NK, Mason J, Salib E, Allanby L, Messenger D, Allison AS, Smart NJ, Ockrim JB. Factors predicting 30-day readmission after laparoscopic colorectal cancer surgery within an enhanced recovery programme. Color Dis. 2015;17(7):O148–54.

    Article  CAS  Google Scholar 

  54. Fredericks S, Guruge S, Sidani S, Wan T. Postoperative patient education: a systematic review. Clin Nurs Res. 2010;19(2):144–64.

    Article  PubMed  Google Scholar 

  55. Cook DJ, Moradkhani A, Douglas KS, Prinsen SK, Fischer EN, Schroeder DR. Patient education self-management during surgical recovery: combining mobile (iPad) and a content management system. Telemed J E Health. 2014;20(4):312–7.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Weinhouse GL, Schwab RJ, Watson PL, Patil N, Vaccaro B, Pandharipande P, Ely EW. Bench-to-bedside review: delirium in ICU patients - importance of sleep deprivation. Crit Care. 2009;13(6):234.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Timmers T, Janssen L, Pronk Y, van der Zwaard BC, Koeter S, van Oostveen D, de Boer S, Kremers K, Rutten S, Das D, et al. Assessing the efficacy of an educational smartphone or tablet app with subdivided and interactive content to increase patients’ medical knowledge: randomized controlled trial. JMIR Mhealth Uhealth. 2018;6(12):e10742.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Lee BT, Chen C, Yueh JH, Nguyen MD, Lin SJ, Tobias AM. Computer-based learning module increases shared decision making in breast reconstruction. Ann Surg Oncol. 2010;17(3):738–43.

    Article  PubMed  Google Scholar 

  59. Marble N, Loescher LJ, Lim KH, Hiscox H. Use of technology for educating melanoma patients. J Cancer Educ. 2010;25(3):445–50.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Boyce MB, Browne JP, Greenhalgh J. Surgeon's experiences of receiving peer benchmarked feedback using patient-reported outcome measures: a qualitative study. Implement Sci. 2014;9:84.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Nelson MC, Burke RL. Fielding the remote online veterinary record, a veterinary electronic health record to improve patient care and practice management. US Army Med Dep J. 2015;61–6.

  62. Office of National Statistics: Internet access – households and individuals, Great Britain: 2018 [https://www.ons.gov.uk/peoplepopulationandcommunity/householdcharacteristics/homeinternetandsocialmediausage/bulletins/internetaccesshouseholdsandindividuals/2018].

  63. Warrington L, Absolom K, Holch P, Gibson A, Clayton B, Velikova G. Online tool for monitoring adverse events in patients with cancer during treatment (eRAPID): field testing in a clinical setting. BMJ Open. 2019;9(1):e025185.

  64. Blazeby JM. Recruiting patients into randomized clinical trials in surgery. Br J Surg. 2012;99(3):307–8.

  65. Kaur G, Hutchison I, Mehanna H, Williamson P, Shaw R, Tudur Smith C. Barriers to recruitment for surgical trials in head and neck oncology: a survey of trial investigators. BMJ Open. 2013;3(4):e002625. https://doi.org/10.1136/bmjopen-2013-002625.

  66. Pinkney TD, Calvert M, Bartlett DC, Gheorghe A, Redman V, Dowswell G, Hawkins W, Mak T, Youssef H, Richardson C, et al. Impact of wound edge protection devices on surgical site infection after laparotomy: multicentre randomised controlled trial (ROSSINI trial). BMJ. 2013;347:f4305.

Download references

Acknowledgements

The authors would like to thank all the patients who took part in this study, and members of the Surgical Research Nurse teams at University Hospitals Bristol NHS Foundation Trust and University Hospitals Birmingham Heartlands for their assistance in recruiting patients to the study.

Funding

This report is independent research funded by the National Institute for Health Research (Programme Grants for Applied Health research, Towards safer delivery and monitoring of cancer treatments. Electronic patient self-Reporting of Adverse-events: Patient Information and aDvice (eRAPID) RP-PG-0611-20008). This work was undertaken with the support of the Medical Research Council ConDuCT-II (Collaboration and innovation for Difficult and Complex randomised controlled Trials In Invasive procedures) Hub for Trials Methodology Research (MR/K025643/1) (http://www.bristol.ac.uk/social-community-medicine/centres /conduct2/), Royal College of Surgeons of England Bristol Surgical Trials Centre and National Institute for Health Research (NIHR) Biomedical Research Centre (BRC) at the University Hospitals Bristol NHS Foundation Trust and the University of Bristol. JMB holds an NIHR Senior Investigator award. The views expressed in this publication are those of the author(s) and not necessarily those of the NHS, the National Institute for Health Research, Department of Health and Social Care or MRC. The funding bodies played no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

Author information

Authors and Affiliations

  1. Medical Research Council ConDuCT-II Hub for Trials Methodology Research, National Institute for Health Research Bristol Biomedical Research Centre, Bristol Centre for Surgical Research, Bristol Medical School, Population Health Sciences, University of Bristol, 39 Whatley Road, Bristol, BS8 2PS, UK

    H. S. Richards, J. M. Blazeby, K. A. Chalmers & K. N. L. Avery

  2. Division of Surgery, University Hospitals Bristol NHS Foundation Trust, Bristol, BS2 8HW, UK

    J. M. Blazeby, R. Harding, T. Reed & T. Lander

  3. Medical Research Council ConDuCT-II Hub for Trials Methodology Research, Bristol Centre for Surgical Research, Bristol Medical School, Population Health Sciences, University of Bristol, 39 Whatley Road, Bristol, BS8 2PS, UK

    A. Portal

  4. Section of Patient-Centred Outcomes Research, Leeds Institute of Medical Research at St James’s, University of Leeds, St James’s Hospital, Leeds, LS9 7TF, UK

    R. Carter, K. Absolom & G. Velikova

  5. Queen Elizabeth Hospital Birmingham, Mindelson Way, Edgbaston, Birmingham, B15 2WB, UK

    R. Singhal

Authors
  1. H. S. Richards
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. J. M. Blazeby
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. Portal
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. R. Harding
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. T. Reed
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. T. Lander
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. K. A. Chalmers
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. R. Carter
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. R. Singhal
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. K. Absolom
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. G. Velikova
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. K. N. L. Avery
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JB and GV conceived the study. KAb, KA, JB, LB, RC, HR and GV designed the study; HR conducted day-to-day management of the study; KA, RS, JB and GV oversaw the study; RH, AP, HR and RS collected data; KA, KC, AP and HR carried out data analyses; RH, TL and TR made substantial contributions to data interpretation. KA, HR, JB, AP and KC interpreted data and drafted the manuscript; all authors critically reviewed and approved the final version of the manuscript.

Corresponding author

Correspondence to H. S. Richards.

Ethics declarations

Ethics approval and consent to participate

The research protocol for this study was reviewed and approved by London Surrey Borders Research Ethics Committee (15/LO/2017). All patients provided written informed consent prior to participation, including for audio-recording of interviews and telephone consultations.

Consent for publication

Not applicable.

Competing interests

None declared.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Interview Topic Guides.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Richards, H.S., Blazeby, J.M., Portal, A. et al. A real-time electronic symptom monitoring system for patients after discharge following surgery: a pilot study in cancer-related surgery. BMC Cancer 20, 543 (2020). https://doi.org/10.1186/s12885-020-07027-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12885-020-07027-5

Keywords

BMC Cancer

ISSN: 1471-2407

Contact us