The electronic self report assessment and intervention for cancer: promoting patient verbal reporting of symptom and quality of life issues in a randomized controlled trial
BMC Cancer volume 14, Article number: 513 (2014)
The electronic self report assessment - cancer (ESRA-C), has been shown to reduce symptom distress during cancer therapy The purpose of this analysis was to evaluate aspects of how the ESRA-C intervention may have resulted in lower symptom distress (SD).
Patients at two cancer centers were randomized to ESRA-C assessment only (control) or the Web-based ESRA-C intervention delivered to patients’ homes or to a tablet in clinic. The intervention allowed patients to self-monitor symptom and quality of life (SxQOL) between visits, receive self-care education and coaching to report SxQOL to clinicians. Summaries of assessments were delivered to clinicians in both groups. Audio-recordings of clinic visits made 6 weeks after treatment initiation were coded for discussions of 26 SxQOL issues, focusing on patients’/caregivers’ coached verbal reports of SxQOL severity, pattern, alleviating/aggravating factors and requests for help. Among issues identified as problematic, two measures were defined for each patient: the percent SxQOL reported that included a coached statement, and an index of verbalized coached statements per SxQOL. The Wilcoxon rank test was used to compare measures between groups. Clinician responses to problematic SxQOL were compared. A mediation analysis was conducted, exploring the effect of verbal reports on SD outcomes.
517 (256 intervention) clinic visits were audio-recorded. General discussion of problematic SxQOL was similar in both groups. Control group patients reported a median 75% of problematic SxQOL using any specific coached statement compared to a median 85% in the intervention group (p = .0009). The median report index of coached statements was 0.25 for the control group and 0.31 for the intervention group (p = 0.008). Fatigue, pain and physical function issues were reported significantly more often in the intervention group (all p < .05). Clinicians' verbalized responses did not differ between groups. Patients' verbal reports did not mediate final SD outcomes (p = .41).
Adding electronically-delivered, self-care instructions and communication coaching to ESRA-C promoted specific patient descriptions of problematic SxQOL issues compared with ESRA-C assessment alone. However, clinician verbal responses were no different and subsequent symptom distress group differences were not mediated by the patients' reports.
NCT00852852; 26 Feb 2009
Patient-clinician communication has been evaluated and found lacking with regard to clinician assessment of patient experiences, notably symptoms and quality-of-life issues (SxQOL) [1–3], and verbal patient reports of SxQOL . Barriers to communication in the oncology setting have been identified and include 1) clinician-oriented verbal behaviors: use of close-ended (versus open-ended) queries and interruptions of patient symptom descriptions [5, 6], changing the subject after a patient verbally reports an SxQOL;  2) clinician beliefs that quality of life issues are other clinicians' responsibility , 3) patient-oriented issues: reluctance to verbalize problems , recall of SxQOL experiences in between visits , and 4) time limitations during the visit . When clinicians are unaware of SxQOL, particularly treatment-related toxicities, there is danger of higher morbidity and even mortality related to unintentional over-dosing [12, 13]. Interventions to improve patient-clinician communication have been tested with modest, but positive, results [9, 14–16].
In the first electronic self report assessment for cancer (ESRA-C) randomized clinical trial , we demonstrated the feasibility, acceptability and efficacy of computerized SxQOL screening at a large comprehensive cancer center in Seattle, significantly increasing the frequency of patient/clinician communication about problematic issues as measured in audio-recorded clinic visits. Yet, we found that even when clinicians received summaries of patient-reported SxQOL, the most frequently addressed issues were those either regulated by certification bodies (e.g., pain) or likely to be affected by supportive care medications previously ordered by the clinician (e.g., nausea with anti-emetics). High distress SxQOL reported by patients on the ESRA-C measure were often left unaddressed by clinicians [6, 7]. A second randomized trial (ESRA-C II) in which the clinician summary intervention was delivered for all participant clinic visits, tested a new intervention that offered SxQOL tracking, tailored education and communication coaching directly to patients recruited from two comprehensive cancer centers. The results from ESRA-C II indicated significantly lower symptom distress over the course of therapy with the intervention . Because ESRA-C was a multi-component intervention, we wanted to understand more about the impact of the communication coaching on the verbal behaviors of patients during the face-to-face visit. The purpose of this analysis was to compare verbal reports of SxQOL between the study groups with regard to: 1) reported severity, pattern, alleviating/aggravating factors and requests for help for the full set of 26 ESRA-C SxQOL issues; and 2) reports of individual SxQOL issues within the full set, plus 3) to determine whether any observed differences would account for differences in symptom distress.
This analysis is one component of a program of research founded on the Quality Health Outcomes Model, a framework proposed by Mitchell and colleagues  to illustrate that patient outcomes are rarely explained only by specific interventions but also by health care system/provider factors and patient-specific factors. Patients' verbal behaviors can be placed in the model (Figure 1) as a patient-specific factor that may mediate, along with setting factors such as clinician verbal behaviors, the impact of the ESRA-C intervention on symptom distress.
Design, sample, intervention
The ESRA-C II trial was a randomized trial conducted at two comprehensive cancer centers. The study was approved by both the Dana-Farber/Harvard Cancer Center and the Fred Hutchinson Cancer Institute Institutional Review Boards. Participants were patients with various cancers at a range of stages. The details of the trial were reported elsewhere . In brief, adult patients who provided written informed consent to participate and were about to start a new medical or radiation anti-cancer therapy were randomized to receive usual education about SxQOL topics or usual education plus tailored self-care instruction for moderate-to-severe reported SxQOL issues. In both arms, patients reported SxQOL using the ESRA-C and clinicians received summaries of patient-reported SxQOL prior to treatment (T1) and again within 24 hours prior to a face-to-face clinic visit (T2). Cancer symptomatology was measured primarily with the Symptom Distress Scale-15 (SDS-15), adapted from the 13-item, legacy instrument developed by McCorkle and Young  and validated in many subsequent studies and languages . The SDS-15 offers patients with cancer the opportunity to report most of the common symptoms and side effects of therapy in an easy-to-understand format. Patients in the intervention group could access the ESRA-C program from home or in clinic on a touch-screen computer at any time throughout the trial to electronically track SxQOL and view self-care instruction.The patient instruction in the intervention arm included on-screen, tailored coaching on how to better communicate each troublesome SxQOL issue to the clinician, and specifically to remind and encourage the patient to describe the severity, pattern, and alleviating/aggravating factors related to the issue, and to ask for assistance in managing the issue. Figure 2 depicts an exemplar of the communication coaching text. These coaching instructions were delivered immediately before each on-study clinic visit for the 14.5% (109/752) of the sample without remote access to the ESRA-C program and within 24 hours of the visits for those patients with remote access at home (85.5%).
About six weeks after study enrollment and treatment initiation (T2), a regularly scheduled clinic visit between the participant and clinician was audio-recorded. All recordings were cleaned of potential identifiers. Research team members listened to the recordings using Sound Forge Audio Studio software version 9 (Sony Creative Software, Middleton, WI) and coded the following for each of 26 SxQOL issues (including a field for free text entry of SxQOL not specifically assessed): a) who initiated; b) whether the issue was discussed and defined as problematic; and c) which, if any, of the four coached descriptions/requests (severity, pattern, alleviation/aggravation and request for help) the patient and/or caregiver made without clinician prompting. We defined the SxQOL issue problematic when it was discussed as current at any degree of severity.
Members of the study team were trained to code recordings and completed eight practice cases with feedback to achieve proficiency prior to initiating coding. The team met to review and discuss coding monthly over fourteen months. Coders were blinded to group assignment unless it was disclosed during the course of the recorded clinic visit. Cases were assigned for coding randomly. Twelve percent of cases were randomly selected to be double-coded for reliability; percent agreement was calculated in which every matched code was an agreement (for example, both coders identify an utterance as a description of the pattern of a particular symptom), and every unmatched code was a disagreement (for example, one coder identified the patient and another the family member as the initiator of a particular symptom discussion). When there were disagreements, the coders reviewed codes together and determined the final codes used for analysis.
Descriptive statistics were used to summarize baseline sample characteristics and numbers of SxQOL issues identified as problems in the audio-recorded visits. First, the percentage of problematic issues initiated by the patient, family or clinician was calculated. Among problematic SxQOL issues, two measures were defined for analysis across all patients: 1) the percentage of problematic issues about which the patient or caregiver verbally reported at least one coached statement without clinician prompting; and 2) a report index of how many coached statements were made by the patient during the visit), regarding problematic SxQOL issues (for example, if a patient reported only severity for fatigue, the measure would be 1/4 = .25).
The range of both measures was from 0 to 1. The Wilcoxon rank test was used to compare the measures between study groups. Covariates previously identified as influencing symptom distress in the primary outcome analysis (age, clinical service, working status and baseline SDS-15 score) were adjusted in multivariable analysis to improve the precision of estimating the intervention effect on the two scores. Two-way interactions between study group and other covariates were tested and none were found significant. In addition, for each individual SxQOL, the percentage of problematic SxQOL reported as coached was compared between groups with a Fisher’s Exact test.
In order to assess whether patient verbal reports mediated the outcome of the primary analysis , reduced symptom distress, we conducted a mediation analysis using a causal step approach . Specifically, for the analytic sample (participants with audio recordings), the difference in SDS-15 from baseline to study end was calculated. Then three regression analyses were performed: 1) SDS-15 difference on study group, adjusting for baseline SDS-15 score; 2) patient verbal report measure on study group; and 3) SDS-15 difference on study group and patient verbal report measure, adjusting for baseline SDS-15 score. The mediation would be established if all of the following were observed: significant relationships in regression 1 and 2; significant relationship of patient verbal report measure with SDS-15 difference in regression 3; and a smaller coefficient of the study group in regression 3 compared with regression 1. We tested the mediation effect of each patient verbal report measure separately. Lastly, the percentage of problematic SxQOL issues for which clinicians verbalized a treatment or referral was calculated for each patient and compared between two study group with the Wilcoxon rank test. For all tests, a two-sided p-value of 0.05 was considered statistically significant and 0.1 was considered to indicate a trend.
Among 752 eligible patients, 517 clinic visits were audio-recorded and coded for analysis (Figure 3). In one recording, the patient referenced teaching material in the online intervention, effectively un-blinding the coder to group assignment. Sixty-two recordings were double-coded, with a mean percent agreement of 86.7 (median 88.0; range 61.0-99.5). Of the recordings available for analysis, 261 were from the control group patients and 256 from the intervention group. Baseline participant characteristics are presented by study group in Table 1. Patients with audio-recordings were younger in the intervention group than in the control group (p < .0001). Out of 517 patients, 27 (13 control and 14 intervention) did not discuss any problematic SxQOL issue during the clinic visits. There was no significant difference (p = 0.41) between study groups in number of problematic SxQOL issues discussed at all during clinic visits, with a median of 4 issues discussed by control group patients, and 3 by patients in the intervention condition. Patients initiated general discussion of an average 56% of problematic SxQOL issues in the control group and 55% in the intervention group (p = 0.97). Family members initiated 4% of the problematic SxQOL issues in the control group and 5% in the intervention group (p = 0.35).
The percentage of problematic SxQOL issues which patients or caregivers reported using any specific coached statement during the clinic visit, was significantly higher (p = 0.002) in the intervention group than that in the control: a median of 85% of problematic SxQOL were reported as coached in the intervention group versus 75% in the control (Table 2). After adjusting for covariates, group remained significantly associated (p = 0.0009); intervention group patients had an approximate 9% higher rate of describing problems with a coached statement (Table 3).
The report index of coached statements was significantly higher (p = 0.01) in the intervention group than in the control group, with medians of 0.31 and 0.25, respectively (Table 2). In other words, a patient with four discussed problematic issues in the intervention group gave one more coached, specific statement than a similar patient in the control. In the multivariable model adjusting for potential covariates (Table 3), study group was the only factor significantly associated (p = 0.03) with report index scores. Patients in the intervention group had an average 0.036 higher report index than those in the control group.Figure 4 displays the percentage of participants reporting any coached statement for each problematic SxQOL. The most frequently described issues in both groups were those related to symptoms versus quality of life domains. The percentage in the intervention group was significantly higher for fatigue (p = 0.03), pain (p = 0.02) and physical function (p = 0.02), and trended higher for bowel (p = 0.08), sensory neuropathy (p = 0.07), and SxQOL issues reported by patients in free text entry (p = 0.09). However, the percentage of specific, coached descriptions of nausea was significantly lower in the intervention group (p = 0.04).
Of 517 patients with audio data, 445 had SDS-15 scores at baseline and the study endpoint, and thus were included in the mediation analysis. Significant relationships were confirmed between study groups and SDS-15 difference (p = 0.05) in the first regression, and study group and patient verbal report measures in the second regressions (p = 0.0005 for percent of problematic SxQOL issues reported using any coached statement, and p = 0.01 for the report index). However, when the SDS-15 difference was regressed on study group and patient verbal report measures in the final pair of analyses, neither of the two verbal report measures was significant (p = 0.26 for percent of problematic SxQOL reported using any coached statement, p = 0.41 for the report index ). The results suggest that patients' specific verbalization of coached statements did not mediate the impact of the ESRA-C intervention on symptom distress. During the recorded clinic visits, clinicians verbalized treatment or a referral for a median of 48% of problematic SxQOL issues in the control group and a median of 50% in the intervention group (p = 0.15).
The patients in the ESRA-C II randomized trial who received an educational coaching intervention to aid verbal report of problematic SxQOL applied the reporting framework as coached (severity, pattern, aggravating/alleviating factors and help request), reporting these specific details without prompting, significantly more often than control group patients. When examining individual SxQOL issues, we found that reports for the majority of individual SxQOL issues were more frequent in the intervention group. Even though our study was not powered to compare individual SxQOL issues, we found that fatigue, pain and physical function were reported significantly more often by the intervention group. Fatigue is known to be the most common cancer symptom , pain also has a high incidence, and physical functioning is impacted by both. Interestingly, specifics of problematic nausea were reported significantly less often in the intervention group. This may reflect that intervention patients were intent on reporting other SxQOL issues perceived to be more important or more difficult to manage, and consequently, nausea was not one of the priorities.
Findings from our previous randomized trial with ESRA-C  and from Velikova et al.  established the significant and positive effect of a clinician summary on verbal discussions of SxQOL within a face-to-face clinic visit, yet neither trial significantly increased patient verbal self-reports. Instructing the participant to verbally report the same information reported on the quantitative SxQOL questionnaires was not included in these earlier trials. Of all the trials conducted with SxQOL outcomes, very few have utilized a direct measure of patient-provider communication . Wilkie and colleagues  randomized 151 patients with lung cancer and found significantly more unsolicited reports of pain intensity in audio-recordings of on-treatment clinic visits after an intervention consisting of a coaching videotape plus personal reinforcement. Street et al.  reported that, in 148 patients with cancer randomized to an educational communication coaching intervention, higher baseline pain and several demographic variables predicted more pain-specific active participation in the clinic visit conversation. Taking all of these results together, coaching patients with cancer to engage in conversations with specialists monitoring the treatment course shows promise as an adjunct to providing clinicians with quantitative information from SxQOL questionnaires. The use of electronic self-report and education further enhanced the method. Not only did it save data entry time but it also provided customized, immediate patient coaching for the problems of highest intensity or distress, and a quick-to-view summary for the clinicians.
Our findings may be limited by the fact that the audio-recording was made at only one visit, a cross-section of the entire cancer treatment experience. Clinicians may have taken actions relevant to SxQOL issues after the visit or even in the next weekly visit that impacted the symptom distress outcome. Also, while we observed a significantly younger mean age of patients in the intervention group  who may have been more accustomed to web-based instruction than the older control group, our analyses suggest that younger age was not a significant covariate influencing the outcomes. Our sample was predominately a group of educated health care recipients being cared for in two comprehensive cancer centers;  thus these findings only can be generalized beyond such a sample and setting with caution.
These analyses clearly suggest that communication from patients to clinicians with regard to SxQOL may be improved with our intervention, yet many issues remain to be addressed: 1) whether the effect of the intervention was related to how often patients utilized the self-monitoring and teaching components; and 2) whether patients in the intervention group adhered more often to SxQOL management recommendations made by clinicians. Future analyses are clearly warranted to address these issues and understand more fully the effect of such intervention on patient-reported outcomes.
Electronic education and coaching provided to patients with a variety of cancers of all stages resulted in significantly more specific verbal reports of SxQOL concerns made to treating clinicians in face to face visits. While there is evidence that the coached approach to describing SxQOL was adopted, the specific concerns verbalized by patients in one visit did not mediate the overall study outcome of symptom distress. The rate at which clinicians responded verbally with actions to address the concerns was not significantly different between groups. Other unknown or unanalyzed variables may explain why patients in the intervention group of the ESRA-C II trial reported lower symptom distress over the course of cancer treatment.
Electronic self report assessment for cancer
Symptoms and quality of life.
Roter DL, Hall JA: Physician gender and patient-centered communication: a critical review of empirical research. Annu Rev Public Health. 2004, 25: 497-519. 10.1146/annurev.publhealth.25.101802.123134.
Surbone A: Cultural aspects of communication in cancer care. Support Care Cancer. 2008, 16: 235-240. 10.1007/s00520-007-0366-0.
Ong LM, de Haes JC, Hoos AM, Lammes FB: Doctor-patient communication: a review of the literature. Soc Sci Med. 1995, 40: 903-918. 10.1016/0277-9536(94)00155-M.
Kinnersley P, Edwards A, Hood K, Cadbury N, Ryan R, Prout H, Owen D, Macbeth F, Butow P, Butler C: Interventions before consultations for helping patients address their information needs. Cochrane Database Syst Rev. 2007, CD004565-Issue 3. Art. No.: CD004565. doi:10.1002/14651858.CD004565.pub2.
Berry DL, Wilkie DJ, Thomas CR, Fortner P: Clinicians communicating with patients experiencing cancer pain. Cancer Invest. 2003, 21: 374-381. 10.1081/CNV-120018228.
Kennedy Sheldon L, Hilaire D, Berry DL: Provider verbal responses to patient distress cues during ambulatory oncology visits. Oncol Nurs Forum. 2011, 38: 369-375. 10.1188/11.ONF.369-375.
Siefert ML, Hong F, Valcarce B: Berry DL. 2013, Cancer Nurs: Patient and Clinician Communication of Self-reported Insomnia During Ambulatory Cancer Care Clinic Visits
Stead ML, Brown JM, Fallowfield L, Selby P: Lack of communication between healthcare professionals and women with ovarian cancer about sexual issues. British J Cancer. 2003, 88: 666-671. 10.1038/sj.bjc.6600799.
Salsman JM, Grunberg SM, Beaumont JL, Rogers M, Paul D, Clayman ML, Cella D: Communicating about chemotherapy-induced nausea and vomiting: a comparison of patient and provider perspectives. J Natl Compr Canc Netw. 2012, 10: 149-157.
Coolbrandt A, Van den Heede K, Vanhove E, De Bom A, Milisen K, Wildiers H: Immediate versus delayed self-reporting of symptoms and side effects during chemotherapy: does timing matter?. Eur J Oncol Nurs. 2011, 15: 130-136. 10.1016/j.ejon.2010.06.010.
State-of-the-Science Conference on Symptom Management in Cancer: Pain, Depression, and Fatigue. 2002, National Institutes of Health, Accessed 15 Jul 2014 at: http://consensus.nih.gov/2002/2002CancerPainDepressionFatigueSOS022PDF.pdf
Palma DA, Senan S, Tsujino K, Barriger RB, Rengan R, Moreno M, Bradley JD, Kim TH, Ramella S, Marks LB, De Petris L, Stitt L, Rodrigues G: Predicting radiation pneumonitis after chemoradiation therapy for lung cancer: an international individual patient data meta-analysis. Int J Radiat Oncol Biol Phys. 2013, 85: 444-450. 10.1016/j.ijrobp.2012.04.043.
Vandyk AD, Harrison MB, Macartney G, Ross-White A, Stacey D: Emergency department visits for symptoms experienced by oncology patients: a systematic review. Support Care Cancer. 2012, 20: 1589-1599. 10.1007/s00520-012-1459-y.
Heyn L, Ruland CM, Finset A: Effects of an interactive tailored patient assessment tool on eliciting and responding to cancer patients' cues and concerns in clinical consultations with physicians and nurses. Patient Educ Couns. 2012, 86: 158-165. 10.1016/j.pec.2011.04.024.
Boyes A, Newell S, Girgis A, McElduff P, Sanson-Fisher R: Does routine assessment and real-time feedback improve cancer patients' psychosocial well-being?. Eur J Cancer Care (Engl). 2006, 15: 163-171. 10.1111/j.1365-2354.2005.00633.x.
Velikova G, Booth L, Smith AB, Brown PM, Lynch P, Brown JM, Selby PJ: Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. J Clin Oncol. 2004, 22: 714-724. 10.1200/JCO.2004.06.078.
Berry DL, Blumenstein BA, Halpenny B, Wolpin S, Fann JR, Austin-Seymour M, Bush N, Karras BT, Lober WB, McCorkle R: Enhancing patient-provider communication with the electronic self-report assessment for cancer: a randomized trial. J Clin Oncol. 2011, 29: 1029-1035. 10.1200/JCO.2010.30.3909.
Berry DL, Hong F, Halpenny B, Partridge AH, Fann JR, Wolpin S, Lober WB, Bush NE, Parvathaneni U, Back AL, Amtmann D, Ford R: Electronic Self-Report Assessment for Cancer and Self-Care Support: Results of a Multicenter Randomized Trial. J Clin Oncol. 2014, 32: 199-205. 10.1200/JCO.2013.48.6662.
Mitchell PH, Ferketich S, Jennings BM: Quality health outcomes model. American Academy of Nursing Expert Panel on Quality Health Care. Image J Nurs Sch. 1998, 30: 43-46. 10.1111/j.1547-5069.1998.tb01234.x.
McCorkle R, Young K: Development of a symptom distress scale. Cancer Nurs. 1978, 1: 373-378.
McCorkle R, Cooley M, Shea J: A User's Manual for the Symptom Distress Scale. 2000, Unpublished manual: Yale University, Accessed 10 Jul 2014 from: http://fhsson.mcmaster.ca/apn/images/stories/pdfs/Symptom_Distress_Scale_user_manual.pdf.
MacKinnon DP, Fairchild AJ, Fritz MS: Mediation analysis. Annu Rev Psychol. 2007, 58: 593-614. 10.1146/annurev.psych.58.110405.085542.
Cleeland CS, Zhao F, Chang VT, Sloan JA, O'Mara AM, Gilman PB, Weiss M, Mendoza TR, Lee JW, Fisch MJ: The symptom burden of cancer: Evidence for a core set of cancer-related and treatment-related symptoms from the Eastern Cooperative Oncology Group Symptom Outcomes and Practice Patterns study. Cancer. 2013, 119: 4333-4340. 10.1002/cncr.28376.
Takeuchi EE, Keding A, Awad N, Hofmann U, Campbell LJ, Selby PJ, Brown JM, Velikova G: Impact of patient-reported outcomes in oncology: a longitudinal analysis of patient-physician communication. J Clin Oncol. 2011, 29: 2910-2917. 10.1200/JCO.2010.32.2453.
Wilkie D, Berry D, Cain K, Huang HY, Mekwa J, Lewis F, Gallucci B, Lin YC, Chen AC, Ko NY: Effects of coaching patients with lung cancer to report cancer pain. West J Nurs Res. 2010, 32: 23-46. 10.1177/0193945909348009.
Street RL, Slee C, Kalauokalani DK, Dean DE, Tancredi DJ, Kravitz RL: Improving physician-patient communication about cancer pain with a tailored education-coaching intervention. Patient Educ Couns. 2010, 80: 42-47. 10.1016/j.pec.2009.10.009.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2407/14/513/prepub
All authors were funded by a grant from the National Institute of Nursing Research (NINR); 2R01 NR008726, National Institutes of Health for contributions to the study. No author was paid specifically for manuscript preparation. The NINR did not make any publication decisions. The authors are grateful to the patients, family members, and clinicians who gave time and effort to participate in this trial. The work of many talented research staff and students in collecting and coding data is greatly appreciated.
The authors declare that they have no competing interests.
DLB conceived of the study, participated in its design and coordination, and drafted the manuscript. FH performed the statistical analysis and drafted the analytic methods and results. BH participated in study design and directed data collection for the parent study, and EF led the audio coding team. SW and RF facilitated study implementation in Seattle. All other authors participated in study design. All authors read and approved the final manuscript.
About this article
Cite this article
Berry, D.L., Hong, F., Halpenny, B. et al. The electronic self report assessment and intervention for cancer: promoting patient verbal reporting of symptom and quality of life issues in a randomized controlled trial. BMC Cancer 14, 513 (2014). https://doi.org/10.1186/1471-2407-14-513