The impact of audit and feedback on nodal harvest in colorectal cancer
BMC Cancer volume 11, Article number: 2 (2011)
Adequate nodal harvest (≥ 12 lymph nodes) in colorectal cancer has been shown to optimize staging and proposed as a quality indicator of colorectal cancer care. An audit within a single health district in Nova Scotia, Canada presented and published in 2002, revealed that adequate nodal harvest occurred in only 22% of patients. The goal of this current study was to identify factors associated with adequate nodal harvest, and specifically to examine the impact of the audit and feedback strategy on nodal harvest.
This population-based study included all patients undergoing resection for primary colorectal cancer in Nova Scotia, Canada, from 01 January 2001 to 31 December 2005. Linkage of the provincial cancer registry with other databases (hospital discharge, physician claims data, and national census data) provided clinicodemographic, diagnostic, and treatment-event data. Factors associated with adequate nodal harvest were examined using multivariate logistic regression. The specific interaction between year and health district was examined to identify any potential effect of dissemination of the previously-performed audit.
Among the 2,322 patients, the median nodal harvest was 8; overall, 719 (31%) had an adequate nodal harvest. On multivariate analysis, audited health district (p < 0.0001), year (p < 0.0001), younger age (p < 0.0001), non-emergent surgery (p < 0.0001), more advanced stage (p = 0.008), and previous cancer history (p = 0.03) were associated with an increased likelihood of an adequate nodal harvest. Interaction between year and audited health district was identified (p = 0.006) such that the increase in adequate nodal harvest over time was significantly greater in the audited health district.
Improvements in colorectal cancer nodal harvest did occur over time. A published audit demonstrating suboptimal nodal harvest appeared to be an effective knowledge translation tool, though more so for the audited health district, suggesting a potentially beneficial effect of audit and feedback strategies.
In Canada, it is estimated there will be 22,500 new cases of colorectal cancer in 2010. More than 9,100 will die of the disease, making it the second most common cancer-causing death . Survival is clearly related to stage of disease at diagnosis; the status of lymph nodes is a critical discriminator of stage, particularly in discriminating patients with stage II and stage III disease . The use of adjuvant therapies has been clearly shown to improve survival for stage III patients, but less conclusively for stage II patients. Thus, nodal status often plays an important role in determining the need for, and the potential benefit from, such adjuvant therapy [3–6].
Many studies over the past 15 years have demonstrated the importance of an adequate nodal harvest in colorectal cancer, and specifically that node positivity rates increase with increased nodal harvest [7–12]. Moreover, improved survival among patients with greater nodal harvests has also been reproducibly demonstrated [13–18]. Although there exists some variability in the number of lymph nodes suggested for accurate staging , several organizations have advocated that a minimum of 12 lymph nodes are required. A minimum of 12 lymph nodes has been approved by the National Quality Forum as a quality indicator for colorectal cancer care, and has subsequently become a focus for quality and pay for performance initiatives .
Like others, we demonstrated suboptimal nodal harvest in colorectal cancer specimens approximately a decade ago . This work, published in 2002, demonstrated that nodal harvest was adequate (≥ 12 lymph nodes) in only 22% of patients in a single health district. The findings were presented in multiple forums within the specific institution's health district as part of an audit and feedback strategy, over 2001-2003.
The goal of our current study was to identify factors associated with adequate nodal harvest in the entire province of Nova Scotia, and to specifically examine the impact of our prior audit and feedback strategy on subsequent nodal harvest.
This population-based study included all patients over the age of 20 diagnosed with colorectal cancer in the province of Nova Scotia from January 1st 2001 to December 31st 2005, and who underwent resection. The assembly of this cohort was performed based on a linkage of the provincial cancer registry with other administrative databases including hospital discharge data, physician claims data, and national census data, which is described in detail elsewhere . This linked dataset provided clinicodemographic, diagnostic and treatment data on all patients with a diagnosis of colorectal cancer in the province.
From this dataset, we included all patients undergoing surgical resection based on procedure codes (Table 1). We excluded stage IV patients (N = 394), patients in whom no lymph nodes were identified in the specimen (N = 75), and patients with rectal cancer receiving preoperative long-course radiotherapy with or without chemotherapy (N = 80) due to its known negative effect on nodal harvest . The remaining study cohort was comprised of 2,322 patients. Collaborative staging was applied to all patients within the cohort  and was the source of nodal harvest information.
In 2002, we published a retrospective chart review study examining nodal harvest from colorectal cancer resections within a single Nova Scotia health district over a four-year period (1998-2001). This work was disseminated via presentations in forums in the health district where the study was performed, which was also the only academic health center in the province. These forums included Pathology Grand Rounds, Multidisciplinary Gastroenterology Rounds, Cancer Centre Clinical Site Team Tumor Board meeting, and Department of Surgery Research Day. All such forums were within the health district where the study was performed. All surgeons and pathologists involved in colorectal cancer care in the health district were exposed to at least one presentation. These presentations were focused on the results of the study, and did not advocate for any specific advance pathologic technique of increasing lymph node harvest such as fat-clearing xylose. No other provincial dissemination activities were undertaken. The study was also presented as an oral presentation at the Society of Surgery for the Alimentary Tract in June 2002 and was published in the Journal of Gastrointestinal Surgery in November 2002 . No other specific intervention was undertaken to improve nodal harvest within the province of Nova Scotia over the time period of the current study (2001-2005).
For the current study, we defined an adequate nodal harvest as at least 12 lymph nodes identified within the specimen. Health care in the province of Nova Scotia is delivered within nine health districts, all of which have at least one institution providing surgical treatment for colorectal cancer. The rate of adequate nodal harvest according to health district was examined over time. We used multivariate logistic regression to identify factors independently associated with nodal harvest. A priori we planned to examine the interaction between health district and year on adequate nodal harvest rates in the province; this analysis was designed to identify any significant disproportionate improvement in nodal harvest over time in a specific health district. Statistical significance was set at p < 0.05 and all analyses were performed using SAS (Durham, North Carolina).
This study received full approval by Capital District Health Authority Research Ethic Board (#CDHA-RS/2008-049), and all required procedures related to patient confidentiality and privacy were maintained. Given the retrospective administrative database methodology, no patient-level informed consent was required.
Descriptive characteristics of the study cohort (N = 2,322) are found in Table 2. Of the study patients, 35.2%s resided in the health district in which the audit and feedback was provided, while 64.8% resided in one of the other eight health districts. Overall, the median nodal harvest amongst all patients was eight (mean 9.9; interquartile range 4-13). Node positivity rates increased with nodal harvest, as shown in Table 3 (p < 0.0001).
For the entire study cohort, there was an increase in number of nodes harvested by year (Table 4). According to the a priori threshold of ≥ 12 lymph nodes, 719 (31%) of the 2,322 patients had an adequate nodal harvest. Figure 1 depicts the rate of adequate nodal harvest rates by year, stratified according to audit and feedback vs. non-audit and feedback health district. There was an increase in the rate of adequate nodal harvest on univariate analysis over time among both audit and feedback (p < 0.0001) and non-audit and feedback (p < 0.0001) health district. This rate increased from 15.3% in 2001 to 30.0% in 2005 in the non-audit and feedback health district, whereas within the audited health district, the adequate nodal harvest rate rose from 29.4% to 62.3% for the same time period.
Table 5 summarizes the univariate and multivariate analyses of factors associated with an adequate nodal harvest. Younger age, non-emergent surgery, more advanced stage, absence of a previous cancer history, and more recent year were all associated with an increased likelihood of adequate nodal harvest. Controlling for these factors, patients who underwent surgery within the audit and feedback health district were 3.23 times more likely to have an adequate nodal harvest than patients who underwent resection in one of the non-audit and feedback health district. Of note, we were unable to assess hospital volume or type (academic vs. community) in this multivariate analysis due to significant collinearity with the audit and feedback health district variable (variance inflation factor > 10) .
When we examined the impact of health district over time on the adequacy of nodal harvest, there was a significant interaction. The improvement in nodal harvest over time was significantly greater (p = 0.007) within the audit and feedback health district than the improvement in the non-audit and feedback health district (i.e. although a significant improvement was identified in all health districts, this improvement was significantly greater in the audit a feedback health district).
Although several studies have shown improvement of colorectal cancer nodal harvest, there exists no consensus on mechanism(s) responsible for such improvement [25, 26]. To our knowledge, this study is the first to specifically suggest a positive association between audit and feedback on adequacy of nodal harvest in colorectal cancer.
The use of audit and feedback to improve clinical practice has been studied across a range of health care settings, with systematic reviews demonstrating only modest improvements in practice [27, 28]. The effectiveness of audit and feedback may be greater, however, when baseline adherence to a recommended practice is low . In colorectal cancer, prior research has demonstrated suboptimal nodal harvest [12, 29–31], with Wright and colleagues  demonstrating knowledge 'gaps' between current and best practices. However, traditional continuing medical education (CME) has been shown inadequate at bridging the gap between current practice and best available evidence .
In Ontario, Canada, a multi-faceted CME strategy, which included didactic teaching, a gastrointestinal tumour site retreat, informal opinion leadership, performance feedback, and development of a synoptic pathology report, was associated with improved colon cancer staging and nodal harvest at one tertiary cancer centre . Although this overall strategy was effective, its multimodal nature makes it difficult to determine which change techniques were of most benefit. A subsequent Ontario-wide randomized controlled trial demonstrated that a standardized lecture given by formal opinion leaders improved nodal harvest in colon cancer, but academic detailing and provision of a toolkit yielded no further improvements .
The majority of the factors we identified to be associated with nodal harvest were consistent with previous literature. Specifically, an adequate nodal harvest is more common in right colon lesions, non-emergent surgery, and higher stage lesions [30, 35, 36]. We identified a modest association between previous cancer history and lower rate of adequate nodal harvest, a finding not reported previously. Although we have no definitive explanation for this finding, we hypothesize that, at least in part, it may be related to previous abdominal surgery in these patients and subsequent associated challenges in extensive mesenteric resection.
Previous studies have suggested that hospital characteristics such as volume, academic status, or presence of multidiciplinary teams may impact on quality of care in colorectal cancer. We are limited in our ability to fully evaluate these factors in our study given that the audit and feedback health district was also the highest volume centre, the only academic center, and coordinated multidisciplinary case conferences in the province.
A major strength of our study is the assessment of lymph node harvest and associated changes over time for a 5-year population-based, fully staged cohort of colorectal cancer patients. However, there are some limitations. Firstly, the methodology of this work involves the use of linked administrative data, thus limiting the ability to identify the actual clinical factors contributing to nodal harvest. The extent and technique of surgical resection and the specific nodal identification technique used by a pathologist are examples of such potential contributory factors that we are unable to examine with our data sources [37–39]. Specifically, although the audit and feedback strategy did not advocate for any specific advanced techniques of pathologic assessment (e.g. fat-clearing xylose), we are unable to determine if this occurred. Secondly, although we have clearly demonstrated an increase in nodal harvest in the audit and feedback health district, more marked over time, true causation cannot be proven in such a study design. Our data limits us in truly delineating the technical changes made (including whether the improvements were based on surgical or pathological technique, or both) that improved nodal harvest disproportionately in the audit and feedback health district. Finally, the acceptance of nodal harvest as a quality indicator of CRC care implies an association with patient outcome. Neither survival nor recurrence was not evaluated in this study for data availability reasons, but clearly is of utmost importance and is required in future studies.
In conclusion, this study demonstrated that there were clear improvements in CRC nodal harvest that occurred over the time period of the study. Dissemination of a published audit demonstrating suboptimal nodal harvest appeared to be an effective tool. This suggests a potential beneficial effect of audit and feedback strategies to improve colorectal cancer care.
Canadian Cancer Society: Canadian Cancer Statistics 2010. 2010, Canadian Cancer Society/National Cancer Institute of Canada. Toronto, Ontario
American Joint Committee on Cancer: Cancer Staging Handbook. 2010, New York, Springer, 7
Chau I, Cunningham D: Adjuvant therapy in colon cancer--what, when and how?. Ann Oncol. 2006, 17: 1347-1359. 10.1093/annonc/mdl029.
Benson AB, Schrag D, Somerfield MR, Cohen AM, Figueredo AT, Flynn PJ, Krzyzanowska MK, Maroun J, McAllister P, Van Cutsem E, Brouwers M, Charette M, Haller DG: American Society of Clinical Oncology recommendations on adjuvant chemotherapy for stage II colon cancer. J Clin Oncol. 2004, 22: 3408-3419. 10.1200/JCO.2004.05.063.
Compton CC, Fielding LP, Burgart LJ, Conley B, Cooper HS, Hamilton SR, Hammond ME, Henson DE, Hutter RV, Nagle RB, Nielsen ML, Sargent DJ, Taylor CR, Welton M, Willett C: Prognostic factors in colorectal cancer College of American Pathologists Consensus Statement 1999. Arch Pathol Lab Med. 2000, 124: 979-994.
Engstrom PF, Benson AB, Saltz L, National Comprehensive Cancer Network: Colon cancer. Clinical practice guidelines in oncology. J Natl Compr Canc Netw. 2003, 1: 40-53.
Goldstein NS: Lymph node recoveries from 2427 pT3 colorectal resection specimens spanning 45 years: recommendations for a minimum number of recovered lymph nodes based on predictive probabilities. Am J Surg Pathol. 2002, 26: 179-189. 10.1097/00000478-200202000-00004.
Pheby DF, Levine DF, Pitcher RW, Shepherd NA: Lymph node harvests directly influence the staging of colorectal cancer: evidence from a regional audit. J Clin Pathol. 2004, 57: 43-47. 10.1136/jcp.57.1.43.
Maurel J, Launoy G, Grosclaude P, Gignoux M, Arveux P, Mathieu-Daudé H, Raverdy N, Faivre J: Lymph node harvest reporting in patients with carcinoma of the large bowel: a French population-based study. Cancer. 1998, 82: 1482-1486. 10.1002/(SICI)1097-0142(19980415)82:8<1482::AID-CNCR8>3.0.CO;2-B.
Wong JH, Severino R, Honnebier MB, Tom P, Namiki TS: Number of nodes examined and staging accuracy in colorectal carcinoma. J Clin Oncol. 1999, 17: 2896-2900.
Ratto C, Sofo L, Ippoliti M, Merico M, Bossola M, Vecchio FM, Doglietto GB, Crucitti F: Accurate lymph-node detection in colorectal specimens resected for cancer is of prognostic significance. Dis Colon Rectum. 1999, 42: 143-154. 10.1007/BF02237119.
Johnson PM, Malatjalian D, Porter GA: Adequacy of nodal harvest in colorectal cancer: a consecutive cohort study. J Gastrointest Surg. 2002, 6: 883-888. 10.1016/S1091-255X(02)00131-2.
Chang GJ, Rodriguez-Bigas MA, Skibber JM, Moyer VA: Lymph node evaluation and survival after curative resection of colon cancer: systematic review. J Natl Cancer Inst. 2007, 99: 433-441. 10.1093/jnci/djk092.
Le Voyer TE, Sigurdson ER, Hanlon AL, Mayer RJ, Macdonald JS, Catalano PJ, Haller DG: Colon cancer survival is associated with increasing number of lymph nodes analyzed: a secondary survey of Intergroup trial INT-0089. J Clin Oncol. 2003, 21: 2912-2919. 10.1200/JCO.2003.05.062.
Johnson PM, Porter GA, Ricciardi R, Baxter NN: Increasing negative lymph node count is independently associated with improved long-term survival in stage IIIB and IIIC colon cancer. J Clin Oncol. 1996, 24: 3570-3575. 10.1200/JCO.2006.06.8866.
Swanson RS, Compton CC, Stewart AK, Bland KI: The prognosis of T3N0 colon cancer is dependent on the number of lymph nodes examined. Ann Surg Oncol. 2003, 10: 65-71. 10.1245/ASO.2003.03.058.
Chen SL, Bilchik AJ: More extensive nodal dissection improves survival for stages I to III of colon cancer: a population-based study. Ann Surg. 2006, 244: 602-610.
Jestin P, Pahlman L, Glimelius B, Gunnarsson U: Cancer staging and survival in colon cancer is dependent on the quality of the pathologists' specimen examination. Eur J Cancer. 2005, 41: 2071-2078. 10.1016/j.ejca.2005.06.012.
Baxter NN, Ricciardi R, Simunovic M, Urbach DR, Virnig BA: An evaluation of the relationship between lymph node number and staging in pT3 colon cancer using population-based data. Dis Colon Rectum. 2010, 53: 65-70.
National Quality Forum Endorsed Standards. [accessed May 20, 2010], [http://www.qualityforum.org/Measures_List.aspx?keyword=colon&from=header#k=colon]
Urquhart R, Bu J, Maddison A, Asada Y, Grunfeld E, for the CIHR/CCNS Team in Access to Colorectal Cancer Services in Nova Scotia: Building tools to measure and improve access to and quality of colorectal cancer care in Nova Scotia. Canadian Digestive Disease Week. 2010
Morcos B, Baker B, Al Masri M, Haddad H, Hashem S: Lymph node yield in rectal cancer surgery: effect of preoperative chemoradiotherapy. Eur J Surg Oncol. 2010, 345-349. 36
Collaborative Stage Data Collection System. [accessed August 30, 2009], [http://www.cancerstaging.org/cstage/schema/groups.html]
Allison Paul D: Logistic Regression Using SAS®: Theory and Application. 1999, Cary, NC: SAS Institute Inc
Smith AJ, Law CH, Khalifa MA, Hsieh ET, Hanna SS, Wright FC, Poldre PA: Multimodal CME for surgeons and pathologists improves colon cancer staging. J Cancer Educ. 2003, 18: 81-86. 10.1207/S15430154JCE1802_09.
Wright FC, Gagliardi AR, Law CH, Last LD, Klevan AE, Hongjinda S, Stitt LW, Klar N, Ryan DP, Smith AJ: A randomized controlled trial to improve lymph node assessment in stage II colon cancer. Arch Surg. 2008, 143: 1050-1055. 10.1001/archsurg.143.11.1050.
Grimshaw J, Eccles M, Thomas R, MacLennan G, Ramsay C, Fraser C, Vale L: Toward evidence-based quality improvement. Evidence of the effectiveness of guideline dissemination and implementation strategies 1966-1998. J Gen Intern Med. 2006, 21: S14-S20.
Jamtvedt G, Young JM, Kristoffersen DT, O'Brien MA, Oxman AD: Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2006, 2: CD000259-
Wright FC, Law CH, Last L, Khalifa M, Arnaout A, Naseer Z, Klar N, Gallinger S, Smith AJ: Lymph node retrieval and assessment in stage II colorectal cancer: a population-based study. Ann Surg Oncol. 2003, 10: 903-909. 10.1245/ASO.2003.01.012.
Prandi M, Lionetto R, Bini A, Francioni G, Accarpio G, Anfossi A, Ballario E, Becchi G, Bonilauri S, Carobbi A, Cavaliere P, Garcea D, Giuliani L, Morziani E, Mosca F, Mussa A, Pasqualini M, Poddie D, Tonetti F, Zardo L, Rosso R: Prognostic evaluation of stage B colon cancer patients is improved by an adequate lymphadenectomy. Ann Surg. 2002, 235: 458-463. 10.1097/00000658-200204000-00002.
Pocard M, Panis Y, Malassagne B, Nemeth J, Hautefeuille P, Valleur P: Assessing the effectiveness of mesorectal excision in rectal cancer. Dis Colon Rectum. 1998, 41: 839-845. 10.1007/BF02235362.
Wright FC, Law CH, Last LD, Ritacco R, Kumar D, Hsieh E, Khalifa M, Smith AJ: Barriers to optimal assessment of lymph nodes in colorectal cancer specimens. Am J Clin Pathol. 2004, 121: 663-670. 10.1309/17VKM33BFXF9T8WD.
Davis D, O'Brien MA, Freemantle N, Wolf FM, Mazmanian P, Taylor-Vaisey A: Impact of formal continuing medical education: do conferences, workshops, rounds, and other traditional continuing education activities change physician behavior or health care outcomes?. JAMA. 1999, 282: 867-874. 10.1001/jama.282.9.867.
Smith AJ, Law CH, Khalifa MA, Hsieh ET, Hanna SS, Wright FC, Poldre PA: Multimodal CME for surgeons and pathologists improves colon cancer staging. J Cancer Educ. 2003, 18: 81-86. 10.1207/S15430154JCE1802_09.
Hernanz F, Revuelta S, Redondo C, Madrazo C, Castillo J, Gomez-Fleitas M: Colorectal adenocarcinoma: quality of the assessment of lymph node metastases. Dis Colon Rectum. 1994, 37: 373-377. 10.1007/BF02053600.
Canessa CE, Badia F, Socorro F, Fiol V, Hayek : Anatomic study of the lymph nodes of the mesorectum. Dis Colon Rectum. 2001, 44: 1333-1336. 10.1007/BF02234794.
Scott KW, Grace RH: Detection of lymph node metastases in colorectal carcinoma before and after fat clearance. Br J Surg. 1989, 76: 1165-1167. 10.1002/bjs.1800761118.
Cohen SM, Wexner SD, Schmitt SL, Nogueras JJ, Lucas FV: Effect of xylene clearance of mesenteric fat on harvest of lymph nodes after colonic resection. Eur J Surg. 1994, 160: 693-697.
Iversen LH, Laurberg S, Hagemann-Madsen R, Dybdahl H: Increased lymph node harvest from colorectal cancer resections using GEWF solution: a randomised study. J Clin Pathol. 2008, 61: 1203-1208. 10.1136/jcp.2008.060210.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2407/11/2/prepub
The data used in this study was compiled as part of the Canadian Institutes of Health Research (CIHR) program "Access to Quality Cancer Care: New Emerging Team (NET) CIHR/CCNS Team in Access to Colorectal Cancer Services in Nova Scotia".
Dr. Porter receives support through the Gibran and Jamile Ramia Chair in Surgical Oncology research (QEII Health Sciences Centre/Dalhousie University). We also wish to thank Margaret Jorgensen for her administrative assistance with this study and manuscript.
The authors declare that they have no competing interests.
GP, RU. PJ. EG participated in the design of the study. RU, JB assisted with the acquisition of data. GP, RU, JB, PJ, EG participated in the analysis and interpretation of data. GP, JB, RU helped to draft the manuscript. GP, RU, JB, PJ, EG participated in the critical revision of the manuscript. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Porter, G.A., Urquhart, R., Bu, J. et al. The impact of audit and feedback on nodal harvest in colorectal cancer. BMC Cancer 11, 2 (2011). https://doi.org/10.1186/1471-2407-11-2
- Nova Scotia
- Health District
- Continue Medical Education
- Nodal Harvest
- Feedback Strategy