- Research article
- Open Access
Nomogram for individually predicting overall survival in rectal neuroendocrine tumours
BMC Cancer volume 20, Article number: 865 (2020)
This study aimed to develop a nomogram that predicts the overall survival (OS) of rectal neuroendocrine tumours (NETs).
We retrospectively analysed 310 patients with rectal neuroendocrine tumours in 5 hospitals in southern China. All of the patients were assigned to the training set. A multivariable analysis using Cox proportional hazards regression was performed using the training set, and a nomogram was constructed. It was validated on a dataset obtained from the Surveillance, Epidemiology, and End Result (SEER) database of America (n = 547).
In the training set, the nomogram exhibited improved discrimination power compared with the WHO grade guidelines (Herrell’s C-index, 0.872 vs 0.794; p < 0.001) and was also better than the seventh AJCC TNM classification (Herrell’s C-index, 0.872 vs 0.817; p < 0.001). In the SEER validation dataset, the discrimination was also excellent (C-index, 0.648 vs 0.583, p < 0.001 and 0.648 vs 0.603, p = 0.016, respectively, compared with G grade and TNM classification). Calibration of the nomogram predicted individual survival corresponding closely with the actual survival.
We developed a nomogram predicting 1- and 3-year OS of patients with rectal neuroendocrine tumours. Validation revealed excellent discrimination and calibration, suggesting good clinical utility.
Neuroendocrine tumours (NETs) represent a relatively rare neoplastic tumor which are originating from neuroendocrine cells and peptidergic neurons. In recent years, the incidence of NETs has been increasing [1, 2]. The incidence of rectal neuroendocrine tumours is the highest within the gastrointestinal tract  and has significantly increased . However, outcomes of patients with rectal NETs remain uncertain.
Currently, the most commonly used predictive systems for NETs are the AJCC and the European Neuroendocrine Tumour Society (ENETS) TNM staging systems or the WHO grade guidelines, which are based on the mitotic count and Ki67 proliferative index. These systems lack other clinicopathological features that can influence outcomes such as age, sex, and tumour size. Thus, our objective is to create a system that takes clinicopathological features into consideration, hoping it will provide a more accurate prognosis and have utility in clinical practice and medical decision making.
A nomogram is a pictorial representation of a complex mathematical formula . Medical nomograms are good methods for predicting outcomes among patients with cancer . Many take clinical variables such as tumour grade, tumour size, and patient age and build prognostic models that predict the risk of cancer recurrence or mortality for individuals. A nomogram is a graphical calculation instrument based on any type of function including logistic regression and Cox PHs regression models. When we build a nomogram, each variable is listed separately with a corresponding number of points assigned to a particular magnitude of the variable, and the cumulative point score for all of the variables is matched to a scale of outcomes.
In the past few years, Nomogram have been a well-established method for predicting prognostic factors of tumors [6,7,8,9,10]. To date, however, none have researched rectal NETs. With this study, we have designed a nomogram that focuses on rectal NETs. It was developed using the data from a relatively large cohort of patients who were treated in five hospitals in southern China. This nomogram can predict individual 1- and 3-year overall survival rates. It was validated with a dataset from SEER.
Materials and methods
We retrospectively analysed the data of 442 patients with rectal NETs who were treated in 5 hospitals in southern China. However, 102 patients were lost to follow up before 3 years, and 30 patients had missing values; therefore, these 132 patients were excluded. Thus, a total of 310 patients were included in this study from Sun Yat-sen University Cancer Center (SYSUCC, n = 143), the First Affiliated Hospital of Sun Yat-Sen University (SYSUFH, n = 56), Guangdong General Hospital (GGH, n = 54), Nanfang Hospital of Southern Medical University (SMUNH, n = 44), and Sun Yet-san Memorial Hospital of Sun Yat-sen University (SYSUMH, n = 13) from November 1993 to December 2013.
The variables evaluated were age, sex, tumour sizes, surgery procedure, G grade, the depth of tumour invasion (T), the number of metastatic lymph nodes (N), distant metastases (M), and TNM stage. All patients were followed for at least 3 years. An endoscopy with rectal magnetic resonance imaging (MRI) or endoscopic ultrasonography (EUS) at 6 and 12 months were required during the first year of follow-up. After that, the patients were followed every 6 to 12 months. Abdominal and pelvic multiphasic computed tomography (CT) or MRI were required. Measurement of the biochemical marker chromogranin A was considered if the patients had clinical symptoms.
All 310 patients were assigned to the training set. A multivariable analysis using Cox PHs regression was performed using the training set, and the nomogram was constructed.
For the validation dataset, we collected data from the SEER database. We included data from 547 patients treated from 2005 to 2013 who were diagnosed with rectal NETs and had follow-up for at least 3 years.
Construction of the nomogram
We use the dataset from the 5 hospitals in China as the training set. Continuous variables such as tumour size were fitted to a smoothed restricted cubic splines .
The classification of categorical variables was determined by their clinical significance, and they had been divided before the construction of the nomogram. A univariate and multivariable Cox proportional hazards models were made to select the characteristics related to the survival time. By identifying characteristics predictive for overall survival in the multivariate Cox model, a nomogram was constructed to predict 1- and 3-year OS rates.
Validation of the nomogram
Nomogram validation included two components by using the SEER external validation set. First, Discrimination was evaluated using a concordance index (C-index), which estimates the probability of concordance between predicted and observed responses. Harrell’s C-index, which is appropriate for censored data, was used to evaluate the discrimination . The 95% confidence interval for Harrell’s C index can be obtained by adding and subtracting 1.96 × Se (Standard error) from the C index. The second component was calibration which was.
performed by grouping all patients according to the predicted quartile nomogram and then comparing the mean value of the group with the corresponding actual survival OS (calculated by kaplan-Meier method). All analyses were performed using SPSS version 20 (IBM, Armonk, NY, USA) and R version 2.13.2 (http://www.r-project.org) via the design and survival packages. A P-value of < 0.05 was considered significant.
Clinicopathologic characteristics of the patients
A total of 310 patients in China and 547 patients from the SEER databases with rectal NETs were included in this study. All patients were followed for at least 3 years. The longest follow-up time was 224 months. The median survival time was 44 months. A total of 35 and 146 patients died in the training and validation datasets, respectively. The clinicopathologic characteristics of the patients in the training dataset and validation dataset are listed in Table 1.
Independent prognostic factors in the training dataset
The univariate analysis demonstrated that age, sex, surgical treatment, grade, tumour size, T staging, N staging, M staging and TNM stage were statistically significant (Table 2). When we put these variables into the Cox PHs regression model, we found that age, sex, tumour size and TNM stage were independently correlated with prognosis. Table 3 shows the results of the variable selection with hazard ratios and P-values.
Prognostic nomogram for OS
A nomogram was constructed based on the results of the Cox proportional hazards regression predicting 1- and 3-year overall survival (Fig. 1). Each point can be determined by drawing a line straight upward from each variable to the point axis. The total points are then calculated by summing each point to indicate the probability of 1- and 3-year survival.
Comparison of predictive accuracy for OS between the nomogram and the TNM staging system or G grade system
The concordance index of the nomogram was 0.872 (95% CI, 0.806–0.938) for predicting the OS of the rectal NETS, which was superior to both predictions based on the seventh AJCC TNM classification and WHO grade guidelines, with concordance indices of 0.794 (95% CI, 0.721–0.866; p < 0.001) and 0.817 (95% CI, 0.752–0.881; p < 0.001), respectively. In the SEER validation sets, discrimination was also excellent. The C-index was 0.648 (95% CI, 0.611–0.684), which was superior to both predictions based on the seventh AJCC TNM classification and WHO grade guidelines, with concordance indices of 0.603 (95% CI, 0.571–0.635; p = 0.016) and 0.583 (95% CI, 0.547–0.619; p < 0.001), respectively.
Comparison of the accuracy between the prediction by the nomogram and the actual observation for OS
Figure 2 is a calibration diagram of nomogram. The x-axis represents the predicted survival rate calculated by nomogram, and the y-axis represents the actual survival rate estimated by Kaplan Meier. The graph shows that the actual survival rate is closely related to the predicted survival rate and is always within the error range of 10%.
Neuroendocrine tumour (NETs) is a relatively rare tumour, and the incidence of neuroendocrine tumours in the United States was 5.25/100000  in 2004. According to the SEER database, the incidence of gastrointestinal NETs has been increasing in recent years . The incidence of rectal NETS rates is the highest in the gastrointestinal tract, accounting for approximately 29%  of gastrointestinal NETs. However, most NETs seem to be sporadic, and risk factors for sporadic NETs are poorly understood.
There are few studies that focus on rectal NETs and these studies all contain limited patient cohorts [14,15,16]. Our study included 310 patients with rectal NETs and is the largest Chinese cohort so far.
With the application and popularization of endoscopic techniques, rectal neuroendocrine tumours are diagnosed earlier currently, and most of them are treated with endoscopic surgery. Of course, if the tumour size is large or there are metastatic lymph nodes, more extensive surgery is indicated. We can see that the tumour size or lymph node involvement will influence the surgical procedure and influence patient outcomes. However, there are several other clinicopathological features that can influence patients’ outcomes. According to published data and our analysis, grade, the depth of tumour invasion (T), the number of metastatic lymph nodes (N), distant metastases (M) and age at diagnosis are factors that influence outcomes. Chi et al.  found that tumour grade was an independent prognostic factor, while Weinstock et al.  found that tumour stage was an independent prognostic factor, and Chagpar et al.  found that the depth of tumour invasion, tumour size, lymph node metastasis and distant metastasis were independent prognostic factors.
When we discuss prognosis, all of the elements above should be taken into consideration. However, the most common predictive systems, namely, the TNM classification and grade, only focus on a portion of these variables and sometimes these two classifications conflict. For example, if a patient has a grade 1 tumour with liver metastasis, according to the grade predictive system, this patient is low-grade and has a good prognosis. In contrast, when we put this patient into the TNM system, it is a late-stage tumour and the patient has a poor prognosis. Clearly, these two systems are limited in predicting patient outcomes.
However, nomograms can take these variables into account in a Cox PHs regression. However, only a few nomogram studies have focused on NETs. Modlin et al.  focused on small-intestinal neuroendocrine tumours and Ye L et al.  built a nomogram to predict outcomes for pancreatic neuroendocrine tumours. However, these studies have relatively small samples and do not include rectal NETs. This study presents the first nomogram for predicting the survival of patients with rectal NETs.
This nomogram includes both grade and TNM stage, thereby addressing some of the limitations of the other predictive models. As expected, the predictive accuracy of the nomogram was superior to both the predictions of the TNM classification and the WHO grade guidelines, with concordance indices of 0.872 compared with 0.794 and 0.817, p < 0.001, respectively.
As for age and tumour size, we found that they were both important elements that influence prognosis. Zhang X et al.  reported that young age was a favourable prognostic factor, while Li P et al.  reported that lymph node metastasis was related to the tumour diameter and furthermore influenced the prognosis of rectal NETs. In our study, we found that patients likely had a decreased rate of survival with increasing tumour size.
It seems that Ki-67 or mitotic rate per 10 high-power fields could be better variables because they are continuous variables that have a wider range of values and can be more individual compared with the categorical variables. However, we combined these two variables as grade in order to simplify this model and to make sure this nomogram can be used easily.
This study has some limitations. One is that we did not include functional status or treatment as variables. According to the NCCN guidelines, patients with metastatic neuroendocrine tumours and carcinoid syndrome should be treated with somatostatin analogues . However, even though our 5 hospitals are the largest medical centres in southern China, medical resources are limited. Some patients could not wait to receive continuous therapy and went to other hospitals for treatment. Others declined treatment secondary to cost or due to a lack of understanding. Given these limitations, we opted to not include these variables to not compromise the current form of the nomogram.
Another limitation was that most of the patients were diagnosed within the last 3 years as this disease has become more widely recognized. With the routine use of endoscopy, the incidence of rectal NETs has been increasing in recent years, but given the lack of patients with long-term follow-up, we could not include the 5-year overall survival rate. With time, we can collect more patients and variables and improve upon the nomogram.
We have developed an individualized nomogram for precisely predicting OS for patients with rectal NETs. Its advantages as a prognostic tool when compared to traditional TNM staging systems or WHO grade classifications should allow it to make a significant clinical impact in the near future.
Availability of data and materials
The datasets used and analysed during the current study available from the corresponding author on reasonable request. You can go through the listed link and email the corresponding author for a password and get the data. https://pan.baidu.com/s/1gYw6xmg1swLSHV-nJduU8Q.
Surveillance, Epidemiology, and End Result
Tumour Node Metastasis
American Joint Committee on Cancer
European Neuroendocrine Tumour Society
National Comprehensive Cancer Network
Yao JC, Hassan M, Phan A, et al. One hundred years after “carcinoid”: epidemiology of and prognostic factors for neuroendocrine tumors in 35,825 cases in the United States. J Clin Oncol. 2008;26(18):3063–72.
Modlin IM, Oberg K, Chung DC, et al. Gastroenteropancreatic neuroendocrine tumours. Lancet Oncol. 2008;9(1):61–72.
Lawrence B, Gustafsson BI, Chan A, Svejda B, Kidd M, Modlin IM. The epidemiology of gastroenteropancreatic neuroendocrine tumors. Endocrin Metab Clin. 2011;40(1):1–18, vii.
Grimes DA. The nomogram epidemic: resurgence of a medical relic. Ann Intern Med. 2008;149(4):273–5.
Shariat SF, Karakiewicz PI, Suardi N, Kattan MW. Comparison of nomograms with other methods for predicting outcomes in prostate cancer: a critical analysis of the literature. Clin Cancer Res. 2008;14(14):4400–7.
Wierda WG, O'brien S, Wang X, et al. Prognostic nomogram and index for overall survival in previously untreated patients with chronic lymphocytic leukemia. Blood. 2007;109(11):4679–85.
Han DS, Suh YS, Kong SH, et al. Nomogram predicting long-term survival after d2 gastrectomy for gastric cancer. J Clin Oncol. 2012;30(31):3834–40.
Wang SJ, Lemieux A, Kalpathy-Cramer J, et al. Nomogram for predicting the benefit of adjuvant chemoradiotherapy for resected gallbladder cancer. J Clin Oncol. 2011;29(35):4627–32.
Weiser MR, Landmann RG, Kattan MW, et al. Individualized prediction of colon cancer recurrence using a nomogram. J Clin Oncol. 2008;26(3):380–5.
Hirabayashi S, Kosugi S, Isobe Y, et al. Development and external validation of a nomogram for overall survival after curative resection in serosa-negative, locally advanced gastric cancer. Ann Oncol. 2014;25(6):1179–84.
Hess KR. Assessing time-by-covariate interactions in proportional hazards regression models using cubic spline functions. Stat Med. 1994;13(10):1045–62.
Harrell FE Jr, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361–87.
Tsikitis VL, Wertheim BC, Guerrero MA. Trends of incidence and survival of gastrointestinal neuroendocrine tumors in the United States: a seer analysis. J Cancer. 2012;3:292–302.
Weinstock B, Ward SC, Harpaz N, Warner RR, Itzkowitz S, Kim MK. Clinical and prognostic features of rectal neuroendocrine tumors. Neuroendocrinology. 2013;98(3):180–7.
Sung HY, Kim SW, Kang WK, et al. Long-term prognosis of an endoscopically treated rectal neuroendocrine tumor: 10-year experience in a single institution. Eur J Gastroenterol Hepatol. 2012;24(8):978–83.
De Mestier L, Brixi H, Gincul R, Ponchon T, Cadiot G. Updating the management of patients with rectal neuroendocrine tumors. Endoscopy. 2013;45(12):1039–46.
Chi Y, Du F, Zhao H, Wang JW, Cai JQ. Characteristics and long-term prognosis of patients with rectal neuroendocrine tumors. World J Gastroenterol. 2014;20(43):16252–7.
Chagpar R, Chiang YJ, Xing Y, et al. Neuroendocrine tumors of the colon and rectum: prognostic relevance and comparative performance of current staging systems. Ann Surg Oncol. 2013;20(4):1170–8.
Modlin IM, Gustafsson BI, Pavel M, Svejda B, Lawrence B, Kidd M. A nomogram to assess small-intestinal neuroendocrine tumor (‘carcinoid’) survival. Neuroendocrinology. 2010;92(3):143–57.
Ye L, Ye H, Zhou Q, et al. A retrospective cohort study of pancreatic neuroendocrine tumors at single institution over 15 years: new proposal for low- and high-grade groups, validation of a nomogram for prognosis, and novel follow-up strategy for liver metastases. Int J Surg. 2016;29:108–17.
Zhang X, Ma L, Bao H, Zhang J, Wang Z, Gong P. Clinical, pathological and prognostic characteristics of gastroenteropancreatic neuroendocrine neoplasms in China: a retrospective study. BMC Endocr Disord. 2014;14:54.
Li P, Wu F, Zhao H, et al. Analysis of the factors affecting lymph node metastasis and the prognosis of rectal neuroendocrine tumors. Int J Clin Exp Pathol. 2015;8(10):13331–8.
Oberg K. Consensus report on the use of somatostatin analogs for the management of neuroendocrine tumors of the gastroenteropancreatic system. Ann Oncol. 2004;15(6):966–73.
We would like to thank all of the participants that contributed to this work.
There was no funding to support this study.
Ethics approval and consent to participate
This study was approved by the Ethics Committee of Sun Yat-sen University Cancer Center, the First Affiliated Hospital of Sun Yat-Sen University, Guangdong General Hospital, Nanfang Hospital of Southern Medical University and Sun Yat-sen Memorial Hospital of Sun Yat-sen University, and written informed consent was obtained from all patients prior to surgery. All procedures performed in the studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Feng, X., Wei, G., Wang, W. et al. Nomogram for individually predicting overall survival in rectal neuroendocrine tumours. BMC Cancer 20, 865 (2020). https://doi.org/10.1186/s12885-020-07328-9
- Rectal neoplasms
- Neuroendocrine tumours
- Overall survival