Skip to main content
Download PDF

Using machine learning to develop preoperative model for lymph node metastasis in patients with bladder urothelial carcinoma

BMC Cancer volume 24, Article number: 725 (2024) Cite this article

Abstract

Background

Lymph node metastasis (LNM) is associated with worse prognosis in bladder urothelial carcinoma (BUC) patients. This study aimed to develop and validate machine learning (ML) models to preoperatively predict LNM in BUC patients treated with radical cystectomy (RC).

Methods

We retrospectively collected demographic, pathological, imaging, and laboratory information of BUC patients who underwent RC and bilateral lymphadenectomy in our institution. Patients were randomly categorized into training set and testing set. Five ML algorithms were utilized to establish prediction models. The performance of each model was assessed by the area under the receiver operating characteristic curve (AUC) and accuracy. Finally, we calculated the corresponding variable coefficients based on the optimal model to reveal the contribution of each variable to LNM.

Results

A total of 524 and 131 BUC patients were finally enrolled into training set and testing set, respectively. We identified that the support vector machine (SVM) model had the best prediction ability with an AUC of 0.934 (95% confidence interval [CI]: 0.903–0.964) and accuracy of 0.916 in the training set, and an AUC of 0.855 (95%CI: 0.777–0.933) and accuracy of 0.809 in the testing set. The SVM model contained 14 predictors, and positive lymph node in imaging contributed the most to the prediction of LNM in BUC patients.

Conclusions

We developed and validated the ML models to preoperatively predict LNM in BUC patients treated with RC, and identified that the SVM model with 14 variables had the best performance and high levels of clinical applicability.

Peer Review reports

Background

Bladder cancer (BC) is one of the most common urinary carcinomas, which was reported to be the tenth most common malignancy in both sexes and the sixth most common malignancy in men in 2020 worldwide [1]. As for patients with muscle-invasive bladder cancer (MIBC) and high-grade non-muscle‑invasive bladder cancer (NMIBC), treated with bladder-conserving therapies often result in early recurrence and progression. Therefore, radical cystectomy (RC) with pelvic lymph node dissection (PLND) is standardly recommended for these patients [2, 3].

Even if most patients treated with RC had negative surgical margins, approximately 50% patients had the possibility of recurrence, indicating the existence of extravesical tumor deposits at the time of surgery [4, 5]. Lymph node metastasis (LNM) is the most common site of BC metastases, which was reported to be ranging from 24 to 29% in patients receiving RC [4, 6]. It was reported that BC patients who had LNM had only 19% 5-year overall survival rate with RC treatment alone. Even if patients received RC combined with neoadjuvant or adjuvant chemotherapy, the 5-year overall survival rate was only around 30% [7]. Hence, preoperatively predicting LNM in patients with BC is necessary and beneficial.

Machine learning (ML) is one application field of artificial intelligence, which can automatically learn and improve the model performance without programming comparing with traditional methods [8]. Its algorithms can fit different configurations of data, assign weighting, and calculate the divinable power of each combination of variables in order to assess diagnostic and prognostic elements [9]. Several ML models which preoperatively predicted LNM in prostate cancer and renal cell carcinoma were established and validated, and some of which indicated the better performance compared with traditional logistic regression models [10, 11].

Over 90% of BC cases were pathologically diagnosed with bladder urothelial carcinoma (BUC). And previously we have established a traditional nomogram for predicting LNM in BUC, which was highly accurate, reliable, and clinically applicable in both internal validation and external validation [12]. However, there was no study aimed at preoperatively predicting LNM using ML in BC being reported. Therefore, we aimed to use ML algorithms to construct and validate a model for preoperatively predicting LNM in BUC using demographic information, imaging data, pathologic characteristics from transurethral resection of the bladder tumor (TURBT) specimens, and laboratory measurements.

Methods

Patient selection

This study was approved by the Medical Ethics Committee of the Affiliated Hospital of Qingdao University with the number of QYFYWZLL28026, and was carried out following the Declaration of Helsinki of the World Medical Association. We retrospectively collected the clinical data of patients who underwent RC and bilateral lymphadenectomy in the urology department of the Affiliated Hospital of Qingdao University between January 2013 and April 2022. We divided these patients into training set (80%) and testing set (20%) by stratified random sampling using the Stratified Shuffle-Split function in Python. LNM was defined as the confirmation of lymph node metastasis in the specimen from RC through pathology. Patients were excluded based on the following criteria: (a) age < 18 years; (b) without TURBT before RC or without muscle in TURBT; (c) patients with incomplete imaging examination data before RC; (d) tumor originated from sites other than the bladder; (e) patients with distant metastasis; (f) patients with incomplete laboratory measurements within a month before RC; (g) patients were diagnosed with non-urothelial carcinoma in pathology from RC; (h) patients receiving preoperative radiotherapy; (i) patients with severe or end-stage chronic kidney disease. This study complied with the principles of the Declaration of Helsinki and was conducted in accordance with the ethical standards of the medical ethics committee of our institution.

Data collection

The following preoperative data of included patients were recorded: age, sex, body mass index (BMI), tumor grade of TURBT, papillary tumor presence of TURBT, urothelial variants of TURBT, muscle invasion of TURBT, infiltration of TURBT, hydronephrosis on imaging, extravesical invasion on imaging, positive LN on imaging, tumor size on imaging, neutrophil count, monocyte count, basophil count, eosinophil count, lymphocyte count, erythrocyte count, platelet count, hemoglobin, fibrinogen, urea nitrogen, creatinine, and albumin. We used the respective cell counts to calculate neutrophil to lymphocyte ratio (NLR), platelet to lymphocyte ratio (PLR), monocyte to lymphocyte ratio (MLR), and neutrophil to platelet ratio (NPR). Besides, the systemic immune-inflammation index (SII) was defined as multiplying the platelet count by the neutrophil count and dividing this value by the lymphocyte count.

The pathological characteristics (including tumor grade, papillary tumor presence, differentiation, muscle invasion, and infiltration) of the highest tumor grade or cancer stage were recorded when they received several rounds of TURBT. If the latest TURBT was performed over one month before RC, the pre-RC laboratory measurements were recorded. Otherwise, the measurements before TURBT were collected, which could reduce the impact of surgery on the results.

Feature selection and model building

We conducted the univariate analysis for the recorded clinical variables to primarily determine potential preoperative risk factors for LNM in BUC. Secondly, spearman correlation analysis was performed to reduce collinearity among features. To reduce the risk of overfitting, the least absolute shrinkage and selection operator (LASSO) algorithm was applied to select features with non-zero coefficient values.

The prediction model of LNM in BUC patients after RC was established using five ML algorithms, including the support vector machine (SVM), light gradient boosting machine (LightGBM), eXtreme gradient boosting (XGBoost), random forest (RF) and extra-trees classifier. All patients were randomly categorized into training set (80%) and testing set (20%). The training set was used to establish the prediction models using five-fold cross-validation, whereas the testing set was used to validate the prediction models using the area under the curve (AUC) of the receiver operating characteristics (ROC) and corresponding 95% confidence intervals (95%CI). We considered the model with the highest AUC as the best model. We calculated the correlation coefficient between features and drew shapely additive explanation (SHAP) summary plot, which were used to visualize the relative importance ranking of each feature to the model predictions. Decision curve analysis (DCA) was performed to demonstrate net benefit for each risk threshold probability, as well as the clinical application value of the best model.

Statistical analyses

The Stratified Shuffle-Split function was conducted in Python (version 3.7). Continuous variables with a normal distribution were described as means and standard deviations, continuous variables with an abnormal distribution were described as medians and interquartile ranges, and categorical variables were described as frequencies and proportions. Continuous variables with a normal distribution, continuous variables with an abnormal distribution, and categorical variables were univariately analyzed using Student’s t-test, Mann-Whitney U-test, and Chi-squared test, respectively. Univariate statistical analyses were performed using SPSS (version 24.0). Other statistical analyses, correlation analysis, and LASSO algorithm were implemented by importing the “scipy”, “numpy”, and “sklearn” packages in Python (version 3.7), and were performed using the “One-key AI” platform (http://www.medai.icu/), which was based on Python (version 3.7). The code used in this study was derived from: https://gitee.com/wangqingbaidu/OnekeyCompo. A bilateral P-value < 0.05 was considered as a measure of statistical significance.

Results

Patient characteristics

A total of 805 patients with BUC were potentially eligible from the Affiliated Hospital of Qingdao University between January 2013 and April 2022. After the selecting process, 655 patients were finally enrolled in our study, and 105 of which had LNM. The training set included 440 patients without LNM and 84 patients with LNM, while the testing set included 110 patients without LNM and 21 patients with LNM (Fig. 1). The baseline data of the included patient are shown in Table 1, which indicated that the grade, papillary, infiltration, hydronephrosis, extravesical invasion, positive lymph node, tumor size, neutrophil count, monocyte count, erythrocyte count, platelet count, hemoglobin, fibrinogen, creatinine, albumin, NLR, PLR, MLR, and SII were significantly different between patients with LNM and patients without LNM in univariate analyses.

Fig. 1
figure 1

Flow chart of the process of patients’ selection

Full size image
Table 1 Baseline characteristics of the patients
Full size table

The comparison of baseline characteristics between the training and testing sets with corresponding P values was shown in Table 2. LNM was not significantly different between training set and testing set (p = 1.000). All baseline characteristics between the training and testing sets were statistically insignificant except diabetes. Considering the rate of diabetes was not significantly different between patients with LNM or not (p = 0.227), the baseline characteristics between two sets were balanced. Besides, the baseline characteristics of the two sets by lymph node status were analyzed and shown in Supplementary Table 1.

Table 2 Comparison of baseline characteristics between the two sets
Full size table

Features selection and model evaluation

We performed spearman correlation analysis and the lasso algorithm with fivefold cross-validation (Fig. 2a and b) to select predictors. 14 potential predictors of LNM after RC were ultimately determined (Supplementary Table 2), which were incorporated into the construction of the prediction model in our study.

Fig. 2
figure 2

(a) The process of feature selection. We used the LASSO regression model with penalty parameter tuning conducted by fivefold cross validation according to minimum criteria. Selection of the tuning parameter (λ). Based on the minimum criteria, the vertical dotted line is plotted at the optimal value λ = 0.0072. (b) The vertical line was plotted with 14 selected features. LASSO, least absolute shrinkage and selection operator

Full size image

Five machine learning algorithms utilizing the 14 selected factors as inputs were used to establish the prediction models in the training set, and the performance of the models was evaluated using the testing set and expressed by the AUC, accuracy, sensitivity, and specificity. The performance results of the prediction models in the training set and testing set were shown in Table 3. The receiver operating characteristics (ROC) and the area under the curve (AUC) for each different prediction models in the testing set were shown in Fig. 3a. The SVM model performed the best prediction ability with an AUC of 0.934 (95%CI: 0.903–0.964) and accuracy of 0.916 in the training set, and an AUC of 0.855 (95%CI: 0.777–0.933) and accuracy of 0.809 in the testing set (Fig. 3b). The RF model had the lowest AUC value of 0.686 (95% CI: 0.563–0.810) and accuracy of 0.611 in the testing set.

Fig. 3
figure 3

(a) Performance for machine learning models in the testing set based on the AUC of the ROC curve. (b) AUC and the ROC curve of SVM model in the training set and the testing set. AUC, area under the curve; ROC, receiver operating characteristics; SVM, support vector machine

Full size image
Table 3 Comparison of the performance of machine learning models in the training and testing set
Full size table

Importance of features of the best model

Coefficients were used to interpret the results of the best prediction model by evaluating the contribution of each variable to the prediction model. We focused on the SVM model since it was the best prediction model, and visualized these variables in Fig. 4a. Moreover, SHAP summary plot was also adopted to show the contribution of each predictor of LNM in the SVM model (Fig. 4b). The results revealed that positive lymph node in imaging contributed the most to the prediction of the outcome, followed by tumor size, extravesical invasion, infiltration, grade, hydronephrosis, papillary, age, fibrinogen, NPR, creatinine, albumin, hemoglobin, and erythrocyte count. Results of the DCA of SVM model in testing set showed that the model offered a clinical benefit at a threshold of between 0.10 and 0.50 (Supplementary Fig. 1).

Fig. 4
figure 4

(a) Top 14 selected features and the corresponding variable coefficients of SVM model. Y-axis shows the top 14 variables, and X-axis shows their impact on the machine model. (b) SHAP summary plot of top 14 selected features of SVM model. SVM, support vector machine; LN, lymph node; NPR, neutrophil-to-platelet ratio; SHAP, shapely additive explanation

Full size image

Discussion

RC plus bilateral PLND and neoadjuvant cisplatin-based combined chemotherapy are recognized as standard treatments of MIBC and some very high-risk NMIBC patients [2, 3]. However, the high possibility of concealed micro metastases resulted in the high recurrence rate of BUC after surgery [13]. Considering BUC patients with LNM were reported to have tumor tissue in LNs which were outside the region of standard PLND, the extended PLND were put up [14]. Even one study developed a nomogram aimed at LNM prediction in BC patients treated with extended PLND [15]. However, one prospective randomized trial demonstrated that extended LND showed no significant survival advantage over standard PLND [16]. Thus, preoperatively predicting LNM in BUC patients treated with RC is of high clinical value. Here, we developed and validated models for preoperatively predicting LNM in BUC using ML, and demonstrated that the SVM model performed the best prediction ability.

Several articles have extensively explored the independent predictors of LNM in BC after RC using various features. Two articles developed nomogram models containing gene signature. Cao et al. established epithelial-mesenchymal transition-LN signature containing 19 candidate genes and identified it as a predictor of LNM in BC [17]. Wu et al. also selected 5 LN-status-related mRNA and developed the five-mRNA-based classifier, which was also incorporated in the nomogram as an independent risk factor for LNM in BUC [18]. Besides, two studies used CT-based radiomics signature and MRI-based radiomics signature as independent variables to predict LNM in BC patients, respectively. And both CT-based radiomics signature contained nomogram and MRI-based radiomics signature contained nomogram showed good calibration and discrimination in the training and validation sets [19, 20]. However, the patients’ genomic and clinical features of gene-based nomograms were from online database such as The Cancer Genome Atlas, which could lead to the information selection bias and the restriction of the range of analyses. Although the radiomics features were selected from authors’ institution, the low sample size and the lack of external validation limited the validation and application of the nomogram models. Then, the genomic information and radiomics signature were difficult to collect and apply in clinical life, and finally restricted the clinical value of these models.

One study based on the Surveillance, Epidemiology, and End Results database identified age, tumor grade, tumor size, and tumor T stage as independent risk factors for LNM in BUC patients [21], which was similar to our selected predictors in the final ML model. Although the sample size was large, the AUC in training dataset was only 0.69, and the AUC in testing dataset was only 0.704, indicating the low accuracy of this model. Besides, another limitation was that the tumor grade in the database was from the pathology of RC, which could not be preoperatively collected. Ou et al. constructed a nomogram for predicting LNM in T1 high-grade BUC containing MLR and fibrinogen [22]. Another study also demonstrated that systemic inflammatory biomarker such as NLR was an independent risk factor for LNM in BUC [13]. Therefore, we selected information of laboratory measurements and calculated systemic inflammatory biomarkers. Although several articles reported that T stage was a risk factor of LNM in BC [13, 21], the staging accuracy of imaging tool such as CT was low. Therefore, we selected the “presence or absence of extravesical invasion” parameter instead of “T stage” to analyze. Although TURBT is typically recommended before RC and the resection specimen should contain bladder muscle tissue, the staging accuracy of TURBT is low, which was evidenced by the results that around 25–51% patients who were diagnosed with NMIBC in TURBT were upstaged to MIBC at RC [23,24,25]. The presence of lymphovascular invasion (LVI) was not accurately reported in our institution because immunohistochemistry is a nonessential tool in the diagnosis of BC [26]. Thus, we collected pathological information from TURBT excepted LVI. And finally, we developed the ML model based on preoperative demographic, pathological, imaging, and laboratory data, which were comprehensive and easily collected in clinical application.

We analyzed the relationship between positive LN on imaging and LNM in both training set and testing set using Chi-squared test, which was shown in Supplementary Table 1. Results indicated that positive LN was significantly different between patients with LNM and patients without LNM in both training set (p < 0.001) and testing set (p = 0.002). The accuracy of LN on imaging of diagnosing LNM was 0.821 and 0.832 in training set and testing set, respectively. However, the sensitivity was only 34.5% and 33.3% separately in training set and testing set, which was much lower than our model. Even though CT and MRI are most common imaging modalities in BUC, it was reported that both of them had limitation in the sensitivity of accessing LNM [3]. The sensitivity of diagnosing LNM in CT and MRI was only ranging from 14 to 30% [27, 28]. Even the most advanced imaging techniques such as PET-CT showed low sensitivity in predicting LNM [27, 29, 30]. Our machine learning model showed high accuracy, sensitivity, and specificity, which could aid clinical diagnosis. Positive LN still had the highest weight in our model (Fig. 4a and b), which might due to the high accuracy and specificity of this variable.

The precision medicine was commonly defined as the stratification of patients using clinical, lifestyle, genetic and further biomarker information with large-scale data [31]. ML is an accurate and new approach to facilely estimate individualized outcomes and bring better decision-making protocols with the availability of plenty of electronic patient clinical and genomic data at present [32]. Previously we had established a nomogram model for predicting LNM of BUC using multivariate traditional logistic regression. We identified tumor grade, infiltration, extravesical invasion, positive LN on imaging, tumor size, and serum creatinine levels as independent preoperative risk factors, while the AUC of 0.817 in training set and the AUC of 0.805 in testing set proved its accuracy and stability [12]. One study identified LNM related genes in prostate cancer using ML algorithm, and performed well in the validation process, indicating the excellent data handling capacity of ML methods [33]. Sabbagh et al. constructed a ML model to predict LNM in prostate cancer using standard clinicopathologic variables, and proved that ML model outperforms traditional tools by AUC and decision curve analysis [10]. The SVM model in our study containing 14 variables had AUCs of 0.934 and 0.855 in the training set and testing set, respectively, which were higher than the results in the traditional logistic regression model. Therefore, we concluded that the SVM model has better prediction performance in LNM of BUC patients than traditional model.

As far as we know, this is the first study to develop the ML model to preoperatively predict LNM in BUC patients using demographic, pathological, imaging, and laboratory data. The high AUCs in both training set and testing set demonstrated the high accuracy and discrimination ability of our model, and the large sample size guaranteed the stability of our results. Besides, the preoperative variables we selected were easily to get, facilitating the application of our model in clinical life.

Nevertheless, this study also had some limitations. First, the inaccurate data selection and the introduction of other potential confounders could not be eliminated due to the retrospective study design. Second, we only conducted the internal validation of all ML models and identified SVM model as the best model. The external validation with large sample size should be furtherly conducted. Third, several clinical trials and retrospective studies proved the survival benefit in BUC patients with neoadjuvant cisplatin-based chemotherapy [34,35,36]. Although neoadjuvant cisplatin-based chemotherapy has become the standard of care for cNOM0 patients with MIBC, we did not analyze the influence of neoadjuvant chemotherapy on LNM due to the lack of data. The relationship between neoadjuvant chemotherapy and LNM in patients with radical cystectomy should be explored with large sample size in the future. Finally, we only collected traditional pathological features of TURBT and traditional imaging data. One recently published study collected new pathological characteristics and radiomics features using deep learning algorithm and constructed the deep learning model to predict LNM in prostate cancer [37]. Thus, the micro variables of pathology and radiomics could be included and used to construct prediction model using deep learning in the future.

Conclusions

We developed and validated the ML models to preoperatively predict LNM in BUC patients received RC, and identified that the SVM model with 14 variables had the best performance. The SVM model displayed high levels of accuracy and clinical applicability by internal validation.

Data availability

The datasets used and analyzed during the current study are available from the corresponding author on reasonable request. The code used in this study are available at: https://github.com/333JJJJ/Machine-Learning-Model.git.

Abbreviations

LNM:

Lymph node metastasis

BUC:

Bladder urothelial carcinoma

ML:

Machine learning

RC:

Radical cystectomy

AUC:

Area under the curve

SVM:

Support vector machine

BC:

Bladder cancer

MIBC:

Muscle-invasive bladder cancer

NMIBC:

Non-muscle‑invasive bladder cancer

PLND:

Pelvic lymph node dissection

TURBT:

Transurethral resection of the bladder tumor

BMI:

Body mass index

NLR:

Neutrophil to lymphocyte ratio

PLR:

Platelet to lymphocyte ratio

MLR:

Monocyte to lymphocyte ratio

NPR:

Neutrophil to platelet ratio

SII:

Systemic immune-inflammation index

LASSO:

Least absolute shrinkage and selection operator

RF:

Random forest

ROC:

Receiver operating characteristics

SHAP:

Shapely additive explanation

DCA:

Decision curve analysis

95%CI:

95% confidence intervals

LVI:

Lymphovascular invasion

References

  1. Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, Bray F. Global Cancer statistics 2020: GLOBOCAN estimates of incidence and Mortality Worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2021;71(3):209–49.

    Article  PubMed  Google Scholar 

  2. Babjuk M, Burger M, Capoun O, Cohen D, Comperat EM, Dominguez Escrig JL, Gontero P, Liedberg F, Masson-Lecomte A, Mostafid AH, et al. European Association of Urology Guidelines on non-muscle-invasive bladder Cancer (Ta, T1, and carcinoma in situ). Eur Urol. 2022;81(1):75–94.

    Article  PubMed  Google Scholar 

  3. Witjes JA, Bruins HM, Cathomas R, Comperat EM, Cowan NC, Gakis G, Hernandez V, Linares Espinos E, Lorch A, Neuzillet Y, et al. European Association of Urology Guidelines on muscle-invasive and metastatic bladder Cancer: Summary of the 2020 guidelines. Eur Urol. 2021;79(1):82–104.

    Article  CAS  PubMed  Google Scholar 

  4. Stein JP, Lieskovsky G, Cote R, Groshen S, Feng AC, Boyd S, Skinner E, Bochner B, Thangathurai D, Mikhail M, et al. Radical cystectomy in the treatment of invasive bladder cancer: long-term results in 1,054 patients. J Clin Oncol. 2001;19(3):666–75.

    Article  CAS  PubMed  Google Scholar 

  5. Yafi FA, Aprikian AG, Chin JL, Fradet Y, Izawa J, Estey E, Fairey A, Rendon R, Cagiannos I, Lacombe L, et al. Contemporary outcomes of 2287 patients with bladder cancer who were treated with radical cystectomy: a Canadian multicentre experience. BJU Int. 2011;108(4):539–45.

    Article  PubMed  Google Scholar 

  6. Li S, Wang Y, Hu X. Prognostic nomogram based on the lymph node metastasis indicators for patients with bladder cancer: a SEER population-based study and external validation. Cancer Med. 2023;12(6):6853–66.

    Article  CAS  PubMed  Google Scholar 

  7. Galsky MD, Stensland K, Sfakianos JP, Mehrazin R, Diefenbach M, Mohamed N, Tsao CK, Boffetta P, Wiklund P, Oh WK, et al. Comparative effectiveness of treatment strategies for bladder Cancer with Clinical evidence of Regional Lymph Node involvement. J Clin Oncol. 2016;34(22):2627–35.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. Khene ZE, Bigot P, Doumerc N, Ouzaid I, Boissier R, Nouhaud FX, Albiges L, Bernhard JC, Ingels A, Borchiellini D, et al. Application of machine learning models to Predict Recurrence after Surgical Resection of Nonmetastatic Renal Cell Carcinoma. Eur Urol Oncol. 2023;6(3):323–30.

    Article  PubMed  Google Scholar 

  9. Darcy AM, Louie AK, Roberts LW. Machine learning and the Profession of Medicine. JAMA. 2016;315(6):551–2.

    Article  CAS  PubMed  Google Scholar 

  10. Sabbagh A, Washington SL 3rd, Tilki D, Hong JC, Feng J, Valdes G, Chen MH, Wu J, Huland H, Graefen M et al. Development and External Validation of a machine learning model for prediction of Lymph Node Metastasis in patients with prostate Cancer. Eur Urol Oncol 2023.

  11. Li W, Wang B, Dong S, Xu C, Song Y, Qiao X, Xu X, Huang M, Yin C. A novel nomogram for prediction and evaluation of lymphatic metastasis in patients with renal cell carcinoma. Front Oncol. 2022;12:851552.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Ji J, Yao Y, Sun L, Yang Q, Zhang G. Development and validation of a preoperative nomogram to predict lymph node metastasis in patients with bladder urothelial carcinoma. J Cancer Res Clin Oncol 2023.

  13. Schuettfort VM, D’Andrea D, Quhal F, Mostafaei H, Laukhtina E, Mori K, Konig F, Rink M, Abufaraj M, Karakiewicz PI, et al. A panel of systemic inflammatory response biomarkers for outcome prediction in patients treated with radical cystectomy for urothelial carcinoma. BJU Int. 2022;129(2):182–93.

    Article  CAS  PubMed  Google Scholar 

  14. Dorin RP, Daneshmand S, Eisenberg MS, Chandrasoma S, Cai J, Miranda G, Nichols PW, Skinner DG, Skinner EC. Lymph node dissection technique is more important than lymph node count in identifying nodal metastases in radical cystectomy patients: a comparative mapping study. Eur Urol. 2011;60(5):946–52.

    Article  PubMed  Google Scholar 

  15. Moschini M, Afferi L, Gandaglia G, D’Andrea D, Zamboni S, Di Bona C, Mordasini L, Mattei A, Baumeister P, Martini A, et al. Prediction of the need for an extended Lymphadenectomy at the Time of Radical Cystectomy in patients with bladder Cancer. Eur Urol Focus. 2021;7(5):1067–74.

    Article  PubMed  Google Scholar 

  16. Gschwend JE, Heck MM, Lehmann J, Rubben H, Albers P, Wolff JM, Frohneberg D, de Geeter P, Heidenreich A, Kalble T, et al. Extended Versus Limited Lymph Node dissection in bladder Cancer patients undergoing Radical Cystectomy: Survival results from a prospective, randomized trial. Eur Urol. 2019;75(4):604–11.

    Article  PubMed  Google Scholar 

  17. Cao R, Ma B, Wang G, Xiong Y, Tian Y, Yuan L. An Epithelial-Mesenchymal Transition (EMT) Preoperative Nomogram for Prediction of Lymph Node Metastasis in Bladder Cancer (BLCA). Dis Markers 2020, 2020:8833972.

  18. Wu SX, Huang J, Liu ZW, Chen HG, Guo P, Cai QQ, Zheng JJ, Qin HD, Zheng ZS, Chen X, et al. A genomic-clinicopathologic Nomogram for the preoperative prediction of Lymph Node Metastasis in bladder Cancer. EBioMedicine. 2018;31:54–65.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Wu S, Zheng J, Li Y, Yu H, Shi S, Xie W, Liu H, Su Y, Huang J, Lin T. A Radiomics Nomogram for the preoperative prediction of Lymph Node Metastasis in bladder Cancer. Clin Cancer Res. 2017;23(22):6904–11.

    Article  CAS  PubMed  Google Scholar 

  20. Wu S, Zheng J, Li Y, Wu Z, Shi S, Huang M, Yu H, Dong W, Huang J, Lin T. Development and validation of an MRI-Based Radiomics signature for the preoperative prediction of Lymph Node Metastasis in bladder Cancer. EBioMedicine. 2018;34:76–84.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Tian Z, Meng L, Wang X, Diao T, Hu M, Wang M, Zhang Y, Liu M. Predictive nomogram and risk factors for lymph node metastasis in bladder Cancer. Front Oncol. 2021;11:690324.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Ou N, Song Y, Liu M, Zhu J, Yang Y, Liu X. Development and validation of a Nomogram to predict Lymph Node Metastasis in patients with T1 high-Grade Urothelial Carcinoma of the bladder. Front Oncol. 2020;10:532924.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Shariat SF, Palapattu GS, Karakiewicz PI, Rogers CG, Vazina A, Bastian PJ, Schoenberg MP, Lerner SP, Sagalowsky AI, Lotan Y. Discrepancy between clinical and pathologic stage: impact on prognosis after radical cystectomy. Eur Urol. 2007;51(1):137–49. discussion 149–151.

    Article  PubMed  Google Scholar 

  24. Svatek RS, Shariat SF, Novara G, Skinner EC, Fradet Y, Bastian PJ, Kamat AM, Kassouf W, Karakiewicz PI, Fritsche HM, et al. Discrepancy between clinical and pathological stage: external validation of the impact on prognosis in an international radical cystectomy cohort. BJU Int. 2011;107(6):898–904.

    Article  PubMed  Google Scholar 

  25. Turker P, Bostrom PJ, Wroclawski ML, van Rhijn B, Kortekangas H, Kuk C, Mirtti T, Fleshner NE, Jewett MA, Finelli A, et al. Upstaging of urothelial cancer at the time of radical cystectomy: factors associated with upstaging and its effect on outcome. BJU Int. 2012;110(6):804–11.

    Article  PubMed  Google Scholar 

  26. Comperat E, Amin MB, Epstein JI, Hansel DE, Paner G, Al-Ahmadie H, True L, Baydar D, Bivalacqua T, Brimo F, et al. The Genitourinary Pathology Society Update on Classification of Variant Histologies, T1 substaging, Molecular Taxonomy, and Immunotherapy and PD-L1 Testing implications of Urothelial Cancers. Adv Anat Pathol. 2021;28(4):196–208.

    Article  CAS  PubMed  Google Scholar 

  27. Brunocilla E, Ceci F, Schiavina R, Castellucci P, Maffione AM, Cevenini M, Bianchi L, Borghesi M, Giunchi F, Fiorentino M, et al. Diagnostic accuracy of (11)C-choline PET/CT in preoperative lymph node staging of bladder cancer: a systematic comparison with contrast-enhanced CT and histologic findings. Clin Nucl Med. 2014;39(5):e308–312.

    Article  PubMed  Google Scholar 

  28. Lonati C, Mordasini L, Afferi L, De Cobelli O, Di Trapani E, Necchi A, Colombo R, Briganti A, Montorsi F, Simeone C, et al. Diagnostic accuracy of preoperative lymph node staging of bladder cancer according to different lymph node locations: a multicenter cohort from the European Association of Urology - Young Academic urologists. Urol Oncol. 2022;40(5):195. e127-195 e135.

    Article  Google Scholar 

  29. Einerhand SMH, van Gennep EJ, Mertens LS, Hendricksen K, Donswijk ML, van der Poel HG, van Rhijn. BWG: 18F-fluoro-2-deoxy-D-glucose positron emission tomography/computed tomography in muscle-invasive bladder cancer. Curr Opin Urol. 2020;30(5):654–64.

    Article  PubMed  Google Scholar 

  30. Ha HK, Koo PJ, Kim SJ. Diagnostic accuracy of F-18 FDG PET/CT for Preoperative Lymph Node staging in newly diagnosed bladder Cancer patients: a systematic review and Meta-analysis. Oncology. 2018;95(1):31–8.

    Article  CAS  PubMed  Google Scholar 

  31. Konig IR, Fuchs O, Hansen G, von Mutius E, Kopp MV. What is precision medicine? Eur Respir J 2017, 50(4).

  32. Wilkinson J, Arnold KF, Murray EJ, van Smeden M, Carr K, Sippy R, de Kamps M, Beam A, Konigorski S, Lippert C, et al. Time to reality check the promises of machine learning-powered precision medicine. Lancet Digit Health. 2020;2(12):e677–80.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Shamsara E, Shamsara J. Bioinformatics analysis of the genes involved in the extension of prostate cancer to adjacent lymph nodes by supervised and unsupervised machine learning methods: the role of SPAG1 and PLEKHF2. Genomics. 2020;112(6):3871–82.

    Article  CAS  PubMed  Google Scholar 

  34. Choueiri TK, Jacobus S, Bellmunt J, Qu A, Appleman LJ, Tretter C, Bubley GJ, Stack EC, Signoretti S, Walsh M, et al. Neoadjuvant dose-dense methotrexate, vinblastine, doxorubicin, and cisplatin with pegfilgrastim support in muscle-invasive urothelial cancer: pathologic, radiologic, and biomarker correlates. J Clin Oncol. 2014;32(18):1889–94.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. International Collaboration of T, Medical Research Council Advanced Bladder Cancer, Working P, European Organisation for R, Treatment of Cancer Genito-Urinary Tract Cancer G, Australian Bladder Cancer Study G, National Cancer Institute of Canada Clinical Trials G, Finnbladder G, Griffiths G et al. International phase III trial assessing neoadjuvant cisplatin, methotrexate, and vinblastine chemotherapy for muscle-invasive bladder cancer: long-term results of the BA06 30894 trial. J Clin Oncol 2011, 29(16):2171–2177.

  36. Peyton CC, Tang D, Reich RR, Azizi M, Chipollini J, Pow-Sang JM, Manley B, Spiess PE, Poch MA, Sexton WJ, et al. Downstaging and Survival outcomes Associated with Neoadjuvant Chemotherapy regimens among patients treated with cystectomy for muscle-invasive bladder Cancer. JAMA Oncol. 2018;4(11):1535–42.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Hou Y, Bao J, Song Y, Bao ML, Jiang KW, Zhang J, Yang G, Hu CH, Shi HB, Wang XM, et al. Integration of clinicopathologic identification and deep transferrable image feature representation improves predictions of lymph node metastasis in prostate cancer. EBioMedicine. 2021;68:103395.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We thank Cathel Kerr, BSc, PhD, from Liwen Bianji (Edanz) (www.liwenbianji.cn) for editing the English text of a draft of this manuscript. This study was partly funded by the Natural Science Foundation of Shandong Province (ZR2021MH354), Medical and health research program of Qingdao (2021-WJZD170). The funders had no roles in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Funding

This study was partly funded by the Natural Science Foundation of Shandong Province (ZR2021MH354), Medical and health research program of Qingdao (2021-WJZD170). The funders had no roles in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Author information

Author notes

  1. Junjie Ji and Tianwei Zhang contributed equally to this work.

Authors and Affiliations

  1. Department of Urology, The Affiliated Hospital of Qingdao University, Qingdao, China

    Junjie Ji, Tianwei Zhang, Yu Yao, Jingchang Mei, Lijiang Sun & Guiming Zhang

  2. Shandong Key Laboratory of Digital Medicine and Computer Assisted Surgery, The Affiliated Hospital of Qingdao University, Qingdao, China

    Ling Zhu

Authors
  1. Junjie Ji
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tianwei Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ling Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yu Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jingchang Mei
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Lijiang Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Guiming Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

G.Z. conceived and designed the study. J.J. and T.Z. collected the data. L.Z. and J.M. analyzed the data. Y.Y. and L.Z. made the figures and tables. J.J. and T.Z. wrote the manuscript. G.Z. and L.S. reviewed and edited the manuscript. All authors have read and approved the final manuscript.

Corresponding author

Correspondence to Guiming Zhang.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Medical Ethics Committee of the Affiliated Hospital of Qingdao University with the number of QYFYWZLL28026, and was carried out following the Declaration of Helsinki of the World Medical Association. Written informed consent was obtained from all patients included in this retrospective study, and the data were anonymous.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Supplementary Material 2

Supplementary Material 3

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ji, J., Zhang, T., Zhu, L. et al. Using machine learning to develop preoperative model for lymph node metastasis in patients with bladder urothelial carcinoma. BMC Cancer 24, 725 (2024). https://doi.org/10.1186/s12885-024-12467-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12885-024-12467-4

Keywords

BMC Cancer

ISSN: 1471-2407

Contact us