Skip to main content

A nomogram combining clinical factors and biomarkers for predicting the recurrence of high-risk cutaneous squamous cell carcinoma

Abstract

Background

Although determining the recurrence of cutaneous squamous cell carcinoma (cSCC) is important, currently suggested systems and single biomarkers have limited power for predicting recurrence.

Objective

In this study, combinations of clinical factors and biomarkers were adapted into a nomogram to construct a powerful risk prediction model.

Methods

The study included 145 cSCC patients treated with Mohs micrographic surgery. Clinical factors were reviewed, and immunohistochemistry was performed using tumor tissue samples. A nomogram was constructed by combining meaningful clinical factors and protein markers.

Results

Among the various factors, four clinical factors (tumor size, organ transplantation history, poor differentiation, and invasion into subcutaneous fat) and two biomarkers (Axin2 and p53) were selected and combined into a nomogram. The concordance index (C-index) of the nomogram for predicting recurrence was 0.809, which was higher than that for the American Joint Committee on Cancer (AJCC) 7th, AJCC 8th, Brigham and Women’s Hospital, and Breuninger staging systems in the patient data set.

Conclusion

A nomogram model that included both clinical factors and biomarkers was much more powerful than previous systems for predicting cSCC recurrence.

Peer Review reports

Background

Cutaneous squamous cell carcinoma (cSCC) is the second most common skin cancer, and its incidence is increasing annually [1, 2]. Complete surgical excision is the treatment of choice for cSCC, and further systemic treatment is not required for localized cSCC [3,4,5,6,7]. However, cSCC often recurs even 1after complete surgical excision, and the prognosis of recurrent cSCC is notably poorer than that of the primary tumor [8, 9]. In a recent study, the cost of inpatient care was much higher for cSCC than for non-cSCC ($66,841 per cSCC patient vs. $37,102 per non-cSCC patient), especially for patients with aggressive cSCC, with recurrence or metastasis [10].

According to previous studies, various clinical parameters, such as age, tumor location on auricle or lip, organ recipient, tumor diameter > 2 cm, poor differentiation, invasion into subcutaneous fat, and presence of perineural invasion are well-known factors for a poor prognosis of cSCC [11,12,13,14,15,16,17]. Various clinical staging systems or definitions for high-risk cSCC have also been suggested based on these clinical risk factors [11,12,13,14,15,16, 18, 19]. However, all currently suggested systems or definitions have limited ability for predicting recurrence [18, 20], and there is a need to identify biomarkers that more accurately predict high-risk cSCC.

Aberrant expressions of various proteins have been found during cSCC progression. In our previous study, we found axis inhibition protein 2 (Axin2), Snail, and melanoma-associated antigen A12 (MAGEA12) to be poor prognostic markers for cSCC [21, 22]. Furthermore, we investigated several candidate biomarkers and validated the value of these proteins for predicting cSCC recurrence.

Since cSCC recurrence develops in a multistage process through the accumulation of alterations in various factors, prediction of the risk of cSCC recurrence using a single factor is difficult. Therefore, by combining several biomarkers and further combining them with clinical factors for synergistic effects, cSCC recurrence can be more accurately predicted. Moreover, a nomogram, which is a mathematical formula constructed using various factors with different weights, is another tool for predicting cancer prognosis, and it reflects complex factors.

In this retrospective study, we aimed to evaluate the predictive value of clinical factors and biomarkers in cSCC recurrence and to construct a powerful risk prediction model for cSCC recurrence using combined factors applied in a nomogram.

Materials and methods

Patient selection

Patients with cSCC who underwent Mohs micrographic surgery at the Department of Dermatology, Severance Hospital, Seoul, South Korea from 2000 to 2017 were retrospectively reviewed. This study was approved by the Institutional Review Board for Bioethics of Yonsei University Health System, Severance Hospital (4–2018-0331).

Clinical factors

We selected several candidate factors using previous literature on cSCC risk prediction. Clinical factors such as age, sex, tumor location, organ transplantation history, tumor size, differentiation grade, and invasion depth were analyzed. These candidate factors were considered in the patient cohort, and the association of individual factors with recurrence was analyzed. Various clinical factors were then combined to investigate the best clinical factor combinations for predicting recurrence, and predictive ability was analyzed for each combination.

Biomarkers and immunohistochemistry

For biomarker evaluation, tumor tissues from 145 patients stored in the Department of Pathology were retrospectively reviewed. Formalin-fixed paraffin-embedded tissue samples were cut into 4-μm tissue sections for immunohistochemistry. Antigen retrieval and blocking of endogenous peroxidase activity were performed after deparaffinization and rehydration of tissue sections.

In our previous study, we selected genes that were involved in important biological processes of cancer cells, such as epithelial-mesenchymal transition (EMT), formation of functional invadopodia, and tumor suppression. Further, we evaluated the biological functions and clinicopathological significance of the genes in cSCC [21, 22]. In the present study, we validated the clinicopathologic significance of previously selected candidate biomarkers and further investigated tumor suppressor gene proteins such as p53, p16, AT-rich interaction domain (ARID) 1A, and ARID1B as candidate prognostic markers using the cSCC cohort. Cortactin (CTTN, Abcam Inc., Cambridge, MA, USA), pTyr421-CTTN (LifeSpan BioSciences Inc., Seattle, WA, USA), pTyr466-CTTN (LifeSpan BioSciences Inc.), MAGEA12 (Abcam Inc.), p21 (Abcam Inc.), p16 (Dako Inc., Glostrup, Denmark), p53 (Dako Inc.), ARID1A (Abcam Inc.), ARID1B (Abcam Inc.), Axin2 (Abcam Inc.), and Snail (Abcam Inc.) primary antibodies were used for this study. Tissue sections were incubated with primary antibodies at room temperature for 1 h. REAL EnVision HRP Rabbit/Mouse Detection System (Dako Inc.) was used as a secondary antibody. After visualizing with 3,3′-diaminobenzidine (Dako Inc.), counterstaining was performed with hematoxylin (Abcam Inc.). Histoscores for each protein expression were calculated with the weighted histoscore method according to the tissue staining intensity and percentage of positive cells [23]. Patients were subdivided into two groups: low (histoscore 0–100) and high (histoscore 101–300) expression.

Statistical analysis

The effects of various factors on the prediction of cSCC recurrence were assessed with the Cox proportional-hazards model. Various types of metrics were suggested in previous studies to evaluate the prediction models, such as the concordance index (C-index) and the integrated discrimination improvement index [24,25,26,27,28,29]. The selection of the most suitable metrics helps create a powerful prediction model. In accordance with previous studies [24,25,26,27], the recurrence prediction ability was calculated using the C-index for different combinations of clinical factors. The protein expression in each group of patients was compared using the chi-square test. Kaplan–Meier analysis and log-rank test were used to evaluate the survival rate between groups in our cohort. The predictive nomogram was created using a combination of clinical factors and biomarkers for cSCC recurrence and evaluated using the C-index. The American Joint Committee on Cancer (AJCC) 7th, AJCC 8th, Brigham and Women’s Hospital (BWH), and Breuninger staging systems for cSCC were applied to the patient data set, and the C-index for predicting recurrence was calculated for each staging system [14, 15, 19]. SPSS for Windows version 23.0 (IBM Corp., Armonk, NY, USA) and R (R Foundation for Statistical Computing, Vienna, Austria) were used for the statistical analysis in this study.

Results

Patient demographics in the cSCC cohort

The cSCC cohort comprised 145 patients (70 men, 75 women; median age: 75 years; age range: 30–98 years) with cSCC (mean follow-up period: 22 months) treated with Mohs micrographic surgery. Of these, 20 (13.8%) patients showed recurrence, and 125 (86.2%) patients did not show recurrence during follow-up. Among the 20 patients with recurrence in our cohort, 12 patient showed only local recurrence, 3 patients showed both local and distant recurrence, and 5 patients had regional nodal recurrence or distant metastasis.

The clinicopathological characteristics of the patients are described in Table 1. As shown in Table 1, no significant association was found between any clinicopathological factor and recurrence. We then combined different clinical factors and explored the predictive accuracies (Supplementary Fig. 1). The C-index was the highest when four clinicopathological factors were combined, and among various combinations of four clinicopathological factors, tumor size, histologic grade, invasion depth, and organ transplantation history showed the highest predictive accuracy (Supplementary Table 1). When a nomogram was constructed using these clinical factors, the C-index of the combined clinical factors for predicting cSCC recurrence was approximately 0.650 (Fig. 1).

Table 1 Demographics of 145 cSCC patients
Fig. 1
figure 1

Predictive nomogram including four clinical factors (C-index 0.650 in our patient cohort). RFS: recurrence-free survival; WD: well-differentiated; MD: moderately differentiated; PD: poorly differentiated

Characteristics of protein expression for the candidate biomarkers in cSCC

The candidate biomarkers showed various expression patterns (Fig. 2). cSCC cells typically showed nuclear expression of p53, p21, ARID1A, and ARID1B. Cytoplasmic expressions of Axin2, CTTN, pTyr421-CTTN, pTyr466-CTTN, and MAGEA12 were also found. In addition, p16 and Snail expressions were detected in both the nucleus and cytoplasm of cSCC cells. The differences between patients with or without recurrence in tissue immunoreactivity against candidate biomarkers are shown in Supplementary Table 2. Kaplan–Meier analysis showed that the immunoreactivity of p53, ARID1A, Axin2, pTyr421-CTTN, pTyr466-CTTN, MAGEA12, p16, and Snail were significantly related to the recurrence-free survival of cSCC patients (Supplementary Fig. 2).

Fig. 2
figure 2

Expression pattern of biomarkers in the cSCC tissue samples. Each column shows high (i), low (ii), and negative (iii) expression. Each row shows the expression patterns of different biomarkers. p53, p21, ARID1A, and ARID1B showed nuclear expression pattern in cSCC cells, and p16 and SNAIL showed expression in both the nucleus and cytoplasm. Axin2, CTTN, pTyr421-CTTN, pTyr466-CTTN, and MAGEA12, showed cytoplasmic expression (original magnification: × 200, scale bar: 100 μm; magnification for inset micrograph: × 1000, scale bar: 20 μm). ARID: AT-rich interaction domain; Axin2: axis inhibition protein 2; cSCC: cutaneous squamous cell carcinoma; MAGEA12: melanoma-associated antigen A12

Selection of combined risk factors for predicting cSCC recurrence

To implement an optimal prediction model, we first attempted to identify the number of biomarkers that could show the most efficient predictive power when combined with clinical factors. To identify the most valuable biomarker set, we combined different proteins and explored their predictive ability (Fig. 3). C-indexes increased as the number of biomarkers increased. For ease of clinical application, we identified the number of biomarkers that showed the highest predictive power with the smallest number of proteins, and the most optimal result was obtained with two proteins. The C-index achieved by combining selected clinicopathological factors and biomarkers is shown in Supplementary Table 3.

Fig. 3
figure 3

Concordance index (C-index) according to number of combined protein factors. The C-indexes increased as the number of factors increased. First boxplot: only protein(s); Second boxplot: protein(s) and clinicopathologic factors including tumor size, histologic grade, invasion into subcutaneous fat, and history of organ transplantation

Nomogram construction using combined risk factors

We constructed a nomogram (Fig. 4A) to predict the probability of recurrence by combining data concerning tumor size, histologic grade, subcutaneous invasion, history of organ transplantation, and Axin2 and p53 expressions. The C-index of the nomogram was approximately 0.809 (Supplementary Table 3). The probability of recurrence in 1, 3, and 5 years was determined by the calculated total scores. For comparison with the traditional staging systems, four staging systems, namely AJCC 7th, AJCC 8th, BWH, and Breuninger, were considered in our patient set, and their C-indices were 0.6264, 0.7073, 0.7086, and 0.7185, respectively, which were lower than the C-index of our model (Supplementary Table 4) [14, 15, 19].

Fig. 4
figure 4

Nomogram constructed by combining clinical risk factors and biologic markers. A A diagram of the constructed nomogram B HTML construct of the nomogram. The probability of recurrence in 1, 3, and 5 years can be calculated by checking the status of patients. C Calibration plots of the nomogram for predicting the probability recurrence in 1, 3, and 5 years. D Kaplan–Meier graph showing recurrence-free survival according to score at nomogram. RFS: recurrence-free survival

For practical usage of the nomogram, a hypertext markup language (HTML) format of the nomogram was also constructed (Fig. 4B). In the HTML format, the probability of recurrence in 1, 3, and 5 years was calculated by checking the status of patients. For example, a patient with tumor size < 2 cm, well to moderately differentiated histologic grade, invasions of tumor cells in subcutaneous fat, no history of organ transplantation, low expression of Axin2, and high expression of p53 would have a total score of 170, which would correspond to a probability of recurrence of 18.0%, 53.5%, and 78.7% in 1, 3, and 5 years, respectively.

A statistically significant relationship between recurrence predicted by the nomogram and actual outcomes of cSCC patients was found in this study. When the prediction values calculated by nomogram were assigned to the x-axis and the actual clinical outcomes were assigned to the y-axis, the calibration plot showed a solid line in each indicated follow-up period (Fig. 4C). We also evaluated whether the total points calculated by the nomogram could be used to predict recurrence in our cohort. The total points ranged from 68 to 311, and the patients were further divided into two groups using the median value of the total point calculated by nomogram (cutoff score: 211). We found a significant difference in recurrence-free survival between the two groups of patients, according to Kaplan–Meier analysis (Log rank test, p < 0.001) (Fig. 4D). These findings suggest that the prediction model for the recurrence of cSCC, constructed using combined factors, is ideal.

Discussion

Predicting recurrence and identifying high-risk cSCC patients that require strict surveillance are major issues in cSCC management. The incidence of basal cell carcinoma is higher, but it shows a much indolent prognosis. The prognosis of melanoma is much poorer; however, there is a well-established clinical staging system for melanoma as well as crucial target biomarkers such as BRAF. In contrast, cSCC, which is the second most common skin cancer following basal cell carcinoma, has no clinically effective biomarkers or a staging system with a high predictive value.

Consistent with previous observations, traditional staging systems that utilize only clinical factors did not show a satisfactory ability in predicting recurrence in our cohort. No significant association was found between patient outcome and the classic clinical prognostic predictors such as age, tumor location, history of organ transplantation, histologic grade, and invasion depth in our cohort. These discrepancies might be due to the fact that predictive power of the single clinical factors is not high enough to apply to any cohort. Because of the limited predictive power of clinical factors, predictive biomarkers have been investigated for risk stratification of SCC. In a recent study, Shapanis et al. conducted proteomic profiling on cSCC tissues and compared the metastasis and non-metastasis groups [30]. In their study, the prediction model incorporating significant proteins showed higher predictive power for metastasis compared with previous clinical staging systems in the cSCC patient group, which implies that protein expressions are important factors and should be included in a risk prediction model.

In our previous study, Axin2, Snail, pTyr421-CTTN, pTyr466-CTTN, and MAGEA12 expressions were significantly associated with recurrence-free survival [21, 22]. In the current study, tumor suppressor genes, such as ARID1A, p53, and p16 were also found to be risk factors for cSCC recurrence in our cohort (Supplementary Fig. 2).

For higher predictive power, combinations of biomarkers were included in the nomogram. Although the predictive power increased with a higher number of protein combinations, two biomarkers were selected, considering clinical practicality. When combined with clinical factors, p53 and Axin2 showed the highest synergistic power and were included in the final nomogram.

In response to several types of stress, the tumor suppressor protein, p53, can be stabilized in the nucleus and acts as a transcription factor for many genes that are involved in the proliferation and differentiation of normal cells. In contrast, in various cancer cells, especially for ultraviolet light-induced carcinogenesis, mutation of the p53 gene is the most common genetic alteration during progression, which often leads to the overexpression of the p53 protein [31,32,33]. The association of p53 overexpression with SCC prognosis has been consistently reported and was noted in our study as well [34, 35].

Axin2, as a component of the β-catenin degradation complex under the absence of Wnt signals, was initially identified as a tumor suppressor gene [36]. However, recent studies have demonstrated the oncogenic activities of Axin2 in both premalignant lesions and various malignancies [37, 38]. Studies showed that the abundant expression of Axin2 was significantly associated with the malignant transformation of oral leukoplakia, and both Wnt signaling and the invasive ability of cancer cells were attenuated by Axin2 knockdown in colorectal cancers [37,38,39,40]. Moreover, as a downstream target of the Wnt signaling pathway, Axin2 acts as a nucleocytoplasmic shuttle of glycogen synthase kinase 3 (GSK-3), thereby inhibiting GSK-3-dependent Snail degradation and resulting in the nuclear stabilization of Snail, which is a key mediator of EMT [41]. Consistent with previous studies [21, 41], Axin2 expression was significantly associated with Snail expression, and increased Axin2 expression was also a significant risk factor for recurrence, in our cohort. Moreover, some investigators showed that microRNA-34, a transcriptional target of p53, can suppress Axin2 expression due to its binding with the 5’ and 3’ untranslated regions of Axin2 [42]. Considering the inhibitory effect of p53 on Axin2 expression, genetic alteration of p53 may be a sign of increased Axin2 expression. Therefore, the synergistic effect of p53 and Axin2 expression may result from the critical role of EMT mediated via the p53-Axin2-GSK3-Snail axis in cSCC progression.

A nomogram, which is a mathematical formula with a diagram, has recently been adopted in the field of oncology [43]. The nomogram may provide patients with personalized predictions and aid in determining treatment plans. Disparate risk factors for each cancer type can be mathematically weighted and combined into a nomogram as a reliable and reproducible prediction model. To date, various nomograms have been used for the prediction of various cancers [44,45,46,47,48,49,50]. However, there are only a few reports on the application of the nomogram in cSCC. In the present study, we constructed a predictive nomogram to determine the probability of recurrence in 1, 3, and 5 years in cSCC patients after Mohs micrographic surgery.

This study had certain limitations. Some important clinical factors such as perineural invasion and vascular invasion were not included in this study because of missing entries in > 60% of the patients. Moreover, there may be other crucial predictive protein markers or genetic alterations related to cSCC recurrence that were not included in our nomogram. Nevertheless, in the current prediction model, we found that the C-index was approximately 0.65 when only clinical factors were considered, but this increased to approximately 0.809 when the clinical factors were combined with p53 and Axin2 expression. In addition, the calibrated nomogram showed high predictive accuracy, in our study.

The combined expressions of the p53 and Axin2 proteins may be useful for assessing the risk of cSCC recurrence. Despite the lack of external validation, the nomogram constructed by combining appropriate clinical risk factors and biomarkers showed higher predictive value than previous prediction systems for cSCC. By using a relevant nomogram model, high-risk cSCC patients can be identified more accurately, and stricter surveillance would be possible in these patients.

Availability of data and materials

The datasets used and analyzed during the current study are available from the corresponding author on reasonable request.

References

  1. Lomas A, Leonardi-Bee J, Bath-Hextall F. A systematic review of worldwide incidence of nonmelanoma skin cancer. Br J Dermatol. 2012;166(5):1069–80.

    Article  CAS  PubMed  Google Scholar 

  2. Stang A, Khil L, Kajuter H, Pandeya N, Schmults CD, Ruiz ES, Karia PS, Green AC. Incidence and mortality for cutaneous squamous cell carcinoma: comparison across three continents. J Eur Acad Dermatol Venereol. 2019;33(Suppl 8):6–10.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Kauvar AN, Arpey CJ, Hruza G, Olbricht SM, Bennett R, Mahmoud BH. Consensus for nonmelanoma skin cancer treatment, Part II: Squamous cell carcinoma, including a cost analysis of treatment methods. Dermatol Surg. 2015;41(11):1214–40.

    Article  CAS  PubMed  Google Scholar 

  4. van Lee CB, Roorda BM, Wakkee M, Voorham Q, Mooyaart AL, de Vijlder HC, Nijsten T, van den Bos RR. Recurrence rates of cutaneous squamous cell carcinoma of the head and neck after Mohs micrographic surgery vs. standard excision: a retrospective cohort study. Br J Dermatol. 2019;181(2):338–43.

    Article  PubMed  Google Scholar 

  5. Marrazzo G, Zitelli JA, Brodland D. Clinical outcomes in high-risk squamous cell carcinoma patients treated with Mohs micrographic surgery alone. J Am Acad Dermatol. 2019;80(3):633–8.

    Article  PubMed  Google Scholar 

  6. Leibovitch I, Huilgol SC, Selva D, Hill D, Richards S, Paver R. Cutaneous squamous cell carcinoma treated with Mohs micrographic surgery in Australia II. Perineural invasion J Am Acad Dermatol. 2005;53(2):261–6.

    Article  PubMed  Google Scholar 

  7. Stratigos AJ, Garbe C, Dessinioti C, Lebbe C, Bataille V, Bastholt L, Dreno B, Concetta Fargnoli M, Forsea AM, Frenard C, et al. European interdisciplinary guideline on invasive squamous cell carcinoma of the skin: Part 2. Treatment Eur J Cancer. 2020;128:83–102.

    Article  CAS  PubMed  Google Scholar 

  8. Oh Y, Kim J, Zheng Z, Kim SK, Chung KY, Roh MR. Risk factors for recurrence in cutaneous squamous cell carcinoma after Mohs micrographic surgery: a retrospective review of 237 Asian patients. J Dermatol. 2020;47(1):72–7.

    Article  PubMed  Google Scholar 

  9. Dean NR, Sweeny L, Magnuson JS, Carroll WR, Robinson D, Desmond RA, Rosenthal EL. Outcomes of recurrent head and neck cutaneous squamous cell carcinoma. J Skin Cancer. 2011;2011:972497.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Tripathi R, Knusel KD, Ezaldein HH, Bordeaux JS, Scott JF. Characteristics of patients hospitalized for cutaneous squamous cell carcinoma. Dermatol Surg. 2020;46(6):742–6.

    Article  CAS  PubMed  Google Scholar 

  11. Baum CL, Wright AC, Martinez JC, Arpey CJ, Brewer JD, Roenigk RK, Otley CC. A new evidence-based risk stratification system for cutaneous squamous cell carcinoma into low, intermediate, and high risk groups with implications for management. J Am Acad Dermatol. 2018;78(1):141–7.

    Article  PubMed  Google Scholar 

  12. Thompson AK, Kelley BF, Prokop LJ, Murad MH, Baum CL. Risk factors for cutaneous squamous cell carcinoma recurrence, metastasis, and disease-specific death: a systematic review and meta-analysis. JAMA Dermatol. 2016;152(4):419–28.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Farasat S, Yu SS, Neel VA, Nehal KS, Lardaro T, Mihm MC, Byrd DR, Balch CM, Califano JA, Chuang AY, et al. A new American joint committee on cancer staging system for cutaneous squamous cell carcinoma: creation and rationale for inclusion of tumor (T) characteristics. J Am Acad Dermatol. 2011;64(6):1051–9.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Lydiatt WM, Patel SG, O’Sullivan B, Brandwein MS, Ridge JA, Migliacci JC, Loomis AM, Shah JP. Head and Neck cancers-major changes in the American Joint Committee on cancer eighth edition cancer staging manual. CA Cancer J Clin. 2017;67(2):122–37.

    Article  PubMed  Google Scholar 

  15. Karia PS, Jambusaria-Pahlajani A, Harrington DP, Murphy GF, Qureshi AA, Schmults CD. Evaluation of American Joint Committee on Cancer, International Union Against Cancer, and Brigham and Women’s Hospital tumor staging for cutaneous squamous cell carcinoma. J Clin Oncol. 2014;32(4):327–34.

    Article  PubMed  Google Scholar 

  16. Stratigos AJ, Garbe C, Dessinioti C, Lebbe C, Bataille V, Bastholt L, Dreno B, Fargnoli MC, Forsea AM, Frenard C, et al. European interdisciplinary guideline on invasive squamous cell carcinoma of the skin: Part 1. epidemiology, diagnostics and prevention. Eur J Cancer. 2020;128:60–82.

    Article  CAS  PubMed  Google Scholar 

  17. Squamous cell skin cancer (Version 1.2021). External link https://www.nccn.org/professionals/physician_gls/pdf/squamous.pdf

  18. Ruiz ES, Karia PS, Besaw R, Schmults CD. Performance of the American Joint Committee on Cancer staging manual, 8th edition vs the Brigham and Women’s Hospital Tumor Classification System for cutaneous squamous cell carcinoma. JAMA Dermatol. 2019;155(7):819–25.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Breuninger H, Brantsch K, Eigentler T, Hafner HM. Comparison and evaluation of the current staging of cutaneous carcinomas. J Dtsch Dermatol Ges. 2012;10(8):579–86.

    PubMed  Google Scholar 

  20. Roscher I, Falk RS, Vos L, Clausen OPF, Helsing P, Gjersvik P, Robsahm TE. Validating 4 staging systems for cutaneous squamous cell carcinoma using population-based data: a nested case-control study. JAMA Dermatol. 2018;154(4):428–34.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Zhao G, Kim KY, Zheng Z, Oh Y, Yoo DS, Lee ME, Chung KY, Roh MR, Jin Z. AXIN2 and SNAIL expression predict the risk of recurrence in cutaneous squamous cell carcinoma after Mohs micrographic surgery. Oncol Lett. 2020;19(3):2133–40.

    CAS  PubMed  PubMed Central  Google Scholar 

  22. Zhao G, Bae JY, Zheng Z, Park HS, Chung KY, Roh MR, Jin Z. Overexpression and implications of melanoma-associated antigen A12 in pathogenesis of human cutaneous squamous cell carcinoma. Anticancer Res. 2019;39(4):1849–57.

    Article  CAS  PubMed  Google Scholar 

  23. Zhang X, Zheng Z, Shin YK, Kim KY, Rha SY, Noh SH, Chung HC, Jeung HC. Angiogenic factor thymidine phosphorylase associates with angiogenesis and lymphangiogenesis in the intestinal-type gastric cancer. Pathology. 2014;46(4):316–24.

    Article  CAS  PubMed  Google Scholar 

  24. Harrell FE Jr, Califf RM, Pryor DB, Lee KL, Rosati RA. Evaluating the yield of medical tests. JAMA. 1982;247(18):2543–6.

    Article  PubMed  Google Scholar 

  25. Lubsen J, Pool J, van der Does E. A practical device for the application of a diagnostic or prognostic function. Methods Inf Med. 1978;17(2):127–9.

    Article  CAS  PubMed  Google Scholar 

  26. Kattan MW, Shariat SF, Andrews B, Zhu K, Canto E, Matsumoto K, Muramoto M, Scardino PT, Ohori M, Wheeler TM, et al. The addition of interleukin-6 soluble receptor and transforming growth factor beta1 improves a preoperative nomogram for predicting biochemical progression in patients with clinically localized prostate cancer. J Clin Oncol. 2003;21(19):3573–9.

    Article  CAS  PubMed  Google Scholar 

  27. Kattan MW, Karpeh MS, Mazumdar M, Brennan MF. Postoperative nomogram for disease-specific survival after an R0 resection for gastric carcinoma. J Clin Oncol. 2003;21(19):3647–50.

    Article  PubMed  Google Scholar 

  28. Kerr KF, McClelland RL, Brown ER, Lumley T. Evaluating the incremental value of new biomarkers with integrated discrimination improvement. Am J Epidemiol. 2011;174(3):364–74.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Pencina MJ, D’Agostino RB Sr, Demler OV. Novel metrics for evaluating improvement in discrimination: net reclassification and integrated discrimination improvement for normal variables and nested models. Stat Med. 2012;31(2):101–13.

    Article  PubMed  Google Scholar 

  30. Shapanis A, Lai C, Smith S, Coltart G, Sommerlad M, Schofield J, Parkinson E, Skipp P, Healy E. Identification of proteins associated with development of metastasis from cutaneous squamous cell carcinomas (cSCCs) via proteomic analysis of primary cSCCs. Br J Dermatol. 2021;184(4):709–21.

    Article  CAS  PubMed  Google Scholar 

  31. Oren M. Decision making by p53: life, death and cancer. Cell Death Differ. 2003;10(4):431–42.

    Article  CAS  PubMed  Google Scholar 

  32. Bennett WP, Hussain SP, Vahakangas KH, Khan MA, Shields PG, Harris CC. Molecular epidemiology of human cancer risk: gene-environment interactions and p53 mutation spectrum in human lung cancer. J Pathol. 1999;187(1):8–18.

    Article  CAS  PubMed  Google Scholar 

  33. Missero C, Antonini D. Crosstalk among p53 family members in cutaneous carcinoma. Exp Dermatol. 2014;23(3):143–6.

    Article  CAS  PubMed  Google Scholar 

  34. Florence ME, Massuda JY, Soares TC, Stelini RF, Poppe LM, Brocker EB, Metze K, Cintra ML, de Souza EM. p53 immunoexpression in stepwise progression of cutaneous squamous cell carcinoma and correlation with angiogenesis and cellular proliferation. Pathol Res Pract. 2015;211(10):782–8.

    Article  CAS  PubMed  Google Scholar 

  35. Campos MA, Macedo S, Fernandes MS, Pestana A, Pardal J, Batista R, Vinagre J, Sanches A, Baptista A, Lopes JM, et al. Prognostic significance of RAS mutations and P53 expression in cutaneous squamous cell carcinomas. Genes (Basel). 2020;11(7):751.

    Article  CAS  PubMed Central  Google Scholar 

  36. Polakis P. Casein kinase 1: a Wnt’er of disconnect. Curr Biol. 2002;12(14):R499–501.

    Article  CAS  PubMed  Google Scholar 

  37. Wu ZQ, Brabletz T, Fearon E, Willis AL, Hu CY, Li XY, Weiss SJ. Canonical Wnt suppressor, Axin2, promotes colon carcinoma oncogenic activity. Proc Natl Acad Sci U S A. 2012;109(28):11312–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  38. Major MB, Roberts BS, Berndt JD, Marine S, Anastas J, Chung N, Ferrer M, Yi X, Stoick-Cooper CL, von Haller PD, et al. New regulators of Wnt/beta-catenin signaling revealed by integrative molecular screening. Sci Signal. 2008;1(45):ra12.

    Article  PubMed  Google Scholar 

  39. Ahn SY, Kim NH, Lee K, Cha YH, Yang JH, Cha SY, Cho ES, Lee Y, Cha JS, Cho HS, et al. Niclosamide is a potential therapeutic for familial adenomatosis polyposis by disrupting Axin-GSK3 interaction. Oncotarget. 2017;8(19):31842–55.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Zhang X, Kim KY, Zheng Z, Kim HS, Cha IH, Yook JI. Snail and Axin2 expression predict the malignant transformation of oral leukoplakia. Oral Oncol. 2017;73:48–55.

    Article  CAS  PubMed  Google Scholar 

  41. Yook JI, Li XY, Ota I, Hu C, Kim HS, Kim NH, Cha SY, Ryu JK, Choi YJ, Kim J, et al. A Wnt-Axin2-GSK3beta cascade regulates Snail1 activity in breast cancer cells. Nat Cell Biol. 2006;8(12):1398–406.

    Article  CAS  PubMed  Google Scholar 

  42. Kim NH, Cha YH, Kang SE, Lee Y, Lee I, Cha SY, Ryu JK, Na JM, Park C, Yoon HG, et al. p53 regulates nuclear GSK-3 levels through miR-34-mediated Axin2 suppression in colorectal cancer cells. Cell Cycle. 2013;12(10):1578–87.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  43. Iasonos A, Schrag D, Raj GV, Panageas KS. How to build and interpret a nomogram for cancer prognosis. J Clin Oncol. 2008;26(8):1364–70.

    Article  PubMed  Google Scholar 

  44. Balachandran VP, Gonen M, Smith JJ, DeMatteo RP. Nomograms in oncology: more than meets the eye. Lancet Oncol. 2015;16(4):e173-180.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Bertolli E, de Macedo MP, Calsavara VF, Pinto CAL, Duprat Neto JP. A nomogram to identify high-risk melanoma patients with a negative sentinel lymph node biopsy. J Am Acad Dermatol. 2019;80(3):722–6.

    Article  PubMed  Google Scholar 

  46. Jeong SH, Kim RB, Park SY, Park J, Jung EJ, Ju YT, Jeong CY, Park M, Ko GH, Song DH, et al. Nomogram for predicting gastric cancer recurrence using biomarker gene expression. Eur J Surg Oncol. 2020;46(1):195–201.

    Article  PubMed  Google Scholar 

  47. Rocco B, Sighinolfi MC, Sandri M, Puliatti S, Bianchi G. A novel nomogram for predicting ECE of prostate cancer. BJU Int. 2018;122(6):916–8.

    Article  PubMed  Google Scholar 

  48. Su J, Miao LF, Ye XH, Cui MS, He XF. Development of prognostic signature and nomogram for patients with breast cancer. Medicine (Baltimore). 2019;98(11):e14617.

    Article  CAS  Google Scholar 

  49. Wang S, Yang L, Ci B, Maclean M, Gerber DE, Xiao G, Xie Y. Development and validation of a nomogram prognostic model for SCLC patients. J Thorac Oncol. 2018;13(9):1338–48.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Wang SJ, Patel SG, Shah JP, Goldstein DP, Irish JC, Carvalho AL, Kowalski LP, Lockhart JL, Holland JM, Gross ND. An oral cavity carcinoma nomogram to predict benefit of adjuvant radiotherapy. JAMA Otolaryngol Head Neck Surg. 2013;139(6):554–9.

    PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable

Funding

This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (No. 2020R1A2C1102987) and faculty research grant of Yonsei University College of Medicine (No. 6–2019-0083).

Author information

Authors and Affiliations

Authors

Contributions

Methodology, Y.O., Z.Z., and K.Y.K.; Software, K.Y.K. and M.L.P.; Validation, X.X, B.O., and S.K.K; Formal analysis, Y.O. and K.Y.K.; Investigation: Y.O. and K.Y.K.; Writing-original draft preparation: Y.O. and Z.Z.; Writing-review and editing, B.O., S.K.K., K.Y.C, and M.R.R.; Supervision, K.Y.C., M.R.R.. All authors have read and agreed to the published version of the manuscript.

Corresponding authors

Correspondence to Kee Yang Chung or Mi Ryung Roh.

Ethics declarations

Ethics approval and consent to participate

All methods were carried out in accordance with relevant guidelines and regulations. The study was approved by Institutional Review Board for Bioethics of Yonsei University Health System, Severance Hospital (4–2018-0331) in accordance with the Declaration of Helsinki. All individual participants provided written informed consent.

Consent for publication

Not applicable.

Competing interests

Authors declare no Competing Interest for this article. It is the responsibility of the corresponding author to review this policy with all authors.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Oh, Y., Zheng, Z., Kim, KY. et al. A nomogram combining clinical factors and biomarkers for predicting the recurrence of high-risk cutaneous squamous cell carcinoma. BMC Cancer 22, 1126 (2022). https://doi.org/10.1186/s12885-022-10213-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12885-022-10213-2

Keywords