- Research article
- Open Access
Novel nomogram to predict risk of bone metastasis in newly diagnosed thyroid carcinoma: a population-based study
BMC Cancer volume 20, Article number: 1055 (2020)
The aim of this study was to develop and validate a visual nomogram for predicting the risk of bone metastasis (BM) in newly diagnosed thyroid carcinoma (TC) patients.
The demographics and clinicopathologic variables of TC patients from 2010 to 2015 in the Surveillance, Epidemiology and End Results (SEER) database were retrospectively reviewed. Chi-squared (χ2) test and logistic regression analysis were performed to identify independent risk factors. Based on that, a predictive nomogram was developed and validated for predicting the risk of BM in TC patients. The C-index was used to compute the predictive performance of the nomogram. Calibration curves and decision curve analysis (DCA) were furthermore used to evaluate the clinical value of the nomogram.
According to the inclusion and exclusion criteria, the data of 14,772 patients were used to analyze in our study. After statistical analysis, TC patients with older age, higher T stage, higher N stage, poorly differentiated, follicular thyroid carcinoma (FTC) and black people had a higher risk of BM. We further developed a nomogram with a C-index of 0.925 (95%CI,0.895–0.948) in the training set and 0.842 (95%CI,0.777–0.907) in the validation set. The calibration curves and decision curve analysis (DCA) also demonstrated the reliability and accuracy of the clinical prediction model.
The present study developed a visual nomogram to accurately identify TC patients with high risk of BM, which might help to further provide more individualized clinical decision guidelines.
Thyroid carcinoma (TC) is the most common type of endocrine malignancy, for which incidence has grown rapidly worldwide during the past few decades [1, 2]. Owing to biological characteristics and effective therapeutic responses, TC has a favorable long-term prognosis, with an average 10-year overall survival of approximately 90% [3, 4]. However, the overall prognosis worsens significantly once patients develop distant metastasis (DM), as the 10-year survival drops to 40% [5,6,7]. Even more noteworthy, approximately 70% of TC patients with DM die within four years of diagnosis .
Bone metastasis (BM) is a typical metastatic pattern for TC patients. It was reported that BM occur in about 4% of all TC patients , and the 5- and 10-year survival rates of TC patients with BM are 61 and 27%, respectively . The majority of thyroid carcinoma metastases are asymptomatic and are detected only upon systemic surveillance or a full-body metastatic examination of malignant thyroid nodules. It is extremely rare to present with symptomatic DM as the sole initial manifestation in the absence of neck swelling . Due to the low incidence of BM and its asymptomatic nature, the work-up regarding BM is mostly ignored during the primary diagnoses of TC patients. Patients are often advised to perform whole-body nuclear medicine bone scanning or PET-CT only when they develop suspicious symptoms of skeletal-related events (SREs). Azeez Farooki et al. reported that the median SRE time was 5 months after BM . At this time, most of patients with TC have likely developed the advanced stage or multiple metastases have occurred, which means the optimal chance of treatment for TC patients will be missed. In 2019, Kim H et al. conducted a retrospective study to evaluate the usefulness of early detection in asymptomatic DM in patients with TC and found that early identification had a significant positive impact on survival outcomes for asymptomatic DM patients with TC after 2004 . A clinical risk model of predicting BM appears to be a helpful tool to clarify how likely a TC patient is to suffer from BM and identify those TC patients with high risk of BM and who should be advised to perform more individualized and purposeful inspection and surveillance plans. Published studies have identified many risk factors of BM including age, histological type, tumour size, marked hypoechogenicity and nodule-in-nodule appearance [8, 13,14,15]. Nevertheless, no research has focused on the development of an ideal model for predicting BM in TC, which means that the probability of BM cannot be quantified.
Therefore, based on the population-based data from the Surveillance, Epidemiology, and End Results (SEER) database, we aimed to develop and validate a nomogram for predicting the risk of BM in newly diagnosed TC patients. This study might help to further provide more individualized clinical decision guidelines and the rational allocation of health resources.
The subjects included in the present study were obtained from the Surveillance, Epidemiology, and End Results (SEER) Program. Patient data were downloaded from the SEER∗Stat 8.3.6 Database. We limited this study to between 2010 and 2015 because the information about site-specific metastasis was only available from 2010 and onward. The TC patients included in our research were diagnosed by histological examination, and BM was diagnosed by imaging examination and/or pathological examination. Meanwhile, the exclusion criteria were as follows: (1) the information of race, tumor size, grade, T stage, N stage, bone metastatic status, insurance status and marital status was unknown; (2) TC was not the first tumor. Because the SEER database does not release personal identification information, ethical approval and consent were not required for this study. Figure 1displays the flow chart of the patient selection procedure in this study. All included cases were staged using the 7th edition of the AJCC TNM staging system.
In the present study, 11 variables were included to identify the independent risk factors of BM from TC. The demographic variables included sex, race, age at diagnosis, insurance status and marital status. The clinicopathological variables included histology, grade, T stage, N stage and tumor size, laterality, Histology was classified into four categories with the following IDO-O-3 codes: “8340. 8341.8342.8344.8260. Papillary thyroid carcinoma (PTC)”; “8330. 8331. 8335. Follicular thyroid carcinoma (FTC)”; “8020.8021.8030. 8032. Anaplastic thyroid carcinoma (ATC)”; and “8510.Medullary thyroid carcinoma (MTC)”. “Unmarried”, “separated”, “single”, “widow” and “divorced” were included in the unmarried group and the“ any medicaid”, “insured” and “insured/no specific” were included in the insurance group. All methods were performed in accordance with the relevant guidelines of the SEER database.
All statistical analysis in our research was performed in R software (version 3.6.1, R Foundation for Statistical Computing, Austria) (http://www.r-project.org/) and SPSS (version 25, IBM, USA) [16, 17]. The process of classifying patients in the training and validation sets was completely randomized and was performed in R software. The chi-squared test was used to compare variables between the training set and the testing set. In the univariate analysis, the chi-squared test or Fisher’s exact test was used to compared the variables between patients with BM and without BM. Variables with p value< 0.05 in the univariate analysis were further integrated into the multivariate logistic regression analysis. Then, the independent risk factors of BM in TC patients were identified. Based on that, a nomogram was established by rms package in R. Meanwhile, the performance of prediction and discrimination was assessed by Harrell’s concordance index (C-index) which was calculated using the function concordance index. The value of the C-index should range from 0.5 to 1.0, with 0.5 indicating random chance and 1.0 indicating a perfectly corrected discrimination . The receiver operating characteristic (ROC) curve was plotted to show the prediction power of each risk factor and the independent BM-related factors combined model, and the area under curve (AUC) value was also listed. Higher AUC presented a higher prediction power. Calibration curves and decision curve analysis (DCA) were furthermore used to evaluate the clinical value of the nomogram . P value< 0.05 (two-sided) was considered as statistically significant.
According to the inclusion and exclusion criteria, 14,772 patients were finally included to identify the risk factors of BM in TC patients. Among these, 120 cases (0.8%) had BM at initial diagnosis and 14,652 cases (99.2%) were without BM. All patients were classified into the training set (10,340 cases) and the validation set (4432 cases), with a ratio of approximately 7:3. In the training set, 24.2% patients were male, and the majority was White in race distribution (80.31%). For grade, 79.9% TC patients were Grade I. The most common T stage and N stage were T1(55.4%) and N0(74.3%), respectively. The demographic and clinicopathological information for all patients is shown in Table 1.
Independent risk factors for BM from TC
To investigate the independent BM-related factors, univariate analysis was performed. The results of univariate analysis are illustrated in Table 2. Several variables showed significant differences between patients with and without BM, including age, race, sex, tumor size, histology, grade, T stage and N stage, (All p value< 0.05). Then, the multivariate logistic regression analysis (forward LR) was performed, and six variables were determined to be independent risk factors, including age at diagnosis(P < 0.001), race(P < 0.001), grade(P = 0.001), and, histology(P = 0.013), T stage(P < 0.001) and N stage(P = 0.048). (Table 3).
Development and validation of the nomogram
Based on the independent risk factors, a nomogram was established (Fig. 2). The total score value of each individual patient was obtained by adding the corresponding scores of different categories of each independent risk factor, and then corresponding total points scale represented the probability of BM of this patient. The C-indexes in the training set and validation set were 0.925(95%CI,0.895–0.948) and 0.842(95%CI,0.777–0.907), respectively, which indicates that the nomogram performs well in predicting BM of TC patients. Meanwhile, ROC curves of both the training set and validation set were generated and illustrated in Fig. 3. Remarkably, the ROC curves of each independent predictor were also generated (Fig. 4). The AUC of the combined model was the highest, which indicated the combined model showed the highest prediction power of BM at diagnosis. In addition, the favorable calibration curve of our nomogram is shown in Fig. 5, which indicated that the prediction by the nomogram is highly consistent with the actual observations. Finally, DCA indicated that this nomogram can serve as an excellent diagnostic tool for predicting BM in newly diagnosed TC patients (Fig. 6).
BM frequently deteriorates the quality of life by inducing severe bone pain, spinal cord compression, pathological fracture and other SREs. Farooki A et al. have found that approximately 78% TC patients with BM develop at least one SRE . Orita Y et al. observed 52 DTC patients with BM that constituted 3.7% of 1398 patients . A recent study also reported a similar result wherein BM occurred in 3.9% (1173 cases) of the TC patients . Here, we found that the proportion of BM incidence (0.8%) in TC patients was much less than previous reports. This can be attributed to the rare incidence of synchronous BM recorded in the SEER database instead of metachronous BM in other studies. Synchronous BM diagnosed in TC patients is very rare, in other words, a majority of BM develops during clinical follow-up after the primary diagnosis of TC. Iñiguez-Ariza NM and colleagues conducted a systematic review and suggested that the natural disease course of BM from TC may vary by demographic factor and tumor characteristics . The early identification of BM at the initial diagnosis of TC has great significance for receiving appropriate treatment and improving prognosis. To better address this issue, we used a population-based database to identify independent risk factors for BM and developed a prediction model based on demographics and tumor characteristics to predict the risk of BM in patients with newly diagnosed TC.
In the present study, we found six independent predictors associated with BM, including age at diagnosis, histology, grade, T stage, N stage and race. More importantly, we developed and validated a diagnostic nomogram for the purpose of predicting BM in newly diagnosed TC patients. The total score can be calculated through collecting the information of several variables on the nomogram of every TC patient. Then, the risk of BM can be identified from the nomogram with ease. Meanwhile, this predictive model demonstrated excellent performance in the risk assessment of BM from TC, which will make personalized medical decision-making and surveillance more accurate. Although SRE has long been identified as a sign of bone metastatic disease, it is unreasonable to consider BM and perform targeted investigations in thyroid cancer patients only when they have symptoms of bone involvement. Thus, proactive attention should be given to patients with TC who have been identified by nomogram as having a high risk of BM. In a previous study, Goffredo P et al. found that the risk of DM for younger TC patients was significantly lower compared with elderly patients . Similarly, age at diagnosis was identified as an independent predictor of BM in TC patients in our study(P < 0.001). More evidence now suggests that the biological characteristics of tumors play a crucial role in disease progression, which could be closely associated with the initiation and development of BM. Vuong HG and colleagues performed a meta-analysis and found that tumor size, multifocality, vascular invasion (VI), extrathyroidal extension (ETE), lymph node metastasis (LNM), and lateral LNM were associated with significant risks for DM . Liu Z et al. suggested that LNM has a synergic effect with either follicular thyroid histology or larger tumor size for a higher risk of DM, which is important for predicting and diagnosing DM . Here, we found that T stage and N stage were independent risk factors associated with BM in TC patients. We also found that patients with poorly or undifferentiated tumors were more prone to have BM. This might be because cancer cells have the capability of invading surrounding tissues, capillaries and lymphatics with stronger growth potential to develop early metastasis. These findings are in agreement with the research of other scholars . TC was highly heterogeneous in terms of its molecular and clinical properties, and consist of four main subtypes that are associated with different tendencies of BM. As previously noted by Do M Y et al. , although PTC is the most frequent type of TC, FTC is more prone to BM. The results of multivariate logistic regression analysis showed that the risk of BM was highest in FTC. It is therefore possible and reasonable that blood vessel invasion is more common in FTC than in PTC.
There are several strengths of this study. First of all, it was a population-based study with a large sample size that included all types of TC, and the results of this study are therefore of good representative and clinical guidance value. Besides, at the molecular level, osteocalcin, cDNA and the expression of focal adhesion kinase (FAK), Integrin αvβ3 and cDNA were thought to be associated with BM from TC [25,26,27,28]. However, these biomarkers were inconvenient and impractical to apply promptly to clinical decision-making. The independent risk factors identified in this study are common clinical predictors, which can be easily accessed in routine clinical practice routine clinical practice. Most importantly, a nomogram with excellent performance was developed to identify the individual risk of BM from TC by combining all independent predictors, which means that the probability of BM can be quantified.
Despite these advantages, this study still faces several limitations. First, as a retrospective study, potential selection bias was inevitable. Second, the information recorded in the SEER database was descriptive of the disease at the initial diagnosis, which indicates that treatment data cannot be included in the prediction analysis of BM from TC. Third, the nomogram provided a relative reference for clinical doctors. Some other factors that are relevant to the risk of BM in TC are likely to exist in the clinical environment.
Our study suggests that age, race, histology, grade, T stage and N stage are independent BM-related risk factors for TC. Furthermore, the predictive nomogram we created is expected to be a convenient, personalized and visual clinical tool for risk assessment of BM in newly diagnosed TC.
Availability of data and materials
The datasets generated and/or analyzed during the current study are available in the SEER database (https://seer.cancer.gov/).
Thyroid carcinoma with bone metastasis
Surveillance, Epidemiology and End Results
Receiver operating characteristic curve
Area under the curve
Decision curve analyses
Papillary thyroid carcinoma
Follicular thyroid carcinoma
Anaplastic thyroid carcinoma
Medullary thyroid carcinoma
Lymph node metastasis
Siegel RL, Miller KD, Jemal A. Cancer statistics, 2020. CA Cancer J Clin. 2020;70(1):7–30.
La Vecchia C, Malvezzi M, Bosetti C, Garavello W, Bertuccio P, Levi F, Negri E. Thyroid cancer mortality and incidence: a global overview. Int J Cancer. 2015;136(9):2187–95.
Yang L, Shen W, Sakamoto N. Population-based study evaluating and predicting the probability of death resulting from thyroid cancer and other causes among patients with thyroid cancer. J Clin Oncol. 2013;31(4):468–74.
Liu M, Ruan M, Chen L. Update on the molecular diagnosis and targeted therapy of thyroid cancer. Med Oncol (Northwood, London, England). 2014;31(6):973.
Mazzaferri EL, Kloos RT. Clinical review 128: current approaches to primary therapy for papillary and follicular thyroid cancer. J Clin Endocrinol Metab. 2001;86(4):1447–63.
Farooki A, Leung V, Tala H, Tuttle RM. Skeletal-related events due to bone metastases from differentiated thyroid cancer. J Clin Endocrinol Metab. 2012;97(7):2433–9.
Durante C, Haddy N, Baudin E, Leboulleux S, Hartl D, Travagli JP, Caillou B, Ricard M, Lumbroso JD, De Vathaire F, et al. Long-term outcome of 444 patients with distant metastases from papillary and follicular thyroid carcinoma: benefits and limits of radioiodine therapy. J Clin Endocrinol Metab. 2006;91(8):2892–9.
Iñiguez-Ariza NM, Bible KC, Clarke BL. Bone metastases in thyroid cancer. J Bone Oncol. 2020;21:100282.
Choksi P, Papaleontiou M, Guo C, Worden F, Banerjee M, Haymart M. Skeletal complications and mortality in thyroid Cancer: a population-based study. J Clin Endocrinol Metab. 2017;102(4):1254–60.
Wu D, Lima CJG, Moreau SL, Kulkarni K, Zeymo A, Burman KD, Wartofsky L, Van Nostrand D. Improved survival after multimodal approach with I treatment in patients with bone metastases secondary to differentiated thyroid Cancer. Thyroid. 2019;29(7):971–8.
See A, Iyer NG, Tan NC, Teo C, Ng J, Soo KC, Tan HK. Distant metastasis as the sole initial manifestation of well-differentiated thyroid carcinoma. Eur Arch Oto-rhino-laryngol. 2017;274(7):2877–82.
Kim H, Park SY, Jung J, Kim JH, Hahn SY, Shin JH, Oh YL, Chung MK, Kim HI, Kim SW, et al. Improved survival after early detection of asymptomatic distant metastasis in patients with thyroid cancer. Sci Rep. 2019;9(1):18745.
Kim H, Shin JH, Hahn SY, Oh YL, Kim SW, Park KW, Lim Y. Prediction of follicular thyroid carcinoma associated with distant metastasis in the preoperative and postoperative model. Head Neck. 2019;41(8):2507–13.
Lee YM, Song DE, Kim TY, Sung TY, Yoon JH, Chung KW, Hong SJ. Risk factors for distant metastasis in patients with minimally invasive follicular thyroid carcinoma. PLoS One. 2016;11(5):e0155489.
Vuong HG, Duong UNP, Pham TQ, Tran HM, Oishi N, Mochizuki K, Nakazawa T, Hassell L, Katoh R, Kondo T. Clinicopathological risk factors for distant metastasis in differentiated thyroid carcinoma: a meta-analysis. World J Surg. 2018;42(4):1005–17.
Hackenberger BK. R software: unfriendly but probably the best. Croat Med J. 2020;61(1):66–8.
Khan AM. R-software: a newer tool in epidemiological data analysis. Indian J Commun Med. 2013;38(1):56–8.
Harrell FE, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361–87.
Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decision Mak. 2006;26(6):565–74.
Orita Y, Sugitani I, Matsuura M, Ushijima M, Tsukahara K, Fujimoto Y, Kawabata K. Prognostic factors and the therapeutic strategy for patients with bone metastasis from differentiated thyroid carcinoma. Surgery. 2010;147(3):424–31.
Goffredo P, Sosa JA, Roman SA. Differentiated thyroid cancer presenting with distant metastases: a population analysis over two decades. World J Surg. 2013;37(7):1599–605.
Liu Z, Chen S, Huang Y, Hu D, Zeng W, Wang M, Zhou W, Chen D, Feng H, Wei W, et al. Synergic effects of histology subtype, tumor size, and lymph node metastasis on distant metastasis in differentiated thyroid cancer. Ann Transl Med. 2019;7(20):533.
Sugino K, Ito K, Nagahama M, Kitagawa W, Shibuya H, Ohkuwa K, Yano Y, Uruno T, Akaishi J, Kameyama K, et al. Prognosis and prognostic factors for distant metastases and tumor mortality in follicular thyroid carcinoma. Thyroid. 2011;21(7):751–7.
Do MY, Rhee Y, Kim DJ, Kim CS, Nam KH, Ahn CW, Cha BS, Kim KR, Lee HC, Park CS, et al. Clinical features of bone metastases resulting from thyroid cancer: a review of 28 patients over a 20-year period. Endocr J. 2005;52(6):701–7.
Kessler BE, Sharma V, Zhou Q, Jing X, Pike LA, Kerege AA, Sams SB, Schweppe RE. FAK expression, not kinase activity, is a key mediator of thyroid tumorigenesis and Protumorigenic processes. Mol Cancer Res. 2016;14(9):869–82.
Chen KT, Lin JD, Chao TC, Hsueh C, Chang CA, Weng HF, Chan EC. Identifying differentially expressed genes associated with metastasis of follicular thyroid cancer by cDNA expression array. Thyroid. 2001;11(1):41–6.
Pécheur I, Peyruchaud O, Serre CM, Guglielmi J, Voland C, Bourre F, Margue C, Cohen-Solal M, Buffet A, Kieffer N, et al. Integrin alpha(v)beta3 expression confers on tumor cells a greater propensity to metastasize to bone. FASEB J. 2002;16(10):1266–8.
Gao Y, Lu H, Luo Q, Wu X, Sheng S. Predictive value of osteocalcin in bone metastatic differentiated thyroid carcinoma. Clin Biochem. 2010;43(3):291–5.
We are thankful for the contribution of the SEER database and the 18 registries supplying cancer research information, and we thank all colleagues involved in the study for their contributions.
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Ethics approval and consent to participate
We received permission to access the research data file in the SEER program from the National Cancer Institute, US (reference number 15260-Nov2018). Approval was waived by the local ethics committee, as SEER data is publicly available and de-identified.
Consent for publication
All authors declare no conflicts of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Tong, Y., Hu, C., Huang, Z. et al. Novel nomogram to predict risk of bone metastasis in newly diagnosed thyroid carcinoma: a population-based study. BMC Cancer 20, 1055 (2020). https://doi.org/10.1186/s12885-020-07554-1
- Thyroid carcinoma
- risk factors
- SEER database