- Research article
- Open Access
- Open Peer Review
Prognostic model for predicting overall survival in children and adolescents with rhabdomyosarcoma
BMC Cancervolume 14, Article number: 654 (2014)
The purpose of this study was to develop a prognostic model for the survival of pediatric patients with rhabdomyosarcoma (RMS) using parameters that are measured during routine clinical management.
Demographic and clinical variables were evaluated in 1679 pediatric patients with RMS registered in the Surveillance, Epidemiology, and End Results (SEER) program from 1990 to 2010. A multivariate Cox proportional hazards model was developed to predict median, 5-year and 10-year overall survival (OS). The Akaike information criterion technique was used for model selection. A nomogram was constructed using the reduced model after model selection, and was internally validated.
Of the total 1679 patients, 543 died. The 5-year OS rate was 64.5% (95% confidence interval (CI), 62.1-67.1%) and the 10-year OS was 61.8% (95%CI, 59.2-64.5%) for the entire cohort. Multivariate analysis identified age at diagnosis, tumor size, histological type, tumor stage, surgery and radiotherapy as significantly associated with survival (p < 0.05). The bootstrap-corrected c-index for the model was 0.74. The calibration curve suggested that the model was well calibrated for all predictions.
This study provided an objective analysis of all currently available data for pediatric RMS from the SEER cancer registry. A nomogram based on parameters that are measured on a routine basis was developed. The nomogram can be used to predict 5- and 10-year OS with reasonable accuracy. This information will be useful for estimating prognosis and in guiding treatment selection.
Rhabdomyosarcoma (RMS) is the most common soft-tissue sarcoma in children and adolescents and accounts for 3% of all pediatric tumors . Approximately 350 children are diagnosed with RMS in the United States every year . Incidence peaks at a very young age. Because RMS is derived from immature striated skeletal muscle, this disease can occur at any site in the body. Prognosis of RMS has improved significantly, with multidisciplinary management accounting for most of the increase in survival rate. Since 1972, the Intergroup Rhabdomyosarcoma Study Group (IRSG) has conducted a series of clinical trials and published a series of treatment guidelines for different primary sites. As a result, the long-term survival rate of these patients has nearly tripled from approximately 25% in 1970 to more than 70% in the 1990s [3, 4].
The rarity of this disease means that most information regarding survival is derived from these clinical trials. However, overall survival (OS) results differ between clinical trials and population-based cancer registries because of important differences between patients treated in routine practice and those treated in clinical trials. For example, IRSG reports showed a 5-year OS of 70% in the 1990s [3, 4], while, even in the 2000s, the 5-year OS was only approximately 50% in children with RMS according to population-based data . Clinical trials may select participants based on strict inclusion criteria, which consider the extent of disease, previous history of treatment, comorbidities, psychosocial conditions and other factors ; patients in a poor condition may thus be excluded from the protocol. OS in trials may therefore not reflect the prognosis of patients who receive treatment in a community setting.
Individualized estimation of the prognosis could be useful for counseling cancer patients on treatment selection and for optimizing therapeutic approaches . However, to the best of our knowledge, there is currently no such estimation tool for RMS based on patients from the general population. In this study, we analyzed the OS in children and adolescents with RMS using population-based data collected by the Surveillance, Epidemiology, and End Results (SEER) program of the National Cancer Institute (NCI) , and constructed a nomogram based on variables collected from the routine cancer registry, with the aim of providing clinicians and patients with a practical clinical tool to predict survival.
The data were derived from the SEER program, which collects demographic, diagnostic and treatment information on all newly diagnosed cancer patients residing within specific US geographic regions. Registry data are submitted without personal identifiers to the NCI, and these data are publicly available for research purpose. Because all information in public-use SEER database remains de-identified, approval by an ethics committee was not necessary to perform the analysis . All authors have signed the data-use agreement and got permission from SEER program to use this data.
Using the SEER registry public database, we identified patients with RMS diagnosed from 1990 to 2010 . Children diagnosed with malignant, first primary RMS and aged 0–19 years were eligible for this analysis. In this study, eligible RMS cases had International Classification of Childhood Cancer (ICCC) code IXa, corresponding to ICO-O-3 morphology codes: 1) RMS not otherwise specified 8900/3; 2) pleomorphic RMS adult-type 8901/3; 3) mixed-type RMS 8902/3; 4) embryonal RMS 8910/3; 5) spindle cell RMS 8912/3; 6) alveolar RMS 8920/3; or 7) embryonal sarcoma 8991/3. Patients were excluded from the analysis if the diagnosis was made at autopsy or by death certificate only. Patients with no confirmation of diagnosis by microscopy were also excluded. After selection, there were 1679 cases left in the cohort. The flow chart for data selection is shown in Figure 1.
In the description of variables and calculation of OS, age at diagnosis was classified as 0–4, 5–9, 10–14 or 15–19 years. Age at diagnosis was treated as a continuous variable in multivariate analysis. Other clinical factors included primary tumor site, histologic tumor subtype, tumor stage, tumor size, surgery and radiotherapy (RT). Primary tumor sites were classified as favorable or unfavorable based on the criteria for staging of pediatric tumors . The head and neck (nonparameningeal), genitourinary (non-bladder/prostate), and bile duct regions were defined as favorable sites, all other sites were defined as unfavorable, and an unknown site was regarded as a missing value. Histology was classified as embryonal, alveolar or other histological subtype. Histological subtypes with RMS not otherwise specified were treated as missing values. Tumor stage was classified according to the SEER historic staging system. Cases with insufficient information to define the stage were regarded as having a missing value. Tumor size was truncated at 20 cm and was grouped into three levels for both character description and calculation of OS: 1) 0–4 cm; 2) 5–9 cm; and 3) ≥10 cm. Size was treated as a continuous variable in the multivariate model.
All missing values were imputed with the ‘transcan’ function of the rms package . OS was calculated by the Kaplan-Meier product-limited method. Survival curves were compared using the log-rank test. Cox proportional hazard regressions were performed to assess the effects of covariates on OS. For continuous variables, we fitted restricted cubic splines with three knots at 10%, 50% and 90% empirical quantiles. We also considered the interaction effect between surgery and RT. The proportional hazard assumption was justified by examining residual plots. The Akaike information criterion was utilized for model selection. We constructed a nomogram with the beta coefficients of variables in the reduced model.
The model was internally validated. We generated 200 bootstrap samples to determine the calibration and discrimination of the model. Calibration refers to the ability of a model to make unbiased estimates of outcome. Calibration was assessed using a calibration curve generated by plotting the model-predicted 5-year and 10-year survival probabilities against the observed probability, as calculated by the Kaplan-Meier method. The prognostic accuracy of the model was quantified by computing the concordance index (c-index) described by Harrell et al. . The c-index is a discrimination measure that estimates the probability that, of two randomly chosen patients, the patient with the higher predicted survival will outlive the patient with the lower predicted survival. The c-index ranges from 0.5 (no discrimination) to 1.0 (perfect discrimination).
All statistical analyses were conducted using R version 3.1.0 software (Institute for Statistics and Mathematics, Vienna, Austria; http://www.r-project.org) . The model and nomogram were constructed using the R package rms . All statistical tests were two-sided, and values of p < 0.05 were considered significant.
Patient demographics are listed in Table 1. A total of 1679 pediatric patients with RMS were included in the study. Approximately 38.1% of the subjects were aged 0–4 years, 23.2% were 5–9 years, 20.6% were 10–14 years and 18.1% were 15–19 years. There were 974 (58.0%) boys, and 705 (42.0%) girls. The majority of patients were white (75.9%). Approximately 61.1% of RMS occurred at unfavorable sites. Around 59.0% of patients were diagnosed with embryonal RMS, 33.2% with alveolar RMS and 7.7% with other RMS. Based on SEER staging, 33.4% of patients had localized tumors, 34.9% had regional RMS and 31.7% had metastasis. More than half (62.8%) of the patients had received RT, and 59.1% received surgery.
The 5-year OS rate for the entire cohort was 64.5% (95% confidence interval (CI), 62.1-67.1%) and the 10-year OS rate was 61.8% (95%CI, 59.2-64.5%). Five- and 10-year OS rates by characteristic are listed in Table 1. Sex and race had no influence on OS. Prognosis worsened with increasing age; young children (0–4 years) had a better prognosis than adolescents (15–19 years), with 5-year OS of 71.3% and 47.9%, respectively. Children with embryonal RMS had a longer survival than those with alveolar RMS, with estimated 5-year OS of 73.5% and 46.3%, respectively. Patients with localized tumors had a better prognosis (5-year OS of 84.0%) than those with regional disease (72.4%) or distant metastasis (35.7%). RMS at favorable sites had a better prognosis than that at unfavorable sites (p < 0.001). Patients with surgery had improved survival compared with those without surgery (p < 0.001). RT showed a weak but significant association with prognosis; 5-year OS was 65.6% in patients with RT compared with 62.7% in those without RT (p = 0.045).
Multivariate analysis was performed using a Cox proportional hazards regression model. We pre-specified nonlinearity for age at diagnosis and tumor size variables, and considered the effect on prognosis of the interaction between surgery and RT. Residual plots indicated that the proportional hazards assumption held. After model selection, we obtained a reduced model. Beta coefficients and hazard ratios of variables are listed in Table 2.The nomogram included age at diagnosis, size, tumor site, stage, histological type, surgery and RT (Figure 2). To use the nomogram, we drew a vertical line to the point row to assign point values for each variable, summed the point values for each variable to obtain total points, and then dropped a vertical line from the total points row to get the 5- and 10-year OS rates.The model was internally validated. Discrimination suggested good accuracy with a bootstrap-corrected c-index of 0.74, which denotes 74% probability that, of two randomly selected patients, the patient who survives longer will have a higher survival probability than the patient with shorter survival. The calibration plots for 5- and 10-year OS are shown in Figure 3. Points in the calibration plot were close to the 45° line, which suggested that the model was well-calibrated for all predictions.
The current study evaluated OS among pediatric patients with newly-diagnosed RMS in a population-based dataset, and constructed a nomogram to predict 5- and 10-year OS. This prognostic tool will be useful for estimating prognosis and guiding treatment selection.
The rarity of this disease means that most published studies are retrospective analyses of clinical studies, or small, single-institution, observational studies. Results from a single institution often fail to identify a true relationship between outcome and risk factors because of the small sample size and short follow-up period. Our analyses were based on the SEER database, which is considered to be the largest cancer registry. Reports from a population-based cohort have the advantage of including many more patients, thus increasing the power to estimate the true effects of risk factors on survival. Moreover, unlike most results from clinical studies, analysis of a population-based database includes not only those treated using formal protocols, but also those excluded from protocols because of comorbidity, tumor stage, or other factors. The reported results thus represent the full spectrum of the disease. Furthermore, SEER data are high quality and are collected in a uniform manner with uniform data standards. Quality control ensures that the SEER program has a relatively low rate of errors in the cancer registry .
Our study cohort included 1679 RMS patients and 543 deaths, which sample size was adequate to establish a reasonable model. The outcome measure of OS is one of the most useful pieces of information for counseling and is commonly used to develop staging schemes. Although the nomogram is not perfectly accurate, the error bars in the calibration plot suggest that predictions from the nomogram are within approximately 5% of the actual probability on average, and the bootstrap-corrected c-index of 0.74 suggests that the nomogram has good ability to discriminate among patients. This accuracy is comparable with most published nomograms for cancer prognosis.
The prognostic nomogram is a model-based tool to predict patient outcome. It directly quantifies the prognosis of individual patients based on proven prognostic factors. Different from a staging or scoring system, a nomogram considers multiple commonly available prognostic variables simultaneously, including continuous variables. Individual predictions are expressed on a probability scale, making it more easily understood by patients and clinicians than relative rates or hazard ratios . A nomogram has the potential to stratify patients for clinical studies, meaning that treatment regimens can be tested in more homogenous populations. Selecting high-risk patients based on predictions from a nomogram can also help to improve trial efficiency; for example, trials evaluating a treatment strategy could target patients with poor prognoses. Identifying high-risk patients for trial recruitment using a nomogram will increase the power to detect differences among treatment effects, thus reducing the required sample size. This method has been used in prospective randomized trials .
There is increasing interest in personalized medicine. A number of cancer nomograms to predict prognosis have been published in recent decades, such as for prostate, breast, soft-tissue sarcoma, and other cancers, including our previous nomogram for thyroid cancer [7, 15–23]. To the best of our knowledge however, the nomogram constructed in this study represents the first OS nomogram for pediatric RMS that is generalizable to the population.
The results of the Cox model identified age at diagnosis, stage of tumor, tumor size, histological subtype and treatment as important predictors of RMS survival in pediatric patients. The findings are expressed consistently in the nomogram. For example, adolescence, distant disease, large tumor size, alveolar RMS and no treatment, which were associated with a reduced survival based on the model, were given larger points in the nomogram. Meanwhile, a larger total point indicates a lower OS.
Simplicity is a strength of our model. Unlike models that aim to identify associations between prognosis and risk factors, predictive models should focus more on accuracy and parsimony . Complex models including a number of variables may be abandoned in clinical practice. In contrast, the nomogram developed in this study relies on limited variables that are routinely available from the tumor registry, making it easy for clinicians to use to calculate survival for individual patients.
Adult RMS was not included in this model. Pediatric and adult RMS have different clinical characteristics and prognoses. For example, pleomorphic RMS is common among adult patients, but is seldom seen in pediatric patients. Additionally, adult patients have a poorer response to chemotherapy. Research has suggested that increased levels of a resistance-related protein in adult embryonal and pleomorphic RMS compared with pediatric RMS may explain the reduced response to chemotherapy . Information regarding chemotherapy and variables in the protein level was not available in the current study and it was therefore not possible to adjust for these potential effects on prognosis in the SEER cohort. Moreover, adult RMS may have lower pathologic accuracy compared with pediatric RMS . We therefore excluded adult RMS from the current analysis to avoid these confounders and bias and to increase the accuracy of the model.
Although our nomogram showed reasonable accuracy for predicting OS, care should be taken when using a nomogram for counseling. Because it is impossible to include all risk factors, the prognostic predictive value of a nomogram should not be used as the sole basis for selecting a treatment regimen; treatment should be selected based on not only the expected value from the nomogram, but also taking into account other prognostic factors and quality of life.
There were some limitations to our study. First, the SEER public dataset does not include information on chemotherapy, comorbidity and surgical margins, which are viewed as important prognostic variables. This information would be useful for refining the predictive model. Second, although we restricted our cohort to patients diagnosed after 1990, the study period still spanned approximately two decades, during which time there have been improvements in surgery, chemotherapy and RT. Our nomogram thus tends to underestimate current OS. Third, unlike IRSG clinical trials, the SEER program does not utilize a central pathology review to minimize misclassification . Finally, we used internal validation to evaluate the accuracy of the model, and external validation based on independent data would be useful to validate the model further.
In conclusion, we used a population-based dataset to establish and internally validate a model to estimate the probability that a pediatric patient will be alive 5 and 10 years after being diagnosed with RMS. This study represents an objective analysis of all currently available data from the SEER cancer registry. The model shows good ability to discriminate among patients, with a c-index of 0.74. This predictive tool may be useful for patient counseling and to enable more individualized treatment planning.
Surveillance, Epidemiology, and End Results
National Cancer Institute
Intergroup Rhabdomyosarcoma Study Group
International Classification of Childhood Cancer
Miller RW, Young JL, Novakovic B: Childhood cancer. Cancer. 1995, 75 (1 Suppl): 395-405.
Ries L, Smith M, Gurney J, Linet M, Tamra T, Young J, Bunin G: Cancer Incidence and Survival among Children and Adolescents: United States SEER Program 1975–1995. 1999, Bethesda, MD: National Cancer Institute, SEER Program, NIH Pub. No. 99–4649
Crist W, Gehan EA, Ragab AH, Dickman PS, Donaldson SS, Fryer C, Hammond D, Hays DM, Herrmann J, Heyn R, Jones PM, Lawrence W, Newton W, Ortega J, Raney RB, Ruymann FB, Tefft M, Webber B, Wiener E, Wharam M, Vietti TJ, Maurer HM: The Third Intergroup Rhabdomyosarcoma Study. J Clin Oncol. 1995, 13 (3): 610-630.
Pappo AS, Shapiro DN, Crist WM, Maurer HM: Biology and therapy of pediatric rhabdomyosarcoma. J Clin Oncol. 1995, 13 (8): 2123-2139.
Surveillance, Epidemiology, and End Results (SEER) Program SEER*Stat Database: Incidence - SEER 9 Regs Research Data, Nov 2011 Sub (1973–2010) <Katrina/Rita Population Adjustment> - Linked To County Attributes - Total U.S., 1969–2010 Counties, National Cancer Institute, DCCPS, Surveillance Research Program, Surveillance Systems Branch,released April 2013, based on the November 2012 submission. 2011, [http://www.seer.cancer.gov], Nov Sub (1973–2010) <Katrina/Rita Population Adjustment> - Linked To County Attributes - Total U.S., 1969–2010 Counties, National Cancer Institute, DCCPS, Surveillance Research Program, Surveillance Systems Branch,released April 2013, based on the November 2012 submission
Punyko JA, Mertens AC, Baker KS, Ness KK, Robison LL, Gurney JG: Long-term survival probabilities for childhood rhabdomyosarcoma. A population-based evaluation. Cancer. 2005, 103 (7): 1475-1483. 10.1002/cncr.20929.
Barnholtz-Sloan JS, Yu C, Sloan AE, Vengoechea J, Wang M, Dignam JJ, Vogelbaum MA, Sperduto PW, Mehta MP, Machtay M, Kattan MW: A nomogram for individualized estimation of survival among patients with brain metastasis. Neurooncol. 2012, 14 (7): 910-918.
Lee CM, Szabo A, Shrieve DC, Macdonald OK, Gaffney DK: Frequency and effect of adjuvant radiation therapy among women with stage I endometrial adenocarcinoma. JAMA. 2006, 295 (4): 389-397. 10.1001/jama.295.4.389.
Sultan I, Qaddoumi I, Yaser S, Rodriguez-Galindo C, Ferrari A: Comparing adult and pediatric rhabdomyosarcoma in the surveillance, epidemiology and end results program, 1973 to 2005: an analysis of 2,600 patients. J Clin Oncol. 2009, 27 (20): 3391-3397. 10.1200/JCO.2008.19.7483.
rms: Regression Modeling Strategies. R package version 4.2-0. [http://CRAN.R-project.org/package=rms]
Harrell FE, Lee KL, Mark DB: Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996, 15 (4): 361-387. 10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4.
R Core Team: R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing, [http://www.R-project.org/.]
Porter CR, Suardi N, Capitanio U, Hutterer GC, Kodama K, Gibbons RP, Correa R, Perrotte P, Montorsi F, Karakiewicz PI: A nomogram predicting prostate cancer-specific mortality after radical prostatectomy. Urol Int. 2010, 84 (2): 132-140. 10.1159/000277588.
Eastham JA, Kelly WK, Grossfeld GD, Small EJ: Cancer, Leukemia Group B; Cancer and Leukemia Group B (CALGB) 90203: a randomized phase 3 study of radical prostatectomy alone versus estramustine and docetaxel before radical prostatectomy for patients with high-risk localized disease. Urology. 2003, 62 (Suppl 1): 55-62.
Stephenson AJ, Scardino PT, Kattan MW, Pisansky TM, Slawin KM, Klein EA, Anscher MS, Michalski JM, Sandler HM, Lin DW, Forman JD, Zelefsky MJ, Kestin LL, Roehrborn CG, Catton CN, DeWeese TL, Liauw SL, Valicenti RK, Kuban DA, Pollack A: Predicting the outcome of salvage radiation therapy for recurrent prostate cancer after radical prostatectomy. J Clin Oncol. 2007, 25 (15): 2035-2041. 10.1200/JCO.2006.08.9607.
Rouzier R, Pusztai L, Delaloge S, Gonzalez-Angulo AM, Andre F, Hess KR, Buzdar AU, Garbay JR, Spielmann M, Mathieu MC, Symmans WF, Wagner P, Atallah D, Valero V, Berry DA, Hortobagyi GN: Nomograms to predict pathologic complete response and metastasis-free survival after preoperative chemotherapy for breast cancer. J Clin Oncol. 2005, 23 (33): 8331-8339. 10.1200/JCO.2005.01.2898.
Brennan MF, Kattan MW, Klimstra D, Conlon K: Prognostic nomogram for patients undergoing resection for adenocarcinoma of the pancreas. Ann Surg. 2004, 240 (2): 293-298. 10.1097/01.sla.0000133125.85489.07.
Kattan MW, Karpeh MS, Mazumdar M, Brennan MF: Postoperative nomogram for disease-specific survival after an R0 resection for gastric carcinoma. J Clin Oncol. 2003, 21 (19): 3647-3650. 10.1200/JCO.2003.01.240.
Yang L, Shen W, Sakamoto N: Population-based study evaluating and predicting the probability of death resulting from thyroid cancer and other causes among patients with thyroid cancer. J Clin Oncol. 2013, 31 (4): 468-474. 10.1200/JCO.2012.42.4457.
Kutikov A, Egleston BL, Wong YN, Uzzo RG: Evaluating overall survival and competing risks of death in patients with localized renal cell carcinoma using a comprehensive nomogram. J Clin Oncol. 2010, 28 (2): 311-317. 10.1200/JCO.2009.22.4816.
Kattan MW, Leung DH, Brennan MF: Postoperative nomogram for 12-year sarcoma-specific death. J Clin Oncol. 2002, 20 (3): 791-796. 10.1200/JCO.20.3.791.
Gronchi A, Miceli R, Shurell E, Eilber FC, Eilber FR, Anaya DA, Kattan MW, Honore C, Lev DC, Colombo C, Bonvalot S, Mariani L, Pollock RE: Outcome prediction in primary resected retroperitoneal soft tissue sarcoma: histology-specific overall survival and disease-free survival nomograms built on major sarcoma center data sets. J Clin Oncol. 2013, 31 (13): 1649-1655. 10.1200/JCO.2012.44.3747.
Chisholm JC, Marandet J, Rey A, Scopinaro M, de Toledo JS, Merks JH, O’Meara A, Stevens MC, Oberlin O: Prognostic factors after relapse in nonmetastatic rhabdomyosarcoma: a nomogram to better define patients who can be salvaged with further therapy. J Clin Oncol. 2011, 29 (10): 1319-1325. 10.1200/JCO.2010.32.1984.
Zini L, Cloutier V, Isbarn H, Perrotte P, Capitanio U, Jeldres C, Shariat SF, Saad F, Arjane P, Duclos A, Lattout JB, Montorsi F, Karakiewicz PI: A simple and accurate model for prediction of cancer-specific mortality in patients treated with surgery for primary penile squamous cell carcinoma. Clin Cancer Res. 2009, 15 (3): 1013-1018. 10.1158/1078-0432.CCR-08-1888.
Komdeur R, Klunder J, van der Graaf WT, van den Berg E, de Bont ES, Hoekstra HJ, Molenaar WM: Multidrug resistance proteins in rhabdomyosarcomas: comparison between children and adults. Cancer. 2003, 97 (8): 1999-2005. 10.1002/cncr.11259.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2407/14/654/prepub
This research was not funded. The authors would like to thank SEER for open access to their database.
The authors declare that they have no competing interests.
LY designed and performed analyses and drafted the paper; TT prepared the data and created the figure; JF edited the paper and commented on the interpretation of the results. All authors read and approved the final manuscript.