- Research article
- Open Access
- Open Peer Review
Performance of a prognostic 31-gene expression profile in an independent cohort of 523 cutaneous melanoma patients
BMC Cancer volume 18, Article number: 130 (2018)
The heterogeneous behavior of patients with melanoma makes prognostication challenging. To address this, a gene expression profile (GEP) test to predict metastatic risk was previously developed. This study evaluates the GEP’s prognostic accuracy in an independent cohort of cutaneous melanoma patients.
This multi-center study analyzed primary melanoma tumors from 523 patients, using the GEP to classify patients as Class 1 (low risk) and Class 2 (high risk). Molecular classification was correlated to clinical outcome and assessed along with AJCC v7 staging criteria. Primary endpoints were recurrence-free (RFS) and distant metastasis-free (DMFS) survival.
The 5-year RFS rates for Class 1 and Class 2 were 88% and 52%, respectively, and DMFS rates were 93% versus 60%, respectively (P < 0.001). The GEP was a significant predictor of RFS and DMFS in univariate analysis (hazard ratio [HR] = 5.4 and 6.6, respectively, P < 0.001 for each), along with Breslow thickness, ulceration, mitotic rate, and sentinel lymph node (SLN) status (P < 0.001 for each). GEP, tumor thickness and SLN status were significant predictors of RFS and DMFS in a multivariate model that also included ulceration and mitotic rate (RFS HR = 2.1, 1.2, and 2.5, respectively, P < 0.001 for each; and DMFS HR = 2.7, 1.3 and 3.0, respectively, P < 0.01 for each).
The GEP test is an objective predictor of metastatic risk and provides additional independent prognostic information to traditional staging to help estimate an individual’s risk for recurrence. The assay identified 70% of stage I and II patients who ultimately developed distant metastasis. Its role in consideration of patients for adjuvant therapy should be examined prospectively.
Cutaneous melanoma continues to be a significant contributor to cancer morbidity and mortality, with over 90,000 new cases and over 9000 deaths expected in 2018 . Assessment of survival outcomes is based on the American Joint Committee on Cancer (AJCC) staging . Stage I and II patients greatly outnumber later stage patients, thus the vast majority of melanoma-related deaths occur in patients belonging to this group at diagnosis . In the Multicenter Selective Lymphadenectomy Trial (MSLT-1), 13% of node-negative patients had biologically aggressive disease that resulted in metastases and death [3, 4]. The fact that a substantial proportion of melanoma related deaths occur in patients with thin, T1, melanoma tumors has also been reported [5,6,7]. Based on current guidelines these patients do not receive the intensive surveillance or adjuvant therapy offered to AJCC high risk patients . Recent advances in our understanding of tumor biology should enable us to identify high-risk disease based on molecular characteristics of the tumor [9,10,11].
A 31-gene expression profile (GEP) test that dichotomizes cutaneous melanoma patients as Class 1 (low-risk) or Class 2 (high-risk) has been previously described [12, 13]. Class 2 results are associated with an increased risk for metastatic disease that is independent of staging factors . This study evaluates the GEP test in a previously unreported, independent cohort of 523 cutaneous melanoma cases from a multi-center consortium.
Following institutional review board approval of the study and waiver of patient consent at each of the 16 participating centers, archival formalin-fixed, paraffin-embedded primary cutaneous melanoma tumor tissue was collected. Inclusion in the study required biopsy confirmed stage I–III cutaneous melanoma diagnosed between 2000 and 2014, with at least 5 years of follow-up, unless there was an earlier documented recurrence or metastatic event. Thus, all cases diagnosed after October 31, 2011 that were included in the study had a documented metastatic event. All cases included in the study that had no documented metastasis event had at least 5 years of follow-up. Clinical, pathological and outcome data were collected by collaborating centers through an electronic case report form, and on-site monitoring of each case was completed prior to data analysis with a censor date of October 31, 2016.
Data collection and class assignment
Expression profiling of the 31 genes (28 class-discriminating and 3 endogenous control genes; Additional file 1: Table S1) was performed via RT-PCR and radial basis machine (RBM) predictive modeling was used to generate a probability score and subsequent class assignment (Class 1 or Class 2) for each sample, as previously described [12, 13]. Only cases that met preestablished pre- and post-analytic quality control thresholds were included (Table 1).
The RBM model generates a linear probability score from 0 to 1. Within the model, cases with a probability score between 0 and 0.49 are labeled Class 1, with samples within one standard deviation (SD) of the median probability score for Class 1 cases (0–0.41) designated as Class 1A and samples outside of the SD (0.42–0.49) designated as Class 1B (Additional file 2: Supplemental methods). Similarly, Class 2 cases have a score between 0.5 and 1. Samples with a probability score within one SD of the median (0.59–1) are classified as Class 2B, while those with a score outside the SD (0.5–0.58) are labeled Class 2A. In both the Class 1 and Class 2 groups, “A” subclass reflects a better and “B” reflects a worse prognosis within the Class. Results from subclass analysis are reported in the clinical setting.
Primary endpoints were recurrence-free survival (RFS), or time from diagnosis to any local, regional, or distant recurrence, excluding a positive SLN, and distant metastasis-free survival (DMFS), or time from diagnosis to any distant metastasis. Melanoma-specific survival (MSS), or time from diagnosis to death documented as resulting from melanoma, was a secondary endpoint. All survival variables were calculated from documented diagnosis and event (or censor) dates.
Kaplan-Meier and Cox proportional hazards survival analyses were performed using R version 3.3.0, with P < 0.05 considered statistically significant by log-rank method or Cox regression analysis. For proportional hazards analysis, Breslow thickness was measured as a continuous variable, while all other factors were dichotomized.
Performance of the GEP
Of 601 cutaneous melanoma cases, 523 met inclusion criteria (Table 1). Class 1 patients had 5-year RFS, DMFS and MSS rates of 88%, 93% and 98% in Kaplan-Meier analysis, respectively, compared to 52%, 60% and 78% for the Class 2 group (P < 0.001 for all comparisons; Fig. 1a-c). Analysis of survival rates by molecular substage resulted in Class 1A RFS, DMFS and MSS of 91%, 96% and 100%, respectively, compared to Class 2B rates of 43%, 51% and 70%, respectively (P < 0.001; Fig. 1d-f).
Kaplan-Meier analysis for stage I showed 5-year RFS rates for all Class 1 and 2 patients of 96% and 85% (P = 0.01, Fig. 2a). By comparison, considering the risk associated with GEP subclasses, RFS rates of 98% and 73% were observed for Class 1A and Class 2B groups, respectively (P < 0.001 [adjusted], P = 0.0008 [nominal], Fig. 2d). DMFS rates for Class 1 and Class 2 groups were 97% and 90%, respectively (P = 0.085; Fig. 2b), while DMFS rates for Class 1A and Class 2B groups were 98% and 87%, respectively (P = 0.05 [adjusted], P = 0.028 [nominal], Fig. 2e). MSS rates for Class 1A and Class 2B groups were 100% and 93%, respectively (P < 0.01 [adjusted], P = 0.0038 [nominal], Fig. 2f).
In stage II, 5-year RFS rates were 74% and 55% (P = 0.043, Fig. 3a), and DMFS rates were 90% and 63% (P = 0.004, Fig. 3b), respectively, for Class 1 and 2 patients. Comparing Class 1A and 2B groups, 5-year RFS rates were 77% and 50% (P = 0.13 [adjusted], P = 0.086 [nominal], Fig. 3d), and DMFS rates were 95% and 57%, respectively (P < 0.001 [adjusted], P = 0.0077 [nominal], Fig. 3e). MSS rates for Class 1A and Class 2B were 100% and 82%, respectively (P = 0.13 [adjusted], P = 0.037 [nominal], Fig. 2f). Of note, 30 of 43 stage I and II patients (70%) who had a distant metastasis were Class 2 (Table 2). Of the 11 stage I and II patients who died from melanoma, 9 (82%) were Class 2.
There were 166 stage III cases in the study. Stage IIIA patients had 5-year RFS rates for Class 1 and 2 of 72% and 51%, respectively (P = 0.015, Additional file 3: Figure S1A), DMFS rates of 80% and 54% (P = 0.019, Additional file 3: Figure S1B), and MSS rates of 100% and 67% (P = 0.009, Additional file 3: Figure S1C).
GEP independently predicts metastatic risk
In univariate Cox regression analysis, Breslow thickness, mitotic rate, ulceration, positive SLN, and molecular Class 2 were all significant predictors of recurrence and distant metastasis. In multivariate analysis, molecular Class 2, Breslow thickness, and positive SLN were independent predictors of RFS and DMFS (Table 3). The expanded confidence GEP subclasses were also significant predictors of RFS and DMFS in both multivariate and univariate models (Additional file 4: Table S2).
Evaluation with SLN biopsy status
Of the 523 cases evaluated, 337 had confirmed results from both the GEP test and SLN biopsy (SLNB). In comparing SLN-negative/Class 1 patients with SLN-negative/Class 2 patients, the 5-year RFS was 87% vs. 67%, DMFS was 93% vs. 75%, and MSS was 98% vs. 92% (Table 4). For SLN-positive/Class 1, the RFS, DMFS and MSS rates were 61%, 74% and 93%, respectively, while in SLN-positive/Class 2 patients’ rates were 37%, 44% and 63%, respectively. The expanded GEP subclasses were also significant in association with SLN status (Additional file 5: Table S3). SLN-negative/Class 1A vs. SLN-negative/Class 2B cases had 90% vs. 60%, 96% vs. 69%, and 100% vs. 88% 5-year RFS, DMFS, and MSS rates, respectively. SLN-positive/Class 1A vs. SLN-positive/Class 2B cases had 60% vs. 32%, 76% vs 38%, and 97% vs.59% 5-year RFS, DMFS, and MSS rates respectively.
Accuracy of the GEP compared to SLN biopsy
Class 2 results showed sensitivity of 70% for prediction of recurrence, 75% for distant metastasis, and 85% for melanoma-specific death, compared to the sensitivity of SLN-positivity of 66%, 67% and 79%, respectively (Table 5). A schematic depicting the clinical utility of the GEP is presented in Fig. 4, showing improved sensitivity for prediction of both locoregional (LR) and distant metastasis (DM) when the test is used in combination with SLNB. The specificity of a Class 1 result for recurrence, distant metastasis, and melanoma-specific death were 71%, 69%, and 64% compared to 65%, 62%, and 58% for SLN negativity. The positive predictive values (PPV) of a Class 2 signature and SLN-positivity, were 48% and 52% for recurrence, 40% and 42% for distant metastasis, and 19% and 21% for melanoma-specific mortality. The PPV of a Class 2B was 55% for recurrence, 45% for distant metastasis, and 24% for melanoma-specific mortality (Additional file 6: Table S4). The negative predictive values (NPV) of the Class 1 signature and a SLN-negative result were 87% and 76% for recurrence, 91% and 82% for distant metastasis, and 98% and 95% for melanoma-specific mortality. The NPV of a Class 1A was 89% for recurrence, 94% for distant metastasis and 99% for melanoma-specific mortality (Additional file 6: Table S4).
The use of molecular classification of disease is now routine in clinical practice [10, 14]. For any new molecular clinical test it is critical to evaluate whether the test i) accurately predicts its intended outcome; ii) has consistent, sustainable accuracy across multiple independent studies, and iii) adds value beyond existing clinical tools [15,16,17]. Here we report that the 31-gene expression profile test is able to predict metastatic risk in an independent cohort of 523 melanoma patients with results that are consistent with those reported in prior studies [12, 13]. In this cohort, we observed a 5-year DMFS rate of 93% for Class 1 cases and 62% for Class 2 cases (compared to 100% and 58%, respectively, in the smaller, initial study). We previously reported that this test could identify the majority of SLN-negative patients with an elevated risk of metastasis . In this study, the majority (70%) of the node-negative patients who had a distant metastasis were Class 2, as well as the majority (78%) of SLN-negative patients who died from melanoma (7 of 9 patients).
This study is based on a cohort of melanoma patients with clinical characteristics that align with those of the general cutaneous melanoma population. While the SLN positivity rate is higher than the 15–20% reported in previous studies, the 5-year survival rates for the SLN-negative and SLN-positive groups (95% vs. 75%, respectively) are similar to those reported in the MSLT-1 study (90% vs. 70%, respectively) [3, 4]. Breslow thickness, ulceration and mitotic rate were all important in univariate models of risk prediction (Table 3), supporting similarity with previous cohorts used to identify relevant staging factors. SLN status is currently regarded as the gold standard for prognosticating cutaneous melanoma, as a positive SLNB is associated with a significantly increased risk of metastasis  and our results confirm this. Compared to the SLNB procedure, the GEP test performed with better sensitivity across all endpoints studied. The results suggest that the GEP could enhance current prognostic accuracy by identifying clinically and pathologically SLN-negative patients who harbor an elevated risk of metastasis. Thus, highest sensitivity for detecting patients at high risk for recurrence, distant metastasis or melanoma-specific death can be achieved when the test is used in combination with current staging criteria. Importantly, this is coupled with high negative predictive values across endpoints, reflecting a substantially low risk associated with the Class 1 result. While the positive predictive values are lower, this accuracy metric may be impacted by 1) a favorable host immune response to metastatic tumor cells; and 2) follow-up time that is not long enough to observe the metastatic event. Importantly, the positive predictive values observed for the GEP are similar to those observed SLN status in this cohort (Table 5).
Considering that approximately two thirds of melanoma-related deaths in patients originally diagnosed without distant metastatic disease (stage I-III) occur in SLN negative patients (stage I-II) , the identification of patients in this group with biologically aggressive disease is a clinically significant unmet need. The current study demonstrates that implementing the GEP test after initial staging of melanoma tumors adds value by further stratifying the risk associated with stage I and stage II patients. That value is illustrated by a risk of recurrence that is three times higher for the stage I/Class 2 group compared to the stage I/Class 1 group (15% vs. 5%), and nearly seven times higher when comparing the stage I/Class 2B group to the stage I/Class 1A group (27% vs. 4%). The stage II/Class 2 group has nearly twice the risk of recurrence compared to the stage II/Class 1 group (49% vs. 28%), however, it should be noted that five of the nine events in the Class 1 group were regional recurrences. By comparison, the stage II/Class 2 group has three times the risk of developing distant metastasis compared to the stage II/Class 1 group (43% vs. 13%) and five times the risk in the stage II/Class 2B group compared to the stage II/Class 1A group (47% vs. 9%). The ability to subdivide stage II patients into groups with as high as 43% chance of developing distant metastasis and alternatively groups with as low as 5% risk at 5-years could significantly impact management decisions and clinical care. The results suggest that the GEP offers the opportunity to personalize risk assessment within each of these population-based AJCC stages.
The identification of high risk early stage patients is especially relevant considering current advances in melanoma therapies, which require us to improve risk evaluation in order to better weigh benefit versus harm of adjuvant therapy . These findings suggest that new tools are necessary to supplement current staging approaches, even as we achieve better outcomes for melanoma patients overall. Early stage patients could potentially benefit from adjuvant therapy but may not be recognized as high risk by the current staging system, and even among stage III patients there is often a dilemma as to whether systemic treatment is appropriate. The results of this study suggest that the GEP test should be evaluated in the context of new adjuvant therapy trials and trials evaluating the benefit of management approaches in stage III patients.
One of the limitations of this study is the inclusion of samples in the cohort that were diagnosed prior to widespread standardization of reporting for pathological variables such as Breslow thickness, ulceration and mitosis and therefore some pathology reports did not specify all features. However, the Cox regression models assessing the association between GEP and those factors account for this limitation and only patients with all factors specified were included in this analysis. Another limitation is the retrospective nature of the study and thus does not take into account recent advances in management of patients with advanced melanoma in the adjuvant and metastatic settings. However, recently published results of an interim analysis of the GEP test in a prospective cohort show consistency of results with this another retrospective cohorts [12, 13, 19].
Current guidelines indicate that management should ultimately be tailored to an individual’s probability of recurrence . The risk classification provided by this test, along with current prognostic factors, can be used to better estimate an individual’s risk for recurrence and therefore aid in determining the most appropriate surveillance methodology and frequency. As illustrated in Fig. 4, the clinical utility of the test in conjunction with SLNB can identify as many as 89% of the patients who will experience a distant metastasis, and over 70% of those patients who are SLNB-negative. Several recent studies have demonstrated that modern therapies for melanoma are more effective when disease burden is low [21, 22]. Thus, the need to accurately predict risk in melanoma patients is more critical than ever to enable risk-tailored surveillance and management of early staged patients with biologically aggressive tumors.
The 31-gene expression profile is an accurate predictor of metastatic risk that has shown consistent performance and provides additional prognostic information to standard clinical and pathologic factors included in AJCC staging.
American Joint Committee on Cancer
Distant metastasis-free survival
Gene expression profile
Multicenter Selective Lymphadenectomy Trial
Negative predictive value
Positive predictive value
Radial basis machine
Sentinel lymph node
Sentinel lymph node biopsy
Siegel RL, Miller KD, Jemal A. Cancer statistics, 2018. CA Cancer J Clin. 2018;68(1):7–30.
Balch CM, Gershenwald JE, Soong SJ, et al. Final version of 2009 AJCC melanoma staging and classification. J Clin Oncol. 2009;27:6199–206.
Morton DL, Thompson JF, Cochran AJ, et al. Final trial report of sentinel-node biopsy versus nodal observation in melanoma. N Engl J Med. 2014;370:599–609.
Morton DL, Thompson JF, Cochran AJ, et al. Sentinel-node biopsy or nodal observation in melanoma. N Engl J Med. 2006;355:1307–17.
Shaikh WR, Dusza SW, Weinstock MA, et al. Melanoma Thickness and Survival Trends in the United States, 1989 to 2009. J Natl Cancer Inst. 2016;108
Landow SM, Gjelsvik A, Weinstock MA. Mortality burden and prognosis of thin melanomas overall and by subcategory of thickness, SEER registry data, 1992–2013. J Am Acad Dermatol. 2017;76:258–63.
Whiteman DC, Baade PD, Olsen CM. More people die from thin melanomas (1 mm) than from thick melanomas (>4 mm) in Queensland, Australia. J Invest Dermatol. 2015;135:1190–3.
Coit DG, Thompson JA, Algazi A, et al. Melanoma, Version 2.2016, NCCN Clinical Practice Guidelines in Oncology. J Natl Compr Cancer Netw. 2016;14:450–73.
Paik S, Shak S, Tang G, et al. A multigene assay to predict recurrence of tamoxifen-treated, node-negative breast cancer. N Engl J Med. 2004;351:2817–26.
Onken MD, Worley LA, Char DH, et al. Collaborative Ocular Oncology Group report number 1: prospective validation of a multi-gene prognostic assay in uveal melanoma. Ophthalmology. 2012;119:1596–603.
Malara NM, Leotta A, Sidoti A, et al. Ageing, hormonal behaviour and cyclin D1 in ductal breast carcinomas. Breast. 2006;15:81–9.
Gerami P, Cook RW, Russell MC, et al. Gene expression profiling for molecular staging of cutaneous melanoma in patients undergoing sentinel lymph node biopsy. J Am Acad Dermatol. 2015;72:780–5. e783
Gerami P, Cook RW, Wilkinson J, et al. Development of a prognostic genetic signature to predict the metastatic risk associated with cutaneous melanoma. Clin Cancer Res. 2015;21:175–83.
van de Vijver MJ, He YD, van’t Veer LJ, et al. A gene-expression signature as a predictor of survival in breast cancer. N Engl J Med. 2002;347:1999–2009.
Engstrom PF, Bloom MG, Demetri GD, et al. NCCN molecular testing white paper: effectiveness, efficiency, and reimbursement. J Natl Compr Cancer Netw. 2011;9(Suppl 6):S1–16.
Febbo PG, Ladanyi M, Aldape KD, et al. NCCN Task Force report: Evaluating the clinical utility of tumor markers in oncology. J Natl Compr Cancer Netw. 2011;9(Suppl 5):S1–32. quiz S33
Simon RM, Paik S, Hayes DF. Use of archived specimens in evaluation of prognostic and predictive biomarkers. J Natl Cancer Inst. 2009;101:1446–52.
Eggermont AM, Chiarion-Sileni V, Grob JJ, et al. Prolonged Survival in Stage III Melanoma with Ipilimumab Adjuvant Therapy. N Engl J Med. 2016;375:1845–55.
Hsueh EC, DeBloom JR, Lee J, et al. Interim analysis of survival in a prospective, multi-center registry cohort of cutaneous melanoma tested with a prognostic 31-gene expression profile test. J Hematol Oncol. 2017;10:152.
Coit DG, Thompson JA, Andtbacka R, et al. Melanoma, version 4.2014. J Natl Compr Cancer Netw. 2014;12:621–9.
Kaufman HAT, Nemunaitis JJ, Chesne JA, Delman KA, Spitler LE, Collichio FA, Ross MI, Zhang Y, Shilkrut M, Andtbacka RHI. Tumor size and clinical outcomes in melanoma patients (MEL pts) treated with talimogene laherparepvec (T-VEC). J Clin Oncol. 2015;33:9074.
Ribas A, Hamid O, Daud A, et al. Association of Pembrolizumab With Tumor Response and Survival Among Patients With Advanced Melanoma. JAMA. 2016;315:1600–9.
The authors wish to thank the physicians and clinical staff at each of the contributing institutions, and recognize the significant contributions to clinical data review and tissue processing by Jeff Wilkinson, PhD, Clare Johnson, RN, Natalie Lassen, PhD, John Stone, PhD, and Kristen Oelschlager, RN.
This study was sponsored by Castle Biosciences, Inc., which provided funding for tissue and clinical data retrieval to contributing centers.
Availability of data and materials
The dataset analyzed during the current study is not publicly available because public release of data was not included in the IRB protocol approved by each IRB listed above. Results from the DecisionDx-Melanoma test include proprietary information that is not publicly available, but can be reviewed upon request.
Ethics approval and consent to participate
The current study was approved, and patient consent was waived according to regulatory review requirements, as set forth in section 46.101 (b) of 45 CFR 46, by the following institutional review boards:
Emory University IRB (Emory University Winship Cancer Center)
Cleveland Clinic IRB (Cleveland Clinic)
Liberty IRB (Moffitt Cancer Center)
Colorado Multiple IRB (University of Colorado – Denver)
Methodist Healthcare IRB (Methodist Healthcare – San Antonio)
Northwestern University Biomedical IRB (Northwestern University)
Oregon Health & Science University IRB (Oregon Health & Science University)
University of Arizona IRB (University of Arizona Cancer Center)
University of Tennessee HSC IRB (Methodist Healthcare – Memphis)
Western IRB (University of Pittsburgh Medical Center, Dermatology North Palm Beach, Kelsey-Seybold Clinic, Affiliated Dermatology, Pariser Dermatology, Florida Hospital Memorial Medical Center Cancer Institute, Pathology Associates)
Consent for publication
JSZ, BRG, SL, RCG, MDF, ARM, DMP, JTV, JDW and PG have previously served as paid consultants to Castle Biosciences, Inc. SIE serves as a paid clinical consultant to Castle Biosciences, Inc. RWC, BM, KRC and KMP are employees of Castle Biosciences, Inc. and hold stock options. All remaining authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Control and discriminant gene targets assessed by the GEP test. (DOCX 12 kb)
Supplemental Methods for the 523-patient cohort. These methods describe the generation of four subclasses of GEP test results (1A, 1B, 2A, 2B) based on the linear probability score. (PDF 260 kb)
Survival outcomes for stage IIIA and combined stage IIIB & IIIC patients with molecular classification by the 31-gene expression profile test. (PDF 343 kb)
Cox regression analysis for recurrence and distant metastasis incorporating reduced confidence groups. The multivariate model is based on 244 cases with complete data for all variables assessed. (DOCX 13 kb)
Survival rates combining normal and reduced confidence GEP results with SLN status in the population of patients receiving a sentinel lymph node biopsy. (DOCX 12 kb)
Accuracy of the GEP test, limiting GEP result to the normal confidence Class 1A or Class 2B groups. (DOCX 13 kb)
About this article
Cite this article
Zager, J.S., Gastman, B.R., Leachman, S. et al. Performance of a prognostic 31-gene expression profile in an independent cohort of 523 cutaneous melanoma patients. BMC Cancer 18, 130 (2018) doi:10.1186/s12885-018-4016-3
- Gene expression profiling
- Cutaneous melanoma