Skip to main content
Download PDF

Characterization of molecular scores and gene expression signatures in primary breast cancer, local recurrences and brain metastases

BMC Cancer volume 19, Article number: 549 (2019) Cite this article

Abstract

Background

Breast cancer is a leading cause of cancer-related death in women worldwide. Despite extensive studies in all areas of basic, clinical and applied research, accurate prognosis remains elusive, thus leading to overtreatment of many patients. Diagnosis could be improved by introducing multigene molecular scores in standard clinical practice. Several tests that work with formalin-fixed tissue have become routine. Molecular scores usually include several genes representing processes, response to oestrogens, progestogens and human epidermal growth factor receptor 2 (Her2), respectively, which are combined additively in single values. These multi-gene scores have the advantage of being more robust and reproducible than single-gene scores. Their utility may be further enhanced by combining them with classical diagnostic parameters. Here, we present an exploratory study comparing the RISK and research versions of Oncotype DX recurrence score (RS), Prosigna Risk of Recurrence (ROR) and EndoPredict (EP) with respect to their prognostic potential for ipsilateral recurrence and/or distant relapse in brain, and we compared the scores to the intrinsic subtypes based on PAM50.

Methods

RNA was extracted from formalin-fixed, paraffin-embedded (FFPE) tissue cores of primary tumours, local recurrences and brain metastases. Gene expression was measured on a NanoString nCounter Analysis System. Intrinsic subtypes and molecular scores were computed according to published literature and RISK, RS, ROR and EP were compared against each other and to the intrinsic subtypes Luminal A (lumA), Luminal B (lumB), Her2-enriched (Her2↑), Basal-like (basal), and Normal-like (normal) of PAM50. Local recurrences and brain metastases were compared to their corresponding primary tumours.

Results

All four molecular scores were highly correlated. Highest correlations were observed among genes related to proliferation while lower correlations were found among oestrogen-related genes. The scores were significantly higher in primary tumours progressing to brain metastases as compared to recurrence-free primary tumours and primary tumours that relapsed as local recurrences.

Conclusions

RISK and ROR-P are prognostic for primary tumours metastasizing to the brain. All four scores, RISK, RS, EP and ROR-P failed to discriminate between primary tumours that remained recurrence-free and primary tumours relapsing as local recurrences.

Peer Review reports

Background

In spite of early detection, accurate classification and optimal treatment, about 30% of patients with early breast cancer will suffer a locoregional or a distant recurrence [1]. Recurrent breast cancer can develop in essentially any organ of the body; metastases are more aggressive than the primary tumour and account for the majority of deaths related to breast cancer. Many locoregional recurrences can be controlled initially, but they are associated with a high risk of distant metastasis and death [2, 3]. Traditionally, several parameters are related to the risk of recurrence and to the response to drug therapy, e.g. tumour size, histological grade and proliferation, lymph node involvement, lymphovascular invasion, overexpression and/or amplification of the human epidermal growth factor receptor 2 (Her2) gene and failure to express the oestrogen receptor (ER) and progesterone receptor (PR). More recently, several robust molecular scores have been developed. Each score is based on a rather simple algorithm integrating expression levels of several genes. Such scores are correlated with prognosis and their values are more stable than expression values of individual genes.

Starting with the seminal work of Perou et al. [4] and Sørlie et al. [5], through iterative refinements, a set of stable molecular subgroups (intrinsic subtypes) of breast cancer was identified from microarray data with thousands of genes. Fifty genes were sufficient to reliably classify breast cancer into the five intrinsic subtypes: Luminal A (lumA), Luminal B (lumB), Her2-enriched (Her2↑), Basal-like (basal) and Normal-like (normal) [6, 7]. The intrinsic subtypes are important parameters as they added independent prognostics (survival of patients) [4, 5] to the classical risk factors and predictors [6, 7]. The PAM50 was further developed to a commercial test made by NanoString under the brand Prosigna. It identifies the intrinsic subtype and provides the risk of (distant) recurrence (ROR-P) [8]. The Oncotype DX® recurrence score (RS) provides information about the risk of distant recurrence [9, 10] as well as the benefit of chemotherapy in ER+/Her2- breast cancer patients [11]. The RS assay has been clinically validated and the test is performed at the central clinical reference laboratory of Genomic Heath, Inc. EndoPredict (EP) and EPclin, which is a combination of EP with tumour size and nodal status, predict distant recurrence and they can be applied to ER+/Her2- breast cancers [12]. EP also predicts response to chemotherapy in ER+/Her2- breast cancer patients [13] and is available as a commercial test as well. The RISK score predicts disease free survival in patients with ER+ breast cancer [14]. Even though these scores combine genes related to proliferation and ER, the overlap between them is reduced or non-existent. The RISK and RS also contain two genes overexpressed in Her2↑ tumours: ERBB2 (the gene coding for Her2) and GRB7 (the gene is linked to ERBB2 on chromosome 17). While multigene molecular risk scores have improved the prediction of distant recurrence, their ability to predict ipsilateral local recurrence has remained uncertain.

In this study, we compared four multigene risk scores (research versions of RISK, RS, ROR-P and EP) and contrasted them with the intrinsic subtypes built from PAM50. The scores of recurrence-free patients and patients who later developed an ipsilateral local recurrence or a brain metastasis were compared, as well as the expression pattern between primary tumours and their matched local recurrences or brain metastases. Our results revealed that RISK, RS, ROR-P and EP show an amazingly similar performance with respect to their risk of recurrence. All four scores failed completely to discriminate between primary breast cancer that remained recurrence-free (curated control patients) and primary tumours that relapsed and formed locally recurrent tumours.

Methods

Patient population

Archival material was collected retrospectively from formalin-fixed paraffin-embedded (FFPE) tumour samples from the repository of the Swiss Sentinel Node Study and the Biobank Bern. Eighty-seven samples were from primary tumours, 43 from patients without local or distant recurrence (controls); 25 from patients who developed local recurrence in the residual breast parenchyma in the same quadrant and 19 from patients who developed brain metastasis. In addition, tumour tissues derived from 20 local recurrences and 25 brain metastases were obtained from the Biobank Bern. Primary tumours and local recurrences were available for 19 patients, while primary tumours and brain metastases were available also for 19 patients. Median follow-up time of recurrence-free patients was 88 months. The study was approved by the Cantonal Ethics Committee of the Canton Bern (Ref 2017–02025). Primary tumours were diagnosed between 1987 and 2009. Tumours were removed by breast conservative surgery and treated postoperatively with radiotherapy. Patients with uncertain or positive resection margins were excluded from the study. Patients were treated with chemotherapy and adjuvant treatment depending on hormone receptor status and tumour stage.

Immunohistochemistry (IHC)

The ER and the PR were measured immunohistochemically using 1% labelling as threshold for negative (−) and positive (+) staining. The Her2 was measured immunohistochemically. Staining was defined as negative (Her2 = 0 or 1+) or positive (Her2 = 3+); tumours with partial membrane staining of more than 10% tumour cells (Her2 = 2+) were reanalysed by Fluorescence In Situ Hybridization (FISH), according to the ASCO-CAP guidelines [15]. Proliferation was measured with a monoclonal antibody against Ki-67 (MIB-1) and expressed as labelling index (LI). As thresholds for low and high Ki-67, LI < 14% and LI ≥ 14% were used, according to Cheang and coworkers [16].

The IHC-based classification was used to build immunohistochemical surrogates of intrinsic subtypes as described by Guiu et al. [17]. Each tumour was assigned to one of the four classes: lumA (ER+ and/or PR+, Her2– and Ki-67 LI low), lumB (ER+ and/or PR+, Her2– and Ki-67 LI high, or ER+ and/or PR+, Her2+ and Ki-67 LI low or high), Her2↑ (ER–, PR– and Her2+) and basal (ER–, PR– and Her2–). Normal-like tumours were not considered for this classification. The PAM50-based intrinsic subtype prediction was performed as described [18]. The RISK and the risk of recurrence, ROR-P, were determined from all the 132 tumours, the Oncotype DX recurrence score, RS, and EndoPredict, EP, were determined from ER+ and Her2– tumours (based on IHC).

RNA isolation and processing

Two core punches of FFPE material were prepared based on a local inspection of tumour blocks, the paraffin was dissolved, and the RNA subjected to demodification and purification on silica-based columns (AmpTec GmbH, Hamburg, Germany), as described previously [19, 20]. Seven samples were discarded due to poor quality of RNA or insufficient recovery. The remaining 132 RNAs were used for gene expression analysis.

Eighty-four test and twelve reference genes were measured on a NanoString nCounter System (NanoString Technologies, Seattle USA). The genes are listed in additional file 1. Eight negative controls (no homology to eukaryotic RNA) and six positive probes (directed against unrelated RNA) were also included. The RNAs corresponding to the positive probes (spike-in RNAs) are present in each sample before hybridization. One hundred ng RNA was hybridized overnight at 65 °C and processed on an nCounter Prep Station. Gene expression was then quantified with a Digital Analyzer. The procedure is completely enzyme-free and highly robust regarding RNA fragmentation. The raw signal for each gene was background corrected and normalized using the negative and positive control genes in each sample. The resulting data was highly reproducible and NanoString data correlated with microarray data or real-time PCR data [21]. The expression data was further normalized against internal reference genes and log2 transformed to determine the intrinsic subtypes and the molecular scores of each sample (see below). Raw data is shown in additional file 3.

Normalization of gene expression data

The raw expression data from the Digital Analyzer was normalized using nSolver version 3.0 (NanoString Technologies, Seattle USA) or NanoStringNorm R package [22]. Both analyses gave the same results (data not shown). Briefly, the expression data was background corrected and poor-quality samples were excluded. The data of all the remaining 132 samples were normalized using all the 12 reference genes (reference genes are listed in additional file 1). The normalized data were then subjected to a hierarchical cluster analysis [23] based on the union of 74 genes of PAM50, RISK, RS and EP in nSolver (version 3.0) using Euclidean distance.

The PAM50 and the molecular scores were originally developed from microarray data or from real-time PCR data. Erroneously, the probes for CDC6 and CDCA1 which are part of PAM50 classifier were missing in the CodeSet during hybridization. To assess the effect of the two genes on the stability of PAM50 predictions, we compared the subtype assignments made by PAM50 classifier (R package genefu with robust standardization [18]) on two publicly available data sets [24] [25] with and without the two genes. Globally, < 3% of samples (7 from [24] and 3 from [25], respectively) changed their subtype when CDC6 and CDCA1 were discarded. Thus, we considered that the assignment without the two genes was stable enough to assign all 87 primary and 45 recurrent cancers to one of the five classes: normal, lumA, lumB, Her2↑ and basal [18].

Analysis of molecular scores

The NanoString data was normalized separately for each molecular score using the procedures and reference genes described for each score: three reference genes for RISK [14], five reference genes for RS [10] and three reference genes for EP [12]. The genes for ROR-P are part of PAM50; therefore, normalized PAM50 data was used. Threshold cutoffs and re-scaling of RS (0–100) were omitted as the scores were exclusively used for relative comparison with other scores or with PAM50 subtypes. The RISK, RS and EP were computed from at least two groups of functionally related genes, where the first group comprised genes reflecting the proliferative potential of tumour cells (termed PRO-subscore), and the second group integrated the capacity of tumour cells to respond to steroid hormones and their receptors (oestrogen and progesterone and their receptors). They were termed ER- and PR-subscore. A PRO-subscore was also computed from the ROR-P score [6], based on the proliferation-related genes in PAM50.

Statistical analysis

The intrinsic subtypes were determined based on immunohistochemical data [17] and on gene expression [18]. The agreement between the IHC and PAM50 classifications was measured in terms of Cohen’s kappa statistic. Only the tumours with lumA, lumB, Her2↑ or basal classification were included for this comparison, since normal-like tumours were not mapped to an IHC-defined subtype.

The agreement between scores was estimated with Cohen’s kappa statistics categorizing one-third of samples into high risk and two-thirds of samples into intermediate-low risk. The significance level was set a priori to p = 0.05 for all tests. The correlations between molecular scores and subscores were evaluated using Spearman’s correlation test.

Each molecular score was compared within PAM50 intrinsic subtypes (lumA, lumB, Her2↑, basal and normal) using the Mann-Whitney test. Similarly, molecular scores and subscores were compared between groups of samples (primary tumours from controls, primary tumours from patients who developed local recurrence, primary tumours from patients who developed brain metastasis, local recurrences and brain metastases).

Results

Comparison of gene expression and immunohistochemistry

This study is based on 87 primary breast cancers, 20 local recurrences and 25 brain metastases. Forty-three primary tumours remained recurrence free, 19 patients had a local recurrence and 25 had a brain metastasis. Clinical characteristics of patients and histological data of primary and recurrent tumours are summarized in Table 1 together with immunohistochemical data on the ER, the PR, Her2 and Ki-67 (Table 1).

Table 1 Patient and tumour characteristics
Full size table

In a first comparison, the RNA-based expression of ER (ESR1), PR (PGR) and Her2 (ERBB2) was compared to the immunohistochemical data for the respective proteins (additional file 2, panels A-C). Similarly, the expression of Ki-67 (measured with the probe MKI67) was compared to the proliferation marker Ki-67. The Ki-67 was quantified as labelling index (LI) with a monoclonal antibody against Ki-67 (MIB-1) (additional file 2, panel D). The Ki-67 was dichotomized into low (LI < 14% immunostaining with MIB-1) and high (LI ≥ 14% immunostaining with MIB-1) as described previously [16]. The comparison of immunohistochemistry data and gene expression data revealed excellent concordance between all four markers.

Intrinsic subtypes were also built from IHC data of the tumours [17] (Table 1). The procedure is described in the Methods section. The subtypes according to IHC were compared to subtypes according to gene expression (PAM50). The agreement between the two classifications was only moderate (Cohen’s kappa, κ = 0.58). The discordances between classifications were 33, 49, 17 and 18% for lumA, lumB, Her2↑ and basal subtypes, respectively. Tumours with normal-like classification were omitted from this comparison.

Hierarchical clustering of primary breast cancer, local recurrences and distant metastases

Primary tumours, local recurrences and distant metastases were then characterized on the basis of gene expression. Gene expression was measured with NanoString and the raw data was normalized using 12 reference genes, representing a combination of five reference genes for PAM50, three for RISK, five for RS and three for EP. The test and reference genes are listed in additional file 1. The 132 tumours were characterized by hierarchical clustering using all the 74 genes represented in PAM50, RISK, RS and/or EP. The result is shown as a heatmap (Fig. 1, panel a), with genes by columns and tumours by rows. Tumours that remained recurrence-free were termed controls, and are marked with white boxes in panel B; primary tumours that relapsed as local recurrence and local recurrences are marked with grey boxes (panel B); and primary tumours that progressed to brain metastases and brain metastases are marked with black boxes (panel B). Recurrence-free controls and local recurrences (primary tumours and recurrences) predominantly clustered in the upper part of the heatmap while primary tumours metastasizing to the brain and brain metastases are more abundant in the lower part (panel B). Intrinsic subtypes [7] are symbolized with colours (panel C) according to Parker et al. [7]: normal (ochre), lumA (light blue) and lumB (blue), Her2↑ (pink) and basal (brown). Normal and lumA are predominantly in the upper part, Her2↑ and basal in the lower part of the heatmap. The majority of lumB are between these two clusters.

Fig. 1
figure 1

Hierarchical clustering of primary tumours, local recurrences and distant metastases. a The gene expression profile of all tumours was characterized by hierarchical clustering and the results are shown as a heatmap. Rows correspond to the 132 tumour samples and columns correspond to the 74 genes (which are part of RISK, RS, EP and/or PAM50). b The panel indicates for each sample whether it is a control (white), a primary tumour that later relapsed as local recurrence (grey) or a primary tumour that later progressed to a brain metastasis (black). The same colours are used for the local recurrences and brain metastases (grey and black, respectively). c Indicates the intrinsic subtype of each tumor: normal-like (ochre), lumA (light blue), lumB (blue), Her2↑ (pink) or basal (brown). d Indicates 19 pairs of primary tumours (P1 – P19) and local recurrences (R1 – R19). Pairs clustering in the vicinity of each other are highlighted with brackets. e. Indicates 19 pairs of primary tumours and brain metastases. Primary tumours and corresponding metastases are labeled P20 – P38 and M20 – M38, respectively. Pairs of tumors clustering in the vicinity of each other on the heatmap are depicted with brackets

Full size image

Twenty-five tumours were primary tumours that progressed to local recurrences and 20 were local recurrences. Corresponding tissue from primary and recurrence tumours was available from 19 patients marked as P1 – P19 for primaries and R1 – R19 for recurrences (panel D). The analysis of these pairs of tumours showed that, to the extent of genes considered here, they were not particularly similar, with only three pairs clustering together.

Similarly, among the 44 primary tumours and brain metastases 19 were matched samples, primary tumours are labelled P20 – P38 and metastases were labelled M20 – M38 (panel E). It may be worth mentioning that 11 pairs of primary metastases from the same patients clustered in the immediate vicinity of each other on the heatmap (panel E). This clustering may suggest that, at least with regard to the expression of the genes considered here, primary tumours and corresponding brain metastases are more similar to each other than primary tumours and local recurrences. It is also apparent that primary tumours with enriched Her2 tend to metastasize to the brain.

Comparison of molecular scores

The gene expression data was also used to compute the four molecular scores RISK, RS, ROR-P and EP according to the published instructions, using the test and reference genes described for each of them [6, 10, 12, 14] (see Additional file 1 for the complete list of genes). The distributions of scores are shown separately for control tumours and primary tumours that later relapsed as local recurrence or as brain metastasis. Similarly, the distributions of scores are shown for local recurrences and brain metastases. The data for RISK and ROR-P are based on all available tumours (Fig. 2a). The calculation of RS and EP is limited to ER+ and Her2- tumours (Fig. 2b). Only three primary tumours later relapsed as brain metastases and four brain metastases were ER+ and Her2-, therefore, the corresponding data for these tumours are not shown. For all four molecular scores, no statistically significant differences were found between recurrence-free controls and primary tumours that later relapsed as local recurrences (Mann-Whitney test) (Table 2). Recurrence-free controls were also compared to primary tumours that later relapsed as brain metastases. The RISK and ROR-P scores were higher in tumours that relapsed as compared to recurrence-free controls (p <  0.01) and primary tumours that relapsed as local recurrence (p <  0.01 for RISK and p = 0.03 for ROR-P). The discrimination between control tumours and primary tumours of brain metastases was also evident at the level of the three subscores representing the hormonal status (ER-, PR and Her2-subscores). The molecular scores were also compared between primary tumours and local recurrences and clearly, they did not change over time (Table 2). Similarly, the RISK score did not increase between primary tumours and brain metastases, whereas the ROR-P score increased during progression from primary tumours to brain metastases (p = 0.01).

Fig. 2
figure 2

RISK, ROR-P, RS, and EP scores in primary tumours and recurrences. a Scatter dot plots (median with interquartile range) of RISK and ROR-P scores are shown for primary tumours (Controls, Local, Met.) and for recurrences (Local and Met.) The total number of tumours was 132. b Scatter dot plots (median with interquartile range) of RS and EP scores are shown for 72 ER+/Her2- primary tumours (Control and Local) and recurrences (Local)

Full size image
Table 2 Comparison of molecular scores between control tumours, local recurrence and brain metastasis
Full size table

The four scores were directly compared against each other using correlation plots (Fig. 3a). Depending on the different comparisons the Spearman’s correlations were 0.65–0.84 and the Cohen’s kappa statistics (for dichotomized versions – see Methods) indicated moderate to substantial agreement (κ within 0.48–0.67). The results indicate remarkable similarities between any two scores and at the same time it is obvious that the correlations are remarkably high, although in fact they are never very high.

Fig. 3
figure 3

Comparison of molecular scores. a Molecular scores were determined from primary tumours and pairwise comparisons are shown as scatter plots. Spearman’s correlation coefficients (ρ) and Cohen’s kappa (κ) are shown in the inset. For κ, low and intermediate scores (2/3 of samples) were compared to high scores (1/3 of samples). b Genes related to proliferation were used to determine proliferation-related subscores of RISK (RISKPRO), RS (RSPRO), ROR-P (ROR-PPRO) and EP (EPPRO). Pairwise correlations of subscores are plotted and Spearman’s correlation coefficients (ρ) of subscores are shown in the inset. c Similarly, ER-subscores were calculated from ER-related genes in RISK (RISKER), RS (RSER) and EP (EPER). Pairwise comparisons of subscores and Spearman’s correlation coefficients (ρ) are shown

Full size image

The correlation of all the pairs of scores was divided into PRO- and ER-subscores and analysed separately (see Methods for further details). Increased expression of genes related to proliferation produced higher PRO-subscores indicating poorer prognosis of the patient. Higher ER-subscore correlates with a favourable response to steroid hormone-based therapies and therefore correlates with better prognosis. The PRO-and ER-subscores were determined for RISK, RS and EP (Fig. 3b and c). Spearman correlations for each of the comparisons were very strong (ρ ≥ 0.82), while correlations between ER-subscores were considerably lower (ρ = 0.37–0.75).

Relationship between intrinsic subtypes and molecular scores in primary and recurrent breast cancer

As implied by the IHC-based definition of intrinsic subtypes, the PAM50 subtypes were aligned with the molecular scores, in the sense that the scores generally increased from lumA to lumB, Her2↑ and basal, respectively. In Fig. 4, the classification into normal, lumA, lumB, Her2↑ and basal subtypes is shown separately for RISK, ROR-P, RS and EP. Since the RS and EP were developed for ER+ and Her2– tumours, and the tests were not validated for ER– and/or Her2+ tumours, the respective scores are marked distinctly. The scores were lowest for lumA tumours and significantly higher in lumB tumours. The scores of lumA and lumB tumours were significantly lower than the scores of Her2↑ and basal subtypes (Table 3) which were similar. The molecular scores of normal tumours tended to be higher for lumA tumours. The comparison between normal and lumB led to a less clear picture: the molecular scores were higher in lumB tumours than in normal-like tumours, with respect to ROR-P, they were not different with respect to the three other scores (Table 3).

Fig. 4
figure 4

Allocation of molecular scores among PAM50 intrinsic subtypes. Molecular scores were measured from 87 primary cancers (including control tumours and primary tumours from patients who developed local recurrences or brain metastases). Scatter dot plots (median with interquartile range) of RISK, ROR-P, RS, and EP are shown itemised into intrinsic subtypes normal, lumA, lumB, Her2↑ and basal. The RS and EP were only validated for ER+/Her2- tumours, therefore, ER- and/or Her2+ tumours are shown exclusively for comparison (open circles)

Full size image
Table 3 Allocation of molecular scores among PAM50 intrinsic subtypes
Full size table

Discussion

Multigene molecular risk scores aim to stratify patients into risk of recurrence groups. In this study we measured the expression of genes of the PAM50 signature and four prognostic scores (RISK, RS, ROR-P and EP) in primary breast cancer, in local recurrences and in brain metastases. We compared primary tumours from patients that remained recurrence-free (controls) with primary tumours that relapsed as local recurrences or primary tumours that relapsed as brain metastases, and we compared primary tumours with matched local recurrences or brain metastases.

We are aware of the limitations of our study, since the patients in our cohort were selected retrospectively and based on availability of tumour material. Thus, the hypotheses generated in this study should be verified with material from prospectively collected patient data or, preferably, in a controlled clinical trial. Invariably, the recurrence-free patients had lower risk scores than those who developed distant metastases.

Comparison of molecular and immunohistochemical classification

Primary tumours were classified separately into intrinsic subtypes on the basis of molecular and IHC data. The comparison revealed that the agreement between molecular and IHC classification was only ‘moderate’ (κ = 0.58; Table 1). In a similar study, Chia and colleagues compared 347 tumours [26]. Although they observed a slightly higher concordance between molecular and histological classifications (κ = 0.64), the two classifications were characterized by numerous misclassifications [26]. The results of both studies suggest that molecular and immunohistochemical classifications are related but clearly not interchangeable.

Hierarchical clustering of primary tumours, local recurrences and distant metastases

Primary tumours, local recurrences and brain metastases were further characterized by hierarchical clustering (Fig. 1), revealing that most tumours with normal-like and lumA subtypes were separated from Her2↑ and basal subtypes, while lumB tumours were situated between the two clusters. A similar arrangement was described in the two original studies that were based on 65 breast cancers of 42 individuals [4, 5] or 78 tumours and cDNA microarrays with more than 8.000 genes [4, 5].

We also compared gene expression profiles of primary tumours with profiles of corresponding recurrences from the same patients. Local recurrences were also preferentially of luminal subtype, like the corresponding primary tumours, but the majority of matched samples were noticeably unrelated and did not separate in the immediate vicinity on the heatmap (Fig. 1). Our results probably do not allow drawing further conclusions, but it seems remarkable that many changes take place at the level of gene expression between primary tumours and local recurrences that arose later in the same area of the breast. Other studies based on IHC concurrently reported that more than 70% of primary tumours and local recurrences were lumA or lumB [27, 28].

In contrast, primary tumours that relapsed as brain metastases were predominantly Her2↑ or basal (nine and four of 19, respectively) and matched samples often had the same intrinsic subtype. Moreover, 11 metastases cluster next to their matched primary tumours on the heatmap. Similar results were reported from a study based on 20 pairs of primary tumours and brain metastases. Seventeen metastases retained the same PAM50 subtype as their corresponding primary tumours and 12 primary tumours and metastases clustered close to each other [29]. The comparison was based on 143 genes, 61 of which were the same as in our study. Other results based on IHC showed that primary tumours with Her2-enriched or basal subtype preferentially relapsed as brain metastases [30, 31].

Comparison of molecular scores

Primary tumours that relapsed as brain metastases had significantly higher scores than primary tumours that remained recurrence-free (controls) (Fig. 2 and Table 2). The results are shown for RISK and ROR-P. The RS and EP were not included, as these scores were developed and validated in ER+ tumours with normal Her2. In addition, ER-, PR- and Her2- subscores from RISK were also able to discriminate between tumors that relapsed as brain metastases and recurrence-free controls. The four molecular scores were also compared between recurrence-free controls and primary tumours that relapsed locally. We observed that molecular scores did not increase when primary tumours relapsed as local recurrence (Fig. 2, Table 2). This contradicts some earlier reports that the molecular scores were higher in primary tumours that relapsed as local recurrences when compared to controls [32,33,34]. However, the different definitions of local recurrence (e.g. recurrences in the chest skin after mastectomy or any site in the breast were considered local recurrence) may explain this apparent discrepancy. It cannot be excluded that such tumours have higher scores than local recurrences according to our definition. In addition, none of these earlier observations was validated in independent retrospective or prospective studies. Moreover, several groups failed to find a molecular signature in primary tumours discriminating between controls and tumours relapsing as local recurrence. For instance, Servant and colleagues tested 22 different gene-signatures, including RS and found that none of them was able to predict ipsilateral local recurrences [35]. In this study we tested RS and other three additional scores and, similarly, found no difference between recurrence-free controls and primary tumours that later reappeared as local relapse. Therefore, patients at risk of local recurrence are probably missed by the current molecular scores. In fact, a de novo search for such markers might be successful as we observed two genes, RBBP8 and MLL3, from our list of 84 genes whose expression was different in primary tumours of local recurrences as compared to controls.

The RISK, RS, ROR-P and EP scores were originally developed as prognostic parameters [6, 10, 12, 14]. Although each score is computed from different genes, their prognostic power seems to be similar and, it is possible that they can be used interchangeably. They are all built from genes associated with proliferation; the RISK, RS and EP scores contain additional genes related to ER and the response to oestrogen. The ERBB2 gene which codes for Her2, and the GRB7 gene are part of RISK and RS. These two genes are physically linked on chromosome 17 and overexpression correlates with amplification of DNA in this region of the chromosome.

The correlations between any two molecular scores were 0.65 < ρ < 0.85 (Fig. 3a). While all the correlations between PRO-subscores (genes related to proliferation) were higher (0.82 ≤ ρ ≤ 0.97; panel B), the correlations between ER-subscores (genes related to ER response) were clearly lower (0.37 ≤ ρ ≤ 0.75; panel C). The implications of the lower correlations among ER-subscores are not obvious and it should be clarified whether ER-subscores could be improved by adding or replacing some genes that are not consistently related to ER and its response.

Our analyses are based on retrospectively collected tumour samples. The results must thus be considered cautiously, but they seem to indicate that the proliferation-related genes (PRO-subscore) favour the agreement between RISK, RS, ROR-P and EP, while the ER-subscores are more variable and therefore limit the agreement between the scores.

Previous studies compared RS and EP [36], or RS and ROR [37]. In these comparisons, RS was measured in the laboratories of Genomic Heath. As a consequence, the analyses and comparisons were based on separate tissue sections, and RNAs were processed with different assays and on different instruments. Nevertheless, the studies reported similar results. We directly compared RISK with RS that was either measured at Genomic Health, or in our own laboratory, and we found higher correlations when RS was measured on the same tissue and in the same laboratory (ρ = 0.82, κ = 0.52 as compared to ρ = 0.43, κ = 0.23). The comparison was based on 220 prospectively collected samples (data not shown and [38]).

The study presented here comprised 87 primary tumours (43 recurrence-free controls, 25 primary tumours of local recurrences and 19 primary tumours of brain metastases). Each tumour was classified into intrinsic subtypes according to PAM50. Twenty-nine tumours were lumA; these tumours had the lowest scores, corresponding to the best prognosis (Fig. 4). Twenty-four tumours were lumB; the corresponding scores were significantly higher than in lumA (p < 0.01 for all scores). Sixteen primary tumours were Her2↑ and 12 were basal, the corresponding RISK and ROR-P scores were higher than lumB tumours (p < 0.01) (Fig. 4, Table 3). This observation is consistent with other studies [8] showing the lowest scores for lumA tumours and higher scores in all other subtypes.

Conclusions

In this study we measured four molecular scores – RISK, RS, ROR-P and EP – in recurrence-free primary breast cancer (controls) and in primary tumours that later relapsed with a local recurrence or a brain metastasis. All four scores performed similarly, and high pairwise correlations were found between them. None of the four scores allowed discriminating between recurrence-free controls and primary tumours that relapsed with a local recurrence. This observation is in conflict with other studies that reported that RS and EP are prognostic for both, local and distant recurrences. Our data confirmed that primary tumours that later relapsed with a brain metastasis had significantly higher RISK and ROR-P scores. As many of these tumours were Her2↑, they did not qualify for testing with RS and EP. We found that primary tumours and corresponding brain metastases were similar (at least with respect to gene expression). This is in contrast to local recurrences where gene expression profiles of primary tumours and corresponding local recurrences were surprisingly different. The results may imply that tumour cells that survive from primary tumours undergo major changes when they proliferate and form local recurrences. This observation should be considered when molecular scores derived from primary tumours are used to estimate the risk of recurrence, or even guide decisions on potential therapies.

Availability of data and materials

The raw data from NanoString is available in Additional file 3.

Abbreviations

Her2↑:

Her2-enriched

basal:

Basal-like

EP:

EndoPredict

ER:

Oestrogen receptor

FFPE:

formalin-fixed paraffin-embedded

FISH:

Fluorescence In Situ Hybridization

Her2:

Human epidermal growth factor receptor 2

IHC:

Immunohistochemistry

LI:

labelling index

lumA:

Luminal A

lumB:

Luminal B

normal:

Normal-like

PR:

Progesterone receptor

ROR:

Risk of recurrence

RS:

Recurrence score

References

  1. Early Breast Cancer Trialists' Collaborative Group (EBCTCG). Effects of chemotherapy and hormonal therapy for early breast cancer on recurrence and 15-year survival: an overview of the randomised trials. Lancet. 2005;365(9472):1687–717.

    Article  Google Scholar 

  2. Park S, Han W, Kim J, Kim MK, Lee E, Yoo T-K, Lee H-B, Kang YJ, Kim Y-G, Moon H-G, et al. Risk factors associated with distant metastasis and survival outcomes in breast Cancer patients with Locoregional recurrence. J Breast Cancer. 2015;18(2):160–6.

    Article  Google Scholar 

  3. Sirohi B, Leary A, Johnston SRD. Ipsilateral breast tumor recurrence: is there any evidence for benefit of further systemic therapy? Breast J. 2009;15(3):268–78.

    Article  Google Scholar 

  4. Perou C, Sorlie T, Eisen M, van de Rijn M, Jeffrey S, Rees C, Pollack J, Ross D, Johnsen H, Akslen L, et al. Molecular portraits of human breast tumours. Nature. 2000;406(6797):747–52.

    Article  CAS  Google Scholar 

  5. Sørlie T, Perou CM, Tibshirani R, Aas T, Geisler S, Johnsen H, Hastie T, Eisen MB, van de Rijn M, Jeffrey SS, et al. Gene expression patterns of breast carcinomas distinguish tumor subclasses with clinical implications. Proc Natl Acad Sci. 2001;98(19):10869–74.

    Article  Google Scholar 

  6. Nielsen TO, Parker JS, Leung S, Voduc D, Ebbert M, Vickery T, Davies SR, Snider J, Stijleman IJ, Reed J, et al. A comparison of PAM50 intrinsic subtyping with immunohistochemistry and clinical prognostic factors in tamoxifen-treated estrogen receptor positive breast cancer. Clin Cancer Res. 2010;16(21):5222–32.

    Article  Google Scholar 

  7. Parker JS, Mullins M, Cheang MC, Leung S, Voduc D, Vickery T. Supervised risk predictor of breast cancer based on intrinsic subtypes. J Clin Oncol. 2009;27(8):1160–7.

    Article  Google Scholar 

  8. Wallden B, Storhoff J, Nielsen T, Dowidar N, Schaper C, Ferree S, Liu S, Leung S, Geiss G, Snider J. Development and verification of the PAM50-based Prosigna breast cancer gene signature assay. BMC Med Genet. 2015;8(1):54.

    Google Scholar 

  9. Dowsett M, Cuzick J, Wale C, Forbes J, Mallon EA, Salter J, Quinn E, Dunbier A, Baum M, Buzdar A, et al. Prediction of risk of distant recurrence using the 21-gene recurrence score in node-negative and node-positive postmenopausal patients with breast Cancer treated with Anastrozole or tamoxifen: a TransATAC study. J Clin Oncol. 2010;28(11):1829–34.

    Article  Google Scholar 

  10. Paik S, Shak S, Tang G, Kim C, Baker J, Cronin M, Baehner FL, Walker MG, Watson D, Park T, et al. A multigene assay to predict recurrence of tamoxifen-treated, node-negative breast Cancer. N Engl J Med. 2004;351(27):2817–26.

    Article  CAS  Google Scholar 

  11. Sparano JA, Gray RJ, Makower DF, Pritchard KI, Albain KS, Hayes DF, Geyer CE, Dees EC, Perez EA, Olson JA. Prospective validation of a 21-gene expression assay in breast cancer. N Engl J Med. 2015;373(21):2005–14.

    Article  CAS  Google Scholar 

  12. Filipits M, Rudas M, Jakesz R, Dubsky P, Fitzal F, Singer CF, Dietze O, Greil R, Jelen A, Sevelda P, et al. A new molecular predictor of distant recurrence in ER-positive, HER2-negative breast cancer adds independent information to conventional clinical risk factors. Clin Cancer Res. 2011;17(18):6012–20.

    Article  CAS  Google Scholar 

  13. Bertucci F, Finetti P, Viens P, Birnbaum D. EndoPredict predicts for the response to neoadjuvant chemotherapy in ER-positive, HER2-negative breast cancer. Cancer Lett. 2014;355(1):70–5.

    Article  CAS  Google Scholar 

  14. Antonov J, Popovici V, Delorenzi M, Wirapati P, Baltzer A, Oberli A, Thürlimann B, Giobbie-Hurder A, Viale G, Altermatt HJ, et al. Molecular risk assessment of BIG 1-98 participants by expression profiling using RNA from archival tissue. BMC Cancer. 2010;10(1):37.

    Article  Google Scholar 

  15. Wolff AC, Hammond ME, Hicks DG, Dowsett M, McShane LM, Allison KH. Recommendations for human epidermal growth factor receptor 2 testing in breast cancer: American Society of Clinical Oncology/College of American Pathologists clinical practice guideline update. J Clin Oncol. 2013;31(31):3997–4013.

    Article  Google Scholar 

  16. Cheang M, Chia S, Voduc D, Gao D, Leung S, Snider J, Watson M, Davies S, Bernard P, Parker J. Ki67 index, HER2 status, and prognosis of patients with luminal B breast cancer. J Natl Cancer Inst. 2009;101(10):736–50.

    Article  CAS  Google Scholar 

  17. Guiu S, Michiels S, André F, Cortes J, Denkert C, Di Leo A, Hennessy BT, Sorlie T, Sotiriou C, Turner N, et al. Molecular subclasses of breast cancer: how do we define them? The IMPAKT 2012 working group statement. Ann Oncol. 2012;23(12):2997–3006.

    Article  CAS  Google Scholar 

  18. Gendoo DMA, Ratanasirigulchai N, Schröder MS, Paré L, Parker JS, Prat A, Haibe-Kains B. Genefu: an R/Bioconductor package for computation of gene expression-based signatures in breast cancer. Bioinformatics. 2016;32(7):1097–9.

    Article  CAS  Google Scholar 

  19. Oberli A, Popovici V, Delorenzi M, Baltzer A, Antonov J, Matthey S, Aebi S, Altermatt H, Jaggi R. Expression profiling with RNA from formalin-fixed, paraffin-embedded material. BMC Med Genet. 2008;1(1):9.

    Google Scholar 

  20. Schobesberger M, Baltzer A, Oberli A, Kappeler A, Gugger M, Burger H, Jaggi R. Gene expression variation between distinct areas of breast cancer measured from paraffin-embedded tissue cores. BMC Cancer. 2008;8(1):343.

    Article  Google Scholar 

  21. Geiss G, Bumgarner R, Birditt B, Dahl T, Dowidar N, Dunaway D, Fell H, Ferree S, George R, Grogan T. Direct multiplexed measurement of gene expression with color-coded probe pairs. Nat Biotechnol. 2008;26(3):317–25.

    Article  CAS  Google Scholar 

  22. Waggott D, Chu K, Yin S, Wouters BG, Liu F-F, Boutros PC. NanoStringNorm: an extensible R package for the pre-processing of NanoString mRNA and miRNA data. Bioinformatics. 2012;28(11):1546–8.

    Article  CAS  Google Scholar 

  23. Eisen MB, Spellman PT, Brown PO, Botstein D. Cluster analysis and display of genome-wide expression patterns. Proc Natl Acad Sci U S A. 1998;95(25):14863–8.

    Article  CAS  Google Scholar 

  24. Miller LD, Smeds J, George J, Vega VB, Vergara L, Ploner A, Pawitan Y, Hall P, Klaar S, Liu ET, et al. An expression signature for p53 status in human breast cancer predicts mutation status, transcriptional effects, and patient survival. Proc Natl Acad Sci U S A. 2005;102(38):13550–5.

    Article  CAS  Google Scholar 

  25. Sotiriou C, Wirapati P, Loi S, Harris A, Fox S, Smeds J, Nordgren H, Farmer P, Praz V, Haibe-Kains B, et al. Gene expression profiling in breast Cancer: understanding the molecular basis of histologic grade to improve prognosis. J Natl Cancer Inst. 2006;98(4):262–72.

    Article  CAS  Google Scholar 

  26. Chia SK, Bramwell VH, Tu D, Shepherd LE, Jiang S, Vickery T. A 50-gene intrinsic subtype classifier for prognosis and prediction of benefit from adjuvant tamoxifen. Clin Cancer Res. 2012;18(16):4465–72.

    Article  CAS  Google Scholar 

  27. Voduc KD, Cheang MCU, Tyldesley S, Gelmon K, Nielsen TO, Kennecke H. Breast Cancer subtypes and the risk of local and regional relapse. J Clin Oncol. 2010;28(10):1684–91.

    Article  Google Scholar 

  28. Wen G, Zhang J-S, Zhang Y-J, Zhu Y-J, Huang X-B, Guan X-X. Predictive value of molecular subtyping for Locoregional recurrence in early-stage breast Cancer with N1 without Postmastectomy radiotherapy. J Breast Cancer. 2016;19(2):176–84.

    Article  Google Scholar 

  29. Priedigkeit N, Hartmaier RJ, Chen Y, et al. Intrinsic subtype switching and acquired erbb2/her2 amplifications and mutations in breast cancer brain metastases. JAMA Oncology. 2017;3(5):666–71.

    Article  Google Scholar 

  30. Kimbung S, Loman N, Hedenfalk I. Clinical and molecular complexity of breast cancer metastases. Semin Cancer Biol. 2015;35:85–95.

    Article  CAS  Google Scholar 

  31. Oehrlich NE, Spineli LM, Papendorf F, Park-Simon T-W. Clinical outcome of brain metastases differs significantly among breast cancer subtypes. Oncol Lett. 2017;14(1):194–200.

    Article  CAS  Google Scholar 

  32. Mamounas EP, Liu Q, Paik S, Baehner FL, Tang G, Jeong J-H, Kim SR, Butler SM, Jamshidian F, Cherbavaz DB, et al. 21-gene recurrence score and Locoregional recurrence in node-positive/ER-positive breast Cancer treated with chemo-endocrine therapy. JNCI. J Natl Cancer Inst. 2017;109(4):1–8.

    Article  Google Scholar 

  33. Mamounas EP, Tang G, Fisher B, Paik S, Shak S, Costantino JP, Watson D Jr. CEG, Wickerham DL, Wolmark N: association between the 21-gene recurrence score assay and risk of Locoregional recurrence in node-negative, estrogen receptor–positive breast Cancer: results from NSABP B-14 and NSABP B-20. J Clin Oncol. 2010;28(10):1677–83.

    Article  Google Scholar 

  34. Fitzal F, Filipits M, Rudas M, Greil R, Dietze O, Samonigg H, Lax S, Herz W, Dubsky P, Bartsch R, et al. The genomic expression test EndoPredict is a prognostic tool for identifying risk of local recurrence in postmenopausal endocrine receptor-positive, her2neu-negative breast cancer patients randomised within the prospective ABCSG 8 trial. Br J Cancer. 2015;112(8):1405–10.

    Article  CAS  Google Scholar 

  35. Servant N, Bollet MA, Halfwerk H, Bleakley K, Kreike B, Jacob L, Sie D, Kerkhoven RM, Hupé P, Hadhri R, et al. Search for a gene expression signature of breast Cancer local recurrence in young women. Clin Cancer Res. 2012;18(6):1704–15.

    Article  CAS  Google Scholar 

  36. Varga Z, Sinn P, Fritzsche F, von Hochstetter A, Noske A, Schraml P, Tausch C, Trojan A, Moch H. Comparison of EndoPredict and Oncotype DX test results in hormone receptor positive invasive breast Cancer. PLoS One. 2013;8(3):e58483.

    Article  CAS  Google Scholar 

  37. Alvarado MD, Prasad C, Rothney M, Cherbavaz DB, Sing AP, Baehner FL, Svedman C, Markopoulos CJ. A prospective comparison of the 21-gene recurrence score and the PAM50-based Prosigna in estrogen receptor-positive early-stage breast Cancer. Adv Ther. 2015;32(12):1237–47.

    Article  CAS  Google Scholar 

  38. Jaggi R, Varga Z, Bigler M, Bize V, Bustamante Eduardo M, Berardi S, Chiesa F, Dedes KJ, Müller A, Tausch C, et al. A correlative study of Ki67 and two multigene RNA expression signatures in operable ER-positive postmenopausal breast cancer (SAKK 26/10). Eur J Cancer. 1971;2015(51):S324.

    Google Scholar 

Download references

Acknowledgements

We thank N. Schuster for excellent technical assistance and the physicians and pathologists from the Institute of Pathology, Bern, and the Pathologie Länggasse, Bern, for providing material and corresponding clinicopathological data. We are grateful to the Institute of Pathology, Bern, for preparing core punches from archival tissue blocks.

Funding

MBE was supported by the Berger-Janser Foundation (Bern). VP was supported by the RECETOX Research Infrastructure (LM2015051 and CZ.02.1.01/0.0/0.0/16_013/0001761).

AG received financial support for his research from Zonta Group Bern, Novartis Foundation, AstraZeneca, Pfizer and Bayer Pharma AG. The funding body had no involvement in the study design, collection, analysis or interpretation of data or in writing the manuscript.

Author information

Authors and Affiliations

  1. Department for Biomedical Research, University of Bern, Murtenstrasse, 40, 3008, Bern, Switzerland

    Mariana Bustamante Eduardo & Rolf Jaggi

  2. RECETOX, Faculty of Science, Masaryk University, Brno, Czech Republic

    Vlad Popovici

  3. Department of Gynecology and Obstetrics, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland

    Sara Imboden

  4. Department of Medical Oncology, Cantonal Hospital of Lucerne, Lucerne, Switzerland

    Stefan Aebi

  5. Breast Center Unit at gyn-zentrum, Lucerne, Switzerland

    Nadja Ballabio & Andreas Günthert

  6. consultarif DRG, Lohn-Ammannsegg, Switzerland

    Hans Jörg Altermatt

Authors
  1. Mariana Bustamante Eduardo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vlad Popovici
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sara Imboden
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Stefan Aebi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Nadja Ballabio
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hans Jörg Altermatt
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Andreas Günthert
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Rolf Jaggi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

S.I., N.B., H.J.A., S.A. and A.G. contributed by providing clinical material and clinical and pathological data. The clinical and pathological data were assembled by S.I and N.B. The experimental part and evaluation of data were performed by M.B.E., V.P. and R.J., bioinformatics analyses were performed by M.B.E. and V.P. The manuscript was written by M.B.E. and R.J. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Rolf Jaggi.

Ethics declarations

Ethics approval and consent to participate

Clinical studies have to be presented to Cantonal Ethics Committees in Switzerland. Material that was used for this study was from patients and pathological samples that were collected in part before 1990 when informed consents were not commonly used. The Swiss law allows the use of such material under specific and very restrictive conditions. The Cantonal Ethics Committee of the Canton Bern examined the study and approved it on January, 18, 2018. The reference number is Ref 2017–02025.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional files

Additional file 1:

Gene Identifications, Categories and Score affiliations. The list contains all the genes (gene symbols and accession numbers). The column marked “Score” indicates for each gene whether it is part of PAM50 (1), RISK (2), RS (3) and/or EP (4). ROR-P is part of PAM50. Reference genes are marked (Ref). (XLS 32 kb)

Additional file 2:

Comparison of IHC and gene expression in primary tumours. A, Primary tumours were dichotomized into ER-negative (ER–) and ER-positive tumours (ER+) based on antibody staining using 1% labelling as threshold. The relative gene expression of ESR1 (mRNA for ER) was plotted for each tumour (y-axis). Similarly, the gene expression of PGR was plotted for primary tumours dichotomized into PR-negative (−) and PR-positive (+) tumours using 1% labelling as threshold. C, The Her2-negative (Her2–) and Her2-positive tumours (Her2+) were compared to ERBB2 expression. D, Finally, the proliferation marker Ki-67 was quantified with MIB1 antibody and cells were dichotomized based on the labelling index (LI). The LI high was defined high when LI ≥ 14% and low for LI < 14%. The LI was plotted against the mRNA coding for Ki-67, MKI67 (relative expression levels of ESR1, PGR, ERBB2 and MKI67 after log2 transformation). Boxplots show interquartile ranges, whiskers go to 2.5 and 97.5 percentiles, dots are used for outliers. Statistical evaluations were performed using the Mann-Whitney test. The p-values (two-tailed) for each analysis are shown for each plot. (PDF 34 kb)

Additional file 3:

Raw data from NanoString experiment. This spreadsheet contains the raw nCounter data used for the comparisons. (XLS 4183 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bustamante Eduardo, M., Popovici, V., Imboden, S. et al. Characterization of molecular scores and gene expression signatures in primary breast cancer, local recurrences and brain metastases. BMC Cancer 19, 549 (2019). https://doi.org/10.1186/s12885-019-5752-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12885-019-5752-8

Keywords

BMC Cancer

ISSN: 1471-2407

Contact us