Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

SISH/CISH or qPCR as alternative techniques to FISH for determination of HER2 amplification status on breast tumors core needle biopsies: a multicenter experience based on 840 cases

  • Jocelyne Jacquemier1Email author,
  • Frédérique Spyratos2,
  • Benjamin Esterni1,
  • Marie-Joëlle Mozziconacci1,
  • Martine Antoine3,
  • Laurent Arnould4,
  • Sarab Lizard4,
  • Philippe Bertheau5,
  • Jacqueline Lehmann-Che5,
  • Cécile Blanc Fournier6,
  • Sophie Krieger6,
  • Frédéric Bibeau7,
  • Pierre-Jean Lamy7,
  • Marie Pierre Chenard8,
  • Michèle Legrain8,
  • Jean-Marc Guinebretière2,
  • Delphine Loussouarn9,
  • Gaëtan MacGrogan10,
  • Isabelle Hostein10,
  • Marie Christine Mathieu11,
  • Ludovic Lacroix11,
  • Alexander Valent11,
  • Yves Marie Robin12,
  • Françoise Revillion12,
  • Magali Lacroix Triki13,
  • Aline Seaume13,
  • Anne Vincent Salomon14,
  • Patricia de Cremoux15,
  • Geneviève Portefaix16,
  • Luc Xerri1,
  • Sophie Vacher2,
  • Ivan Bièche2 and
  • Frédérique Penault-Llorca16
Contributed equally
BMC Cancer201313:351

https://doi.org/10.1186/1471-2407-13-351

Received: 13 February 2013

Accepted: 28 June 2013

Published: 22 July 2013

Abstract

Background

Until now, FISH has been the gold standard technique to identify HER2 amplification status in ambiguous cases of breast cancer. Alternative techniques have been developed to increase the capacities of investigating HER2 amplification status. The aims of this multicenter study in a large series of breast cancer patients were to prospectively compare the level of performance of CISH, SISH, and qPCR alternative techniques on paraffin-embedded core biopsies with “gold standard FISH” for evaluation of HER2 amplification status.

Methods

This study was performed on 840 cases scored by immunohistochemistry (IHC): 0=317 (38%), 1+=183 (22%), 2+=109 (13%), 3+=231 (27%). Each of the 15 French centers participating in the study analyzed 56 breast carcinoma cases diagnosed on fixed paraffin-embedded core biopsies. HER2 amplification status was determined by commercially available FISH used as the reference technique with determination of the HER2/CEN17 ratio or HER2 copy number status. The alternative techniques performed on the same cases were commercially available SISH or CISH and a common qPCR method especially designed for the study including a set of 10 primer pairs: 2 for HER2 (exons 8 and 26), 5 to evaluate chromosome 17 polysomy TAOK1, UTP6, MRM1, MKS1, SSTR2 and 3 for diploidy control TSN, LAP3 and ADAMTS16.

Results

The concordance between IHC and FISH was 96% to 95% based on the HER2/CEN17 ratio (n=766) or HER2 copy number (n=840), respectively. The concordance of the alternative techniques with FISH was excellent: 97% and 98% for SISH (498 and 587 cases), 98% and 75% for CISH (108 and 204 cases) and 95% and 93% (699 and 773 cases) for qPCR based on the HER2/CEN17 ratio or HER2 copy number, respectively. Similarly, sensitivity ranged from 99% to 95% for SISH, 100% to 99% for CISH and 89% to 80% for qPCR. The concordance with FISH (ratio) in the 2+ cases was 89% for SISH, 100% for CISH and 93% for qPCR.

Conclusion

These alternative techniques showed an excellent concordance with FISH in core biopsies allowing their use in routine clinical practice. This newly designed qPCR on paraffin-embedded core biopsies deserves special attention, as it is reliable, easy to perform and less expensive than ISH tests.

Keywords

HER2 FISH SISH CISH qPCR Multicenter analysis

Background

HER2 overexpression occurs in 14% to 20% of early breast cancers. The poor prognosis initially described for these HER2-positive cases has been corrected by the development of a humanized monoclonal antibody, trastuzumab (HERCEPTIN®) that significantly improves the survival of patients with HER2-positive status, as demonstrated by numerous clinical trials [1, 2]. Immunohistochemistry (IHC) using scoring tools such as the “Hercept scale” and, more recently, the ASCO/CAP scale, was the simplest way to identify positive cases likely to benefit from trastuzumab [3]. However, according to this scale, HER2 amplification of 2+ cases had to be confirmed by Fluorescent in situ hybridization (FISH).

IHC is susceptible to interobserver variability and, as with any assay technique, required standardization and validation [310]. A very good correlation has been demonstrated between HER2 protein overexpression and HER2 gene amplification [11]. Therapeutic response to trastuzumab was observed exclusively in patients harboring HER2 gene amplification [12]. Some neoadjuvant studies suggested that the level of response was correlated with the level of gene amplification [13], while large-scale prospective adjuvant clinical trials failed to demonstrate this correlation [14]. HER2 amplification status can be analyzed by FISH, which is a sensitive and specific method that identifies the number of copies of the HER2 gene often in conjunction with the chromosome 17 centromere and is considered to be the “gold standard”. However, FISH is not readily available, requires very specific training [15], is time-consuming requiring the use of a fluorescent microscope and cytogenetic skills, and is also expensive. Chromogenic in situ hybridization (CISH) [16] and silver-enhanced in situ hybridization (SISH) [1721] are new bright field techniques that have been more recently introduced for determination of HER2 gene status. Quantitative real-time polymerase chain reaction (qPCR) is such a rapid, sensitive and quantitative alternative technique [2229], requiring small amounts of tissue and which can be performed on paraffin-embedded samples. Moreover, it has a high throughput capacity.

The main objective of this multicenter study, based on large series of patients, was to prospectively compare the performance level of the CISH, SISH and qPCR alternative techniques on core biopsy specimens with the “gold standard FISH” for evaluation of HER2 amplification status. The second objective was to conduct a medico-economic study, which is not reported in this paper. This study was conducted by 15 hospitals homogeneously distributed throughout France in the framework of a project entitled "Support Program for Costly Diagnostic and Therapeutic Innovations" supported by the French Institute of Cancer (INCa).

Results

Population characteristics

The mean age of the patients included in the study was 58.6 years; 92% of women had non-inflammatory breast cancer, and the mean clinical diameter of the lesion was 26.75 mm.

The study was confined to core biopsies performed before therapy: 89% of core biopsies were microbiopsies, including 81% of 14 G needle biopsies. The median value of tumor cellularity was 60% (5-100). The intraductal component represented a mean of 3.9%. Only 12% of core biopsies had a fixation time of less than 4 hours.

Immunohistochemistry and FISH

IHC and FISH with HER2 copy number were available for 840 breast cancer cases: 766 cases were analyzed by a double probe technique allowing calculation of both HER2 copy number and HER2/CEN17 ratio. The remaining 74 cases were analyzed by a mono-probe technique only taking into account HER2 copy number.

A strong correlation was observed between the ASCO/CAP score for IHC and the FISH level of amplification (Tables 1 and 2). On FISH, 223/766 (29%) cases had a ratio greater than 2.2 (Table 1) and 248/840 (29.5%) cases had an HER2 copy number greater than 6 (Table 2).
Table 1

Distribution of the 766 cases analyzed by double probe FISH expressed as HER2/CEN17 ratio in 3 categories with respect to the CISH, SISH and QPCR alternative techniques

Techniques

Class

Number of cases

FISH ratio <1.8 N=534 (%)

FISH ratio [1.8-2.2] N=9 (%)

FISH ratio >2.2 N=223 (%)

IHC

0

287

282 (98.2)

3 (1)

2 (0.8)

 

1+

172

166 (96.5)

3 (1.75)

3 (1.75)

 

2+

95

77 (81)

2 (2.2)

16 (16.8)

 

3+

212

9 (4.2)

1 (0.4)

202 (95.2)

SISH

<1.8

331

327 (98.8)

3 (0.9)

1 (0.3)

 

[1.8-2.2]

11

7 (63.7)

3 (27.3)

1 (9)

 

>2.2

156

10 (6.4)

1 (0.6)

145 (92.9)

 

ND or NA

268

190

2

76

CISH

<1.8

75

74 (98.7)

1 (1.3)

0

 

[1.8-2.2]

0

0

0

0

 

>2.2

33

2 (6)

0

31 (94)

 

ND or NA

658

458

8

192

qPCR

<1.8

492

471 (95.7)

5 (1)

16 (3.3)

 

[1.8-2.2]

12

5 (41.7)

0

7 (58.3)

 

>2.2

195

12 (6.2)

3 (1.5)

180 (92.3)

 

ND or NA

67

46

1

20

ND: not done.

NA: not available.

Table 2

Distribution of the 840 cases analyzed by mono or double probe FISH expressed as HER2 copy number (cutoff set at 6 HER2 copies) with respect to the CISH, SISH and QPCR alternative techniques

Techniques

Class

Number of cases

FISH Copies Number <6 N=592 (%)

FISH Copies Number >=6 N=248 (%)

IHC

0

317

316 (99.6)

1 (0.4)

 

1+

183

179 (97.8)

4 (2.2)

 

2+

109

86 (78.9)

23 (21.1)

 

3+

231

11 (4.8)

220 (95.2)

SISH

<6

417

409 (98)

8 (2)

 

>=6

170

4 (2.4)

166 (97.6)

 

ND or NA

243

179

74

CISH

<6

89

88 (98.8)

1 (0.2)

 

>=6

115

49 (42.6)

66 (57.4)

 

ND or NA

636

455

181

qPCR

<6

576

531 (92.2)

45 (7.8)

 

>=6

197

12 (6)

185 (94)

 

ND or NA

67

49

18

ND: not done.

NA: not available.

Among the 3+ IHC cases, 95.2% had an HER2/CEN17 ratio greater than 2.2, and 95.2% had an HER2 copy number greater than 6. Among the 2+IHC cases, 16.8% had an HER2/CEN17 ratio greater than 2.2, 21.1% had an HER2 copy number greater than 6 and 2.2% had a borderline HER2/CEN17 ratio (1.8-2.2). In the 1+ IHC category, 1.75% of cases had an HER2/CEN17 ratio greater than 2.2 and 1.75% of cases had a borderline ratio. Only 2.2% of the 1+ cases had an HER2 copy number greater than 6. A similar correlation was obtained with the 0 IHC category, in which 0.8% of cases had an HER2/CEN17 ratio >2.2 and 0.4% of cases had an HER2 copy number greater than 6.

As shown in Additional file 1: Table S3, results are very similar when the HER2/CEN 17 ratio cutoff is set at 2. In this situation, the number of patients eligible for Trastuzumab is higher for SISH (n=6) and qPCR (n=4) and identical for CISH.

Concordance between FISH and alternative techniques

The results of IHC, FISH and alternative techniques are presented in Tables 1 and 2, expressed in terms of the HER2/CEN17 ratio in 3 categories and the HER2 copy number, respectively. Concordances and predictive values are presented in Tables 3 and 4.
Table 3

Predictive value of each alternative technique compared with FISH expressed as HER2/CEN17 ratio in 3 categories in the overall population (n=766) and in the IHC 2+ subpopulation

Techniques

Population

Concordance (95%CI)

Sensitivity (95%CI)

Specificity (95%CI)

Positive predictive value (95%CI)

Negative predictive value (95%CI)

IHC

All (N=766)

96% [94-97]

91% [86-94]

98% [97-99]

95% [91-98]

96% [94-98]

SISH

All (N=498)

97% [96-99]

99% [95-100]

97% [94-98]

93% [88-96]

99% [98-100]

 

IHC 2+ (N=54)

89% [77-96]

80% [44-97]

91% [78-97]

67% [35-90]

95% [84-99]

CISH

All (N=108)

98% [93-100]

100% [89-100]

97% [91-100]

94% [80-99]

100% [95-100]

 

IHC 2+ (N=18)

100% [81-100]

100% [16-100]

100% [79-100]

100% [16-100]

100% [79-100]

qPCR

All (N=699)

95% [93-96]

89% [83-93]

97% [95-98]

92% [88-96]

95% [93-97]

 

IHC 2+ (N=86)

93% [85-97]

73% [45-92]

97% [90-100]

85% [55-98]

95% [87-98]

CI: confidence interval.

Table 4

Predictive value of each alternative technique compared with FISH expressed as HER2 copy number (cutoff set at 6 HER2 copies) in the overall population (n=840) and in the IHC 2+ subpopulation

Techniques

Population

Concordance (95%CI)

Sensitivity (95%CI)

Specificity (95%CI)

Positive predictive value (95%CI)

Negative predictive value (95%CI)

IHC

All (N=840)

95% [94-97]

89% [84-92]

98% [97-99]

95% [92-98]

95% [93-97]

SISH

All (N=587)

98% [96-99]

95% [91-98]

99% [98-100]

98% [94-99]

98% [96-99]

 

IHC 2+ (N=60)

90% [81-96]

72% [47-90]

96% [87-100]

87% [60-98]

91% [81-97]

CISH

All (N=204)

75% [69-81]

99% [92-100]

64% [56-72]

57% [48-67]

99% [94-100]

 

IHC 2+ (N=27)

62% [42-79]

100% [40-100]

56% [35-76]

27% [8-55]

100% [77-100]

qPCR

All (N=773)

93% [91-94]

80% [75-85]

98% [96-99]

94% [90-97]

92% [90-94]

 

IHC 2+ (N=86)

86% [78-92]

45% [24-68]

97% [91-100]

83% [52-98]

86% [77-93]

CI: confidence interval.

Each center was required to perform IHC, FISH, SISH or CISH and qPCR for each case. For various reasons, this objective was not achieved and some participants were unable to perform all methods.

Among the 498 cases evaluable by SISH with FISH expressed as a ratio, 156 had an HER2/CEN17 ratio greater than 2.2 (Table 1) and a global concordance of 97% with FISH (Table 3). The Figure 1 shows the correlation between FISH and CISH in terms of HER2/CEN17 ratio expressed in 3 categories. Among the 587 cases evaluable by SISH with FISH expressed as HER2 copy number, 170 cases had an HER2 copy number greater than 6 (Table 2) with a global concordance of 98% with FISH (Table 4). The Figure 2 shows the correlation between FISH and SISH in terms of HER2/CEN17 ratio expressed in 3 categories.
Figure 1

Correlation between FISH and CISH in terms of HER2/CEN17 ratio mentioning the three categories cutoff.

Figure 2

Correlation between FISH and SISH in terms of HER2/CEN17 ratio mentioning the three categories cutoff.

Among the 108 cases analyzed by CISH with FISH expressed as a ratio, 33 had an HER2/CEN17 ratio greater than 2.2 (Table 1) and a global concordance 98% with FISH (Table 3). On the 115 of cases who had an HER2 copy number greater than 6 (Table 2) we observed only 75% concordance between the two methods (Table 4).

Of the 699 cases analyzed by qPCR with FISH expressed as a ratio, 195 cases had an HER2/CEN17 ratio greater than 2.2 (Table 1) and a global concordance of 95% with FISH (Table 3). The Figure 3 shows the correlation between FISH and qPCR in terms of HER2/CEN17 ratio expressed in 3 categories.
Figure 3

Correlation between FISH and qPCR in terms of HER2/CEN17 ratio mentioning the three categories cutoff.

Among the 773 cases analyzed by qPCR with FISH expressed as HER2 copy number, 197 had an HER2 copy number greater than 6 (Table 2) corresponding to 93% of global concordance with FISH (Table 4).

Predictive value of each alternative technique

The sensitivity of qPCR appeared to be slightly lower than that of CISH and SISH. However, a higher sensitivity was observed when FISH was expressed as the HER2/CEN17 ratio in 3 categories (Table 3) than when it was expressed as HER2 copy number (Table 4). A very high specificity (97%) was observed for 3 alternative techniques when FISH was expressed as the HER2/CEN17 ratio. When FISH was expressed as HER2 copy number, SISH and qPCR were associated with very high specificities (99% and 98% respectively), while the specificity of CISH was only 64%.

When the HER2/CEN17 ratio cutoff was set at 2, the level of predictive value is quite similar (Additional file 1: Table S4).

Predictive value of alternative techniques in the subpopulation of 2+ cases

A marked heterogeneity was observed between the 15 centers in terms of the proportion of amplified cases (FISH HER2/CEN17 ratio greater than 2.2) among the 2+ cases, varying from 0% in three centers to less than 25% in nine centers and more than 25% in the other three centers. The results, especially the CISH results, must be interpreted cautiously in view of the small number of 2+ cases analyzed by an alternative technique (86 for qPCR, 54 for SISH and only 18 for CISH). Indeed, CISH appeared to have very good predictive values for 2+ cases, but this could not be formally demonstrated due to the small number of cases.

When FISH was expressed as a ratio in 3 categories (Table 3), the highest concordance was observed for CISH (100%) followed by qPCR (93%) and SISH (89%). When FISH was expressed as copy number (Table 4), the highest concordance was observed for SISH (90%) followed by qPCR (86%) and CISH (62%).

Except for CISH, lower sensitivity was observed when FISH was expressed as HER2 copy number rather than HER2/CEN17 ratio (72% for SISH and 45% for qPCR). When FISH was expressed as HER2/CEN17 ratio, the highest specificity was observed for SISH and very similar results were observed for qPCR (97%) and for CISH (91%). When FISH was expressed as HER2 copy number, high specificities were observed for SISH and qPCR, while CISH specificity was only 56%.

When the HER2/CEN17 ratio cutoff was set at 2, the level of predictive value is quite similar; higher specificity level was observed for qPCR (Additional file 1: Table S4).

Discussion

We have previously demonstrated the accuracy of HER2 determination on core biopsies with respect to surgical resection by using alternative techniques to FISH such as CISH and SISH [17]. The present multicenter study, performed on consecutive cases from 15 French institutions, is the largest series performed on paraffin-embedded diagnostic core biopsies, demonstrating correlations between IHC, FISH and additional alternative methods i.e. CISH or SISH and qPCR. Few analyses have been done on needle core biopsies exclusively and in a so large multicenter manner. Analysis of core biopsies represents real clinical practice for patients receiving neoadjuvant therapy. The global concordance of IHC with FISH in these cases was excellent and comparable to that reported in previous studies mainly performed on surgical specimens [9, 3133]. Each of the 15 participating institutions had to use the alternative “in situ” technique used routinely in their respective laboratory, which explains why only 204 cases of this series were analyzed by CISH. Following completion of this study, CISH was widely replaced by SISH, which is more rapid, more reproducible and more easily automated [31]. However in this study, the concordance between CISH and FISH was excellent and similar to that reported in previous studies [3437]. SISH gave also an excellent concordance with FISH in this series, i.e. comparable to that previously reported [1821], for example Papouchado’s study based on 298 surgical specimens who reported a concordance of 92.1% with a high level of reproducibility (96.6%) between ten pathologists [18].

The correlation between FISH and qPCR was also excellent. Despite the heterogenous variable expertise of the various participants at the beginning of the study, the preliminary training steps, the common protocol and common controls and reagents resulted in an excellent yield, as only seven cases were not interpretable and only three cases had to be repeated in a second series of slides (not shown). Molecular analysis was performed on paraffin-embedded core biopsies in contrast with most published studies, which were generally performed on frozen surgical material [2225]. Some studies were performed on paraffin sections but were based on a small number of cases and used the HER-2/neu Quantification Kit™ developed by Roche for a LightCycler platform [2628]. This kit has now been withdrawn from the market, as it was shown to be not optimal to detect chromosome 17 polysomy [29]. With a concordance of 95% with FISH, the results of the present study are comparable to those of previous studies [2329]. The qPCR assay designed for this study was performed with five probes located on chromosome 17 (arm 17q) to distinguish between chromosome 17 polysomy and HER2 focal amplification. Overall, the correlation with FISH was better in the overall population and in the 2+ cases when the results were expressed as the HER2/CEN17 ratio, suggesting that this is a suitable approach. The potential disadvantage of qPCR is that it cannot avoid dilution artefacts inherent to DNA extraction in heterogeneous tumor specimens. Macrodissection is now used in the routine detection of KRAS, EGFR, BRAF… mutations and its systematic use in this study could have further improved the performances of qPCR in cases with low cellularity. However, the high level of cellularity (median value of 60%) and the low percentage of in situ component observed in this series should be stressed. These results on paraffin sections are very encouraging for routine clinical practice, as, when studying paraffin-embedded material, DNA material is easier to use than RNA, which is more sensitive to fixation conditions and degradation, resulting in a potential risk of HER2 misclassification [38]. At last, the high throughput capacity of qPCR and its attractive cost price are worth noting.

We observed very similar results using a HER2/CEN17 ratio expressed in 3 categories or in 2 categories with a cutoff set at 2, as it has been recently suggested.

These alternative techniques to FISH could be used in routine practice as a primary test or to more reliably evaluate ambiguous 2+ cases, particularly in the neoadjuvant setting. The frequency of HER2 amplification demonstrated by FISH in 2+ cases is consistent with the results published in the literature [31, 39] with 16.8% of cases presenting an HER2/CEN17 ratio greater than 2.2 and 21.1% of cases presented an HER2 copy number greater than 6. In general, the 2+ cases present low levels of amplification and low copy numbers depending on the percentage of true complete membrane staining [40]. It has been demonstrated that this category may present high rates of polysomy, which would explain why a high copy number can be associated with an HER2/CEN17 less than 2.2 [41], consequently improving the positive predictive value with the true HER2 copy number. An excellent concordance with FISH was observed for both SISH and qPCR, the sensitivity was lower than in the overall population, but nevertheless associated with a better positive value for qPCR when FISH is expressed as the HER/CEN17 ratio. These results suggest that the use of several probes to estimate polysomy provides a better correlation with FISH than when only the HER2 copy number is used. Equivalent positive predictive values were obtained when these two techniques were based on HER2 copy number.

Another important point is the fact that 2+ cases are considered to be the most heterogeneous category, explaining the discordance between core biopsies and surgical specimens [42] and the technique cannot be repeated on surgical specimens in the neoadjuvant setting. These discrepancies are observed more frequently around the cut-off used to define positivity [40].

The marked variation between centers in terms of the level of amplification in 2+ cases suggests that the IHC technique must be more closely standardized for these cases. According to the guidelines, 2+ amplified cases must be included in external controls for IHC [6, 7, 35], but these cases are rare and present amplification in less than 25% of cases, for example 14% in the Nottingham series [42]. The 2+ cases correspond to the cases with the most marked genetic heterogeneity [43] with a lower level of amplification compared to 3+ cases [44]. This amplification is related to the percentage of positive membrane staining cells [42]. Under these conditions, needle core biopsies are the least appropriate specimens for 2+ cases. All of these borderline and heterogeneous situations therefore required repeated analysis or the use of alternative techniques.

Medico-economic aspects must also be taken into account in the choice of method. The medico-economic study is ongoing in the same patient series, but the results are not reported here.

Conclusions

This multicenter study shows that SISH, CISH and qPCR alternative techniques to evaluate HER2 amplification status are easy to use and provide encouraging results. In ambiguous cases scored 2+ by IHC, the heterogeneity, the small proportion of amplified cases, and the lower HER2 copy number must be taken into account in the neoadjuvant setting to assess HER2 status on core biopsies. In this case, the use of various alternative techniques such as SISH and qPCR could be a reliable approach.

The qPCR protocol used in the 15 participating institutions was found to be an acceptable alternative to FISH to detect HER2 amplification in paraffin-embedded material.

Methods

Patient selection

This study is a non-interventional study and no written consent was needed. In agreement with the French legislation, the protocol was approved by the Comité Consultatif sur le Traitement de l’Information en matière de Recherche dans le domaine de la Santé (CCTIRS) and declared to the Commission Nationale de l’Informatique et des Libertés (CNIL).

The required number of patients was estimated according to the expected FISH positivity of each IHC level according to ASCO/CAP 2007 [3]: 840 cases were necessary: 0=317 (38%), 1+= 183 (22%), 2+= 109 (13%), 3+ =231 (27%). Each of the 15 centers complied with this proportion by recruiting a mean of 56 cases.

Tumor cell percentage and presence of an in situ component were assessed on Hematein/Eosin stained sections.

A representative block of fixed paraffin-embedded tumor tissue from each patient was selected and used to prepare sections for IHC and FISH/SISH/CISH. Four additional 10-μm sections were taken from the same block for DNA extraction and qPCR.

a) IHC and in situ hybridization

All 15 centers participate in the French national annual quality control (AFAQAP) and are members of the GEFPICS group [4, 9]. According to French guidelines, the choice of method (IHC vs ISH, brand of antibodies or ISH kits) is left to the pathologist’s discretion. The list of the antibodies used by the participants is given in Additional file 1: Table S1. As different fixatives are used in routine practice, a training step was conducted before initiation of this study using two types of tissue micro-arrays (TMA) representative of the fixative used in each center. A 0.6 mm diameter needle was used for the TMA. The first TMA was performed with alcohol formalin (AF) used by 41% of the participants, the second TMA was performed with formalin (F) used by the remaining 59% of participants. Each TMA included 13 cases 6/3+, 2/2+ 3/1+ and 2/0 and 3 control cell lines with various HER2 amplification levels (T47D, MCF7, BT474). The amplification level of each case was evaluated by FISH by two of the authors (JJ/FPL).

Each participant was required to validate IHC and CISH or SISH and FISH in situ techniques on the TMA depending on the fixative used in the center (AF or F). The good concordance obtained (92%) allowed initiation of the study. The cases included in these TMA were also used for qPCR training.

The 2007 ASCO/CAP [3, 30] guidelines were used to define IHC categories: negative = no membrane staining, 1+ = faint or barely perceptible membrane staining, 2+ = 10-30% of strong complete membrane staining or >10% tumor cells with moderate complete membrane staining, 3+ = more than 30% strong complete membrane staining.

A minimum of 20 tumor nuclei are required for in situ hybridization on core biopsy. FISH was performed with a dual probe kit (HER2 and CEN17) HER2 FISH pharmDx™ (Dako France SAS, Trappes, France) or Vysis Path Vysion (Abbott France SAS, Rungis, France). A mono-probe kit INFORM (Ventana Medical Systems SA, Illkirch, France) was used in one center. SISH was performed in 10 centers using the Ventana Kit on Benchmark XT(Roche Diagnostic, Meylan, France) (http://www.ventana.com). CISH was performed in 5 centers according to the DAKO or Cytovision kits (Leica/Cytovision, Nanterre, France). The following cut-offs were used according to the 2007 ASCO/CAP [3, 30] guidelines: amplified (R >2.2) borderline amplification (1.8-2.2) and non amplified (<1.8). A second analysis was performed with the cutoff set at 2: amplified (R>=2) and non amplified (R<2).

b) qPCR

qPCR was coordinated by two of the authors (FS, IB) at the Institut Curie - Hôpital René Huguenin (IC-HRH). All 15 participants used the same DNA extraction procedure (QIAamp kit, Qiagen). The qPCR method was performed in 14 centers; samples from one center were blindly analyzed in the coordinator’s lab without knowledge of the IHC or FISH status. One centre participated to the preliminary steps of the study but did not perform the prospective study.

At the beginning of the project, participants had different levels of expertise in PCR assays. Three rounds of tests were organized before initiating the prospective study in order to test and standardize practices and to define the most appropriate primer pairs for evaluation of HER2 amplification, chromosome 17 polysomy and diploidy controls. The reference genes, located on the same chromosome as HER2, provide a control for DNA quality and loading and are also used as an internal control gene to evaluate chromosome 17 polysomy. The choice of the probes used to detect polysomy was focused on the 17q arm.

A total of 22 primer pairs were tested in three preliminary tests, 7 for HER2, 8 for evaluation of chromosome 17 polysomy and 7 for diploidy control. Primer pairs were chosen on the basis of CGH array studies performed at the IC/HRH, published data and previous experience of HER2 amplification on frozen breast tumors [22]. The initial tool was modified during the course of the 3 preliminary tests. The following material was used to test the evolving tool: three consecutive series of 15 breast cancer tumors provided by the participants (secondarily anonymized and redistributed by the coordinator) with known HER2 status; appropriate controls (normal lymph nodes, cell lines) and cases with various DNA qualities to test the robustness of the assay.

The coordinators proposed a final common protocol to the participants for the prospective study, including 10 sets of primer pairs: 2 for HER2 (exons 8 and 26), 5 for chromosome 17 polysomy detection: TAOK1 at 17q11.2 (sub-centromeric region), UTP6 at 17q11.2 (sub-centromic region), MRM1 at 17q12, MKS1 at 17q22 and SSTR2 at 17q24, and 3 for diploidy control: TSN at 2q14, LAP3 at 4p15 and ADAMTS16 at 5p15 (Additional file 1: Table S2).

Participants received detailed instructions on the technique and vials containing the oligonucleotides for the 10 genes and for the prospective cases to be tested, together with DNA extracted from normal lymph nodes and SKBR-3 breast cancer cell lines, as controls for non-amplified and amplified HER-2 gene copy, respectively. PCR analyses were performed in duplicate in a 10 μL reaction volume. A quantity of 200 ng DNA was necessary for each patient for duplicate analysis of the ten genes (10 ng/PCR reaction). Each participant used his/her own quantitative PCR platform. Considering the threshold of each device, most participants used Applied Biosystems material with the same threshold set at 0.20 for the Appled 7900 for example. For the other devices, threshold was adapted during the preliminary steps of the study. Participants also received Excel sheets with pre-calculated areas from individual Ct values obtained for each gene. In order to be comparable with FISH and SISH/CISH, qPCR data were expressed as the median copy number of the 5 genes used for “chromosome 17 control” and assessment of polysomy, and the median HER2 copy number. Finally, these two numbers were used to calculate the HER2/CEN17 ratio. Cycle threshold (Ct) values above 35 were excluded. Cut-offs used for HER2 amplification status by qPCR were similar to those used in in situ methods.

A database was created with the following parameters provided by the participants:

Hematein-Eosin staining: histological type, percentage of tumor cellularity, proportion of in situ component, grade, core size, fixative, fixation time.

Immunohistochemistry: antibody and dilution, type of pre-treatment, ASCO/CAP 2007 score with the percentage of positive cells and intensity [3].

FISH: 1) name of the kit used; 2) number of nuclei analyzed; 3) absolute and mean HER2 copy number; 4) absolute and mean Chromosome 17 number; 5) HER2/CEN17 ratio and final results with the cut-off values according to ASCO/CAP 2007 guidelines:; 5) the number of times the technique was repeated, when applicable.

CISH and SISH were analyzed according to the same plan.

qPCR: 1) Quality of the DNA 260/280 absorbance ratio (evaluated by Nanodrop™); 2) HER2 copy number; 3) reference gene copy number; 4) final ratio for HER2 status using the same cut-off values as for FISH; 5) the number of times the technique was repeated, when applicable.

Statistical analysis

The sample size was calculated to ensure a lower boundary of the 95% confidence interval of sensitivity and specificity to be upper than 80%. This calculation was based on the CI95’s formula for a proportion.

Data were summarized by frequency and percentage for categorical variables and the median and range were computed for continuous variables.

The predictive capabilities of each experimental technique were described by concordance percentage, sensitivity, specificity, and positive and negative predictive values, considering FISH as the reference technique.

A sample size of 850 cases was required to demonstrate sensitivity and specificity greater than 80%, on the basis of the lower boundary of the 95% confidence interval of a proportion. A total of 840 evaluable cases were finally included.

Statistical analysis was performed using R.2.15.0 software.

Notes

Abbreviations

AF: 

Alcohol formol

AFAQAP: 

Association Française d’Assurance Qualité en Anatomie et cytology Pathologiques

ASCO/CAP: 

American Society of Clinical Oncology/College of American Pathologists

CEN17: 

Centromere chromosome 17

CISH: 

Chromogenic in situ hybridization

CNIL: 

Commission Nationale de l’Informatique et des Libertés

CCTIRS: 

Comité Consultatif sur le Traitement de l’Information en matière de Recherche dans le domaine de la Santé

F: 

Formol

FISH: 

Fluorescent in situ hybridization

GEFPICS: 

Groupe d'Etude des Facteurs Pronostiques IHC dans le Cancer du Sein

IHC: 

Immunohistochemistry

ISH: 

In situ hybridization

qPCR: 

Quantitative real-time polymerase chain reaction

SISH: 

Silver-enhanced in situ hybridization

TMA: 

Tissue microarray.

Declarations

Acknowledgments

This study received financial support from the French Institute of Cancer. (Inca) in the context of the program: "Support Program for Costly Diagnostic and Therapeutic Innovations".

Authors’ Affiliations

(1)
Institut Paoli Calmettes, biopathology department
(2)
Institut Curie - Hôpital René Huguenin
(3)
Hôpital Tenon
(4)
Centre Georges-François Leclerc
(5)
Hôpital St-Louis
(6)
Centre François Baclesse
(7)
Centre Val D’Aurelle
(8)
Hopital Haute Pierre
(9)
Hopital Laennec, Bd Jean Monod
(10)
Institut Bergonié
(11)
Institut Gustave Roussy
(12)
Centre Oscar Lambret
(13)
Institut Claudius Regaud
(14)
Institut Curie Paris
(15)
Hôpital St-Louis
(16)
Centre Jean Perrin

References

  1. Loi S, de Azambuja E, Pugliano L, Sotiriou C, Piccart MJ: HER2-overexpressing breast cancer: time for the cure with less chemotherapy?. Curr Opin Oncol. 2011, 23: 547-558. 10.1097/CCO.0b013e32834bd4c9.View ArticlePubMedGoogle Scholar
  2. Tagliabue E, Campiglio M, Pupa SM, Balsari A, Menard S: The HER2 World: Better Treatment Selection for Better Outcome. J Natl Cancer Inst Monogr. 2011, 2011: 82-85. 10.1093/jncimonographs/lgr041.View ArticlePubMedGoogle Scholar
  3. Wolff AC, Hammond ME, Schwartz JN, Hagerty KL, Allred DC, Cote RJ, et al: American Society of Clinical Oncology/College of American Pathologists guideline recommendations for human epidermal growth factor receptor 2 testing in breast cancer. J Clin Oncol. 2007, 25: 118-145.View ArticlePubMedGoogle Scholar
  4. Lacroix-Triki M, Mathoulin-Pelissier S, Ghnassia JP, MacGrogan G, Vincent-Salomon A, Brouste V, et al: High inter-observer agreement in immunohistochemical evaluation of HER-2/neu expression in breast cancer: a multicentre GEFPICS study. Eur J Cancer. 2006, 42: 2946-2953. 10.1016/j.ejca.2006.06.020.View ArticlePubMedGoogle Scholar
  5. Penault-Llorca F, Adelaide J, Houvenaeghel G, Hassoun J, Birnbaum D, Jacquemier J: Optimization of immunohistochemical detection of ERBB2 in human breast cancer: impact of fixation. J Pathol. 1994, 173: 65-75. 10.1002/path.1711730111.View ArticlePubMedGoogle Scholar
  6. Penault-Llorca F, Jacquemier J, Le DV, Voigt JJ: [Quality challenge for immunohistochemistry: example of the ERBB-2 status in breast cancer. Group for Evaluation of Prognostic Factors in Immunohistochemistry in Breast Cancer (GEFPICS)]. Ann Pathol. 1999, 19: 280-282.PubMedGoogle Scholar
  7. Penault-Llorca F, Vincent-Salomon A, Bellocq JP, Matthieu MC, Grogan GM, Treilleux I, et al: Update of the GEFPICS' recommendations for HER2 status determination in breast cancers in France. Ann Pathol. 2010, 30: 357-373. 10.1016/j.annpat.2010.07.001.View ArticlePubMedGoogle Scholar
  8. Vincent-Salomon A, MacGrogan G, Couturier J, Arnould L, Mathoulin-Pelissier S: Re: HER2 testing in the real world. J Natl Cancer Inst. 2003, 95: 628-629.View ArticlePubMedGoogle Scholar
  9. Vincent-Salomon A, MacGrogan G, Couturier J, Arnould L, Denoux Y, Fiche M, et al: Calibration of immunohistochemistry for assessment of HER2 in breast cancer: results of the French multicentre GEFPICS study. Histopathology. 2003, 42: 337-347. 10.1046/j.1365-2559.2003.01598.x.View ArticlePubMedGoogle Scholar
  10. Wells CA, Sloane JP, Coleman D, Munt C, Amendoeira I, Apostolikas N, et al: Consistency of staining and reporting of oestrogen receptor immunocytochemistry within the European Union–an inter-laboratory study. Virchows Arch. 2004, 445: 119-128.View ArticlePubMedGoogle Scholar
  11. Dowsett M, Hanna WM, Kockx M, Penault-Llorca F, Ruschoff J, Gutjahr T, et al: Standardization of HER2 testing: results of an international proficiency-testing ring study. Mod Pathol. 2007, 20: 584-591. 10.1038/modpathol.3800774.View ArticlePubMedGoogle Scholar
  12. Perez EA, Dueck AC, McCullough AE, Reinholz MM, Tenner KS, Davidson NE, et al: Predictability of adjuvant trastuzumab benefit in N9831 patients using the ASCO/CAP HER2-positivity criteria. J Natl Cancer Inst. 2012, 104: 159-162. 10.1093/jnci/djr490.View ArticlePubMedGoogle Scholar
  13. Coudert BP, Arnould L, Moreau L, Chollet P, Weber B, Vanlemmens L, et al: Pre-operative systemic (neo-adjuvant) therapy with trastuzumab and docetaxel for HER2-overexpressing stage II or III breast cancer: results of a multicenter phase II trial. Ann Oncol. 2006, 17: 409-414. 10.1093/annonc/mdj096.View ArticlePubMedGoogle Scholar
  14. Dowsett M, Procter M, McCaskill-Stevens W, de Azambuja E, Dafni U, Rueschoff J, et al: Disease-free survival according to degree of HER2 amplification for patients treated with adjuvant chemotherapy with or without 1 year of trastuzumab: the HERA Trial. J Clin Oncol. 2009, 27: 2962-2969. 10.1200/JCO.2008.19.7939.View ArticlePubMedPubMed CentralGoogle Scholar
  15. Elkin EB, Weinstein MC, Winer EP, Kuntz KM, Schnitt SJ, Weeks JC: HER-2 testing and trastuzumab therapy for metastatic breast cancer: a cost-effectiveness analysis. J Clin Oncol. 2004, 22: 854-863. 10.1200/JCO.2004.04.158.View ArticlePubMedGoogle Scholar
  16. Arnould L, Denoux Y, MacGrogan G, Penault-Llorca F, Fiche M, Treilleux I, et al: Agreement between chromogenic in situ hybridisation (CISH) and FISH in the determination of HER2 status in breast cancer. Br J Cancer. 2003, 88: 1587-1591. 10.1038/sj.bjc.6600943.View ArticlePubMedPubMed CentralGoogle Scholar
  17. Arnould L, Roger P, MacGrogan G, Chenard MP, Balaton A, Beauclair S, et al: Accuracy of HER2 status determination on breast core-needle biopsies (immunohistochemistry, FISH, CISH and SISH vs FISH). Mod Pathol. 2012, 25: 675-682. 10.1038/modpathol.2011.201.View ArticlePubMedGoogle Scholar
  18. Papouchado BG, Myles J, Lloyd RV, Stoler M, Oliveira AM, Downs-Kelly E, et al: Silver in situ hybridization (SISH) for determination of HER2 gene status in breast carcinoma: comparison with FISH and assessment of interobserver reproducibility. Am J Surg Pathol. 2010, 34: 767-776. 10.1097/PAS.0b013e3181d96231.View ArticlePubMedGoogle Scholar
  19. Dietel M, Ellis IO, Hofler H, Kreipe H, Moch H, Dankof A, et al: Comparison of automated silver enhanced in situ hybridisation (SISH) and fluorescence ISH (FISH) for the validation of HER2 gene status in breast carcinoma according to the guidelines of the American Society of Clinical Oncology and the College of American Pathologists. Virchows Arch. 2007, 451: 19-25. 10.1007/s00428-007-0424-5.View ArticlePubMedGoogle Scholar
  20. Carbone A, Botti G, Gloghini A, Simone G, Truini M, Curcio MP, et al: Delineation of HER2 gene status in breast carcinoma by silver in situ hybridization is reproducible among laboratories and pathologists. J Mol Diagn. 2008, 10: 527-536. 10.2353/jmoldx.2008.080052.View ArticlePubMedPubMed CentralGoogle Scholar
  21. Penault-Llorca F, Bilous M, Dowsett M, Hanna W, Osamura RY, Rüschoff J, et al: Emerging technologies for assessing HER2 amplification. Am J Clin Pathol. 2009, 132: 539-548. 10.1309/AJCPV2I0HGPMGBSQ.View ArticlePubMedGoogle Scholar
  22. Bieche I, Olivi M, Champeme MH, Vidaud D, Lidereau R, Vidaud M: Novel approach to quantitative polymerase chain reaction using real-time detection: application to the detection of gene amplification in breast cancer. Int J Cancer. 1998, 78: 661-666. 10.1002/(SICI)1097-0215(19981123)78:5<661::AID-IJC22>3.0.CO;2-I.View ArticlePubMedGoogle Scholar
  23. Suo Z, Daehli KU, Lindboe CF, Borgen E, Bassarova A, Nesland JM: Real-time PCR quantification of c-erbB-2 gene is an alternative for FISH in the clinical management of breast carcinoma patients. Int J Surg Pathol. 2004, 12: 311-318. 10.1177/106689690401200404.View ArticlePubMedGoogle Scholar
  24. Bergqvist J, Ohd JF, Smeds J, Klaar S, Isola J, Nordgren H, et al: Quantitative real-time PCR analysis and microarray-based RNA expression of HER2 in relation to outcome. Ann Oncol. 2007, 18: 845-850. 10.1093/annonc/mdm059.View ArticlePubMedGoogle Scholar
  25. Susini T, Bussani C, Marini G, Nori J, Olivieri S, Molino C, et al: Preoperative assessment of HER-2/neu status in breast carcinoma: the role of quantitative real-time PCR on core-biopsy specimens. Gynecol Oncol. 2010, 116: 234-239. 10.1016/j.ygyno.2009.10.067.View ArticlePubMedGoogle Scholar
  26. Kulka J, Tokes AM, Kaposi-Novak P, Udvarhelyi N, Keller A, Schaff Z: Detection of HER-2/neu gene amplification in breast carcinomas using quantitative real-time PCR - a comparison with immunohistochemical and FISH results. Pathol Oncol Res. 2006, 12: 197-204. 10.1007/BF02893412.View ArticlePubMedGoogle Scholar
  27. Ntoulia M, Kaklamanis L, Valavanis C, Kafousi M, Stathopoulos E, Arapantoni P, et al: HER-2 DNA quantification of paraffin-embedded breast carcinomas with LightCycler real-time PCR in comparison to immunohistochemistry and chromogenic in situ hybridization. Clin Biochem. 2006, 39: 942-946. 10.1016/j.clinbiochem.2006.06.001.View ArticlePubMedGoogle Scholar
  28. Monego G, Arena V, Maggiano N, Costarelli L, Crescenzi A, Zelano G, et al: Borderline HER-2 breast cancer cases: histochemical versus real-time PCR analysis and impact of different cut-off values. Scand J Clin Lab Invest. 2007, 67: 402-412. 10.1080/00365510601128934.View ArticlePubMedGoogle Scholar
  29. Lamy PJ, Nanni I, Fina F, Bibeau F, Romain S, Dussert C, et al: Reliability and discriminant validity of HER2 gene quantification and chromosome 17 aneusomy analysis by real-time PCR in primary breast cancer. Int J Biol Markers. 2006, 21: 20-29.PubMedGoogle Scholar
  30. Wolff AC, Hammond ME, Schwartz JN, Hagerty KL, Allred DC, Cote RJ, et al: American Society of Clinical Oncology/College of American Pathologists guideline recommendations for human epidermal growth factor receptor 2 testing in breast cancer. Arch Pathol Lab Med. 2007, 131: 18-43.PubMedGoogle Scholar
  31. Bilous M, Ades C, Armes J, Bishop J, Brown R, Cooke B, et al: Predicting the HER2 status of breast cancer from basic histopathology data: an analysis of 1500 breast cancers as part of the HER2000 International Study. Breast. 2003, 12: 92-98. 10.1016/S0960-9776(02)00273-4.View ArticlePubMedGoogle Scholar
  32. Owens MA, Horten BC, Da Silva MM: HER2 amplification ratios by fluorescence in situ hybridization and correlation with immunohistochemistry in a cohort of 6556 breast cancer tissues. Clin Breast Cancer. 2004, 5: 63-69. 10.3816/CBC.2004.n.011.View ArticlePubMedGoogle Scholar
  33. Yaziji H, Goldstein LC, Barry TS, Werling R, Hwang H, Ellis GK, et al: HER-2 testing in breast cancer using parallel tissue-based methods. JAMA. 2004, 291: 1972-1977. 10.1001/jama.291.16.1972.View ArticlePubMedGoogle Scholar
  34. Di Palma S, Collins N, Bilous M, Sapino A, Mottolese M, Kapranos N, et al: A quality assurance exercise to evaluate the accuracy and reproducibility of chromogenic in situ hybridisation for HER2 analysis in breast cancer. J Clin Pathol. 2008, 61: 757-760.View ArticlePubMedGoogle Scholar
  35. Loring P, Cummins R, O'Grady A, Kay EW: HER2 positivity in breast carcinoma: a comparison of chromogenic in situ hybridization with fluorescence in situ hybridization in tissue microarrays, with targeted evaluation of intratumoral heterogeneity by in situ hybridization. Appl Immunohistochem Mol Morphol. 2005, 13: 194-200. 10.1097/01.pai.0000132189.01233.6d.View ArticlePubMedGoogle Scholar
  36. Denoux Y, Arnould L, Fiche M, Lannes B, Couturier J, Vincent-Salomon A, et al: HER2 gene amplification assay: is CISH an alternative to FISH?. Ann Pathol. 2003, 23: 617-622.PubMedGoogle Scholar
  37. Kiyose S, Igarashi H, Nagura K, Kamo T, Kawane K, Mori H, et al: Chromogenic in situ hybridization (CISH) to detect HER2 gene amplification in breast and gastric cancer: comparison with immunohistochemistry (IHC) and fluorescence in situ hybridization (FISH). Pathol Int. 2012, 62: 728-734. 10.1111/j.1440-1827.2012.02862.x.View ArticlePubMedGoogle Scholar
  38. Dabbs DJ, Klein ME, Mohsin SK, Tubbs RR, Shuai Y, Bhargava R: High False-Negative Rate of HER2 Quantitative ReverseTranscription Polymerase Chain Reaction of the Oncotype DXTest: An Independent Quality Assurance Study. J Clin Oncol. 2011, 29: 4279-4285. 10.1200/JCO.2011.34.7963.View ArticlePubMedGoogle Scholar
  39. Dybdal N, Leiberman G, Anderson S, McCune B, Bajamonde A, Cohen RL, et al: Determination of HER2 gene amplification by fluorescence in situ hybridization and concordance with the clinical trials immunohistochemical assay in women with metastatic breast cancer evaluated for treatment with trastuzumab. Breast Cancer Res Treat. 2005, 93: 3-11.View ArticlePubMedGoogle Scholar
  40. Lee AH, Key HP, Bell JA, Hodi Z, Ellis IO: Breast carcinomas with borderline (2+) HER2 immunohistochemistry: percentage of cells with complete membrane staining for HER2 and the frequency of HER2 amplification. J Clin Pathol. 2011, 64: 490-492. 10.1136/jcp.2011.089177.View ArticlePubMedGoogle Scholar
  41. Perez EA, Reinholz MM, Hillman DW, Tenner KS, Schroeder MJ, Davidson NE, et al: HER2 and chromosome 17 effect on patient outcome in the N9831 adjuvant trastuzumab trial. J Clin Oncol. 2010, 28: 4307-4315. 10.1200/JCO.2009.26.2154.View ArticlePubMedPubMed CentralGoogle Scholar
  42. Chivukula M, Bhargava R, Brufsky A, Surti U, Dabbs DJ: Clinical importance of HER2 immunohistologic heterogeneous expression in core-needle biopsies vs resection specimens for equivocal (immunohistochemical score 2+) cases. Mod Pathol. 2008, 21: 363-368. 10.1038/modpathol.3801021.View ArticlePubMedGoogle Scholar
  43. Ohlschlegel C, Zahel K, Kradolfer D, Hell M, Jochum W: HER2 genetic heterogeneity in breast carcinoma. J Clin Pathol. 2011, 64: 1112-1116. 10.1136/jclinpath-2011-200265.View ArticlePubMedGoogle Scholar
  44. Meijer SL, Wesseling J, Smit VT, Nederlof PM, Hooijer GK, Ruijter H, et al: HER2 gene amplification in patients with breast cancer with equivocal IHC results. J Clin Pathol. 2011, 64: 1069-1072. 10.1136/jclinpath-2011-200019.View ArticlePubMedGoogle Scholar
  45. Pre-publication history

    1. The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2407/13/351/prepub

Copyright

© Jacquemier et al.; licensee BioMed Central Ltd. 2013

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.