Skip to main content
  • Research article
  • Open access
  • Published:

Comparison of the Roche cobas® 4800 and Digene Hybrid Capture® 2 HPV tests for primary cervical cancer screening in the HPV FOCAL trial

Abstract

Background

HPV FOCAL is a randomized trial (ISRCTN79347302, registered 20 Apr 2007) comparing high-risk (hr) HPV testing vs. liquid-based cytology (LBC) for cervical cancer screening of women aged 25–65. We compared the Digene Hybrid Capture® 2 High-Risk HPV DNA Test® (HC2) and the Roche cobas® 4800 HPV Test (COBAS) for primary screening.

Methods

Women (n = 6,172) were screened at baseline by HC2 and COBAS and by LBC 24 months later. We assessed HPV genotyping and reflex LBC for colposcopy triage of baseline HPV positive women.

Results

Overall HC2/COBAS agreement was 96.1 % (kappa 0.75) and positive agreement was 77.5 %. Baseline CIN2 and CIN3+ rates based on HPV screening were 8.6/1,000 and 6.6/1,000 respectively; 24 month rates were 0.7/1,000 and 0.4/1,000 (LBC screening). HC2 and COBAS were concordant positive for 91 % of round 1 CIN2 and 98 % of CIN3+. CIN3+ was significantly associated with HPV 16 (Odds Ratio [OR] 5.11; 95 % confidence interval [CI] 2.30, 11.37), but not HPV 18 (OR 2.62; 95 % CI 0.73, 9.49), vs. non-HPV 16/18 HPV at baseline. There was no significant association between HPV genotype and CIN2. CIN3+ was significantly more likely for high-grade (OR 5.99; 95 % CI 2.53, 14.18), but not low-grade (OR 0.54; 95 % CI 0.20, 1.49), vs. negative LBC. No significant association was observed between LBC grade and CIN2. HPV 16 and 18 were associated with 33 % of CIN2 and 68 % of CIN3+ identified at baseline.

Conclusions

For hrHPV positive women, abnormal reflex LBC is appropriate for colposcopy triage. In addition, immediate referral of women with HPV 16/18 and normal cytology may allow for earlier detection of CIN2+ lesions which would not be detected until after follow-up testing.

Peer Review reports

Background

Persistent infection with high-risk (hr) human papillomavirus (HPV) genotypes is recognized as the cause of cervical cancer [1, 2] and many screening programs are shifting from traditional Pap cytology to hrHPV testing. Screening for hrHPV has higher sensitivity relative to the Pap for detection of cervical precancerous lesions [3] (i.e., cervical intraepithelial neoplasia grade two [CIN2] or CIN2 and worse [CIN2+]). In addition, hrHPV testing has a negative predictive value for CIN2+ of greater than 99 %, enabling screening intervals to be extended up to 5 years or longer [46]. A number of hrHPV screening tests are commercially available, many of which incorporate partial genotyping in addition to generating a qualitative positive/negative result [7]. Since HPV 16 and 18 infections account for at least 70 % of cervical cancers worldwide [8], specific detection of these two genotypes provides useful additional information for colposcopy triage of hrHPV positive women who are more likely to have or develop pre-cancerous lesions [9, 10].

A challenge is that hrHPV testing identifies women with both persistent and transient HPV infections, with most of the latter clearing spontaneously within 2 years [11]. For that reason it is undesirable to refer all hrHPV positive women to colposcopy since treatment of lesions which are likely to spontaneously regress is associated with increased health system costs, patient anxiety [12] and the potential for reproductive harms [13, 14]. An efficient triage mechanism is required so that women at the highest risk of developing rapidly progressive cervical disease are referred to colposcopy, whereas those at lower risk could be more closely followed for clearance of transient infections, with colposcopy referral only for those hrHPV infections which persist. Several triage approaches for hrHPV positive women have been assessed, including reflex cytology [5], p16/Ki67 immunostaining [15], HPV 16/18 genotyping [9, 10] and the detection of methylation of HPV and/or human genes [16, 17].

In this study, we compared the performance of the Digene Hybrid Capture® 2 High-Risk HPV DNA Test® (HC2) to that of the Roche cobas® 4800 HPV Test (COBAS) for primary cervical screening within the HPV FOCAL randomized trial. We assessed CIN outcomes following reflex cytology and HPV genotyping for colposcopy triage.

Methods

Study population

The HPV FOCAL Trial design has been described previously [18] (Fig. 1). Briefly, the trial is a three-arm, randomized controlled trial (ISRCTN79347302, registered 20 Apr 2007) to establish the efficacy of hrHPV screening (using HC2) with liquid-based cytology (LBC) triage of HC2 positive women (Intervention and Safety Arms) compared to LBC screening with HC2 triage of atypical squamous cells of undetermined significance (ASCUS) (Control Arm) in women aged 25–65 years. The Safety Arm was included to verify the safety of the Intervention Arm 4 year screening interval by re-screening baseline HC2 negative women with LBC at 2 years, comparable to the current standard of care in British Columbia (BC), conventional cytology every 2 years. Women in the Safety Arm are the subjects of the present analysis. At baseline, HC2 positive women with LBC ≥ASCUS were referred immediately to colposcopy, whereas those HC2 positive/LBC negative for intraepithelial lesions or malignancy (NILM) were re-tested by HC2 and LBC at 12 months. Those persistently HC2 positive and/or LBC ≥ASCUS were then referred to colposcopy. Visible lesions were biopsied and if none were seen, endocervical curettage was performed for histological analysis. Baseline HC2 negative women, together with those who cleared hrHPV and were LBC NILM at 12 months, had their Safety Arm exit screen at 24 months. Round 1 refers to the baseline screen together with the 12-month follow-up and Round 2 refers to the exit screen at 24 months (Fig. 1).

Fig. 1
figure 1

HPV FOCAL Trial Design. Abbreviations: HPV Digene Hybrid Capture® 2 high-risk HPV DNA test®, LBC liquid-based cytology, ASCUS atypical squamous cells, undetermined significance, ASCH atypical squamous cells, cannot exclude high-grade, LSIL low-grade squamous intraepithelial lesion

All trial subjects provided written informed consent and the study was approved by the University of British Columbia/BC Cancer Agency Clinical Research Ethics Board.

Laboratory testing

Cervical specimens collected in PreservCyt® (Hologic Inc., Bedford MA, USA) by participating family physicians in Metro Vancouver and Greater Victoria BC were used for both hrHPV testing and LBC. For Safety Arm enrollment and 12 month follow-up specimens, separate aliquots for HC2 (6 mL) and COBAS (2 mL) were removed from the PreservCyt® vial prior to any other processing. At the 24 month exit screen, aliquots for reflex HC2 testing were obtained after cytology processing. At enrollment, all specimens were tested by HC2 (Qiagen, Gaithersburg MD, USA), COBAS (Roche Molecular Systems, Pleasanton CA, USA) and the Roche Linear Array HPV Genotyping Test (LA; Roche Molecular Systems). HC2 generates a qualitative result for the presence or absence of one or more of 13 hrHPV genotypes (HPV 16, 18, 31, 33, 35, 45, 51, 52, 56, 58, 59 and 68). We used a relative light unit/cutoff (RLU/CO) ratio of ≥1.0 to indicate a positive HC2 result. Specimens which had no visible cell pellet at the preparation stage were rejected as inadequate and reported as HC2 invalid. COBAS generates individual qualitative results for HPV 16, HPV 18 and a pool of 12 other hr (OHR) HPV genotypes (HPV 31, 33, 35, 45, 51, 52, 56, 58, 59, 66 and 68). LA generates individual qualitative results for the same 14 hrHPV genotypes as COBAS together with 23 additional HPV genotypes which are defined for the purposes of this study as low-risk (lr) HPV. LA was performed using residual extracts from COBAS testing. COBAS and LA were performed blinded at the time of collection and were not used for subject management. Specimens with initially invalid COBAS results were re-tested to confirm the invalid result. LBC slides were prepared and stained for all subjects at enrollment but were not screened and interpreted unless the subject was HC2 positive. COBAS and LA results were unblinded and compared with HC2 after Safety Arm women exited the trial at 2 years. LBC slides were then screened and interpreted retrospectively for women with baseline HC2 negative/COBAS positive and HC2 negative/LA positive results. For the latter group, specimens positive by LA for at least one hrHPV genotype were classified as hrHPV positive and those positive for only lrHPV genotype(s) were classified as lrHPV positive.

Statistical analysis

Overall agreement, Cohen’s kappa, and positive and negative agreements with 95 % confidence intervals (CI) were calculated for enrollment HC2 vs. COBAS results. Positive agreement was calculated by the formula p pos = (2a)/(N + a - d) and negative agreement by p neg = (2d)/(N – a + d), where N is the number tested, a is the number positive by both tests, and d is the number negative by both tests [19]. Genotyping agreements (overall and positive) and Cohen’s kappa with 95 % CI were calculated for COBAS vs. LA.

CIN diagnoses were obtained from the centralized provincial cervical screening registry, which includes all screening and histopathology results for BC women. CIN2 and CIN3+ rates with 95 % CI, stratified by baseline HC2 and COBAS results, per 1,000 women screened were calculated and 95 % CI for rates assumed a Poisson distribution. Round 1 included CIN lesions identified within 2 years after the colposcopy referral date, which could have occurred at baseline or after 12 months follow-up, while round 2 included CIN lesions identified within 2 years of the colposcopy referral date following the exit screen. If a subject had more than one colposcopic biopsy, the result for the highest grade CIN lesion identified was used for analysis. The analyses in this paper were based only on CIN lesions identified among women referred to colposcopy as per the FOCAL trial protocol. For trial quality assurance purposes, periodic audits of the provincial registry were conducted to identify CIN2+ lesions among trial subjects whose colposcopy referrals were not based on the trial protocol. Any additional CIN2+ identified by the audits were not included in the analyses.

A multivariate logistic regression model was fitted to the data to test the hypothesis regarding the relationship between HPV genotype and reflex LBC results and the likelihood of a CIN outcome. Since a given subject may be positive for more than one hrHPV genotype, subjects were classified hierarchically for analysis: for HPV 16, the subject was HPV 16 positive but could also be positive for HPV 18 and OHR HPV genotypes; for HPV 18, the subject was HPV 16 negative, HPV 18 positive, and could also be positive for OHR HPV genotypes; for OHR HPV, the subject was negative for HPV 16 and 18 and positive for one or more of the OHR HPV genotypes.

The Median score and Mann-Whitney U tests were used to calculate p values for the median HC2 RLU/CO and COBAS cycle threshold (Ct) values for concordant vs. discordant hrHPV positive specimens. The significance of the differences between proportions used a Z score test. All statistical calculations were performed using SAS v.9.3 (SAS Institute Inc., Cary NC, USA).

Results

HC2 and COBAS positivity rates

Among 6,214 women enrolled to the Safety Arm, 10 (0.16 %) and 11 (0.18 %) respectively had invalid HC2 and COBAS results, and 21 (0.34 %) had one or more missing HC2, COBAS or LA results. The present analysis includes the 6,172 (99.3 %) women with valid baseline HC2, COBAS and LA results. Overall HC2/COBAS agreement was 96.1 % (95 % CI: 95.6 – 96.6) and Cohen’s kappa was 0.75 (95 % CI: 0.72 – 0.79) (Table 1). Positive and negative agreements were 77.5 % (95 % CI: 74.7 – 80.3) and 97.9 % (95 % CI: 97.6 – 98.2) respectively. The respective baseline HC2 and COBAS positivity rates were 8.4 % (516/6,172; 95 % CI: 7.7 – 9.1) and 8.8 % (542/6,172; 95 % CI: 8.1 – 9.5). HC2 positivity rates for those 25–29, 30–34, 35–49 and ≥50 years, were 26.6 % (122/458), 15.1 % (84/556), 7.5 % (213/2,859) and 4.2 % (97/2,299) respectively; the corresponding COBAS rates were 27.9 % (128/458), 17.4 % (97/556), 7.7 % (219/2,859) and 4.3 % (98/2,299).

Table 1 Digene HC2 and Roche COBAS agreement at baseline

COBAS genotyping

COBAS genotyping demonstrated 2.1 % (128/6,172) HPV 16 positive, 0.7 % (46/6,171) HPV 18 positive and 7.1 % (437/6,171) OHR HPV positive (Table 2). COBAS and LA overall genotyping agreements ranged from 97.9 to 99.8 %, positive agreements from 85.7 to 87.0 %, and the kappa’s (0.85 – 0.87) indicated excellent genotyping agreement.

Table 2 Roche COBAS and linear array genotyping agreement at baseline

HC2 and COBAS result discordance

Discordant HC2/COBAS results were observed among women of all ages, but were more common among those 25–29 years (34/458; 7.4 %) than those 30 years and older (204/5,714; 3.6 %; p <0.0001). HC2+/COBAS+ specimens had significantly higher median HC2 RLU/CO values compared to those HC2+/COBAS– (54.9 vs. 5.9; p <0.0001). Similarly, HC2+/COBAS+ specimens had significantly lower median COBAS Ct values (30.2 vs. 38.3; p <0.0001) than HC2–/COBAS+ specimens. Median Ct values were similar when stratified by COBAS genotype (Table 3). Reflex LBC was abnormal for 36.3 % of those HC2+/COBAS+, 23.6 % of HC2+/COBAS–, 4.5 % of HC2–/COBAS+ and 0.5 % of HC2–/COBAS– (Additional file 1: Table S1).

Table 3 RLU/CO and Ct values for concordant and discordant digene HC2 and Roche COBAS results

Correlation of HC2 and COBAS results with linear array and reflex LBC

LA confirmed hrHPV genotypes in 96.3 % of HC2+/COBAS+ enrollment specimens (Additional file 1: Table S1). For those with discordant results, HC2+/COBAS− were less likely to contain hrHPV genotypes (12.3 % vs. 68.9 %; p <0.0001) and more likely to contain only lrHPV genotypes (52.8 % vs. 12.1 %; p <0.0001) than those HC2−/COBAS+. There was no significant difference in the overall abnormal reflex LBC proportions for those with discordant HC2/COBAS results (23.6 % vs. 4.5 %; p = 0.47), nor for those discordant specimens containing only lrHPV (26.8 % vs. 18.8 %; p = 0.75). Of interest, specimens containing multiple hrHPV (43 % vs. 28 %; p = 0.002) and lrHPV (42 % vs. 9 %; p = 0.06) genotypes by LA were more likely to have abnormal LBC compared to those with a single hr- or lrHPV genotype (Additional file 1: Table S2).

CIN detection

Overall round 1 and 2 CIN2 and CIN3+ rates classified by HC2 and COBAS results are shown in Table 4. At round 1, the respective rates were 8.6/1,000 (95 % CI: 6.3 – 10.9) and 6.6/1,000 (95 % CI: 4.6 – 8.7), whereas at round 2 (LBC screening, with HC2 triage of ASCUS), the overall rates were 0.7/1,000 (95 % CI: 0.0 – 1.4) and 0.4/1,000 (95 % CI: 0.0 – 0.9) respectively.

Table 4 Rounds 1 and 2 pathology stratified by baseline Digene HC2 and Roche COBAS results

Of the round 1 CIN2 and CIN3+, 48/53 (90.6 %) and 40/41 (97.6 %) respectively were concordant HC2+/COBAS+. The CIN3 identified among HC2+/COBAS− discordant subjects was HPV negative by LA. This subject underwent a loop electrosurgical excision procedure (LEEP) 1 month following the biopsy, at which time CIN2 was identified, suggesting that this lesion may have been destined to regress spontaneously. Immunohistochemistry for p16 was not performed on either the biopsy or the LEEP specimen. Due to the study blinding, it was not possible to obtain histopathology at round 1 for discordant HC2−/COBAS+ subjects, who were not referred to colposcopy unless they had abnormal LBC at round 2, 24 months later. At the 24 month exit LBC screen, among the enrollment HC2−/COBAS+ subjects, one CIN2 was identified, and at baseline, this subject was HPV 16 and HPV 51 positive by both COBAS and LA with NILM LBC. At round 2, LBC had progressed to high-grade squamous intraepithelial lesion and the subject was still HPV 16 and HPV 51 positive by both COBAS and LA. Of the two CIN3 at round 2 among enrollment HC2−/COBAS− subjects, one was LA HPV 16 and HPV 52 positive at enrollment and HPV 52 positive at exit; the second was HPV 16 positive at both enrollment and exit. This suggests that these lesions may have been present at baseline but were not detected by either HC2 or COBAS.

Of the 94 CIN2+ identified in Round 1, 52 (55 %) had LBC ≥ASCUS at baseline; of the remaining subjects with NILM LBC at baseline, 16 (17 %) were HPV 16 or 18 positive. Therefore, if both abnormal LBC and presence of HPV 16/18 genotypes had been used for colposcopy referral, 68/94 (72 %) CIN2+ cases would likely have been identified at the baseline screen, with the remainder identified when 12 month follow-up testing indicated persistent non-HPV 16/18 infection.

Regular audits of the provincial registry for CIN2+ lesions that were not based on a FOCAL trial colposcopy referral identified one adenocarcinoma and one endometrial cancer, both diagnosed ~20 months after the baseline screens (HC2, COBAS and LA were negative for both cases). Both subjects underwent hysterectomy and exited the trial.

HC2 clearance and CIN outcomes

Figure 2 illustrates the round 1 HPV clearance rates and CIN outcomes for the 516 baseline HC2 positive women. Of those HC2+/LBC NILM who attended the 12 month follow-up screen, 177/320 (55.3 %) were persistently HC2 positive, among whom 26/53 (49.1 %) of the round 1 CIN2 and 16/41 (39.0 %) of the round 1 CIN3+ were identified. LBC progression from NILM at baseline to ≥ASCUS at 12 months was not associated with a higher likelihood of having CIN2+ vs. those without LBC progression. There was no CIN2+ among the 143 women who cleared their hrHPV infections by 12 months.

Fig. 2
figure 2

Round 1 CIN Outcomes and HPV Clearance Rates for Baseline Digene HC2 Positive Subjects. Abbreviations: HC2 Digene Hybrid Capture® 2 high-risk HPV DNA test®, LBC liquid-based cytology, ASCUS atypical squamous cells, undetermined significance, NILM negative for intraepithelial lesions and malignancy

Colposcopy triage by reflex LBC and HPV genotyping

Since HC2−/COBAS+ women were not referred to colposcopy at round 1, assessment of the contributions of HPV genotype and reflex LBC to CIN2 and CIN3+ outcomes was performed only for HC2+/COBAS+ subjects (n = 410). For CIN2, by COBAS, 11/48 (23 %) were HPV 16 positive; 7/48 (15 %) were HPV 18 positive; and 32/48 (67 %) were positive only for non-HPV 16/18 OHR HPV. For CIN2, there were no significant differences based on HPV genotype (p = 0.60) (Table 5). For CIN3+, 23/40 (58 %) were HPV 16 positive, 6/40 (15 %) were HPV 18 positive and 13/40 (33 %) were positive only for non-HPV 16/18 OHR HPV. HPV 16 positive subjects were significantly more likely to have CIN3+ compared to those positive for non-HPV 16 genotypes (odds ratio [OR] 5.11, 95 % CI 2.30, 11.37; p = 0.0003), but there was no significant difference for HPV 18 positive vs. non-HPV 16/18 OHR positive subjects (OR 2.62; 95 % CI 0.73, 9.49). HPV 16 positive subjects had a higher proportion of CIN3+ (58 % [23/41]) vs. 23 % [11/48] for CIN2), whereas the proportions were the same for HPV 18 (15 % [7/48] vs. 15 % [6/40]). Conversely, subjects positive only for non-HPV 16/18 OHR HPV had a higher CIN2 proportion compared to CIN3+ (67 % [32/48] vs. 33 % [13/40]).

Table 5 Multivariate analysis for association of HPV genotype and reflex LBC with CIN2 and CIN3+

For reflex LBC, those with high-grade vs. NILM LBC were significantly more likely to have CIN3+ (OR 5.99, 95 % CI 2.53, 14.18; p <0.0001) compared to those with low-grade vs. NILM LBC. In contrast, there was no significant difference for CIN2 for those with either high-grade or low-grade vs. NILM LBC (p = 0.15). There were no significant interactions between HPV genotype and LBC (data not shown).

Discussion

In this sub-study of the HPV FOCAL Trial Safety Arm, we demonstrated that over a 2 year screening interval with hrHPV screening at baseline followed by LBC screening at 24 months, hrHPV testing at baseline identified 94 % of the CIN2+ lesions detected over the two screening rounds. Very low CIN2+ rates were observed at the exit LBC screen, which supports the safety of hrHPV vs. LBC screening every 2 years. It is important to note that in this study women were managed only on their HC2 and corresponding cytology results (COBAS results were blinded). Despite the occurrence of discordant baseline HC2 and COBAS results, 43/44 round 1 CIN3+ were among those who were both HC2 and COBAS positive. If women had been managed on both HC2 and COBAS results, it is possible that additional CIN lesions might have been identified at baseline among those HC2−/COBAS+. In agreement with our findings, a comparison study by Cuzick et al. [7] of the performance of six HPV assays in a population referred to colposcopy on the basis of abnormal cytology, showed that both HC2 and COBAS were positive for all CIN3+ cases. However, in that study HPV positive/cytology normal women, among whom greater discordance between various HPV assays and CIN detection might be expected, were not referred to colposcopy. The full impact of discordant HPV results among cytologically normal women remains under investigation. It is not unexpected that a given hrHPV assay may miss a potentially significant CIN, as other trials, including ALTS, ARTISTIC and POBASCAM, noted that a proportion of CIN2+ test negative for hrHPV [2022]. Of note, co-testing would have identified the CIN3+ that was not detected by COBAS at baseline, since the LBC result was atypical squamous cells, cannot rule out high-grade, which would have resulted in a colposcopy referral. Some studies have shown that co-testing has a higher sensitivity for CIN2+ than hrHPV screening alone [23, 24], whereas others have not demonstrated a difference [25, 26].

The round 1 CIN2 and CIN3+ rates based on primary hrHPV screening (8.6/1,000 and 6.6/1,000 respectively) were higher than in the HPV FOCAL Control Arm (LBC screening, with HC2 triage of ASCUS) which had round 1 rates of 6.0/1,000 and 5.0/1,000 respectively [27]. The CIN2+ rate in this study (15.2/1,000) was also higher than the 2011 CIN2+ rate of 6.3/1,000 for women aged 20–69 in the BC provincial cervical screening program (using conventional cytology) [28]. The round 1 CIN rates in our study are similar to the verification bias-adjusted rates in the ATHENA trial (CIN2: 8.6 vs. 8.0; CIN3+: 6.6 vs. 10.0) [29]. The FOCAL trial did not adjust for verification bias, but there are some differences in the study populations, e.g., the mean age of FOCAL vs. ATHENA subjects (46 vs. 40 years) and those who ever smoked (36.4 % vs. 29.3 %). The FOCAL trial had a higher proportion of individuals with Asian ethnic background (12.5 % vs. 1.6 %), whereas ATHENA had a higher proportion of Black/African American individuals (14.0 %) compared to FOCAL (3.3 %, which includes Aboriginals) [27, 29].

While our study had a lower COBAS positivity rate than ATHENA (8.8 % vs. 12.6 %) [29], in both studies HPV 16 (2.1 % vs. 2.8 %) was approximately three times more commonly detected than HPV 18 (0.7 % vs. 1.0 %). These data are consistent with other studies [7], including a recent BC population-based HPV prevalence survey among unvaccinated women aged 15–69 years attending cervical screening (HPV 16: 2.7 %; HPV 18: 1.1 %, using LA) [30]. Our study identified similar HPV 16- but higher HPV 18-attributable CIN2 and CIN3+ proportions compared to ATHENA. We identified HPV 16 in 23 % (11/48) of CIN2 vs. 30 % (57/192) for ATHENA, and 58 % (23/40) vs. 50 % (153/305) for CIN3+. We identified HPV 18 in 15 % (7/40) of CIN2 compared to 3 % (6/192) for ATHENA, and 15 % (6/40) vs. 8 % (25/305) for CIN3+.

For concordant HC2/COBAS positive subjects, CIN3+ was significantly more likely when LBC was high-grade vs. NILM. Reflex LBC dysplasia was not significantly different for CIN2. CIN3+ was significantly more likely for HPV 16 vs. non-HPV 16 HPV positive subjects, while no significant differences in CIN3+ were found for HPV 18 vs. non-HPV 16/18 OHR genotypes. There was no significant difference between the CIN2-associated HPV genotypes. These findings are in agreement with the ATHENA trial which concluded that a combination of HPV 16/18 genotyping and reflex cytology is a suitable triage strategy for hrHPV positive women [26].

Specimens with discordant HC2/COBAS results had RLU/CO ratios and Ct values significantly closer to the test limits of detection than concordant positive specimens. It seems reasonable that specimens likely to have lower viral loads (based on low RLU/CO ratios or high Ct values) would be more likely to produce discordant results with different assays. Furthermore, some of these discordant results likely reflect false-positives [31], which are less likely to be consistent between assays. This is supported by the lower CIN2+ rates among women with HC2+/COBAS− results.

Our finding that 45 % of HC2 positive women with NILM LBC at baseline cleared their hrHPV infections after 12 months is consistent with the published literature [11, 32, 33]. The high rate of HPV clearance supports recommendations that when LBC is used for triage, an appropriate way to manage hrHPV positive women with NILM cytology is by re-testing for HPV clearance after a short follow-up period, e.g., 12–18 months [33, 34]. However, this may result in a high rate of loss to follow-up of these women, some of whom will have underlying CIN2+ [9, 20, 26]. A triage test which efficiently identifies a high likelihood of CIN2+ at the time of the initial positive HPV screen test would be of considerable benefit.

Specimens containing only lrHPV types frequently had low-grade LBC abnormalities [11 % (57/516) of HC2 and 3 % (17/542) of COBAS positive results] which may have implications for selection of a primary HPV screening assay if LBC is to be used for triage. Since lrHPV’s have a negligible association with CIN2+ [35], these individuals would not benefit from colposcopy referral. Full genotyping of all hrHPV positives will become increasingly feasible with the availability of automated commercial genotyping assays and this information could be used to prioritize women for colposcopy. However, cost considerations may preclude its use to help identify women with false positive hrHPV screening results. This emphasizes the need for better triage tests to avoid colposcopy over-referral and the associated potential harms.

An important limitation of this study was the inability to obtain CIN outcomes at round 1 for women with HC2−/COBAS+ discordant results, since baseline COBAS results were blinded until after study exit. This precluded comparison of the sensitivity and specificity of the HC2 and COBAS assays. In addition, had these women been referred to colposcopy at baseline, it is possible that additional CIN lesions would have been detected, as was observed for the HC2+/COBAS− group. Furthermore, no hrHPV testing was performed at the 24 month study exit except for HC2 triage of women with ASCUS LBC. Although one CIN2 was identified at round 2 among baseline HC2−/COBAS+ women, it is possible that the use of only LBC at round 2 was not sufficiently sensitive to demonstrate whether this group of women had underlying CIN lesions not detected by HC2 at baseline. A future analysis of the FOCAL Intervention Arm where women were screened with HC2 and COBAS at both enrollment and the 48 month exit screen may provide further insight. However, Intervention Arm COBAS enrollment results were also blinded and not used for subject management, but both HC2 and COBAS were used for colposcopy referral at the 48 month exit screen. Furthermore, there is an opportunity to follow these women for significant CIN outcomes over longer time periods once they exit the trial and return to the centralized cervical screening program. Long term follow-up of Swedescreen subjects after a baseline hrHPV positive screen showed that incidence rate ratios for CIN2+ remained high for greater than nine years [36], especially for those with HPV 16, 18, 31 and 33 identified at baseline.

Another limitation relates to the retrospective cytology interpretations. Reflex LBC for HC2 positive women was performed as it would be in a real setting, whereas LBC slides for HC2 negative, COBAS and/or LA positive women were examined approximately two years later. This could have biased the LBC interpretations relative to those conducted in real-time.

Conclusions

This study demonstrated that over a 2 year screening interval with hrHPV testing at baseline, followed by LBC screening at 24 months, 94 % of CIN2+ detected over the two screening rounds were hrHPV positive at baseline. Women were managed at round 1 only on their HC2 and corresponding LBC results, but 43/44 CIN3+ were detected among those HC2+/COBAS+. It is possible that additional CIN cases would have been detected among HC2−/COBAS+ subjects if COBAS results had also been used for subject management. Of the CIN2+ identified in Round 1, 55 % had abnormal cytology and an additional 17 % were HPV 16 or 18 positive at baseline, demonstrating the added benefit of immediate referral of women with these genotypes to potentially identify CIN2+ earlier than by follow-up testing of those with NILM cytology. Therefore, the results of this study support the use of reflex LBC together with HPV16/18 genotyping for colposcopy triage of hrHPV positive women.  However, as the cohort of HPV vaccinated women reaches cervical screening age, the benefits of HPV 16/18 genotyping for triage will be diminished.

Abbreviations

ASCUS:

Atypical squamous cells, undetermined significance

BC:

British Columbia

CI:

Confidence interval

CIN:

Cervical intraepithelial neoplasia

COBAS:

Roche cobas® 4800 HPV test

Ct:

Cycle threshold

HC2:

Digene Hybrid Capture® 2 HPV test

HPV:

Human papillomavirus

hr:

High-risk

LA:

Roche linear array HPV genotyping test

LBC:

Liquid-based cytology

LEEP:

Loop electrosurgical excision procedure

lr:

Low-risk

NILM:

Negative for intraepithelial lesions or malignancy

OHR:

Other high-risk

OR:

Odds ratio

Q1:

First quartile

Q3:

Third quartile

RLU/CO:

Relative light units/cutoff

References

  1. Walboomers JM, Jacobs MV, Manos MM, Bosch FX, Kummer JA, Shah KV, et al. Human papillomavirus is a necessary cause of invasive cervical cancer worldwide. J Pathol. 1999;189:12–9.

    Article  CAS  PubMed  Google Scholar 

  2. Muñoz N, Bosch FX, De Sanjose S, Herrero R, Castellsague X, Shah KV, et al. Epidemiologic classification of human papillomavirus types associated with cervical cancer. N Engl J Med. 2003;348:518–27.

    Article  PubMed  Google Scholar 

  3. Arbyn M, Ronco G, Anttila A, Meijer CJLM, Poljak M, Ogilvie G, et al. Evidence regarding human papillomavirus testing in secondary prevention of cervical cancer. Vaccine. 2012;30 Suppl 5:F88–99.

    Article  PubMed  Google Scholar 

  4. Gage JC, Schiffman M, Katki HA, Castle PE, Fetterman B, Wentzensen N, et al. Reassurance against future risk of precancer and cancer conferred by a negative human papillomavirus test. J Natl Cancer Inst. 2014;106:dju153.

    Article  PubMed Central  PubMed  Google Scholar 

  5. Ronco G, Dillner J, Elfström KM, Tunesi S, Snijders PJF, Arbyn M, et al. Efficacy of HPV-based screening for prevention of invasive cervical cancer: follow-up of four European randomised controlled trials. Lancet. 2013;383:524–32.

    Article  PubMed  Google Scholar 

  6. Vink MA, Bogaards JA, Meijer CJLM, Berkhof J. Primary human papillomavirus DNA screening for cervical cancer prevention: can the screening interval be safely extended? Int J Cancer. 2015;137:420–27.

    Article  CAS  PubMed  Google Scholar 

  7. Cuzick J, Cadman L, Mesher D, Austin J, Ashdown-Barr L, Ho L, et al. Comparing the performance of six human papillomavirus tests in a screening population. Br J Cancer. 2013;108:908–13.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  8. Muñoz N, Bosch FX, Castellsagué X, Díaz M, de Sanjose S, Hammouda D, et al. Against which human papillomavirus types shall we vaccinate and screen? The international perspective. Int J Cancer. 2004;111:278–85.

    Article  PubMed  Google Scholar 

  9. Castle PE, Stoler MH, Wright TC, Sharma A, Wright TL, Behrens CM. Performance of carcinogenic human papillomavirus (HPV) testing and HPV16 or HPV18 genotyping for cervical cancer screening of women aged 25 years and older: a subanalysis of the ATHENA study. Lancet Oncol. 2011;12:880–90.

    Article  PubMed  Google Scholar 

  10. Cox JT, Castle PE, Behrens CM, Sharma A, Wright TC, Cuzick J. Comparison of cervical cancer screening strategies incorporating different combinations of cytology, HPV testing, and genotyping for HPV 16/18: results from the ATHENA HPV study. Am J Obstet Gynecol. 2013;208:184.e1–84.e11.

    Article  Google Scholar 

  11. Rositch AF, Koshiol J, Hudgens MG, Razzaghi H, Backes DM, Pimenta JM, et al. Patterns of persistent genital human papillomavirus infection among women worldwide: a literature review and meta-analysis. Int J Cancer. 2013;133:1271–85.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  12. Saslow D, Solomon D, Lawson HW, Killackey M, Kulasingam SL, Cain J, et al. American Cancer Society, American Society for Colposcopy and Cervical Pathology and American Society for Clinical Pathology screening guidelines for the prevention and early detection of cervical cancer. Am J Clin Pathol. 2012;137:516–42.

    Article  PubMed  Google Scholar 

  13. Kyrgiou M, Koliopoulos G, Martin-Hirsch P, Arbyn M, Prendiville W, Paraskevaidis E. Obstetric outcomes after conservative treatment for intraepithelial or early invasive cervical lesions: systematic review and meta-analysis. Lancet. 2006;367:489–98.

    Article  CAS  PubMed  Google Scholar 

  14. Castanon A, Landy R, Brocklehurst P, Evans H, Peebles D, Singh N, et al. Risk of preterm delivery with increasing depth of excision for cervical intraepithelial neoplasia in England: nested case–control study. BMJ. 2014;349:g6223.

    Article  PubMed Central  PubMed  Google Scholar 

  15. Ikenberg H, Bergeron C, Schmidt D, Griesser H, Alameda F, Angeloni C, et al. Screening for cervical cancer precursors with p16/Ki-67 dual-stained cytology: results of the PALMS study. J Natl Cancer Inst. 2013;105:1550–7.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  16. Snellenberg S, Strooper LM, Hesselink A, Meijer C, Snijders P, Heideman D, et al. Development of a multiplex methylation-specific PCR as candidate triage test for women with an HPV-positive cervical scrape. BMC Cancer. 2012;12:551.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  17. Brentnall AR, Vasiljević N, Scibior-Bentkowska D, Cadman L, Austin J, Szarewski A, et al. A DNA methylation classifier of cervical precancer based on human papillomavirus and human genes. Int J Cancer. 2014;135:1425–32.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  18. Ogilvie G, van Niekerk D, Krajden M, Martin R, Ehlen T, Ceballos K, et al. A randomized controlled trial of Human Papillomavirus (HPV) testing for cervical cancer screening: trial design and preliminary results (HPV FOCAL Trial). BMC Cancer. 2010;10:111.

    Article  PubMed Central  PubMed  Google Scholar 

  19. Cunningham M. More than Just the Kappa Coefficient: A Program to Fully Characterize Inter-Rater Reliability between Two Raters. SAS Global Forum 2009. Available from http://support.sas.com/resources/papers/proceedings09/242-2009.pdf. Accessed April 27, 2015.

  20. Kitchener HC, Almonte M, Thomson C, Wheeler P, Sargent A, Stoykova B, et al. HPV testing in combination with liquid-based cytology in primary cervical screening (ARTISTIC): a randomised controlled trial. Lancet Oncol. 2009;10:672–82.

    Article  PubMed  Google Scholar 

  21. Rijkaart DC, Berkhof J, Rozendaal L, van Kemenade FJ, Bulkmans NWJ, Heideman DAM, et al. Human papillomavirus testing for the detection of high-grade cervical intraepithelial neoplasia and cancer: final results of the POBASCAM randomised controlled trial. Lancet Oncol. 2012;13:78–88.

    Article  PubMed  Google Scholar 

  22. Castle PE, Cox JT, Jeronimo J, Solomon D, Wheeler CM, Gravitt PE, et al. An analysis of high-risk human papillomavirus DNA-negative cervical precancers in the ASCUS-LSIL triage study (ALTS). Obstet Gynecol. 2008;111:847–56.

    Article  PubMed  Google Scholar 

  23. Bouchard-Fortier G, Hajifathalian K, McKnight MD, Zacharias DG, Gonzalez-Gonzalez LA. Co-testing for detection of high-grade cervical intraepithelial neoplasia and cancer compared with cytology alone: a meta-analysis of randomized controlled trials. J Public Health. 2014;36:46–55.

    Article  Google Scholar 

  24. Blatt AJ, Kennedy R, Luff RD, Austin RM, Rabin DS. Comparison of cervical cancer screening results among 256,648 women in multiple clinical practices. Cancer Cytopathol. 2015;123:282–8.

    Article  PubMed Central  PubMed  Google Scholar 

  25. Elfström KM, Smelov V, Johansson ALV, Eklund C, Nauclér P, Arnheim-Dahlström L, et al. Long term duration of protective effect for HPV negative women: follow-up of primary HPV screening randomised controlled trial. BMJ. 2014;348:g130.

    Article  PubMed Central  PubMed  Google Scholar 

  26. Wright TC, Stoler MH, Behrens CM, Sharma A, Zhang G, Wright TL. Primary cervical cancer screening with human papillomavirus: end of study results from the ATHENA study using HPV as the first-line screening test. Gynecol Oncol. 2015;136:189–97.

    Article  PubMed  Google Scholar 

  27. Ogilvie GS, Krajden M, van Niekerk DJ, Martin RE, Ehlen TG, Ceballos K, et al. Primary cervical cancer screening with HPV testing compared with liquid-based cytology: results of round 1 of a randomised controlled trial - the HPV FOCAL Study. Br J Cancer. 2012;107:1917–24.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  28. British Columbia Cancer Agency. Cervical Cancer Screening Program 2012 Annual Report. Available from http://www.screeningbc.ca/NR/rdonlyres/F2D89BB9-3B33-4DBD-BE76-975A220B0C7B/69596/CCSPAnnualReport2012PrintVersion.pdf. Accessed April 27, 2015.

  29. Wright TC, Stoler MH, Behrens CM, Apple R, Derion T, Wright TL. The ATHENA human papillomavirus study: design, methods, and baseline results. Am J Obstet Gynecol. 2011;46:e1–46.

    Google Scholar 

  30. Ogilvie GS, Cook DA, Taylor DL, Rank C, Kan L, Yu A, et al. Population-based evaluation of type-specific HPV prevalence among women in British Columbia, Canada. Vaccine. 2013;31:1129–33.

    Article  CAS  PubMed  Google Scholar 

  31. Cubie HA, Cuschieri K. Understanding HPV tests and their appropriate applications. Cytopathology. 2013;24:289–308.

    CAS  PubMed  Google Scholar 

  32. Bulkmans NWJ, Berkhof J, Bulk S, Bleeker MCG, van Kemenade FJ, Rozendaal L, et al. High-risk HPV type-specific clearance rates in cervical screening. Br J Cancer. 2007;96:1419–24.

    CAS  PubMed Central  PubMed  Google Scholar 

  33. Naucler P, Ryd W, Törnberg S, Strand A, Wadell G, Elfgren K, et al. Efficacy of HPV DNA testing with cytology triage and/or repeat HPV DNA testing in primary cervical cancer screening. J Natl Cancer Inst. 2009;101:88–99.

    Article  PubMed  Google Scholar 

  34. Rodríguez AC, Schiffman M, Herrero R, Wacholder S, Hildesheim A, Castle PE, et al. Rapid clearance of human papillomavirus and implications for clinical focus on persistent infections. J Natl Cancer Inst. 2008;100:513–7.

    Article  PubMed Central  PubMed  Google Scholar 

  35. Castle PE, Hunt WC, Langsfeld E, Wheeler CM, Committee NMHPR. Three-year risk of cervical precancer and cancer after the detection of low-risk human papillomavirus genotypes targeted by a commercial test. Obstet Gynecol. 2014;123:49–56.

    Article  PubMed Central  PubMed  Google Scholar 

  36. Smelov V, Elfström KM, Johansson ALV, Eklund C, Naucler P, Arnheim-Dahlström L, et al. Long-term HPV type-specific risks of high-grade cervical intraepithelial lesions: a 14-year follow-up of a randomized primary HPV screening trial. Int J Cancer. 2015;136:1171–80.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

The HPV FOCAL Trial was supported by a grant from the Canadian Institutes of Health Research (Grant No. MCT82072). This HPV FOCAL Trial Roche adjunct study was funded by Roche Molecular Systems (RMS), Pleasanton, CA, USA. RMS and the FOCAL trial investigators together designed the adjunct study, but RMS had no input into the design of the original FOCAL Trial. RMS was provided an opportunity to critically review this manuscript but did not influence the decision whether to publish the data.

The authors wish to acknowledge the assistance of Keith Duncan, Steve Sung and Mona Cheng in assembling the study data and Lovedeep Gondara for statistical analysis. We acknowledge the excellent technical skills of the staff of the BCCDC Clinical Trials Unit and the BCCA Cervical Cancer Screening Laboratory who performed all the HPV and LBC screening. Thanks are due to the FOCAL Study Centre staff for their diligence in following up with women to minimize loss to follow-up.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mel Krajden.

Additional information

Competing interests

MK has received research grant funding via his institution from Roche Molecular Systems, Boehringer Ingelheim, Merck, Siemens Healthcare Diagnostics and Hologic Inc. ELF has served as an occasional advisor to companies involved with HPV diagnostics (Roche Molecular Systems, Becton Dickinson, Qiagen, Gen-Probe), HPV vaccines (Merck, GlaxoSmithKline), and cervical cancer cytology (Ikonisys, Cytyc). All other authors declare that they have no competing interests.

Authors’ contributions

DAC, LWS, DJVN, KC, ELF, AJC, GSO and MK conceived and designed the study together with the study sponsor, Roche Molecular Systems. WM carried out the COBAS and HC2 HPV testing. DJVN and KC carried out the cytology and histopathology interpretations. DAC acquired, analysed and interpreted the data, and drafted the manuscript. ELF, AJC and GSO provided advice on statistical analyses. DAC, WM, LWS, DJVN, KC, ELF, AJC, GSO and MK reviewed the draft manuscript, revised it critically for important intellectual content, and read and approved the final submitted manuscript.

Additional file

Additional file 1:

Table S1. Baseline Digene HC2/Roche COBAS Results Stratified by LA and Cytology. Table S2. Baseline Digene HC2 and Roche COBAS Abnormal Cytology Rates Stratified by Linear Array Genotyping. (DOCX 16 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cook, D.A., Mei, W., Smith, L.W. et al. Comparison of the Roche cobas® 4800 and Digene Hybrid Capture® 2 HPV tests for primary cervical cancer screening in the HPV FOCAL trial. BMC Cancer 15, 968 (2015). https://doi.org/10.1186/s12885-015-1959-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12885-015-1959-5

Keywords