Skip to main content
  • Research article
  • Open access
  • Published:

Tivozanib in renal cell carcinoma: a systematic review of the evidence and its dissemination in the scientific literature

Abstract

Background

Tivozanib (Fotivda) is an anti-angiogenic tyrosine kinase inhibitor that was denied access to the US market by the Food and Drug Administration (FDA). In contrast, it was granted approval by the European Medicines Agency (EMA) for the treatment of Renal Cell Carcinoma in adults. Given the conflicting decisions from these regulatory agencies, the objectives of the following study are (i) to critically review the evidence supporting the approval of tivozanib; (ii) to analyse the dissemination of this evidence in the literature by way of a citation analysis.

Methods

Pivotal trials were searched by two independent reviewers using Medline, Cochrane Library, ClinicalTrials.gov and the European Public Assessment Report. The risk of bias for each trial was then inductively assessed. Articles citing any of these trials were identified using Web of Sciences. Finally, the quality of the citations was evaluated by two independent reviewers according to standard data extraction methods.

Results

The search for primary evidence identified two pivotal studies: TIVO-1 upon which the FDA and the EMA decisions were based, and TIVO-3 which was conducted after the agenciesā€™ decisions had been issued. The TIVO-1 trial presented several limitations that compromised causal inference, in relation to (i) design (absence of blinding, inappropriate comparator, and one-way crossover), (ii) poor internal consistency in the results for the primary endpoint, (iii) a discrepancy between a benefit observed for progression-free survival (HR: 0.80, 95% CI [0.64ā€“0.99]) and the absence of difference for overall survival (HR: 1.25, 95% CI [0.95 ā€“ 1.62]). Our citation search protocol identified 229 articles that cited TIVO-1 in the 7Ā years following its publication, among which 151 (65.9%) citing articles discussing efficacy. Presence of spin was identified in 64 (42.4%) of these 151 citing articles, and 39 (25.8%) additional articles citing results without providing enough elements to interpret the TIVO-1 results.

Conclusion

EMAā€™s approval was based on a single pivotal trial presenting critical limitations, rendering the results from the trial potentially inconclusive. The broad dissemination of TIVO-1 results in the scientific literature may have been affected by spin or results were presented in an inadequate critical manner.

Peer Review reports

Background

Tivozanib is an anti-angiogenic tyrosine kinase inhibitor that inhibits vascular endothelial growth factor receptor (VEGFR) 1, 2 and 3. Compared to the first generation of VEGFR inhibitors, tivozanib is more selective and more potent [1]. It could therefore be a more effective and better-tolerated alternative for the treatment of advanced renal cell carcinoma (RCC), an indication for which first-generation of VEGFR inhibitors, such as sunitinib, pazopanib, and sorafenib, are currently indicated [2,3,4]. Another reason supporting the need to find new treatments is the fact that there is no evidence of benefit on survival with any of the previously mentioned first-generation inhibitors [5].

However, the development of tivozanib was laborious. The storytelling got off to a good start with a first human study initiated in 2004 and a first pivotal study thatĀ ended only 8Ā years later with a statistically significant difference on its primary endpoint [6]. Subsequently, a New Drug Application was submitted in September 2012 to the Food and Drug Administration (FDA) by AVEO Oncology for the first- or second-line treatment of patients with advanced RCC. In May 2013, the FDA voted against the approval of tivozanib, arguing that the agent under investigation did not demonstrate a favourable benefit-risk ratio for the treatment of advanced RCC [7]. Furthermore, the FDA expressed serious concern about the higher death rate in the tivozanib arm compared to the control arm (sorafenib), and warned that the design of the study compromised its scientific integrity. The FDA therefore requested a second efficacy study more adequately designed to measure the overall survival (OS) effect of tivozanib. Four years after the FDA refusal, the European Medicines Agency (EMA) reached a different decision: in June 2017, the Committee for Medicinal Products for Human Use (CHMP) issued a positive opinion by majority ā€“ 25 positive votes out of 30 ā€“ for tivozanib as a first-line treatment among adult patients with advanced RCC. A divergent position, undersigned by 6 members of the CHMP, is appended to the EPAR [8].

The second pivotal study, originally demanded by the FDA, had a slow start with first inclusions in May 2016, and results were finally available in 2019 [9]. In response, the FDA recommended that AVEO Oncology should not submit a New Drug Application based on the preliminary OS data from TIVO-3 because, as the preliminary OS analysis showed a hazard ratio of 1.12, the risk of a survival detriment could not be excluded [10]. One year later, after a revised OS analysis, the FDA accepted the submission for a New Drug Application [11]. Tivozanib was finally approved by the FDA for relapsed or refractory advanced renal cell carcinoma on March 10, 2021 [12].

The exact role of tivozanib in the treatment of RCC is also debated in European guidelines. The European Association of Urology (EAU) makes a weak recommendation against offering tivozanib, noting that ā€˜evidence is still considered inferior over existing 3 choices in the front-line settingā€™ [13], while the European Society for Medical Oncology (ESMO) listed tivozanib as ā€˜another standard of care when availableā€™ among good-risk patients [14].

The divergent and antagonistic opinions of these two agencies regarding tivozanib prompted us to critically review the evidence supporting its approval in this indication. In addition, as secondary sources are expected to provide a reliable summary of the level of evidence, we aimed to analyse the dissemination of this evidence in the literature using a citation analysis.

Methods

In this review, we sought to be descriptive and exploratory. No protocol was registered on dedicated platforms prior to the searches.

Search strategy

In April 2020 (with an update on December 14, 2020), we performed an electronic search of Medline, Google Scholar and Cochrane Library databases with the search terms ā€˜tivozanibā€™, and ā€˜renal cell carcinomaā€™ to identify pivotal studies that led to the approval of tivozanib (Supplementary table 1). Two reviewers (L.C. and C.L.) independently reviewed the titles and abstracts of all citations. Potentially relevant studies were examined in full-text. The predefined inclusion criteria were: (i) participants: patients with advanced RCC, (ii) intervention: tivozanib whatever the dose (iii) comparator: placebo or active treatment (iv) outcome: any outcome (v) study: randomized clinical trial designed to demonstrate clinical efficacy of tivozanib. Articles reporting results of pivotal studies supporting tivozanib approval are referred to as ā€˜target articlesā€™.

We also searched ClinicalTrials.gov using the term ā€˜tivozanibā€™ and examined the European public assessment report (EPAR) for Fotivda [8]. In the absence of a marketing authorisation, no documentation from the FDA was available.

Risk of bias was inductively assessed by two reviewers for each study. The two reviewers appraised the methodology qualitatively and discussed thoroughly before agreeing on the existence of any potential limitations. Shortcomings highlighted in the CHMP membersā€™ divergent positions were also taken into consideration.

Citation search

Using Web of Science, we identified all articles ā€“Ā published before December 16, 2020 ā€“ that cited any target paper. All articles that had cited the target paper were evaluated regardless of the publication date, publication type, or publication language. Articles citing the ā€˜target articleā€™ are referred to as ā€˜citing articles.ā€™ After evaluation by two independent reviewers, citing articles that did not provide any information on TIVO-1 trial results or tivozanib efficacy were excluded from further analyses.

Data extraction for ā€˜citing articlesā€™

After a critical analysis of the primary evidence, one reviewer author (L.C.) drew up a standard data extraction form that was subsequently pilot-tested on 10 cited articles and validated by a second reviewer author (C.L.) prior to data extraction. Then two authors (L.C., M.G., W.M., or C.T.) independently extracted information about the studies included. Disagreements were resolved by discussion between the two reviewers or after referral to a third reviewer (C.L.) until a consensus was reached. For each ā€˜citing articleā€™, the following information was collected: (i) the potential existence of at least one author exhibiting conflict of interests with Aveo Pharmaceuticals or Astellas (a marketing partner); (ii) the mention of clinical study characteristics (i.e. randomisation, masking, primary outcome, numbers of patients included); (iii) the mention of results concerning progression-free survival (PFS); (iv) the mention of results concerning OS; (v) and presence of ā€˜spinā€™.

Spin is defined as the use of specific reporting strategies ā€“ either intentional or unintentional ā€“ that distort the interpretation of results and misguide readers [15]. To our knowledge, lists of spin are only described for original articlesĀ ā€“ such as randomized clinical trial reports or systematic reviews and meta-analyses [16] ā€“Ā but not for citing articles. In our study, spin was defined in case of (i) misleading citation that over-estimates the beneficial effect of tivozanib, (ii) inadequate reporting of the limitations or bias identified during the analysis of the evidence. Spin that overestimated the efficacy of the control treatment was not considered.

Data analyses and co-authorship network analysis

This study was intended to be primarily descriptive in nature. Descriptive analyses were performed using R software, version 4.0.3. To identify possible clusters of citing authors, the co-authorship network was visualized using the ā€˜networkā€™ R package.

Results

Primary evidence

The searches yielded a total of 761 records (Fig.Ā 1). Of these, 741 were excluded by review of the title or abstract because they did not meet the selection criteria. On inspection of titles and abstracts, 20 potentially eligible records were retrieved and the full texts were analysed. After examination of the full text of the remaining 20 records, a further 18 records were discarded. Two studies were included in the qualitative analysis (Table 1). The first one (TIVO-1: NCT01030783) was published in 2013 [6] and was therefore the only pivotal study available at the time of EMA approval. The second one (TIVO-3: NCT02627963), which ended 2Ā years after approval, was published in early 2020 [9] and is now being given consideration by the FDA.

Fig. 1
figure 1

Flow chart

Table 1 Main characteristics and results from pivotal RCTs on tivozanib for the treatment of advanced RCC

The TIVO-1 trial

Design of TIVO-1

TIVO-1 was an open-label randomized controlled trial in which 517 patients with advanced or metastatic RCC were allocated to either tivozanib (Nā€‰=ā€‰260) or sorafenib (Nā€‰=ā€‰257). The main eligibility criteria included (i) ageā€‰ā‰„ā€‰18Ā years; (ii) prior nephrectomy; (iii) histologically confirmed RCC with a clear-cell component and recurrence or metastases; (iv) treatment-naive or treated with prior systemic therapy. The primary endpoint was PFS assessed using the Response Assessment Criteria In Solid Tumors (RECIST) imaging criteria and reviewed by independent radiologists who were blinded to the patientsā€™ treatment assignments. Secondary endpoints included OS, and the objective response rate (ORR) defined as complete response plus partial response. The drugs under study ā€“ tivozanib or sorafenib ā€“ were continued until progression of the disease. In case of progression, patients could access a next-line therapy; in particular, patients initially treated with sorafenib could be switched to tivozanib in an optional single-arm extension study (NCT01076010) which was later published as a separate paper [17].

Results of TIVO-1

The main efficacy results (OS and results reported by the blinded independent radiology review) are summarized in Table 1. The median PFS was significantly longer with tivozanib than with sorafenib (11.9 vs 9.1Ā months, respectively; HR: 0.80 [95% CI: 0.64ā€“0.99]; pā€‰=ā€‰0.042). The ORR was comparatively higher in the tivozanib arm (33% [27 ā€“ 39] vs 23% [18ā€“29]; pā€‰=ā€‰0.014). However, the results for OS were not significantly different between the two arms, and showed a trend towards longer survival in the sorafenib arm (28.8 vs 29.3Ā months, respectively; HR: 1.25 [0.95 ā€“ 1.62]; pā€‰=ā€‰0.105). Therefore, the TIVO-1 results support the efficacy of tivozanib on PFS, ORR but not on OS.

Imbalance in post-study treatments

Sixty-five percent of the patients in the sorafenib arm received a next-line therapy compared to only 26% of the patients in the tivozanib arm. This difference was primarily caused by the fact that patients who had disease progression in the sorafenib arm were allowed to cross over to the tivozanib arm (extension study: NCT01076010). It was also in part caused by the non-availability of targeted agents in eastern countries outside a clinical trial. Thus, this imbalance in post-study treatments probably contributed to the conflicting results between PFS and OS. However, there is nothing to rule out the hypothesis that the lower OS in the tivozanib arm could be linked to the toxic effect of this drug. Generally speaking, one-way crossover designs compromise the interpretation of OS. Several statistical approaches could be used to limit the resulting bias. But such methods have to be planned a priori in the study protocol and must not be used to ā€˜ascertain that a treatment confers an OS advantage when this is not apparent in an analysis that does not (strongly) depend on unverifiable assumptions such as an ā€œITT-analysisā€'Ā [18].

Additionally, the divergent position states that ā€˜it is also of concern that a large proportion of patients started a new anti-cancer therapy before progressionā€™ [8]. But neither in the EPAR nor in the TIVO-1 article, we were unable to identify the number of patients concerned, so we could not take account of this limitation.

Internal consistency concerning the primary endpoint

In the divergent positions appended to the EPAR, the CHMP members were also concerned by the lack of internal consistency in the results for the primary endpoint. Indeed, the exploratory results of subgroup analyses according to the geographical region suggested that the efficacy was driven by the subgroup of patients enrolled in North America and Western Europe who made up only a minority of the patients (40 patients [7.7%]). Likewise, predefined subgroup analyses according to the ECOG performance status suggested that the efficacy was driven by the subgroup of patients with ECOG performance status 0, who accounted for half of the patients (255 patients [49.3%]). Unfortunately, interpretation of these subgroup analyses is limited by the absence of interaction tests.

Choice of comparator

Sorafenib is approved for the treatment of patients with advanced RCC who have not responded to prior interferon-alpha or interleukin-2 based therapy, or are considered unsuitable for this therapy [2]. Treatment with sorafenib has never been indicated for the treatment of advanced RCC in first-line, neither in 2009 [19] nor in the most recent guidelines [14]. However, 70% of the patients included in the study were treatment-naĆÆve. Thus, the choice of the comparator is questionable when used to assess the efficacy of tivozanib in the first-line treatment of adult patients with advanced RCC.

Differences in dose reductions

In case of adverse events, the tivozanib dose was reduced from 1.5Ā mg once a day to 1.0Ā mg once a day (66% of the starting dose, with no option for further reduction) and the sorafenib dose was initially reduced from 400Ā mg twice a day to 400Ā mg once a day and then to 400Ā mg every other day (50% and 25% of the starting dose, respectively). In addition, the proportion of patients with dose reductions due to adverse events was greater in the sorafenib group (43%) than in the tivozanib group (14%), and this could result from the different rules for dose reduction in case of hypertension. Therefore, more patients in the sorafenib arm decreased their starting dose, and had a larger dose reduction than in the tivozanib arm. Unequal dose reductions could induce a systematic bias in favour of tivozanib.

The TIVO-3 trial

TIVO-3 design

TIVO-3 was an open-label randomized controlled trial in which 350 patients with advanced or metastatic RCC were allocated to tivozanib (Nā€‰=ā€‰175) or sorafenib (Nā€‰=ā€‰175). The eligibility criteria were similar to those for TIVO-1, except for previous therapy: all patients had previous unsuccessful treatment with two or three systemic regimens (one of which included a VEGFR tyrosine kinase inhibitor other than tivozanib or sorafenib).

TIVO-3 results

The main efficacy results are summarized in Table 1. On the basis of the blinded independent radiology review, the median PFS was significantly longer with tivozanib than with sorafenib, while OS did not significantly differ between treatment groups.

TIVO-3 limitations

Compared to TIVO-1, the same limitations concerning unequal dose reductions (34% versus 50%) and choice of comparator are found for TIVO-3. Indeed, evidence that sorafenib is active as a second-line treatment has been assessed following cytokines [2]; but to the best of our knowledge, studies that assessed the efficacy of drugs among patients who had received previous VEGFR-targeted therapy, used sorafenib as the ā€˜standardā€™. Therefore, it is not clear whether sorafenib is a robust comparator for later lines of therapy.

Unlike TIVO-1, the percentages of patients who received subsequent anticancer therapy are more balanced: 40% in the tivozanib group versus 47% in the sorafenib. Therefore, the OS analysis was not compromised by an imbalance in post-study treatments. Even so, no OS benefit was identified and due to the large confidence interval, a detrimental effect on OS could not be completely ruled out.

Citation searches

Completed after the EMA approval, TIVO-3 was not included in the citation analysis. Therefore, Motzer et al., 2013 [6] ā€“Ā corresponding to TIVO-1 ā€“Ā was the only cited article included in the citation analysis. As mentioned above, because of several study limitations, the results of this trial are difficult to interpret and inconclusive.

On December 16, 2020, the citation search identified 229 articles citing the target article among which 5 were not included because full-texts were not available. Seventy-three (32.6%) were excluded from further analysis because they did not discuss tivozanib efficacy. The main characteristics of the 151 remaining articles are presented in Supplementary table 2.

TIVO-1 study description

Among the 151 citing articles discussing the efficacy of TIVO-1, the number of subjects was mentioned in 54 (35.8%) citing articles, randomization in 52 (34.4%), one-way crossover in 43 (28.5%), and open-label in 16 (10.6%). PFS was clearly referred to as the primary outcome in only 27 (17.9%) citing articles.

Dissemination of the evidence on PFS and OS

Results on PFS or OS were presented in 110 articles (72.8%) and 95 (62.9%), respectively (Table 2). PFS results were expressed qualitatively and quantitatively in 87Ā articles (57.6%). Results on OS were expressed qualitatively in 79 (52.3%) and quantitatively in 62 (41.1%) (Fig.Ā 2). Among the 79 articles that qualitatively commented on OS results, 44 (55.7%) articles described the OS analysis using the phrase ā€˜trend towards longer survivalā€™ to describe the differences between the sorafenib arm and the tivozanib arm, and 42 (53.2%) articles referred to ā€˜no differenceā€™ between the sorafenib and tivozanib arms.

Table 2 Dissemination of PFS and OS results across the 151 citing articles
Fig. 2
figure 2

Alluvial diagram showing mentions of the PFS and OS results of TIVO-1 in citing articles. Green: 55.0% publications reported results for both PFS and OS; yellow: 19.2% publications reported neither PFS nor OS; orange: 7.9% publications reported only OS; red: 17.9% reported only PFS. When they are reported, PFS and OS are described in quantitative manner (HR, median or both) in 79.1% [87/110] and 65.3% [62/95]

Spin and uncritical citations

Spin was identified in 64 (42.4%) citing articles that inappropriately reported the results of TIVO-1. More specifically, (i) in 39 articles (25.8%), tivozanib was presented as a treatment of undisputed efficacy for RCC, (ii) in 26 articles (17.2%), OS results were omitted while PFS results were described, and (iii) in 10 articles (6.6%), OS results were attributed solely to the crossover design. Supplementary table 3 gives examples of wordings extracted from the citing articles. Among the 87 articles without a spin citation, 39 (44.8%) articles cite PFS and OS results in their raw form, i.e. without contextualisation or analysis.

Marketing authorization

While all citing articles were published after the FDA refusal, this information is mentioned in only 38/151 publications (25.2%). Among the 72 articles published after the EMA approval (i.e. August 2017), 33 (45.8%) provide this information.

Co-authorship network

The 151 articles citing the results of the target article (Motzer et al., [6]) involve 722 authors with a median number of articles of 1 (range: 1 ā€“ 10). Interactions between authors who cite Motzer et al. [6] are presented in the co-authorship network in supplementary Fig.Ā 1. A cluster of almost a third of the authors was interconnected for having published in collaboration 42.4% of the citations. The other half of the citations were published by groups of independent authors.

Discussion

Our systematic review of available evidence highlighted two randomized pivotal trials evaluating tivozanib for the management of RCC, one using the drug as a first- or second-line therapy [6] and the other as a third- or fourth-line therapy [9]. The results of TIVO-1 were released in 2013, but critical limitations rendered this trial inconclusive. The limitations were: inappropriate comparator, one-way crossover, absence of blinding, and a lack of internal consistency in the results for the primary endpoint. Although the difference observed for OS was not statistically significant, the trend towards longer survival in the sorafenib arm could be interpreted in many ways. Firstly, it could be due to random variations, as the confidence interval was wide. Secondly, it could be attributed to the imbalance across post-study treatments, partly due to the one-way crossover design. While one-way crossover design is widespread in oncology trials, its use is a controversial issue, mainly because it could confound estimates of overall survival [20, 21]. EMA itself considers that ā€˜cross-over should generally be avoided in order to meet the objectives of the trial. If nevertheless it is considered necessary, there should be sufficient confidence that the available data in terms of PFS, OS, and any other important secondary endpoints will be convincing enough from a scientific and regulatory point of view to meet the objectives of the trial and to ensure that adequate conclusions can be drawnā€™ [22]. Fleming et al. argue that ā€˜a cross control patients into the experimental therapy at disease progression is only justified when that therapy already has been proven to be an effective rescue treatmentā€™, which was not the case for tivozanib when setting the protocol [20]. Thirdly, one cannot exclude that sorafenib could be more effective in improving OS, or that tivozanib could have greater cumulative toxicity contributing to the shorter survival [5]. Indeed, Prasad et al. suggested that unequal dose reductions ā€“Ā with a higher dose reduction for sorafenib ā€“Ā may have played a role in PFS results by disadvantaging sorafenib [23]. These reasons could explain the rejection of the approval by the FDA, and they are in line with the comments expressed in the divergent positions that are annexed to the EPAR. In this document, some members of the CHMP listed several of the aforementioned limits and concluded that the ā€˜efficacy of tivozanib is not considered robustly demonstratedā€™ [8]).

In a context of general demand for replication, the level of evidence provided by at least two pivotal trials is considered as the standard for regulatory approval [24]. EMAā€™s document entitled ā€˜points to consider on application with 1. meta-analyses; 2. one pivotal studyā€™ describes circumstances in which a single pivotal trial might be sufficient to support approval [25]. This document recalls that ā€˜in the exceptional event of a submission with only one pivotal study, this has to be particularly compelling with respect to internal and external validity, clinical relevance, statistical significance, data quality, and internal consistencyā€™. The document also points out that ā€˜all-important endpoints [should show] similar findings.ā€™ So according to the EMA criteria, the TIVO-1 trial is not sound enough to support an approval based on a single pivotal study.

Before the submission of a New Drug Application, the FDA recommended that AVEO conduct a second pivotal clinical trial. This recommendation was in fact concealed by AVEO for many months, resulting in a class action by investors. In the complaint, it is mentioned that AVEO asked whether the second study could be performed as a post-marketing requirement, a demand that was refused by the FDA [26]. This could partly explain why TIVO-3 was slow to start, with the first inclusion taking place 3.5Ā years after the FDA recommendation. The results of TIVO-3 were finally available in 2019 at a time when it would be considerably difficult to find a role for tivozanib, as too many attractive alternatives, including immune-checkpoint inhibitors, had emerged [27].

In oncology, many cancer drugs are approved based on PFS benefits without evidence of a survival gain [28]. Post-marketing studies are advised to clarify the drugā€™s effect on OS but such studies do not systematically prove OS benefit or in some instances, do not test or report OS results [29]. So, to limit the risk of a detrimental effect on OS, we deem important that the following issues be taken into consideration: (i) patient-important health outcomes such as quality of life must be encouraged; (ii) surrogate endpoint such as PFS must be used only if a strong association with OS has been demonstrated; (iii) one-way crossover should be avoided so as to not jeopardise overall survival; (iv) through pharmacovigilance analysis, a detrimental effect on mortality should not be suspected; (v) update results of OS must be properly planned, (vi) decision-makers should require post-marketing studies on survival; (vii) absence of evidence on OS must be reported in a transparent manner to patients; (viii) marketing authorization should be reassessed in light of (absence of) post-marketing studies.

With more than 200 citations, the TIVO-1 paper is regarded as a highly cited paper in Web of Science Core Collection. One major endpoint of secondary sources is to transfer knowledge. It is therefore important that secondary sources report clinical study results with accuracy and transparency. As discussed, TIVO-1 has several study limitations that make the results difficult to interpret and inconclusive. It is therefore expected that these limitations are explained in secondary sources to give readers a quick and faithful overview of the level of evidence. Among the 229 citing articles, around one third do not provide any insight into TIVO-1 results and were therefore excluded from the analysis. Among the 151 remaining articles, spin was detected in two out of five articles. By claiming the beneficial effect of tivozanib without taking into account the several limitations, and/or by selectively reporting only statistically significant results, and/or by claiming that the lack of gain in OS was undoubtedly to be attributed to imbalance in post-trial treatments, these secondary sources can mislead the reader, who could over-estimate the efficacy of tivozanib in RCC [15]. In addition, although the following was not considered as spin, twenty-six additional articles suggested that the OS results were ā€˜likelyā€™ to be confounded by imbalance in post-trial treatments without suggesting further hypotheses. In addition to biased citations, 32 articles cite PFS and OS results in their raw form, i.e. without contextualisation or analysis. To a slightly lesser extent, these uncritical citations could also contribute to a misleading impression of a proven efficacy of tivozanib. Interestingly, the FDAā€™s refusal was far less commented than the EMAā€™s approval. One limitation of this citation analysis is that assessment of spin is inherently a subjective task. To deal with this issue, the presence of spin was evaluated by two independent reviewers according to standard data extraction methods and discrepancies were resolved through discussion until consensus was reached.

Many shortcomings, such as publication bias or outcome reporting bias, contribute to distorting the evidence from clinical studies in the medical literature [30]. The major consequences are the possible threat to the validity of meta-analyses and reduced reliability of available evidence for decision-making. Several positive initiatives have developed concrete solutions to reduce publication bias and/or outcome reporting bias, but they are mainly designed to improve the quality of primary sources, i.e. original articles on health research studies [31, 32]. While much effort has been invested in improving the quality of original articles [31, 32], there is ā€“Ā to our knowledge ā€“Ā no initiative aiming to reduce citation bias or improve the quality of secondary sources. However, our study, limited to a single clinical trial, shows that incomplete citations or insufficiently critical citations can also affect readersā€™ interpretations, and lead to overestimating the efficacy of a treatment. This type of citation bias could influence clinicians towards using insufficiently criticised controversial treatments.

Conclusion

The pivotal TIVO-1 trial is the only one that allowed the EMA to grant tivozanib approval as a first-line treatment in the management of RCC. This trial demonstrates an improvement in PFS for patients treated with tivozanib without improving OS. Although these results suggest a promising treatment, the trial has limitations that do not provide sufficient evidence on the efficacy of tivozanib as a first-line treatment. The broad dissemination of TIVO-1 results in the scientific literature lacked information on the trial characteristics that are essential for all interpretations of results. This literature was widely affected by spin or by uncritically presented results, questioning the reliability of secondary sources.

Availability of data and materials

The data that support the findings of this study are available on request from the corresponding author.

Abbreviations

CHMP:

Committee for Medicinal Products for Human Use

EAU:

European Association of Urology

EMA:

European Medicines Agency

EPAR:

European Public Assessment Report

ESMO:

European Society for Medical Oncology

FDA:

Food and Drug Administration

ORR:

Objective Response Rate

OS:

Overall Survival

PFS:

Progression-Free Survival

RCC:

Renal Cell Carcinoma

RECIST:

Response Assessment Criteria In Solid Tumors

VEGFR:

Vascular Endothelial Growth Factor Receptor

References

  1. Nakamura K, Taguchi E, Miura T, Yamamoto A, Takahashi K, Bichat F, et al. KRN951, a highly potent inhibitor of vascular endothelial growth factor receptor tyrosine kinases, has antitumor activities and affects functional vascular properties. Cancer Res. 2006;66(18):9134ā€“42.

    ArticleĀ  CASĀ  Google ScholarĀ 

  2. Escudier B, Eisen T, Stadler WM, Szczylik C, Oudard S, Siebels M, et al. Sorafenib in advanced clear-cell renal-cell carcinoma. N Engl J Med. 2007;356(2):125ā€“34.

    ArticleĀ  CASĀ  Google ScholarĀ 

  3. Motzer RJ, Hutson TE, Tomczak P, Michaelson MD, Bukowski RM, Rixe O, et al. Sunitinib versus interferon alfa in metastatic renal-cell carcinoma. N Engl J Med. 2007;356(2):115ā€“24.

    ArticleĀ  CASĀ  Google ScholarĀ 

  4. Sternberg CN, Davis ID, Mardiak J, Szczylik C, Lee E, Wagstaff J, et al. Pazopanib in locally advanced or metastatic renal cell carcinoma: results of a randomized phase III trial. J Clin Oncol Off J Am Soc Clin Oncol. 2010;28(6):1061ā€“8.

    ArticleĀ  CASĀ  Google ScholarĀ 

  5. Garnick MB. Preserving the sanctity of overall survival for drugs approved on the basis of progression-free survival: tivozanib as a case study. J Clin Oncol Off J Am Soc Clin Oncol. 2013;31(30):3746ā€“8.

    ArticleĀ  CASĀ  Google ScholarĀ 

  6. Motzer RJ, Nosov D, Eisen T, Bondarenko I, Lesovoy V, Lipatov O, et al. Tivozanib versus sorafenib as initial targeted therapy for patients with metastatic renal cell carcinoma: results from a phase III trial. J Clin Oncol Off J Am Soc Clin Oncol. 2013;31(30):3791ā€“9.

    ArticleĀ  CASĀ  Google ScholarĀ 

  7. AVEO and Astellas Report FDA Oncologic Drug Advisory Committee Votes Tivozanib Application Did Not Demonstrate Favorable Benefit-to-Risk Evaluation in Treatment of Advanced Renal Cell Carcinoma | AVEO Oncology [Internet]. [cited 2020 Dec 10]. Available from: https://investor.aveooncology.com/news-releases/news-release-details/aveo-and-astellas-report-fda-oncologic-drug-advisory-committee

  8. Committee for Medicinal Products for Human Use. Assessment report Fotivda, International non-proprietary name: tivozanib. 2017. (https://investor.aveooncology.com/news-releases/news-release-details/aveo-and-astellas-report-fda-oncologic-drug-advisory-committee cited 2020 Dec 8).

    Google ScholarĀ 

  9. Rini BI, Pal SK, Escudier BJ, Atkins MB, Hutson TE, Porta C, et al. Tivozanib versus sorafenib in patients with advanced renal cell carcinoma (TIVO-3): a phase 3, multicentre, randomised, controlled, open-label study. Lancet Oncol. 2020;21(1):95ā€“104.

    ArticleĀ  CASĀ  Google ScholarĀ 

  10. AVEO Oncology Announces NDA Timing Update [Internet]. Aveo Oncology. 2019 [cited 2020 Dec 14]. Available from: https://aveooncology.gcs-web.com/node/13881/pdf

  11. AVEO Oncology Announces FDA Acceptance for Filing of a New Drug Application for Tivozanib as aTreatment of Relapsed or Refractory Renal Cell Carcinoma [Internet]. Aveo Oncology. 2020 [cited 2020 Dec 10]. Available from: https://aveooncology.gcs-web.com/node/14681/pdf

  12. US Food and Drug Administration. FDA approves tivozanib for relapsed or refractory advanced renal cell carcinoma. FDA [Internet]. 2021 Oct 3 [cited 2021 Mar 15]; Available from: https://www.fda.gov/drugs/drug-approvals-and-databases/fda-approves-tivozanib-relapsed-or-refractory-advanced-renal-cell-carcinoma

  13. Ljungberg B, Albiges L, Bensalah K, Bex A, Giles R, Hora M, et al. EAU Guidelines on Renal Cell Carcinoma 2020 [Internet]. 2020 Mar [cited 2021 Dec 18]. Available from: https://uroweb.org/guidelines/renal-cell-carcinoma.

  14. Escudier B, Porta C, Schmidinger M, Rioux-Leclercq N, Bex A, Khoo V, et al. Renal cell carcinoma: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-upā€ . Ann Oncol Off J Eur Soc Med Oncol. 2019;30(5):706ā€“20.

    ArticleĀ  CASĀ  Google ScholarĀ 

  15. Boutron I, Dutton S, Ravaud P, Altman DG. Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. JAMA. 2010;303(20):2058ā€“64.

    ArticleĀ  CASĀ  Google ScholarĀ 

  16. Yavchitz A, Ravaud P, Altman DG, Moher D, Hrobjartsson A, Lasserson T, et al. A new classification of spin in systematic reviews and meta-analyses was developed and ranked according to the severity. J Clin Epidemiol. 2016;75:56ā€“65.

    ArticleĀ  Google ScholarĀ 

  17. Molina AM, Hutson TE, Nosov D, Tomczak P, Lipatov O, Sternberg CN, et al. Efficacy of tivozanib treatment after sorafenib in patients with advanced renal cell carcinoma: crossover of a phase 3 study. Eur J Cancer Oxf Engl. 1990;2018(94):87ā€“94.

    Google ScholarĀ 

  18. European Medicines Agency, Human Medicines Research and Development Support Division. Question and answer on adjustment for cross-over in estimating effects in oncology trials. 2018. (https://www.ema.europa.eu/en/documents/scientific-guideline/question-answer-adjustment-cross-over-estimating-effects-oncology-trials_en.pdf cited 2022 Jan 25).

    Google ScholarĀ 

  19. Escudier B, Kataja V. Renal cell carcinoma: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol. 2010;1(21):v137ā€“9.

    ArticleĀ  Google ScholarĀ 

  20. Fleming TR, Rothmann MD, Lu HL. Issues in using progression-free survival when evaluating oncology products. J Clin Oncol Off J Am Soc Clin Oncol. 2009;27(17):2874ā€“80.

    ArticleĀ  Google ScholarĀ 

  21. Haslam A, Prasad V. When is crossover desirable in cancer drug trials and when is it problematic? Ann Oncol Off J Eur Soc Med Oncol. 2018;29(5):1079ā€“81.

    ArticleĀ  CASĀ  Google ScholarĀ 

  22. European Medicines Agency. Appendix 1 to the guideline on the evaluation of anticancer medicinal products in man - Methodological consideration for using progression-free survival (PFS) or disease-free survival (DFS) in confirmatory trials. 2012. (https://www.ema.europa.eu/en/documents/scientific-guideline/appendix-1-guideline-evaluation-anticancer-medicinal-products-man-methodological-consideration-using_en.pdf).

    Google ScholarĀ 

  23. Prasad V, Massey PR, Fojo T. Oral anticancer drugs: how limited dosing options and dose reductions may affect outcomes in comparative trials and efficacy in patients. J Clin Oncol Off J Am Soc Clin Oncol. 2014;32(15):1620ā€“9.

    ArticleĀ  CASĀ  Google ScholarĀ 

  24. U.S. Department of Health and Human Services, Food and Drug Administration. Providing Clinical Evidence of Effectiveness for Human Drug and Biological Products. 1998. (https://www.fda.gov/files/drugs/published/Providing-Clinical-Evidence-of-Effectiveness-for-Human-Drug-and-Biological-Products.pdf).

    Google ScholarĀ 

  25. European Agency for the Evaluation of Medicinal Products. Points to consider on application with 1. meta-analyses; 2. one pivotal study. 2001. (https://www.ema.europa.eu/en/documents/scientific-guideline/points-consider-application-1meta-analyses-2one-pivotal-study_en.pdf).

    Google ScholarĀ 

  26. AVEO complaint - No 16-cv-10607-NMG. [cited 2020 Dec 10]; Available from: https://www.sec.gov/divisions/enforce/claims/docs/aveo-complaint-090116.pdf.

  27. Kotecha RR, Motzer RJ, Voss MH. Towards individualized therapy for metastatic renal cell carcinoma. Nat Rev Clin Oncol. 2019;16(10):621ā€“33.

    ArticleĀ  CASĀ  Google ScholarĀ 

  28. Kim C, Prasad V. Cancer Drugs Approved on the Basis of a Surrogate End Point and Subsequent Overall Survival: An Analysis of 5 Years of US Food and Drug Administration Approvals. JAMA Intern Med. 2015;175(12):1992ā€“4.

    ArticleĀ  Google ScholarĀ 

  29. Davis C, Naci H, Gurpinar E, Poplavska E, Pinto A, Aggarwal A. Availability of evidence of benefits on overall survival and quality of life of cancer drugs approved by European Medicines Agency: retrospective cohort study of drug approvals 2009ā€“13. BMJ. 2017;359:j4530.

    ArticleĀ  Google ScholarĀ 

  30. Wieseler B, Kerekes MF, Vervoelgyi V, McGauran N, Kaiser T. Impact of document type on reporting quality of clinical drug trials: a comparison of registry reports, clinical study reports, and journal publications. BMJ. 2012;344:d8141.

    ArticleĀ  Google ScholarĀ 

  31. Simera I, Moher D, Hirst A, Hoey J, Schulz KF, Altman DG. Transparent and accurate reporting increases reliability, utility, and impact of your research: reporting guidelines and the EQUATOR Network. BMC Med. 2010;8(1):24.

    ArticleĀ  Google ScholarĀ 

  32. De Angelis C, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, et al. Clinical trial registration: a statement from the International Committee of Medical Journal Editors. Lancet Lond Engl. 2004;364(9438):911ā€“2.

    ArticleĀ  Google ScholarĀ 

Download references

Acknowledgements

The authors wish to thank Monique Boucquin from Centre de Documentation et dā€™Information Pharmaceutique (CDIP) ā€“ Hospices Civils de Lyon for the literature search as well as Angela Verdier and Stuart Byrom for English revising.

Funding

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

CL and FN designed the study. CL and LC performed the review of evidence and citation research. LC, CL, MG, WM, CT extracted the data. CL and LC wrote the draft of the manuscript. BL and FN contributed to the writing of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Clara Locher.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisherā€™s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Figure S1.

Co-authorship network of researchers who published articles citing the target article (Motzer et al., 2013 [6]).

Additional file 2: Table S1.

Electronic search.

Additional file 3: Table S2.

Main characteristics of citing articles.

Additional file 4: Table S3.

Quotes from the citing articles illustrating the oversimplification of TIVO-1 results.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Caquelin, L., Gewily, M., Mottais, W. et al. Tivozanib in renal cell carcinoma: a systematic review of the evidence and its dissemination in the scientific literature. BMC Cancer 22, 381 (2022). https://doi.org/10.1186/s12885-022-09475-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12885-022-09475-7

Keywords