Time-dependent endpoints as predictors of overall survival in multiple myeloma

  • Jorge Félix1Email author,

    Affiliated with

    • Filipa Aragão1,

      Affiliated with

      • João M Almeida1,

        Affiliated with

        • Frederico JM Calado1,

          Affiliated with

          • Diana Ferreira1,

            Affiliated with

            • António BS Parreira2,

              Affiliated with

              • Ricardo Rodrigues3 and

                Affiliated with

                • João FR Rijo4

                  Affiliated with

                  BMC Cancer201313:122

                  DOI: 10.1186/1471-2407-13-122

                  Received: 19 June 2012

                  Accepted: 7 March 2013

                  Published: 16 March 2013



                  Supporting health care sector decisions using time-dependent endpoints (TDEs) such as time to progression (TTP), progression-free survival (PFS), and event-free survival (EFS) remains controversial. This study estimated the quantitative relationship between median TDE and median overall survival (OS) in multiple myeloma (MM) patients.


                  Studies (excluding allogeneic transplantation) published from 1970 to 2011 were systematically searched (PubMed). The nonparametric Spearman’s rank correlation coefficient measured the association between median TDE and OS. The quantitative relationship between TDEs and OS was estimated with a two-step approach to a simultaneous Tobit model.


                  We identified 153 studies: 230 treatment arms, 22,696 patients and mean study duration of 3.8 years. Mean of median TDEs was 22.5 months and median OS was 39.1 months. Correlation coefficients of median TTP, PFS, and EFS with median OS were 0.51 (P = 0.003), 0.75 (P < 0.0001), and 0.84 (P < 0.0001), respectively. We estimate a 2.5 month (95% confidence interval, 1.7–3.2) increase in median OS for each additional month reported for median TDEs. There was no evidence that this relationship differed by type of surrogate.


                  TDEs predict OS in MM patients; this relationship may be valuable in clinical trial design, drug comparisons, and economic evaluation.


                  Multiple myeloma Overall survival Survival predictors Time-dependent endpoint Time to progression


                  Multiple myeloma (MM) is the second most common hematologic malignancy, after non-Hodgkin lymphoma [1, 2]. In the US, it was estimated that over 20,500 new cases of MM and more than 10,600 deaths occurred in 2011 [3]. Despite improved survival over the past decades, MM remains an incurable disease, with research focused on finding more effective treatments [4]. Although improving overall survival (OS) has been the gold standard outcome for new anticancer treatments, large costly trials with long follow-up periods are required to document an impact on OS [5, 6]. Furthermore, OS can be influenced by trial design characteristics, such as crossover and sequential treatments [7, 8]. Therefore, surrogate endpoints that can be measured sooner and more frequently during the course of a clinical trial, are being used to provide an earlier indication of efficacy [9].

                  A surrogate endpoint is a measurement that can be substituted for the final endpoint (e.g., improvement in OS) to successfully measure the effect of an intervention [10]. Common surrogate endpoints for OS used in clinical oncology trials include: response rate; time to disease progression (TTP); progression-free survival (PFS); and event-free survival (EFS) [6]. For study conclusions to be valid, differences or changes observed in the surrogate endpoints must accurately reflect changes in the final endpoint [11]. There is ongoing debate about the utilization of these time-dependent endpoints (TDEs) as intermediate endpoints for OS in clinical trials [12, 13], as well as their value to health authorities when assessing drug approvals and assessing costs of drug therapy [7, 14, 15].

                  In 1992, the US Food and Drug Administration (FDA) instituted the accelerated approval process to allow earlier marketing of drugs that treat serious, life-threatening diseases [16]. Recently, the FDA ruled that both TTP and PFS are valid and clinically relevant TDEs that can be used in the accelerated approval process for MM agents [17]. Although these endpoints are generally thought to be reliable in MM, their predictive value for OS is unknown. Our objective was to estimate a quantitative relationship between median TDEs and median OS from prospective published MM studies in order to address the question of what the expected median OS would be given the observed effect in the median TDE.


                  Search strategy and selection criteria

                  We systematically searched PubMed for articles published between January 1970 and February 2011 to identify experimental or observational prospective studies that assessed OS in MM using TTP, PFS, or EFS as a primary endpoint. Key search words included “myeloma” or “survival” or “progression”; see Additional file 1 for full search details. Retrospective studies were excluded, as were studies involving allogeneic transplantation, which generally target younger patients with a clinical status that differs greatly from the majority of MM patients. The TDEs considered were median TTP, PFS, and EFS. The final outcome measures considered were median OS, 12-month OS, 24-month OS, 36-month OS, or any survival data that described the proportion of patients alive or deceased and the duration of follow-up. Studies lacking surrogate endpoint outcomes or OS data were excluded; see Additional file 1 for the selection process scheme. The following variables were collected: authors, publication year, journal, study sample characteristics (period of analysis, median age, percentage of males, type and number of previous therapies), and study results (therapies used, median TDEs, median OS, 12-month OS, 24-month OS, and 36-month OS).

                  Statistical methods

                  Using the median TDE as an independent observation to estimate median OS, with each study arm representing a single observation, presents a statistical challenge. Outcome measures such as TTP, PFS, and EFS differs on their exact definition, especially with the inclusion or exclusion of death as event [17]. Concerning the estimation of the statistical model, this points to the presence of endogeneity of the main regressor of interest (TDE) and heterogeneity of observations. In the context of linear regression, an estimation based on an instrumental variables approach may be considered, when the endogeneity of regressors is suspected [18].

                  In addition, the data analyzed are sourced from a literature review of studies with different study designs, patient populations, and treatments. It is possible that the variance of the unexplained share (the residuals) differs among observations and that heteroskedasticity (non-constant variance) is present. In the presence of heteroskedasticity, the instrumental variables estimator yields consistent, but inefficient, estimates of the coefficients and an inconsistent estimate of the covariance matrix [19]. One way to minimize inefficiency in the coefficient estimates is to weight each observation by the number of patients enrolled in the corresponding study arm and to use the Generalized Method of Moments (GMM) [19]. Inconsistency of the standard error estimates may be corrected by using heteroskedasticity robust estimators of the variance–covariance matrix, such as the Huber/White sandwich estimator [20, 21].

                  The set of available exogenous variables (candidates to instruments) comprise the following: 12-months OS rate; proportion of females; median age; dummy variables characterizing patients by previous treatment; type of TDEs; and publication year.

                  Not all study arms included in the review reached the median OS by the last published follow-up; those that did not are censored observations. If, at the end of a given study, less than 50% of the patients at risk were alive, then the exact value of the dependent variable being modeled (median OS) is known. However, if the duration of the study is shorter than the number of months needed to have less than 50% of patients alive, then all that is known about the dependent variable is that it is higher than the study duration. This information is potentially relevant and was included in our analysis.

                  The estimation of the censored model with one endogenous variable (TDE) was performed by a two-step estimation process similar to the method developed by Smith and Blundell [22], with the following modifications:
                  1. (i)

                    The regression of the endogenous variable on the excluded instruments and exogenous variables (Step 1) was weighted by the number of patients in each study arm and estimated using the GMM Cragg estimator [23]. This estimator makes use of information provided by the excluded instruments (median age, percentage of males, and classification of patients by number of previous treatments) to increase efficiency in the presence of heteroskedasticity of unknown form.

                  2. (ii)

                    Given that the censoring point varies with the study arm, a censored normal-weighted regression with the robust option [21] was estimated in Step 2, instead of a purely Tobit model.


                  Following the approach described in Smith and Blundell (1986) [22], variance of the estimators’ formulas was corrected for one endogenous regressor. With such corrections Smith and Blundell demonstrate that estimates for standard errors, t-statistics, and confidence intervals (CIs) are asymptotically valid and hence applicable in the context of the present analysis.

                  Evidence in favor of the use of the instrumental variable approach was generated by the Durbin-Wu-Hausman test for endogeneity of the TDE regressor [2426]. The validity of the instruments used was confirmed by both a high degree of correlation between the instruments and the endogenous regressor and the orthogonality between the endogenous regressor and the error term (Hansen J-statistic) [27]. The Breusch-Pagan test for heterogeneity [28] was used to check for the adequacy of the GMM estimator. The selection of the final functional form of the model was based on the RESET test [29], a test that checks the possible omission of relevant variables or, more specifically, validates the linearity assumption.

                  Alternative model specification was based on three criteria: validity of the instruments used; explanatory power of the instruments in the first-stage regression; and AIC (Akaike Information Criteria) in the second-stage (censored) regression.

                  The association between median TDE and median OS was quantified through Spearman’s rank correlation coefficient in a restricted subset of data consisting of trials only with simultaneously observed values for median TDE and median OS, and excluding those trials with unobserved median OS values [30, 31]. This complete-case analysis is known to result in loss of accuracy and precision when the data are not missing completely at random [32], but was assumed in order to avoid data imputation methods or assumptions about the distribution of the unobserved median OS values. The analysis was performed with the Stata Statistical Software (Release 11. College Station, TX: StataCorp LP).


                  Sample characteristics

                  Of the 1,061 studies retrieved, we included 153 studies involving 230 study arms (see Additional file 1). The primary endpoints reported were: median TTP (n = 46); median EFS (n = 76); and median PFS (n = 108). Of the 230 study arms, 163 reported median OS (67 unobserved values). The 12-, 24-, and 36-month OS rates were reported in 100%, 73%, and 70% of the study arms, respectively. Overall, the sample included 22,696 MM patients, 56.5% of whom were male (Table 1). Each arm included an average ± standard deviation of 99 ± 80 patients (range 8–345). The mean of reported median age was 61.3 ± 7.2 years (range 44–79), and the majority of arms (67.6%) represented only newly diagnosed or treatment-naïve patients. Mean of median TDEs was 22.5 ± 15.2 months (range 3–21), and the mean of median OS was 39.1 ± 18.4 months (range 8–126).
                  Table 1

                  Characteristics of the studies and patients included in the analysis


                  (n = 22,696)



                  Age in years, mean of medians ± standard deviationa

                  61.3 ± 7.2

                  Multiple myeloma, no. of patients (study arms)


                    Newly diagnosed

                  15,345 (128)

                    Relapsed, refractory, or advanced

                  5,273 (68)

                    Mixed or not reportedb

                  2,078 (34)

                  Duration of the studies (years), mean ± standard deviation

                  3.8 ± 2.0

                  Mean of median time-dependent endpoint, months (range)

                  22.5 (3–121)

                    Time to progression

                  16.7 (4–39)

                    Progression-free survival

                  22.7 (5–121)

                    Event-free survival

                  25.7 (3–70)

                  Median overall survival in months, mean (range)

                  39.1 (8–126)

                  aAge statistics represent the mean of medians because the majority of studies reported the median rather than the mean age of the studied population.

                  bCorresponds to those studies including: newly diagnosed; relapsed, refractory, or advanced; or to those not differentiating the type of patients.

                  Correlation between TDEs and OS

                  The Spearman’s rank correlation coefficient of the aggregated median TDE data on median OS was 0.78 (P < 0.0001). Figure 1 shows the correlation between median values of the TDEs and median values of observed OS. The nonparametric Spearman’s rank correlation coefficient value (ρ) was highly significant for all TDEs, with a moderate correlation between median OS and median TTP (ρ = 0.51), and a strong correlation for median PFS (ρ = 0.75) and median EFS (ρ = 0.84).
                  Figure 1

                  Correlation between median values of the time-dependent endpoints (TDEs) and observed median overall survival (OS). Each circle represents a study arm, and the surface area of the circle is proportional to the size of the arm. The nonparametric Spearman’s rank correlation coefficient (ρ) and its level of significance are also reported. Abbreviations: EFS, event-free survival; PFS, progression-free survival; TTP, time to progression.

                  Modeling the effect of TDE on OS

                  Table 2 reports the regression of identified variables in median OS. Regression coefficients (β) correspond to the estimated effect of each variable controlled for the effect of all other variables included in the model. The 95% CIs including zero identify a non-significant effect. We found an increase of 2.45 months (95% CI, 1.71–3.20) in the reported median OS for each additional month in the observed median TDE (Table 2). This estimate was obtained adjusting for differences in the study demographics, patient type, surrogate endpoint type, publication year, and MM treatments including thalidomide (Thal), bortezomib (Bort), or lenalidomide (Len). All other covariables used in this multivariate censored-normal regression model have non-significant coefficients, suggesting a weak explanatory power on median OS in the presence of the highly significant TDE regressor (P < 0.0001). These results also suggest a borderline significant positive association (P = 0.06) between trials including patients with relapsed, refractory, or advanced MM, compared with trials including newly diagnosed MM patients. This weak evidence suggests that other factors not included in the regression model may complement the TDE explanatory power in relapsed, refractory, or advanced MM OS. The type of surrogate endpoint and treatment did not impact the explanatory power to median OS, which suggests surrogacy of TTP, PFS, and EFS to OS.
                  Table 2

                  Effect of median time-dependent endpoints (TDEs) on median overall survival (OS) estimated from a multivariate censored normal regression, by type of TDE





                  95% CI

                  Median TDE, months



                  < 0.0001

                  1.71 ; 3.20





                  − 0.42 ; 0.52

                  Median age, years




                  − 0.16 ; 1.34

                  Year of publication




                  − 0.39 ; 0.87

                  Relapsed, refractory, or advanced MM




                  − 0.66 ; 29.14

                  Mixed or not reported type MM




                  − 2.89 ; 16.78

                  TDE (time to progression)




                  − 2.21 ; 14.11

                  TDE (event-free survival)

                  − 3.51



                  − 11.42 ; 4.40

                  Treatment including Thal, Bort, or Len

                  − 5.98



                  − 17.89 ; 5.94

                  Note: Includes 163 uncensored observations and 67 right-censored observations. The constant of the model was suppressed due to non-significance.

                  Abbreviations: β Regression coefficient, Bort Bortezomib, CI Confidence interval Len Lenalidomide, MM, Multiple myeloma, SE, Standard error, Thal Thalidomide.

                  We also tested our modeling technique against a set of alternative specifications and data samples (censored vs uncensored) to assess the robustness of the quantitative relationship between median TDEs and median OS. The departure model identified in Table 3 as base model includes covariables to control for differences in age, gender, and year of publication across studies. Two sets of data were used: sample without censored observations including only those studies reaching median OS (n = 163); and a larger dataset with 67 additional observations including studies not reaching median OS at the last published follow-up (sample with censored observations, n = 230). In this table, all β were highly significant (P < 0.0001). The inclusion of TTP and EFS as covariables relative to PFS revealed no statistical differences in the type of TDE but a numeric increment of the estimate coefficient of the linear regression relative to the base model. These results suggest that in trials using PFS, the quantitative relationship between PFS and OS is not statistically different to the comparison between TTP or EFS, and OS. However, caution is recommended in interpreting this result because the numeric differences may point to relevant differences in bigger samples. Augmenting the model with information on MM treatment with Thal, Bort, or Len (sample with censored observations) increased the TDE coefficient from 2.36 to 2.45. Despite these therapies not being statistically significant relative to other treatments, they were retained in the model to control for unobserved differences in trials using newer treatment options compared with older treatments. This does not imply that Thal, Bort, and Len have no effect on OS, but instead suggests that these compounds do not add more explanatory power on median OS other than their effect through median TDE.
                  Table 3

                  Effect of median time-dependent endpoints (TDEs) on median overall survival estimate based on alternative modeling specifications


                  With censored observations (n = 230)

                  Without censored observations (n = 163)




                  95% CI



                  95% CI

                  Base model (BM)a



                  1.56 ; 2.08



                  1.69 ; 2.50

                  BM without two perturbing observations



                  1.58 ; 2.11



                  1.73 ; 2.58

                  BM with adjustment for type of patient and type of TDEb



                  1.69 ; 3.04



                  1.52 ; 3.75

                  BM with adjustment for type of patientc, type of TDE and treatment including Bort, or Len, or Thal



                  1.71 ; 3.20



                  1.52 ; 3.71

                  aThe BM is adjusted for age, gender, and year of publication.

                  bType of TDE refers to time to progression, progression-free survival, and event-free survival.

                  cType of MM patient refers to the following groups: newly diagnosed; relapsed, refractory, or advanced; and mixed or not discriminated in the publication.

                  Abbreviations: β Regression coefficient, Bort Bortezomib, CI Confidence interval, Len Lenalidomide, MM Multiple myeloma, SE Standard error Thal Thalidomide.

                  Overall, the consistency of the estimated values for the effect of median TDE on median OS is evident. The maximum variation in the effect of median TDE on median OS is 34% (β = 2.45; 95% CI, 1.71–3.20) relative to the base model (β = 1.82; 95% CI, 1.56–2.08).

                  Results based on the sample with uncensored observations provide higher effect values, most likely related to the study design. In our sample, phase II and phase III randomized controlled trials (RCTs) represent 38.8% and 46.3%, respectively, of the study arms with censored observations, and 23.9% and 55.2%, respectively, of the study arms without censored observations. The results from the regression models including and excluding the two outliers are quite similar, indicating the small effect of these two observations in the analysis.

                  Additional details of the statistical tests performed to assess the validity of the modeling procedures can be found in the Additional file 1.

                  Prediction of median OS from the observation of median TDE

                  The detailed predicted median OS and associated 95% CIs based on the observed median TDE for each study arm included in our analysis are presented in the Additional file 1. In general, lower predicted median OS values in the study arms using TTP were found. TTP is the only TDE that does not include death. There was a higher proportion of study arms using TTP as the primary endpoint in the relapsed, refractory, or advanced MM population (46%) compared with 26% and 25% of the study arms evaluating PFS and EFS, respectively. In addition, 35.5%, 63.7%, and 58.0% of the observed median OS are contained in the 95% CI prediction for the TTP, PFS, and EFS, respectively. In approximately one-third of the TTP arms, median OS is under-observed relative to the 95% CI. In the PFS subset, 26.3% of arms reported median OS below the predicted 95% CI and 10% above it. In the EFS subset, 36% of arms report median OS below the predicted 95% CI and 6% above it.

                  A selection of RCTs retrieved from three recent reviews [3335] investigating treatment options for newly diagnosed MM in patients not eligible for transplantation [3649], the relapsed/refractory MM setting [5052] and post-transplantation maintenance therapy [5359], respectively, were used to illustrate the practicality of our method in predicting median OS from observed data on median TDE. Figures 2, 3, 4 plot the predicted median OS and associated 95% CIs in comparison with the observed/reported median OS, including those that did not report the median OS due to a short follow-up period. It should be noted that the RCTs presented in these figures are very heterogeneous in their design, patient populations, and treatment options, with some including maintenance therapy. This is not an exhaustive sample of all RCTs, but simply represents a selection of published trials that report median PFS or TTP or EFS.
                  Figure 2

                  Predicted median overall survival (OS) versus the observed OS in randomized controlled trials (RCTs) including thalidomide-, bortezomib-, or lenalidomide-based regimens for upfront treatment of multiple myeloma in patients not eligible for transplantation. Horizontal lines represent estimated 95% confidence interval (CI) for the median OS based on the modeled median time-dependent endpoints from each study arm. Solid circles represent observed median OS contained in the corresponding 95% CI estimate, and lozenges represent observed median OS not contained in the corresponding 95% CI estimate. Where data are from different studies, a direct comparison is not possible as different studies use different patient populations, different study designs, and were conducted at different time points. Vertical dashed line stands for the mean of median OS of the MP arms. a19.5% of trial patients received thalidomide maintenance therapy. b88% of patients received thalidomide maintenance therapy. c18.8% of trial patients received thalidomide maintenance therapy. d33–55% of trial patients received bortezomib maintenance therapy. e35% of trial patients received maintenance therapy with bortezomib plus prednisone and 33.5% with bortezomib plus thalidomide. f66.7% of patients received maintenance therapy with bortezomib plus thalidomide. g100% of patients planned to receive maintenance therapy with lenalidomide. Abbreviations: CTDa, attenuated (low-intensity) cyclophosphamide, thalidomide, dexamethasone; MP, melphalan, prednisone; MPR, melphalan, prednisone, lenalidomide; MPR-R, melphalan, prednisone, lenalidomide followed by maintenance with lenalidomide; MPT, melphalan, prednisone, thalidomide; Rd, lenalidomide, low-dose dexamethasone; RD, lenalidomide, dexamethasone; TD, thalidomide, dexamethasone; VD, bortezomib, dexamethasone; VMP, bortezomib, melphalan, prednisone; VMPT-VT, bortezomib, melphalan, prednisone, thalidomide followed by maintenance with bortezomib, thalidomide; VTP, bortezomib, thalidomide, prednisone.

                  Figure 3

                  Predicted median overall survival (OS) versus the observed OS in phase III randomized controlled trials (RCTs) including bortezomib- or lenalidomide-based regimens for the treatment of relapsed/refractory multiple myeloma. Horizontal lines represent estimated 95% confidence intervals (CIs) for the median OS based on the modeled median time-dependent endpoints from each study arm. Solid circle represents observed median OS contained in the corresponding 95% CI estimate, and lozenges represent the observed median OS not contained in the corresponding 95% CI estimate. Where data are from different studies, a direct comparison is not possible as different studies use different patient populations, different study designs, and were conducted at different time points. Vertical dashed line stands for the mean of median OS of the Dex arms. Abbreviations: Bort, bortezomib; Dex, dexamethasone; Len, lenalidomide; PLD, pegylated liposomal doxorubicin.

                  Figure 4

                  Predicted median overall survival (OS) versus the observed OS in randomized controlled trials (RCTs) including thalidomide-, bortezomib-, or lenalidomide-based regimens for post-transplantation maintenance therapy in multiple myeloma. Horizontal lines represent estimated 95% CIs for the median OS based on the modeled median time-dependent endpoints from each study arm. Solid circles represent observed median OS contained in the corresponding 95% CI estimate, and blue lozenge represents observed median OS not contained in the corresponding 95% CI estimate. Vertical dashed line stands for the mean of median OS of the no maintenance arms. Abbreviations: Bort, bortezomib; Dex, dexamethasone; Len, lenalidomide; Thal, thalidomide.

                  Since 2007, results from 8 phase III trials investigating Thal combinations in patients with newly diagnosed MM not eligible for transplantation have been reported. With the exception of the studies by Ludwig et al. [36] and Morgan et al. [37], all other studies compare Thal added to melphalan plus prednisone (MPT) with melphalan plus prednisone (MP). The majority of median OS values reported (13/16) are within our 95% CI estimate for OS, confirming the value of TDE in predicting OS (Figure 2). Another practical implication from our method is that once median TTP/PFS/EFS is observed, we can derive an estimate for the median OS even if it has not been reported. The OS estimates can be used to inform decision makers on newer and promising MM treatment regimens, along with other relevant clinical parameters such as acceptable tolerability, favorable safety profile, and sustainable quality-of-life outcomes.

                  In Figure 3, we present the estimated median OS vs the observed OS in phase III RCTs using Bort- or Len-based regimens for the treatment of relapsed/refractory MM. The only treatment arm reporting median OS within the 95% CI from our model is the Len plus dexamethasone (Dex) arm from the study by Dimopoulos et al. [50]. At first glance, these results suggest that our model is less suitable for predicting median OS in relapsed/refractory MM. However, it should be noted that the effect from subsequent salvage therapies is expected to be more pronounced, with a shorter median TDE, i.e. the faster progression occurs.

                  A recent review by Reece [35] identified several phase III RCTs of post-transplantation maintenance therapy with Thal, Len, and the proteasome inhibitor Bort. These studies differ substantially in the type of induction regimen, transplantation strategy (single vs tandem) and maintenance scheme (drug combinations, doses, and duration). However, this heterogeneity provided us with the opportunity to further evaluate our model. Figure 4 incorporates updated survival outcomes from these trials and presents estimations for the median OS. Trials identified in Reece [35] that did not report median intermediate TDE were not considered in this figure. The study by Lokhorst et al. [56] was the only one from this set to contribute with data to our regression model. At present, we can estimate an average absolute increase of 27 months, 17 months, and 47 months in median OS for post-transplantation maintenance therapy with Thal, Bort, and Len, respectively.


                  There is a sound body of evidence suggesting that TDEs such as PFS, TTP, and EFS are appropriate surrogate endpoints for OS in several types of cancer [31, 6071]. However, some conflicting evidence [61, 72, 73] and some methodological [11], regulatory [74], and conceptual/practical [75] arguments fuel the ongoing discussion about surrogate endpoints in the cancer literature [7678] and challenge the establishment of TDEs in oncology clinical development [79].

                  Our study is the first to highlight the value of TDEs in predicting OS in MM and to confirm the recommendations of the American Society of Hematology/US FDA Workshop on Clinical Endpoints in both newly diagnosed or relapsed/refractory MM [17]. We focused our research on estimating the absolute effect of TDEs on OS rather than using a relative measure. We are aware that other assessments of potential surrogate endpoints require a two-step validation process, which involves: 1) establishing that the surrogate endpoint predicts the final endpoint accurately; 2) demonstrating that the effect of treatment on both the surrogate endpoint and the final endpoint is closely correlated [11]. Our methodology, while inherently considering the two last criteria, follows a less formal [80] approach by using regression modeling methods to show that the effect on median OS is captured by the TDE (validation criterion 1) and that adding treatment to the linear predictor does not improve the prediction (validation criterion 2) (i.e. does not improve the fit), hence suggesting that the causal link between treatment and endpoint has been captured by the TDE predictor.

                  In order to assess our model’s ability to predict OS in different settings, we confronted our estimates with data from studies in relapsed/refractory MM led by Dimopoulos et al. [50] and Richardson et al. [51] (Figure 3). The study by Dimopoulos et al. comparing Len plus Dex with Dex alone reported a hazard ratio (HR) for progression of 0.31 (median 13.4 vs 4.6 months) [81], and for death of 0.71 (median 38.0 vs 31.6 months) [50]. In the study by Richardson et al., which compared Bort to Dex, the reported HR for progression was 0.55 (median 6.2 vs 3.5 months) [82] and for death was 0.77 (median 29.8 vs 23.7 months) [51].

                  Estimates of median OS using our model suggest an HR for death of 0.34 for Len plus Dex vs Dex alone (median OS 33 vs 11 months), and 0.55 for Bort vs Dex (median OS 15 vs 9 months), assuming event times are exponentially distributed [83]. In this case, the treatment effect on TTP would explain more than 90% of the treatment effect on OS for both Len plus Dex and for Bort.

                  It has been argued that OS is not a realistic endpoint in this setting [84], especially considering the ever increasing availability of new, effective drugs that can be used as salvage therapies [8, 85] which may mask the real survival differences between treatment arms. Statistical methods to correct for bias resulting from non-informative censoring (crossover and subsequent treatment options) in survival analysis are increasingly popular [86, 87]. In a recent paper by Ishak et al. [88], information from trials conducted by the Medical Research Council (United Kingdom) was used to calibrate survival regression analyses in order to reproduce survival estimates corrected for patient crossover in clinical trials. These authors present a median OS of 11.6 months (95% CI, 9.5–14.2) for patients with > 1 prior therapy randomized to Dex [50], which is similar to our estimate of 11.3 months. Furthermore, in a survival analysis adjusted for crossover in the APEX trial, Pacou et al. report an OS HR of 0.59 for Bort relative to Dex [89], which is also very similar to the value derived from our model (HR 0.55), suggesting that our model performs accurately in trials with substantial crossover. Nonetheless, caution is recommended for extrapolation outside the context of our sample because more mature data on more recent clinical trials and future research in this topic is clearly needed.

                  We provide a more straightforward way of calculating the expected effect of treatment on median OS (prior to the observation of mature OS data), by estimating an absolute rather than a relative measure for the quantitative relationship between the median TDE and median OS. This regression model recognizes the influence of subsequent therapies because it estimates a mean effect of median TDE on median OS using OS data published in the literature, which is uncorrected for the effect of non-randomized subsequent treatment options. We estimated an average increment of 2.45 months in median OS for each additional month of median TDE. As previously highlighted, these estimates are valuable to assess the expected impact of treatments on median OS, for example in trials of newly diagnosed MM where median OS may not be reached for several years.

                  Information on survival is essential for clinical trial design [90], accelerated approvals for new drugs [91], indirect drug comparisons, and economic considerations (e.g. formulary inclusion and other reimbursement decisions), particularly in the absence of head-to-head comparative clinical trials. Such information may help clinicians select the most suitable treatment options for MM patients.

                  Other studies examining the relationship between TDEs and OS have been reported in metastatic colorectal cancer (mCRC) [31, 62] and in metastatic breast cancer [72]. In mCRC, there was a strong association between PFS and OS [31, 62], with similar correlation coefficients as obtained in our analysis of MM patients [62]. In metastatic breast cancer, no particular endpoint was determined to be an adequate surrogate for OS [72]. The different conclusions from studies in breast cancer, mCRC, and MM emphasize the fact that appropriate TDEs cannot be generalized in oncology, and their validity depends on tumor type.

                  The following caveats should be considered when interpreting our results. Although it seems reasonable to question the endogeneity of TDEs as an explanatory variable for OS, this issue has not been addressed in the MM literature. The methodology presented here attempts to solve the endogeneity problem, but its applicability depends on the availability of valid instruments.

                  In this analysis, TDEs include three distinct surrogate endpoints; TTP, PFS, and EFS. The estimated relationship between the TDE and OS represents the relationship between an “average” TDE and OS. Although no statistical differences have been found in modeled OS by the type of TDE, the value of the information is limited. Further studies are necessary, particularly to clarify the data from studies using TTP, both because of the competing risk estimation problems [92] and the arguments against the use of TTP [7]. Testing could be performed by either modeling each of the subsamples or by including an interaction term between the TDE and type of surrogate endpoint marker in the regression. In the current analysis, no testing could be performed due to the sample size and need for additional (valid) instruments.

                  Our analysis includes therapies available over a period of 40 years that demonstrated a wide range of efficacy levels. We attempted to control these differences by using publication year as a covariate. In addition, our censored analysis omitted treatment arms with proportionally longer median OS and therefore may not reflect adequately the impact of newer, more effective therapies. Finally, the majority of the studies did not report whether data for OS included patients who were allowed to crossover between treatment arms. Study designs that include automatic treatment crossover can obscure differences in OS, due to the benefit achieved from subsequent treatments [8].


                  In conclusion, our analysis confirms the potential value of TDEs (TTP, PFS, and EFS) in predicting OS in patients with MM. Additional research is welcomed to refine this model or to identify alternative complementary statistical models. Until such models are available and validated, the quantitative relationship presented here may be of value in the design of clinical trials, indirect drug comparisons, and economic assessment of new MM drugs.



                  We thank Isabel Boaventura, MD, from Celgene Portugal for her helpful comments on the manuscript. Excerpta Medica provided editorial support in the preparation of this manuscript, funded by Celgene Corporation. Neither Excerpta Medica nor Celgene Corporation influenced the content of the manuscript, nor did the authors receive financial compensation of any kind for authorship of the manuscript.

                  Authors’ Affiliations

                  Exigo Consultores
                  Portuguese Oncology Institute–Lisboa
                  Faculty of Pharmacy, Universidade de Lisboa
                  Hospital Egas Moniz


                  1. American Cancer Society: Cancer Facts & Figures. 2010. http://​www.​cancer.​org/​acs/​groups/​content/​@nho/​documents/​document/​acspc-024113.​pdf
                  2. National Comprehensive Cancer Network: NCCN Clinical Practice Guidelines in Oncology (NCCN Guidelines™): Multiple myeloma, Version 2. 2010. http://​www.​nccn.​org/​professionals/​physician_​gls/​f_​guidelines.​asp
                  3. National Cancer Institute: Surveillance Epidemiology and End Results. SEER Stat Fact Sheets: Myeloma. 2010. http://​seer.​cancer.​gov/​statfacts/​html/​mulmy.​html
                  4. Sirohi B, Powles R: Epidemiology and outcomes research for MGUS, myeloma and amyloidosis. Eur J Cancer 2006, 42:1671–1683.PubMedView Article
                  5. Rajkumar SV: Treatment of myeloma: cure vs control. Mayo Clin Proc 2008, 83:1142–1145.PubMedView Article
                  6. Shi Q, Sargent DJ: Meta-analysis for the evaluation of surrogate endpoints in cancer clinical trials. Int J Clin Oncol 2009, 14:102–111.PubMedView Article
                  7. Fleming TR, Rothmann MD, Lu HL: Issues in using progression-free survival when evaluating oncology products. J Clin Oncol 2009, 27:2874–2880.PubMedView Article
                  8. Korn EL, Freidlin B, Abrams JS: Overall survival as the outcome for randomized clinical trials with effective subsequent therapies. J Clin Oncol 2011, 29:2439–2442.PubMedView Article
                  9. Zhuang SH, Xiu L, Elsayed YA: Overall survival: a gold standard in search of a surrogate: the value of progression-free survival and time to progression as end points of drug efficacy. Cancer J 2009, 15:395–400.PubMedView Article
                  10. Cooper R, Kaanders JH: Biological surrogate end-points in cancer trials: potential uses, benefits and pitfalls. Eur J Cancer 2005, 41:1261–1266.PubMedView Article
                  11. Buyse M, Sargent DJ, Grothey A: Biomarkers and surrogate end points–the challenge of statistical validation. Nat Rev Clin Oncol 2010, 7:309–317.PubMedView Article
                  12. Baker SG: Surrogate endpoints: wishful thinking or reality? J Natl Cancer Inst 2006, 98:502–503.PubMedView Article
                  13. Tuma R: Progression-free survival remains debatable endpoint in cancer trials. J Natl Cancer Inst 2009, 101:1439–1441.PubMedView Article
                  14. Elston J, Taylor RS: Use of surrogate outcomes in cost-effectiveness models: a review of United Kingdom health technology assessment reports. Int J Technol Assess Health Care 2009, 25:6–13.PubMedView Article
                  15. Velasco Garrido M, Mangiapane S: Surrogate outcomes in health technology assessment: an international comparison. Int J Technol Assess Health Care 2009, 25:315–322.PubMedView Article
                  16. Johnson JR, Williams G, Pazdur R: End points and United States food and drug administration approval of oncology drugs. J Clin Oncol 2003, 21:1404–1411.PubMedView Article
                  17. Anderson KC, Kyle RA, Rajkumar SV: Clinically relevant end points and new drug approvals for myeloma. Leukemia 2008, 22:231–239.PubMedView Article
                  18. Greene WH: Econometric analysis. 5th edition. New Jersey: Prentice Hall; 2003.
                  19. Hansen LP: Large sample properties of generalized method of moments estimators. Econometrica 1982, 50:1029–1054.View Article
                  20. Huber PJ: The behavior of maximum likelihood estimates under nonstandard conditions. In Fifth Berkeley Symposium on Mathematical Statistics and Probability. Volume 1 . Edited by: Le Cam LM, Neyman J. Berkeley, CA: University of California Press; 1967:221–233.
                  21. White H: A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica 1980, 48:817–830.View Article
                  22. Smith RJ, Blundell RW: An exogeneity test for a simultaneous equation Tobit model with an application to labor supply. Econometrica 1986, 54:679–685.View Article
                  23. Cragg JG: More efficient estimation in the presence of heteroskedasticity of unknown form. Econometrica 1983, 51:751–763.View Article
                  24. Durbin J: Errors in variables. Rev Int Stat Inst 1954, 22:23–32.View Article
                  25. Hausman J: Specification tests in econometrics. Econometrica 1978, 46:1251–1271.View Article
                  26. Wu DM: Alternative tests of independence between stochastic regressors and disturbances. Econometrica 1973, 41:733–750.View Article
                  27. Hansen L: Proofs for large sample properties of generalized method of moments estimators. J Econ 2012,170(2):325–330.
                  28. Breusch TS, Pagan AR: A simple test for heteroskedasticity and random coefficient variation. Econometrica 1979, 47:1287–1294.View Article
                  29. Ramsey JB: Tests for specification errors in classical linear least squares regression analysis. J Roy Stat Soc B 1969, 31:350–371.
                  30. Sherrill B, Amonkar M, Wu Y: Relationship between effects on time-to-disease progression and overall survival in studies of metastatic breast cancer. Br J Cancer 2008, 99:1572–1578.PubMedView Article
                  31. Tang PA, Bentzen SM, Chen EX: Surrogate end points for median overall survival in metastatic colorectal cancer: literature-based analysis from 39 randomized controlled trials of first-line chemotherapy. J Clin Oncol 2007, 25:4562–4568.PubMedView Article
                  32. Little R, Rubin D: Statistical Analysis with Missing Data. 2nd edition. New York: John Wiley and Sons; 2002.
                  33. Mateos MV, San-Miguel J: Treatment of newly diagnosed myeloma in patients not eligible for transplantation. Curr Hematol Malig Rep 2011, 6:113–119.PubMedView Article
                  34. Ludwig H, Beksac M, Blade J: Current multiple myeloma treatment strategies with novel agents: a European perspective. Oncologist 2010, 15:6–25.PubMedView Article
                  35. Reece DE: Posttransplantation maintenance therapy and optimal frontline therapy in myeloma. Hematology Am Soc Hematol Educ Program 2011, 2011:197–204.PubMedView Article
                  36. Ludwig H, Hajek R, Tothova E: Thalidomide-dexamethasone compared with melphalan-prednisolone in elderly patients with multiple myeloma. Blood 2009, 113:3435–3442.PubMedView Article
                  37. Morgan GJ, Davies FE, Gregory WM: Cyclophosphamide, thalidomide, and dexamethasone (CTD) as initial therapy for patients with multiple myeloma unsuitable for autologous transplantation. Blood 2011, 118:1231–1238.PubMedView Article
                  38. Wijermans P, Schaafsma M, Termorshuizen F: Phase III study of the value of thalidomide added to melphalan plus prednisone in elderly patients with newly diagnosed multiple myeloma: the HOVON 49 study. J Clin Oncol 2010, 28:3160–3166.PubMedView Article
                  39. Waage A, Gimsing P, Fayers P: Melphalan and prednisone plus thalidomide or placebo in elderly patients with multiple myeloma. Blood 2010, 116:1405–1412.PubMedView Article
                  40. Beksac M, Haznedar R, Firatli-Tuglular T: Addition of thalidomide to oral melphalan/prednisone in patients with multiple myeloma not eligible for transplantation: results of a randomized trial from the Turkish myeloma study group. Eur J Haematol 2010, 86:16–22.PubMedView Article
                  41. Palumbo A, Bringhen S, Liberati AM: Oral melphalan, prednisone, and thalidomide in elderly patients with multiple myeloma: updated results of a randomized controlled trial. Blood 2008, 112:3107–3114.PubMedView Article
                  42. Facon T, Mary JY, Hulin C: Melphalan and prednisone plus thalidomide versus melphalan and prednisone alone or reduced-intensity autologous stem cell transplantation in elderly patients with multiple myeloma (IFM 99–06): a randomised trial. Lancet 2007, 370:1209–1218.PubMedView Article
                  43. Hulin C, Facon T, Rodon P: Efficacy of melphalan and prednisone plus thalidomide in patients older than 75 years with newly diagnosed multiple myeloma: IFM 01/01 trial. J Clin Oncol 2009, 27:3664–3670.PubMedView Article
                  44. San Miguel JF, Schlag R, Khuageva NK: Bortezomib plus melphalan and prednisone for initial treatment of multiple myeloma. N Engl J Med 2008, 359:906–917.PubMedView Article
                  45. Niesvizky R, Flinn IW, Rifkin RM: Phase 3b UPFRONT Study: safety and efficacy of weekly bortezomib maintenance therapy after bortezomib-based induction regimens in elderly, newly diagnosed multiple myeloma patients [abstract]. Blood 2010, 116:619.
                  46. Mateos MV, Oriol A, Martinez-Lopez J: Bortezomib, melphalan, and prednisone versus bortezomib, thalidomide, and prednisone as induction therapy followed by maintenance treatment with bortezomib and thalidomide versus bortezomib and prednisone in elderly patients with untreated multiple myeloma: a randomised trial. Lancet Oncol 2010, 11:934–941.PubMedView Article
                  47. Palumbo A, Bringhen S, Rossi D: Bortezomib-melphalan-prednisone-thalidomide followed by maintenance with bortezomib-thalidomide compared with bortezomib-melphalan-prednisone for initial treatment of multiple myeloma: a randomized controlled trial. J Clin Oncol 2010, 28:5101–5109.PubMedView Article
                  48. Palumbo A, Delforge M, Catalano J: A phase 3 study evaluating the efficacy and safety of lenalidomide combined with melphalan and prednisone in patients ≥65 years with newly diagnosed multiple myeloma (NDMM): continuous use of lenalidomide vs fixed-duration regimens [abstract]. Blood 2010, 116:622.View Article
                  49. Rajkumar SV, Jacobus S, Callander NS: Lenalidomide plus high-dose dexamethasone versus lenalidomide plus low-dose dexamethasone as initial therapy for newly diagnosed multiple myeloma: an open-label randomised controlled trial. Lancet Oncol 2010, 11:29–37.PubMedView Article
                  50. Dimopoulos MA, Chen C, Spencer A: Long-term follow-up on overall survival from the MM-009 and MM-010 phase III trials of lenalidomide plus dexamethasone in patients with relapsed or refractory multiple myeloma. Leukemia 2009, 23:2147–2152.PubMedView Article
                  51. Richardson PG, Sonneveld P, Schuster M: Extended follow-up of a phase 3 trial in relapsed multiple myeloma: final time-to-event results of the APEX trial. Blood 2007, 110:3557–3560.PubMedView Article
                  52. Orlowski RZ, Nagler A, Sonneveld P: Randomized phase III study of pegylated liposomal doxorubicin plus bortezomib compared with bortezomib alone in relapsed or refractory multiple myeloma: combination therapy improves time to progression. J Clin Oncol 2007, 25:3892–3901.PubMedView Article
                  53. Stewart AK, Trudel S, Bahlis NJ: A randomized phase III trial of thalidomide and prednisone as maintenance therapy following autologous stem cell transplantation (ASCT) in patients with multiple myeloma (MM): the NCIC CTG MY.10 trial [abstract]. Blood 2010, 116:39.View Article
                  54. Spencer A, Prince HM, Roberts AW: Consolidation therapy with low-dose thalidomide and prednisolone prolongs the survival of multiple myeloma patients undergoing a single autologous stem-cell transplantation procedure. J Clin Oncol 2009, 27:1788–1793.PubMedView Article
                  55. Morgan GJ, Gregory WM, Davies FE: The role of maintenance thalidomide therapy in multiple myeloma: MRC Myeloma IX results and meta-analysis. Blood 2012, 119:7–15.PubMedView Article
                  56. Lokhorst HM, van der Holt B, Zweegman S: A randomized phase 3 study on the effect of thalidomide combined with adriamycin, dexamethasone, and high-dose melphalan, followed by thalidomide maintenance in patients with multiple myeloma. Blood 2009, 115:1113–1120.PubMedView Article
                  57. Sonneveld P, Schmidt-Wolf I, van der Holt B: HOVON-65/GMMG-HD4 randomized phase III trial comparing bortezomib, doxorubicin, dexamethasone (PAD) vs VAD followed by high-dose melphalan (HDM) and maintenance with bortezomib or thalidomide in patients with newly diagnosed multiple myeloma (MM) [abstract]. Blood 2010, 116:40.
                  58. McCarthy P, Owzar K, Anderson K: Phase III intergroup study of lenalidomide versus placebo maintenance therapy following single autologous stem cell transplant (ASCT) for multiple myeloma (MM): CALGB ECOG BMT-CTN 100104 [abstract]. Haematologica 2011, 96:S23.View Article
                  59. Attal M, Olivier P, Cances-Lauwers V: Maintenance treatment with lenalidomide after transplantation for myeloma: analysis of secondary malignancies within the IFM 2005–02 trial. Haematologica 2011, 96:S23.View Article
                  60. Berghmans T, Pasleau F, Paesmans M: Surrogate markers predicting overall survival for lung cancer: ELCWP recommendations. Eur Respir J 2012, 39:9–28.PubMedView Article
                  61. Buyse M: Use of meta-analysis for the validation of surrogate endpoints and biomarkers in cancer trials. Cancer J 2009, 15:421–425.PubMedView Article
                  62. Buyse M, Burzykowski T, Carroll K: Progression-free survival is a surrogate for survival in advanced colorectal cancer. J Clin Oncol 2007, 25:5218–5224.PubMedView Article
                  63. Buyse M, Michiels S, Squifflet P: Leukemia-free survival as a surrogate end point for overall survival in the evaluation of maintenance therapy for patients with acute myeloid leukemia in complete remission. Haematologica 2011, 96:1106–1112.PubMedView Article
                  64. Hackshaw A, Knight A, Barrett-Lee P: Surrogate markers and survival in women receiving first-line combination anthracycline chemotherapy for advanced breast cancer. Br J Cancer 2005, 93:1215–1221.PubMedView Article
                  65. Hotta K, Fujiwara Y, Matsuo K: Time to progression as a surrogate marker for overall survival in patients with advanced non-small cell lung cancer. J Thorac Oncol 2009, 4:311–317.PubMedView Article
                  66. Johnson KR, Ringland C, Stokes BJ: Response rate or time to progression as predictors of survival in trials of metastatic colorectal cancer or non-small-cell lung cancer: a meta-analysis. Lancet Oncol 2006, 7:741–746.PubMedView Article
                  67. Lee L, Wang L, Crump M: Identification of potential surrogate end points in randomized clinical trials of aggressive and indolent non-Hodgkin’s lymphoma: correlation of complete response, time-to-event and overall survival end points. Ann Oncol 2011, 22:1392–1403.PubMedView Article
                  68. Michiels S, Le Maitre A, Buyse M: Surrogate endpoints for overall survival in locally advanced head and neck cancer: meta-analyses of individual patient data. Lancet Oncol 2009, 10:341–350.PubMedView Article
                  69. Miksad RA, Zietemann V, Gothe R: Progression-free survival as a surrogate endpoint in advanced breast cancer. Int J Technol Assess Health Care 2008, 24:371–383.PubMedView Article
                  70. Sargent DJ, Patiyil S, Yothers G: End points for colon cancer adjuvant trials: observations and recommendations based on individual patient data from 20,898 patients enrolled onto 18 randomized trials from the ACCENT Group. J Clin Oncol 2007, 25:4569–4574.PubMedView Article
                  71. Shitara K, Ikeda J, Yokota T: Progression-free survival and time to progression as surrogate markers of overall survival in patients with advanced gastric cancer: analysis of 36 randomized trials. Invest New Drugs 2012, 30:1224–1231.PubMedView Article
                  72. Burzykowski T, Buyse M, Piccart-Gebhart MJ: Evaluation of tumor response, disease control, progression-free survival, and time to progression as potential surrogate end points in metastatic breast cancer. J Clin Oncol 2008, 26:1987–1992.PubMedView Article
                  73. Matsubara Y, Sakabayashi S, Nishimura T: Surrogacy of tumor response and progression-free survival for overall survival in metastatic breast cancer resistant to both anthracyclines and taxanes. Int J Clin Oncol 2011, 16:623–629.PubMedView Article
                  74. Chakravarty A, Sridhara R: Use of progression-free survival as a surrogate marker in oncology trials: some regulatory issues. Stat Methods Med Res 2008, 17:515–518.PubMedView Article
                  75. Prentice RL: Surrogate and mediating endpoints: current status and future directions. J Natl Cancer Inst 2009, 101:216–217.PubMedView Article
                  76. Rajkumar SV, Gahrton G, Bergsagel PL: Approach to the treatment of multiple myeloma: a clash of philosophies. Blood 2011, 118:3205–3211.PubMedView Article
                  77. Maroun JA: The significance of progression-free survival as an endpoint in evaluating the therapeutic value of antineoplastic agents. Curr Oncol 2011,18(Suppl 2):S3-S4.PubMed
                  78. Verma S, McLeod D, Batist G: In the end what matters most? A review of clinical endpoints in advanced breast cancer. Oncologist 2011, 16:25–35.PubMedView Article
                  79. Saad ED, Katz A, Hoff PM: Progression-free survival as surrogate and as true end point: insights from the breast and colorectal cancer literature. Ann Oncol 2010, 21:7–12.PubMedView Article
                  80. Duffy SW, Treasure FP: Potential surrogate endpoints in cancer research–some considerations and examples. Pharm Stat 2011, 10:34–39.PubMedView Article
                  81. Peninsula Technology Assessment Group: The clinical and cost-effectiveness of lenalidomide for multiple myeloma in people who have received at least one prior therapy: An evidence review of the submission from Celgene. 2008. http://​www.​hta.​ac.​uk/​erg/​reports/​1746.​pdf
                  82. Richardson PG, Sonneveld P, Schuster MW: Bortezomib or high-dose dexamethasone for relapsed multiple myeloma. N Engl J Med 2005, 352:2487–2498.PubMedView Article
                  83. Freidlin B, Korn EL, George SL: Randomized clinical trial design for assessing noninferiority when superiority is expected. J Clin Oncol 2007, 25:5019–5023.PubMedView Article
                  84. Di Leo A, Bleiberg H, Buyse M: Overall survival is not a realistic end point for clinical trials of new drugs in advanced solid tumors: a critical assessment based on recently reported phase III trials in colorectal and breast cancer. J Clin Oncol 2003, 21:2045–2047.PubMedView Article
                  85. Kumar SK, Rajkumar SV, Dispenzieri A: Improved survival in multiple myeloma and the impact of novel therapies. Blood 2008, 111:2516–2520.PubMedView Article
                  86. Colleoni M, Giobbie-Hurder A, Regan MM: Analyses adjusting for selective crossover show improved overall survival with adjuvant letrozole compared with tamoxifen in the BIG 1–98 study. J Clin Oncol 2011, 29:1117–1124.PubMedView Article
                  87. Morden JP, Lambert PC, Latimer N: Assessing methods for dealing with treatment switching in randomised controlled trials: a simulation study. BMC Med Res Methodol 2011, 11:4.PubMedView Article
                  88. Ishak KJ, Caro JJ, Drayson MT: Adjusting for patient crossover in clinical trials using external data: a case study of lenalidomide for advanced multiple myeloma. Value Health 2011, 14:672–678.PubMedView Article
                  89. Pacou M, Gauthier A, Abrams K: Survival analysis adjusted for crossover in relapsed multiple myeloma: Results of the APEX trial [abstract]. Value Health 2011, 14:A437-A438.View Article
                  90. Therasse P, Carbonnelle S, Bogaerts J: Clinical trials design and treatment tailoring: general principles applied to breast cancer research. Crit Rev Oncol Hematol 2006, 59:98–105.PubMedView Article
                  91. Ellenberg SS: Accelerated approval of oncology drugs: can we do better? J Natl Cancer Inst 2011, 103:616–617.PubMedView Article
                  92. Putter H, Fiocco M, Geskus RB: Tutorial in biostatistics: competing risks and multi-state models. Stat Med 2007, 26:2389–2430.PubMedView Article
                  93. Pre-publication history

                    1. The pre-publication history for this paper can be accessed here:http://​www.​biomedcentral.​com/​1471-2407/​13/​122/​prepub


                  © Félix et al.; licensee BioMed Central Ltd. 2013

                  This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://​creativecommons.​org/​licenses/​by/​2.​0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.