Time-dependent endpoints as predictors of overall survival in multiple myeloma
© Félix et al.; licensee BioMed Central Ltd. 2013
Received: 19 June 2012
Accepted: 7 March 2013
Published: 16 March 2013
Supporting health care sector decisions using time-dependent endpoints (TDEs) such as time to progression (TTP), progression-free survival (PFS), and event-free survival (EFS) remains controversial. This study estimated the quantitative relationship between median TDE and median overall survival (OS) in multiple myeloma (MM) patients.
Studies (excluding allogeneic transplantation) published from 1970 to 2011 were systematically searched (PubMed). The nonparametric Spearman’s rank correlation coefficient measured the association between median TDE and OS. The quantitative relationship between TDEs and OS was estimated with a two-step approach to a simultaneous Tobit model.
We identified 153 studies: 230 treatment arms, 22,696 patients and mean study duration of 3.8 years. Mean of median TDEs was 22.5 months and median OS was 39.1 months. Correlation coefficients of median TTP, PFS, and EFS with median OS were 0.51 (P = 0.003), 0.75 (P < 0.0001), and 0.84 (P < 0.0001), respectively. We estimate a 2.5 month (95% confidence interval, 1.7–3.2) increase in median OS for each additional month reported for median TDEs. There was no evidence that this relationship differed by type of surrogate.
TDEs predict OS in MM patients; this relationship may be valuable in clinical trial design, drug comparisons, and economic evaluation.
KeywordsMultiple myeloma Overall survival Survival predictors Time-dependent endpoint Time to progression
Multiple myeloma (MM) is the second most common hematologic malignancy, after non-Hodgkin lymphoma [1, 2]. In the US, it was estimated that over 20,500 new cases of MM and more than 10,600 deaths occurred in 2011 . Despite improved survival over the past decades, MM remains an incurable disease, with research focused on finding more effective treatments . Although improving overall survival (OS) has been the gold standard outcome for new anticancer treatments, large costly trials with long follow-up periods are required to document an impact on OS [5, 6]. Furthermore, OS can be influenced by trial design characteristics, such as crossover and sequential treatments [7, 8]. Therefore, surrogate endpoints that can be measured sooner and more frequently during the course of a clinical trial, are being used to provide an earlier indication of efficacy .
A surrogate endpoint is a measurement that can be substituted for the final endpoint (e.g., improvement in OS) to successfully measure the effect of an intervention . Common surrogate endpoints for OS used in clinical oncology trials include: response rate; time to disease progression (TTP); progression-free survival (PFS); and event-free survival (EFS) . For study conclusions to be valid, differences or changes observed in the surrogate endpoints must accurately reflect changes in the final endpoint . There is ongoing debate about the utilization of these time-dependent endpoints (TDEs) as intermediate endpoints for OS in clinical trials [12, 13], as well as their value to health authorities when assessing drug approvals and assessing costs of drug therapy [7, 14, 15].
In 1992, the US Food and Drug Administration (FDA) instituted the accelerated approval process to allow earlier marketing of drugs that treat serious, life-threatening diseases . Recently, the FDA ruled that both TTP and PFS are valid and clinically relevant TDEs that can be used in the accelerated approval process for MM agents . Although these endpoints are generally thought to be reliable in MM, their predictive value for OS is unknown. Our objective was to estimate a quantitative relationship between median TDEs and median OS from prospective published MM studies in order to address the question of what the expected median OS would be given the observed effect in the median TDE.
Search strategy and selection criteria
We systematically searched PubMed for articles published between January 1970 and February 2011 to identify experimental or observational prospective studies that assessed OS in MM using TTP, PFS, or EFS as a primary endpoint. Key search words included “myeloma” or “survival” or “progression”; see Additional file 1 for full search details. Retrospective studies were excluded, as were studies involving allogeneic transplantation, which generally target younger patients with a clinical status that differs greatly from the majority of MM patients. The TDEs considered were median TTP, PFS, and EFS. The final outcome measures considered were median OS, 12-month OS, 24-month OS, 36-month OS, or any survival data that described the proportion of patients alive or deceased and the duration of follow-up. Studies lacking surrogate endpoint outcomes or OS data were excluded; see Additional file 1 for the selection process scheme. The following variables were collected: authors, publication year, journal, study sample characteristics (period of analysis, median age, percentage of males, type and number of previous therapies), and study results (therapies used, median TDEs, median OS, 12-month OS, 24-month OS, and 36-month OS).
Using the median TDE as an independent observation to estimate median OS, with each study arm representing a single observation, presents a statistical challenge. Outcome measures such as TTP, PFS, and EFS differs on their exact definition, especially with the inclusion or exclusion of death as event . Concerning the estimation of the statistical model, this points to the presence of endogeneity of the main regressor of interest (TDE) and heterogeneity of observations. In the context of linear regression, an estimation based on an instrumental variables approach may be considered, when the endogeneity of regressors is suspected .
In addition, the data analyzed are sourced from a literature review of studies with different study designs, patient populations, and treatments. It is possible that the variance of the unexplained share (the residuals) differs among observations and that heteroskedasticity (non-constant variance) is present. In the presence of heteroskedasticity, the instrumental variables estimator yields consistent, but inefficient, estimates of the coefficients and an inconsistent estimate of the covariance matrix . One way to minimize inefficiency in the coefficient estimates is to weight each observation by the number of patients enrolled in the corresponding study arm and to use the Generalized Method of Moments (GMM) . Inconsistency of the standard error estimates may be corrected by using heteroskedasticity robust estimators of the variance–covariance matrix, such as the Huber/White sandwich estimator [20, 21].
The set of available exogenous variables (candidates to instruments) comprise the following: 12-months OS rate; proportion of females; median age; dummy variables characterizing patients by previous treatment; type of TDEs; and publication year.
Not all study arms included in the review reached the median OS by the last published follow-up; those that did not are censored observations. If, at the end of a given study, less than 50% of the patients at risk were alive, then the exact value of the dependent variable being modeled (median OS) is known. However, if the duration of the study is shorter than the number of months needed to have less than 50% of patients alive, then all that is known about the dependent variable is that it is higher than the study duration. This information is potentially relevant and was included in our analysis.
The regression of the endogenous variable on the excluded instruments and exogenous variables (Step 1) was weighted by the number of patients in each study arm and estimated using the GMM Cragg estimator . This estimator makes use of information provided by the excluded instruments (median age, percentage of males, and classification of patients by number of previous treatments) to increase efficiency in the presence of heteroskedasticity of unknown form.
Given that the censoring point varies with the study arm, a censored normal-weighted regression with the robust option  was estimated in Step 2, instead of a purely Tobit model.
Following the approach described in Smith and Blundell (1986) , variance of the estimators’ formulas was corrected for one endogenous regressor. With such corrections Smith and Blundell demonstrate that estimates for standard errors, t-statistics, and confidence intervals (CIs) are asymptotically valid and hence applicable in the context of the present analysis.
Evidence in favor of the use of the instrumental variable approach was generated by the Durbin-Wu-Hausman test for endogeneity of the TDE regressor [24–26]. The validity of the instruments used was confirmed by both a high degree of correlation between the instruments and the endogenous regressor and the orthogonality between the endogenous regressor and the error term (Hansen J-statistic) . The Breusch-Pagan test for heterogeneity  was used to check for the adequacy of the GMM estimator. The selection of the final functional form of the model was based on the RESET test , a test that checks the possible omission of relevant variables or, more specifically, validates the linearity assumption.
Alternative model specification was based on three criteria: validity of the instruments used; explanatory power of the instruments in the first-stage regression; and AIC (Akaike Information Criteria) in the second-stage (censored) regression.
The association between median TDE and median OS was quantified through Spearman’s rank correlation coefficient in a restricted subset of data consisting of trials only with simultaneously observed values for median TDE and median OS, and excluding those trials with unobserved median OS values [30, 31]. This complete-case analysis is known to result in loss of accuracy and precision when the data are not missing completely at random , but was assumed in order to avoid data imputation methods or assumptions about the distribution of the unobserved median OS values. The analysis was performed with the Stata Statistical Software (Release 11. College Station, TX: StataCorp LP).
Characteristics of the studies and patients included in the analysis
(n = 22,696)
Age in years, mean of medians ± standard deviationa
61.3 ± 7.2
Multiple myeloma, no. of patients (study arms)
Relapsed, refractory, or advanced
Mixed or not reportedb
Duration of the studies (years), mean ± standard deviation
3.8 ± 2.0
Mean of median time-dependent endpoint, months (range)
Time to progression
Median overall survival in months, mean (range)
Correlation between TDEs and OS
Modeling the effect of TDE on OS
Effect of median time-dependent endpoints (TDEs) on median overall survival (OS) estimated from a multivariate censored normal regression, by type of TDE
Median TDE, months
1.71 ; 3.20
− 0.42 ; 0.52
Median age, years
− 0.16 ; 1.34
Year of publication
− 0.39 ; 0.87
Relapsed, refractory, or advanced MM
− 0.66 ; 29.14
Mixed or not reported type MM
− 2.89 ; 16.78
TDE (time to progression)
− 2.21 ; 14.11
TDE (event-free survival)
− 11.42 ; 4.40
Treatment including Thal, Bort, or Len
− 17.89 ; 5.94
Effect of median time-dependent endpoints (TDEs) on median overall survival estimate based on alternative modeling specifications
With censored observations (n = 230)
Without censored observations (n = 163)
Base model (BM)a
1.56 ; 2.08
1.69 ; 2.50
BM without two perturbing observations
1.58 ; 2.11
1.73 ; 2.58
BM with adjustment for type of patient and type of TDEb
1.69 ; 3.04
1.52 ; 3.75
BM with adjustment for type of patientc, type of TDE and treatment including Bort, or Len, or Thal
1.71 ; 3.20
1.52 ; 3.71
Overall, the consistency of the estimated values for the effect of median TDE on median OS is evident. The maximum variation in the effect of median TDE on median OS is 34% (β = 2.45; 95% CI, 1.71–3.20) relative to the base model (β = 1.82; 95% CI, 1.56–2.08).
Results based on the sample with uncensored observations provide higher effect values, most likely related to the study design. In our sample, phase II and phase III randomized controlled trials (RCTs) represent 38.8% and 46.3%, respectively, of the study arms with censored observations, and 23.9% and 55.2%, respectively, of the study arms without censored observations. The results from the regression models including and excluding the two outliers are quite similar, indicating the small effect of these two observations in the analysis.
Additional details of the statistical tests performed to assess the validity of the modeling procedures can be found in the Additional file 1.
Prediction of median OS from the observation of median TDE
The detailed predicted median OS and associated 95% CIs based on the observed median TDE for each study arm included in our analysis are presented in the Additional file 1. In general, lower predicted median OS values in the study arms using TTP were found. TTP is the only TDE that does not include death. There was a higher proportion of study arms using TTP as the primary endpoint in the relapsed, refractory, or advanced MM population (46%) compared with 26% and 25% of the study arms evaluating PFS and EFS, respectively. In addition, 35.5%, 63.7%, and 58.0% of the observed median OS are contained in the 95% CI prediction for the TTP, PFS, and EFS, respectively. In approximately one-third of the TTP arms, median OS is under-observed relative to the 95% CI. In the PFS subset, 26.3% of arms reported median OS below the predicted 95% CI and 10% above it. In the EFS subset, 36% of arms report median OS below the predicted 95% CI and 6% above it.
Since 2007, results from 8 phase III trials investigating Thal combinations in patients with newly diagnosed MM not eligible for transplantation have been reported. With the exception of the studies by Ludwig et al.  and Morgan et al. , all other studies compare Thal added to melphalan plus prednisone (MPT) with melphalan plus prednisone (MP). The majority of median OS values reported (13/16) are within our 95% CI estimate for OS, confirming the value of TDE in predicting OS (Figure 2). Another practical implication from our method is that once median TTP/PFS/EFS is observed, we can derive an estimate for the median OS even if it has not been reported. The OS estimates can be used to inform decision makers on newer and promising MM treatment regimens, along with other relevant clinical parameters such as acceptable tolerability, favorable safety profile, and sustainable quality-of-life outcomes.
In Figure 3, we present the estimated median OS vs the observed OS in phase III RCTs using Bort- or Len-based regimens for the treatment of relapsed/refractory MM. The only treatment arm reporting median OS within the 95% CI from our model is the Len plus dexamethasone (Dex) arm from the study by Dimopoulos et al. . At first glance, these results suggest that our model is less suitable for predicting median OS in relapsed/refractory MM. However, it should be noted that the effect from subsequent salvage therapies is expected to be more pronounced, with a shorter median TDE, i.e. the faster progression occurs.
A recent review by Reece  identified several phase III RCTs of post-transplantation maintenance therapy with Thal, Len, and the proteasome inhibitor Bort. These studies differ substantially in the type of induction regimen, transplantation strategy (single vs tandem) and maintenance scheme (drug combinations, doses, and duration). However, this heterogeneity provided us with the opportunity to further evaluate our model. Figure 4 incorporates updated survival outcomes from these trials and presents estimations for the median OS. Trials identified in Reece  that did not report median intermediate TDE were not considered in this figure. The study by Lokhorst et al.  was the only one from this set to contribute with data to our regression model. At present, we can estimate an average absolute increase of 27 months, 17 months, and 47 months in median OS for post-transplantation maintenance therapy with Thal, Bort, and Len, respectively.
There is a sound body of evidence suggesting that TDEs such as PFS, TTP, and EFS are appropriate surrogate endpoints for OS in several types of cancer [31, 60–71]. However, some conflicting evidence [61, 72, 73] and some methodological , regulatory , and conceptual/practical  arguments fuel the ongoing discussion about surrogate endpoints in the cancer literature [76–78] and challenge the establishment of TDEs in oncology clinical development .
Our study is the first to highlight the value of TDEs in predicting OS in MM and to confirm the recommendations of the American Society of Hematology/US FDA Workshop on Clinical Endpoints in both newly diagnosed or relapsed/refractory MM . We focused our research on estimating the absolute effect of TDEs on OS rather than using a relative measure. We are aware that other assessments of potential surrogate endpoints require a two-step validation process, which involves: 1) establishing that the surrogate endpoint predicts the final endpoint accurately; 2) demonstrating that the effect of treatment on both the surrogate endpoint and the final endpoint is closely correlated . Our methodology, while inherently considering the two last criteria, follows a less formal  approach by using regression modeling methods to show that the effect on median OS is captured by the TDE (validation criterion 1) and that adding treatment to the linear predictor does not improve the prediction (validation criterion 2) (i.e. does not improve the fit), hence suggesting that the causal link between treatment and endpoint has been captured by the TDE predictor.
In order to assess our model’s ability to predict OS in different settings, we confronted our estimates with data from studies in relapsed/refractory MM led by Dimopoulos et al.  and Richardson et al.  (Figure 3). The study by Dimopoulos et al. comparing Len plus Dex with Dex alone reported a hazard ratio (HR) for progression of 0.31 (median 13.4 vs 4.6 months) , and for death of 0.71 (median 38.0 vs 31.6 months) . In the study by Richardson et al., which compared Bort to Dex, the reported HR for progression was 0.55 (median 6.2 vs 3.5 months)  and for death was 0.77 (median 29.8 vs 23.7 months) .
Estimates of median OS using our model suggest an HR for death of 0.34 for Len plus Dex vs Dex alone (median OS 33 vs 11 months), and 0.55 for Bort vs Dex (median OS 15 vs 9 months), assuming event times are exponentially distributed . In this case, the treatment effect on TTP would explain more than 90% of the treatment effect on OS for both Len plus Dex and for Bort.
It has been argued that OS is not a realistic endpoint in this setting , especially considering the ever increasing availability of new, effective drugs that can be used as salvage therapies [8, 85] which may mask the real survival differences between treatment arms. Statistical methods to correct for bias resulting from non-informative censoring (crossover and subsequent treatment options) in survival analysis are increasingly popular [86, 87]. In a recent paper by Ishak et al. , information from trials conducted by the Medical Research Council (United Kingdom) was used to calibrate survival regression analyses in order to reproduce survival estimates corrected for patient crossover in clinical trials. These authors present a median OS of 11.6 months (95% CI, 9.5–14.2) for patients with > 1 prior therapy randomized to Dex , which is similar to our estimate of 11.3 months. Furthermore, in a survival analysis adjusted for crossover in the APEX trial, Pacou et al. report an OS HR of 0.59 for Bort relative to Dex , which is also very similar to the value derived from our model (HR 0.55), suggesting that our model performs accurately in trials with substantial crossover. Nonetheless, caution is recommended for extrapolation outside the context of our sample because more mature data on more recent clinical trials and future research in this topic is clearly needed.
We provide a more straightforward way of calculating the expected effect of treatment on median OS (prior to the observation of mature OS data), by estimating an absolute rather than a relative measure for the quantitative relationship between the median TDE and median OS. This regression model recognizes the influence of subsequent therapies because it estimates a mean effect of median TDE on median OS using OS data published in the literature, which is uncorrected for the effect of non-randomized subsequent treatment options. We estimated an average increment of 2.45 months in median OS for each additional month of median TDE. As previously highlighted, these estimates are valuable to assess the expected impact of treatments on median OS, for example in trials of newly diagnosed MM where median OS may not be reached for several years.
Information on survival is essential for clinical trial design , accelerated approvals for new drugs , indirect drug comparisons, and economic considerations (e.g. formulary inclusion and other reimbursement decisions), particularly in the absence of head-to-head comparative clinical trials. Such information may help clinicians select the most suitable treatment options for MM patients.
Other studies examining the relationship between TDEs and OS have been reported in metastatic colorectal cancer (mCRC) [31, 62] and in metastatic breast cancer . In mCRC, there was a strong association between PFS and OS [31, 62], with similar correlation coefficients as obtained in our analysis of MM patients . In metastatic breast cancer, no particular endpoint was determined to be an adequate surrogate for OS . The different conclusions from studies in breast cancer, mCRC, and MM emphasize the fact that appropriate TDEs cannot be generalized in oncology, and their validity depends on tumor type.
The following caveats should be considered when interpreting our results. Although it seems reasonable to question the endogeneity of TDEs as an explanatory variable for OS, this issue has not been addressed in the MM literature. The methodology presented here attempts to solve the endogeneity problem, but its applicability depends on the availability of valid instruments.
In this analysis, TDEs include three distinct surrogate endpoints; TTP, PFS, and EFS. The estimated relationship between the TDE and OS represents the relationship between an “average” TDE and OS. Although no statistical differences have been found in modeled OS by the type of TDE, the value of the information is limited. Further studies are necessary, particularly to clarify the data from studies using TTP, both because of the competing risk estimation problems  and the arguments against the use of TTP . Testing could be performed by either modeling each of the subsamples or by including an interaction term between the TDE and type of surrogate endpoint marker in the regression. In the current analysis, no testing could be performed due to the sample size and need for additional (valid) instruments.
Our analysis includes therapies available over a period of 40 years that demonstrated a wide range of efficacy levels. We attempted to control these differences by using publication year as a covariate. In addition, our censored analysis omitted treatment arms with proportionally longer median OS and therefore may not reflect adequately the impact of newer, more effective therapies. Finally, the majority of the studies did not report whether data for OS included patients who were allowed to crossover between treatment arms. Study designs that include automatic treatment crossover can obscure differences in OS, due to the benefit achieved from subsequent treatments .
In conclusion, our analysis confirms the potential value of TDEs (TTP, PFS, and EFS) in predicting OS in patients with MM. Additional research is welcomed to refine this model or to identify alternative complementary statistical models. Until such models are available and validated, the quantitative relationship presented here may be of value in the design of clinical trials, indirect drug comparisons, and economic assessment of new MM drugs.
We thank Isabel Boaventura, MD, from Celgene Portugal for her helpful comments on the manuscript. Excerpta Medica provided editorial support in the preparation of this manuscript, funded by Celgene Corporation. Neither Excerpta Medica nor Celgene Corporation influenced the content of the manuscript, nor did the authors receive financial compensation of any kind for authorship of the manuscript.
- American Cancer Society: Cancer Facts & Figures. 2010, http://www.cancer.org/acs/groups/content/@nho/documents/document/acspc-024113.pdf,
- National Comprehensive Cancer Network: NCCN Clinical Practice Guidelines in Oncology (NCCN Guidelines™): Multiple myeloma, Version 2. 2010, http://www.nccn.org/professionals/physician_gls/f_guidelines.asp,
- National Cancer Institute: Surveillance Epidemiology and End Results. SEER Stat Fact Sheets: Myeloma. 2010, http://seer.cancer.gov/statfacts/html/mulmy.html,
- Sirohi B, Powles R: Epidemiology and outcomes research for MGUS, myeloma and amyloidosis. Eur J Cancer. 2006, 42: 1671-1683. 10.1016/j.ejca.2006.01.065.View ArticlePubMed
- Rajkumar SV: Treatment of myeloma: cure vs control. Mayo Clin Proc. 2008, 83: 1142-1145. 10.4065/83.10.1142.PubMed CentralView ArticlePubMed
- Shi Q, Sargent DJ: Meta-analysis for the evaluation of surrogate endpoints in cancer clinical trials. Int J Clin Oncol. 2009, 14: 102-111. 10.1007/s10147-009-0885-4.View ArticlePubMed
- Fleming TR, Rothmann MD, Lu HL: Issues in using progression-free survival when evaluating oncology products. J Clin Oncol. 2009, 27: 2874-2880. 10.1200/JCO.2008.20.4107.PubMed CentralView ArticlePubMed
- Korn EL, Freidlin B, Abrams JS: Overall survival as the outcome for randomized clinical trials with effective subsequent therapies. J Clin Oncol. 2011, 29: 2439-2442. 10.1200/JCO.2011.34.6056.PubMed CentralView ArticlePubMed
- Zhuang SH, Xiu L, Elsayed YA: Overall survival: a gold standard in search of a surrogate: the value of progression-free survival and time to progression as end points of drug efficacy. Cancer J. 2009, 15: 395-400. 10.1097/PPO.0b013e3181be231d.View ArticlePubMed
- Cooper R, Kaanders JH: Biological surrogate end-points in cancer trials: potential uses, benefits and pitfalls. Eur J Cancer. 2005, 41: 1261-1266. 10.1016/j.ejca.2005.03.002.View ArticlePubMed
- Buyse M, Sargent DJ, Grothey A: Biomarkers and surrogate end points–the challenge of statistical validation. Nat Rev Clin Oncol. 2010, 7: 309-317. 10.1038/nrclinonc.2010.43.View ArticlePubMed
- Baker SG: Surrogate endpoints: wishful thinking or reality?. J Natl Cancer Inst. 2006, 98: 502-503. 10.1093/jnci/djj153.View ArticlePubMed
- Tuma R: Progression-free survival remains debatable endpoint in cancer trials. J Natl Cancer Inst. 2009, 101: 1439-1441. 10.1093/jnci/djp399.View ArticlePubMed
- Elston J, Taylor RS: Use of surrogate outcomes in cost-effectiveness models: a review of United Kingdom health technology assessment reports. Int J Technol Assess Health Care. 2009, 25: 6-13. 10.1017/S0266462309090023.View ArticlePubMed
- Velasco Garrido M, Mangiapane S: Surrogate outcomes in health technology assessment: an international comparison. Int J Technol Assess Health Care. 2009, 25: 315-322. 10.1017/S0266462309990213.View ArticlePubMed
- Johnson JR, Williams G, Pazdur R: End points and United States food and drug administration approval of oncology drugs. J Clin Oncol. 2003, 21: 1404-1411. 10.1200/JCO.2003.08.072.View ArticlePubMed
- Anderson KC, Kyle RA, Rajkumar SV: Clinically relevant end points and new drug approvals for myeloma. Leukemia. 2008, 22: 231-239. 10.1038/sj.leu.2405016.View ArticlePubMed
- Greene WH: Econometric analysis. 2003, New Jersey: Prentice Hall, 5
- Hansen LP: Large sample properties of generalized method of moments estimators. Econometrica. 1982, 50: 1029-1054. 10.2307/1912775.View Article
- Huber PJ: The behavior of maximum likelihood estimates under nonstandard conditions. Fifth Berkeley Symposium on Mathematical Statistics and Probability. Volume 1. Edited by: Le Cam LM, Neyman J. 1967, Berkeley, CA: University of California Press, 221-233.
- White H: A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica. 1980, 48: 817-830. 10.2307/1912934.View Article
- Smith RJ, Blundell RW: An exogeneity test for a simultaneous equation Tobit model with an application to labor supply. Econometrica. 1986, 54: 679-685. 10.2307/1911314.View Article
- Cragg JG: More efficient estimation in the presence of heteroskedasticity of unknown form. Econometrica. 1983, 51: 751-763. 10.2307/1912156.View Article
- Durbin J: Errors in variables. Rev Int Stat Inst. 1954, 22: 23-32. 10.2307/1401917.View Article
- Hausman J: Specification tests in econometrics. Econometrica. 1978, 46: 1251-1271. 10.2307/1913827.View Article
- Wu DM: Alternative tests of independence between stochastic regressors and disturbances. Econometrica. 1973, 41: 733-750. 10.2307/1914093.View Article
- Hansen L: Proofs for large sample properties of generalized method of moments estimators. J Econ. 2012, 170 (2): 325-330.View Article
- Breusch TS, Pagan AR: A simple test for heteroskedasticity and random coefficient variation. Econometrica. 1979, 47: 1287-1294. 10.2307/1911963.View Article
- Ramsey JB: Tests for specification errors in classical linear least squares regression analysis. J Roy Stat Soc B. 1969, 31: 350-371.
- Sherrill B, Amonkar M, Wu Y: Relationship between effects on time-to-disease progression and overall survival in studies of metastatic breast cancer. Br J Cancer. 2008, 99: 1572-1578. 10.1038/sj.bjc.6604759.PubMed CentralView ArticlePubMed
- Tang PA, Bentzen SM, Chen EX: Surrogate end points for median overall survival in metastatic colorectal cancer: literature-based analysis from 39 randomized controlled trials of first-line chemotherapy. J Clin Oncol. 2007, 25: 4562-4568. 10.1200/JCO.2006.08.1935.View ArticlePubMed
- Little R, Rubin D: Statistical Analysis with Missing Data. 2002, New York: John Wiley and Sons, 2
- Mateos MV, San-Miguel J: Treatment of newly diagnosed myeloma in patients not eligible for transplantation. Curr Hematol Malig Rep. 2011, 6: 113-119. 10.1007/s11899-011-0080-3.View ArticlePubMed
- Ludwig H, Beksac M, Blade J: Current multiple myeloma treatment strategies with novel agents: a European perspective. Oncologist. 2010, 15: 6-25. 10.1634/theoncologist.2009-0203.PubMed CentralView ArticlePubMed
- Reece DE: Posttransplantation maintenance therapy and optimal frontline therapy in myeloma. Hematology Am Soc Hematol Educ Program. 2011, 2011: 197-204. 10.1182/asheducation-2011.1.197.View ArticlePubMed
- Ludwig H, Hajek R, Tothova E: Thalidomide-dexamethasone compared with melphalan-prednisolone in elderly patients with multiple myeloma. Blood. 2009, 113: 3435-3442. 10.1182/blood-2008-07-169565.View ArticlePubMed
- Morgan GJ, Davies FE, Gregory WM: Cyclophosphamide, thalidomide, and dexamethasone (CTD) as initial therapy for patients with multiple myeloma unsuitable for autologous transplantation. Blood. 2011, 118: 1231-1238. 10.1182/blood-2011-02-338665.PubMed CentralView ArticlePubMed
- Wijermans P, Schaafsma M, Termorshuizen F: Phase III study of the value of thalidomide added to melphalan plus prednisone in elderly patients with newly diagnosed multiple myeloma: the HOVON 49 study. J Clin Oncol. 2010, 28: 3160-3166. 10.1200/JCO.2009.26.1610.View ArticlePubMed
- Waage A, Gimsing P, Fayers P: Melphalan and prednisone plus thalidomide or placebo in elderly patients with multiple myeloma. Blood. 2010, 116: 1405-1412. 10.1182/blood-2009-08-237974.View ArticlePubMed
- Beksac M, Haznedar R, Firatli-Tuglular T: Addition of thalidomide to oral melphalan/prednisone in patients with multiple myeloma not eligible for transplantation: results of a randomized trial from the Turkish myeloma study group. Eur J Haematol. 2010, 86: 16-22.View ArticlePubMed
- Palumbo A, Bringhen S, Liberati AM: Oral melphalan, prednisone, and thalidomide in elderly patients with multiple myeloma: updated results of a randomized controlled trial. Blood. 2008, 112: 3107-3114. 10.1182/blood-2008-04-149427.View ArticlePubMed
- Facon T, Mary JY, Hulin C: Melphalan and prednisone plus thalidomide versus melphalan and prednisone alone or reduced-intensity autologous stem cell transplantation in elderly patients with multiple myeloma (IFM 99–06): a randomised trial. Lancet. 2007, 370: 1209-1218. 10.1016/S0140-6736(07)61537-2.View ArticlePubMed
- Hulin C, Facon T, Rodon P: Efficacy of melphalan and prednisone plus thalidomide in patients older than 75 years with newly diagnosed multiple myeloma: IFM 01/01 trial. J Clin Oncol. 2009, 27: 3664-3670. 10.1200/JCO.2008.21.0948.View ArticlePubMed
- San Miguel JF, Schlag R, Khuageva NK: Bortezomib plus melphalan and prednisone for initial treatment of multiple myeloma. N Engl J Med. 2008, 359: 906-917. 10.1056/NEJMoa0801479.View ArticlePubMed
- Niesvizky R, Flinn IW, Rifkin RM: Phase 3b UPFRONT Study: safety and efficacy of weekly bortezomib maintenance therapy after bortezomib-based induction regimens in elderly, newly diagnosed multiple myeloma patients [abstract]. Blood. 2010, 116: 619-
- Mateos MV, Oriol A, Martinez-Lopez J: Bortezomib, melphalan, and prednisone versus bortezomib, thalidomide, and prednisone as induction therapy followed by maintenance treatment with bortezomib and thalidomide versus bortezomib and prednisone in elderly patients with untreated multiple myeloma: a randomised trial. Lancet Oncol. 2010, 11: 934-941. 10.1016/S1470-2045(10)70187-X.View ArticlePubMed
- Palumbo A, Bringhen S, Rossi D: Bortezomib-melphalan-prednisone-thalidomide followed by maintenance with bortezomib-thalidomide compared with bortezomib-melphalan-prednisone for initial treatment of multiple myeloma: a randomized controlled trial. J Clin Oncol. 2010, 28: 5101-5109. 10.1200/JCO.2010.29.8216.View ArticlePubMed
- Palumbo A, Delforge M, Catalano J: A phase 3 study evaluating the efficacy and safety of lenalidomide combined with melphalan and prednisone in patients ≥65 years with newly diagnosed multiple myeloma (NDMM): continuous use of lenalidomide vs fixed-duration regimens [abstract]. Blood. 2010, 116: 622-View Article
- Rajkumar SV, Jacobus S, Callander NS: Lenalidomide plus high-dose dexamethasone versus lenalidomide plus low-dose dexamethasone as initial therapy for newly diagnosed multiple myeloma: an open-label randomised controlled trial. Lancet Oncol. 2010, 11: 29-37. 10.1016/S1470-2045(09)70284-0.PubMed CentralView ArticlePubMed
- Dimopoulos MA, Chen C, Spencer A: Long-term follow-up on overall survival from the MM-009 and MM-010 phase III trials of lenalidomide plus dexamethasone in patients with relapsed or refractory multiple myeloma. Leukemia. 2009, 23: 2147-2152. 10.1038/leu.2009.147.View ArticlePubMed
- Richardson PG, Sonneveld P, Schuster M: Extended follow-up of a phase 3 trial in relapsed multiple myeloma: final time-to-event results of the APEX trial. Blood. 2007, 110: 3557-3560. 10.1182/blood-2006-08-036947.View ArticlePubMed
- Orlowski RZ, Nagler A, Sonneveld P: Randomized phase III study of pegylated liposomal doxorubicin plus bortezomib compared with bortezomib alone in relapsed or refractory multiple myeloma: combination therapy improves time to progression. J Clin Oncol. 2007, 25: 3892-3901. 10.1200/JCO.2006.10.5460.View ArticlePubMed
- Stewart AK, Trudel S, Bahlis NJ: A randomized phase III trial of thalidomide and prednisone as maintenance therapy following autologous stem cell transplantation (ASCT) in patients with multiple myeloma (MM): the NCIC CTG MY.10 trial [abstract]. Blood. 2010, 116: 39-View Article
- Spencer A, Prince HM, Roberts AW: Consolidation therapy with low-dose thalidomide and prednisolone prolongs the survival of multiple myeloma patients undergoing a single autologous stem-cell transplantation procedure. J Clin Oncol. 2009, 27: 1788-1793. 10.1200/JCO.2008.18.8573.View ArticlePubMed
- Morgan GJ, Gregory WM, Davies FE: The role of maintenance thalidomide therapy in multiple myeloma: MRC Myeloma IX results and meta-analysis. Blood. 2012, 119: 7-15. 10.1182/blood-2011-06-357038.View ArticlePubMed
- Lokhorst HM, van der Holt B, Zweegman S: A randomized phase 3 study on the effect of thalidomide combined with adriamycin, dexamethasone, and high-dose melphalan, followed by thalidomide maintenance in patients with multiple myeloma. Blood. 2009, 115: 1113-1120.View ArticlePubMed
- Sonneveld P, Schmidt-Wolf I, van der Holt B: HOVON-65/GMMG-HD4 randomized phase III trial comparing bortezomib, doxorubicin, dexamethasone (PAD) vs VAD followed by high-dose melphalan (HDM) and maintenance with bortezomib or thalidomide in patients with newly diagnosed multiple myeloma (MM) [abstract]. Blood. 2010, 116: 40-
- McCarthy P, Owzar K, Anderson K: Phase III intergroup study of lenalidomide versus placebo maintenance therapy following single autologous stem cell transplant (ASCT) for multiple myeloma (MM): CALGB ECOG BMT-CTN 100104 [abstract]. Haematologica. 2011, 96: S23-10.3324/haematol.2011.041319.View Article
- Attal M, Olivier P, Cances-Lauwers V: Maintenance treatment with lenalidomide after transplantation for myeloma: analysis of secondary malignancies within the IFM 2005–02 trial. Haematologica. 2011, 96: S23-10.3324/haematol.2011.041319.View Article
- Berghmans T, Pasleau F, Paesmans M: Surrogate markers predicting overall survival for lung cancer: ELCWP recommendations. Eur Respir J. 2012, 39: 9-28. 10.1183/09031936.00190310.View ArticlePubMed
- Buyse M: Use of meta-analysis for the validation of surrogate endpoints and biomarkers in cancer trials. Cancer J. 2009, 15: 421-425. 10.1097/PPO.0b013e3181b9c602.View ArticlePubMed
- Buyse M, Burzykowski T, Carroll K: Progression-free survival is a surrogate for survival in advanced colorectal cancer. J Clin Oncol. 2007, 25: 5218-5224. 10.1200/JCO.2007.11.8836.View ArticlePubMed
- Buyse M, Michiels S, Squifflet P: Leukemia-free survival as a surrogate end point for overall survival in the evaluation of maintenance therapy for patients with acute myeloid leukemia in complete remission. Haematologica. 2011, 96: 1106-1112. 10.3324/haematol.2010.039131.PubMed CentralView ArticlePubMed
- Hackshaw A, Knight A, Barrett-Lee P: Surrogate markers and survival in women receiving first-line combination anthracycline chemotherapy for advanced breast cancer. Br J Cancer. 2005, 93: 1215-1221. 10.1038/sj.bjc.6602858.PubMed CentralView ArticlePubMed
- Hotta K, Fujiwara Y, Matsuo K: Time to progression as a surrogate marker for overall survival in patients with advanced non-small cell lung cancer. J Thorac Oncol. 2009, 4: 311-317. 10.1097/JTO.0b013e3181989bd2.View ArticlePubMed
- Johnson KR, Ringland C, Stokes BJ: Response rate or time to progression as predictors of survival in trials of metastatic colorectal cancer or non-small-cell lung cancer: a meta-analysis. Lancet Oncol. 2006, 7: 741-746. 10.1016/S1470-2045(06)70800-2.View ArticlePubMed
- Lee L, Wang L, Crump M: Identification of potential surrogate end points in randomized clinical trials of aggressive and indolent non-Hodgkin’s lymphoma: correlation of complete response, time-to-event and overall survival end points. Ann Oncol. 2011, 22: 1392-1403. 10.1093/annonc/mdq615.PubMed CentralView ArticlePubMed
- Michiels S, Le Maitre A, Buyse M: Surrogate endpoints for overall survival in locally advanced head and neck cancer: meta-analyses of individual patient data. Lancet Oncol. 2009, 10: 341-350. 10.1016/S1470-2045(09)70023-3.View ArticlePubMed
- Miksad RA, Zietemann V, Gothe R: Progression-free survival as a surrogate endpoint in advanced breast cancer. Int J Technol Assess Health Care. 2008, 24: 371-383.View ArticlePubMed
- Sargent DJ, Patiyil S, Yothers G: End points for colon cancer adjuvant trials: observations and recommendations based on individual patient data from 20,898 patients enrolled onto 18 randomized trials from the ACCENT Group. J Clin Oncol. 2007, 25: 4569-4574. 10.1200/JCO.2006.10.4323.View ArticlePubMed
- Shitara K, Ikeda J, Yokota T: Progression-free survival and time to progression as surrogate markers of overall survival in patients with advanced gastric cancer: analysis of 36 randomized trials. Invest New Drugs. 2012, 30: 1224-1231. 10.1007/s10637-011-9648-y.View ArticlePubMed
- Burzykowski T, Buyse M, Piccart-Gebhart MJ: Evaluation of tumor response, disease control, progression-free survival, and time to progression as potential surrogate end points in metastatic breast cancer. J Clin Oncol. 2008, 26: 1987-1992. 10.1200/JCO.2007.10.8407.View ArticlePubMed
- Matsubara Y, Sakabayashi S, Nishimura T: Surrogacy of tumor response and progression-free survival for overall survival in metastatic breast cancer resistant to both anthracyclines and taxanes. Int J Clin Oncol. 2011, 16: 623-629. 10.1007/s10147-011-0231-5.View ArticlePubMed
- Chakravarty A, Sridhara R: Use of progression-free survival as a surrogate marker in oncology trials: some regulatory issues. Stat Methods Med Res. 2008, 17: 515-518. 10.1177/0962280207081862.View ArticlePubMed
- Prentice RL: Surrogate and mediating endpoints: current status and future directions. J Natl Cancer Inst. 2009, 101: 216-217. 10.1093/jnci/djn515.View ArticlePubMed
- Rajkumar SV, Gahrton G, Bergsagel PL: Approach to the treatment of multiple myeloma: a clash of philosophies. Blood. 2011, 118: 3205-3211. 10.1182/blood-2011-06-297853.PubMed CentralView ArticlePubMed
- Maroun JA: The significance of progression-free survival as an endpoint in evaluating the therapeutic value of antineoplastic agents. Curr Oncol. 2011, 18 (Suppl 2): S3-S4.PubMed CentralPubMed
- Verma S, McLeod D, Batist G: In the end what matters most? A review of clinical endpoints in advanced breast cancer. Oncologist. 2011, 16: 25-35.PubMed CentralView ArticlePubMed
- Saad ED, Katz A, Hoff PM: Progression-free survival as surrogate and as true end point: insights from the breast and colorectal cancer literature. Ann Oncol. 2010, 21: 7-12. 10.1093/annonc/mdp523.View ArticlePubMed
- Duffy SW, Treasure FP: Potential surrogate endpoints in cancer research–some considerations and examples. Pharm Stat. 2011, 10: 34-39. 10.1002/pst.406.View ArticlePubMed
- Peninsula Technology Assessment Group: The clinical and cost-effectiveness of lenalidomide for multiple myeloma in people who have received at least one prior therapy: An evidence review of the submission from Celgene. 2008, http://www.hta.ac.uk/erg/reports/1746.pdf,
- Richardson PG, Sonneveld P, Schuster MW: Bortezomib or high-dose dexamethasone for relapsed multiple myeloma. N Engl J Med. 2005, 352: 2487-2498. 10.1056/NEJMoa043445.View ArticlePubMed
- Freidlin B, Korn EL, George SL: Randomized clinical trial design for assessing noninferiority when superiority is expected. J Clin Oncol. 2007, 25: 5019-5023. 10.1200/JCO.2007.11.8711.View ArticlePubMed
- Di Leo A, Bleiberg H, Buyse M: Overall survival is not a realistic end point for clinical trials of new drugs in advanced solid tumors: a critical assessment based on recently reported phase III trials in colorectal and breast cancer. J Clin Oncol. 2003, 21: 2045-2047. 10.1200/JCO.2003.99.078.View ArticlePubMed
- Kumar SK, Rajkumar SV, Dispenzieri A: Improved survival in multiple myeloma and the impact of novel therapies. Blood. 2008, 111: 2516-2520. 10.1182/blood-2007-10-116129.PubMed CentralView ArticlePubMed
- Colleoni M, Giobbie-Hurder A, Regan MM: Analyses adjusting for selective crossover show improved overall survival with adjuvant letrozole compared with tamoxifen in the BIG 1–98 study. J Clin Oncol. 2011, 29: 1117-1124. 10.1200/JCO.2010.31.6455.PubMed CentralView ArticlePubMed
- Morden JP, Lambert PC, Latimer N: Assessing methods for dealing with treatment switching in randomised controlled trials: a simulation study. BMC Med Res Methodol. 2011, 11: 4-10.1186/1471-2288-11-4.PubMed CentralView ArticlePubMed
- Ishak KJ, Caro JJ, Drayson MT: Adjusting for patient crossover in clinical trials using external data: a case study of lenalidomide for advanced multiple myeloma. Value Health. 2011, 14: 672-678. 10.1016/j.jval.2011.02.1182.View ArticlePubMed
- Pacou M, Gauthier A, Abrams K: Survival analysis adjusted for crossover in relapsed multiple myeloma: Results of the APEX trial [abstract]. Value Health. 2011, 14: A437-A438.View Article
- Therasse P, Carbonnelle S, Bogaerts J: Clinical trials design and treatment tailoring: general principles applied to breast cancer research. Crit Rev Oncol Hematol. 2006, 59: 98-105. 10.1016/j.critrevonc.2005.11.003.View ArticlePubMed
- Ellenberg SS: Accelerated approval of oncology drugs: can we do better?. J Natl Cancer Inst. 2011, 103: 616-617. 10.1093/jnci/djr104.View ArticlePubMed
- Putter H, Fiocco M, Geskus RB: Tutorial in biostatistics: competing risks and multi-state models. Stat Med. 2007, 26: 2389-2430. 10.1002/sim.2712.View ArticlePubMed
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2407/13/122/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.