Skip to main content
Download PDF

Multinomial network meta-analysis using response rates: relapsed/refractory multiple myeloma treatment rankings differ depending on the choice of outcome

BMC Cancer volume 22, Article number: 591 (2022) Cite this article

Abstract

Background

Due to the fast growing relapsed/refractory multiple myeloma (RRMM) treatment landscape, a comparison of all the available treatments was warranted. For clinical practice it is important to consider both immediate effects such as response quality and prolonged benefits such as progression-free survival (PFS) in a meta-analysis. The objective of this study was to assess the impact of the choice of outcome on the treatment rankings in RRMM.

Methods

A multinomial logistic network meta-analysis was conducted to estimate the ranking of sixteen treatments based on both complete and objective response rates (CRR and ORR). Seventeen phase III randomized controlled trials from a previously performed systematic literature review were included. Treatment ranking was based on the surface under the cumulative ranking curve (SUCRA). Sensitivity analysis was conducted.

Results

The ranking of treatments differed when comparing PFS hazard ratios rankings with rankings based on CRR. Pomalidomide, bortezomib and dexamethasone ranked highest, while a substantial lower ranking was observed for the triplet elotuzumab, lenalidomide, dexamethasone. The ranking of treatments did not differ when comparing PFS hazard ratios and ORR. The scenario analyses showed that the results were robust. In all scenarios the top three was dominated by the same triplets. The treatment with the highest probability of having the best PFS and ORR was the triplet daratumumab, lenalidomide plus dexamethasone in the base case.

Conclusion

This analysis shows that depending on the chosen outcome treatment rankings in RRMM may differ. When conducting NMAs, the response rate, a clinically recognized outcome, should therefore be more frequently considered.

Peer Review reports

Background

Many treatment combinations are currently available for treating relapsed and/or refractory multiple myeloma (RRMM) patients and more will be added in rapid pace [1]. Current treatments are mostly combinations of the first-generation proteasome inhibitor (PI) bortezomib or the immunomodulatory drug (IMiD) lenalidomide, in combination with the second-generation PIs (carfilzomib, ixazomib), iMiD ( pomalidomide), HDAC inhibitors (vorinostat, panobinostat), monoclonal antibodies (elotuzumab, daratumumab, isatuximab) and three miscellaneous drugs (dexamethasone, oblimersen, pegylated liposomal doxorubicin).

For cross-trial comparisons, a network meta-analysis (NMA) using binomial outcomes is the most common way of synthesizing available treatment evidence. This synthesized treatment evidence is relevant for doctors and patients, but also for HTA bodies like the National Institute for Health and Care Excellence (NICE) [2]. Several NMAs have already been conducted in this target patient population comparing available MM treatments using progression-free survival (PFS). The first NMA including all available RRMM phase III randomized controlled trials (RCTs) was published in 2017, which compared PFS hazard ratios of seventeen published trials [3]. Eight other full-text publications [4,5,6,7,8,9,10,11] were found presenting NMAs in RRMM, which all used a binomial approach and applied restrictions on the number of trials. All these NMAs in RRMM used binomial outcomes like odds ratios of complete or objective response rates, HRs for survival outcomes as PFS and OS or risk ratios for adverse events.

Although binomial outcomes has shown to be broadly applicable for different types of clinical outcomes a multinomial NMA would better represent the response outcome. Response rates being an important outcome for MM patients, often cover more than two categories, therefore synthesizing this outcome would need more adjustments if the method is limited to binomial outcomes. For example, in case of three categories A, B and C the binomial model could be used in which first the odds ratio of A versus “not A” (i.e., B and C) is synthesized. Then as a second nested step the odds ratio of B versus C could be synthesized using the traditional binomial approach. After obtaining all the odds ratios the actual estimated rates per category can be obtained. The multinomial NMA makes the intermediate step obsolete and is designed to synthesize clinical outcomes that cover more than two categories.

Therefore, the objective of this study is to explore the difference in outcomes between a binomial NMA and a multinomial NMA in RRMM. The multinomial NMA included the different response rates per response category (i.e. complete response (CR), partial response (PR) and less than PR (< PR)).

Methods

Systematic literature review

The systematic literature review was previously described in detail [3]. In short, studies were included if they described a phase III RCT among adult patients with RRMM. Furthermore, the regimens of the RCT had to include at least one of the prespecified novel treatments. Several literature databases were searched within a timeframe from 01 January 1999 to 01 April 2020.

Data extraction

Data was extracted from phase III RCTs that reported the number or the proportion of patients achieving an objective response. A thorough description of the whole data extraction process was described before [3]. The responses were grouped into three categories: Complete Response or better (CR), Partial Response (PR) and < PR. The CR-group contained CR, stringent CR (sCR) and near CR (nCR). The PR-group consisted of very good PR (VGPR) and PR, and in the < PR-group the remaining categories like minimal response (MR), no change (NC), and progressive disease (PD) were grouped. In case there were zero responders in at least one category within an RCT, a zero-correction factor of k = 1 was added to all the fields in the data table of that specific trial to properly run the NMA [12].

Network meta-analysis

A Bayesian multinomial logistic model was built based on a competing risk NMA model, described by Ades et al. [12] and published in the NICE DSU Technical Support Document 2 [13]. The NMA is an iterative process. Each iteration was based on a different set of patients per response category for each trial and arm. The number of patients per response category were drawn from the 95% confidence intervals (CIs) of a Multinomial distribution. After all simulations, the NMA calculated the probability that the treatment ranked a certain rank k. These probabilities were then used to calculate the surface under the cumulative ranking (SUCRA). The SUCRA can range between 0 and 100%. When SUCRA is close to 100%, the treatment is very likely to be the best treatment and when it is close to 0%, the treatment is very likely to rank last. Results based on objective response rates (defined as responses ≥ PR and abbreviated as ORR) were also considered in this NMA defined as ORR SUCRA. Appendix A provides an illustrative numerical example of the NMA method applied in this research.

Since the NMA method is an iterative process using different sets of patients distributed over the three response categories based on their 95% CIs, it is important to determine convergence of the results. This was assessed using the Brooks-Gelman-Ruben diagnostic R which is available in WinBUGS. This software provides a graphical representation of this convergence diagnostic and shows the diagnostic after each iteration of the different sets of patients in which one should be concerned both with convergence of R to 1, and with convergence of both the pooled and within interval widths to stability.

Another significant check is the face-validity of the NMA outcomes. Face-validity was checked by comparing the computed response rates by the NMA with the response rates reported in the publications of the trials.

Scenario analyses

Three scenario analyses were conducted to test the robustness of the study results: [1] the MM-003 trial was removed from the NMA since the patient population is heavily pretreated in comparison with the other included trials, [2] the doublet lenalidomide plus dexamethasone was used as the NMA reference treatment instead of dexamethasone to see the impact on the results and [3] trials with at least one zero event (i.e. for CR) were removed (i.e. MM-003[14], GMY302[15] and Hjorth2012[16]).

Results

Systematic literature review

A detailed description and PRISMA flow chart of the systematic literature review can be found in Van Beurden-Tan et al. [3]. Of the total 19,773 citations retrieved from the different databases and the two added abstracts, 71 citations were eligible for full text analysis. These citations included sixteen RCTs of which fifteen full publications and one conference abstract. Another RCT was identified through screening ClinicalTrials.gov and resulting in a total of seventeen identified phase III RCTs. The details of the RCTs are shown in Table 1.

Table 1 Details and data extraction of relapsed and/or refractory multiple myeloma phase III RCTs
Full size table

In these RCTs, eighteen different treatment options were used. For this analysis the addition of dexamethasone to bortezomib or thalidomide is assumed to have equal efficacy results as bortezomib or thalidomide monotherapy. Therefore, instead of having eighteen treatment options, sixteen treatment options were included in the current NMA. Because vorinostat does not have regulatory approval for myeloma therapy, the VANTAGE-088 trial was omitted from this analysis [17].

Data extraction

The extracted data is presented in Table 1. The oldest included trial started in the year 2000 and the median follow-up ranged from 5·59 months (PANORAMA1 [18]) to 32·3 months (ASPIRE [19]). The age ranged from 28 to 91 years, with the median age above 59 years. The response criteria evolved over time; therefore seven types of response definitions [20,21,22,23,24,25,26] were found among which the EBMT [21] (older studies), Richardson [26] (for nCR) and IMWG [22] (most recent studies) were mostly used. In all those response definitions CR and PR remained the same, but the changes were in the additional categories like stringent CR and VGPR. The number of previous therapies were comparable with a median of 2 prior therapies, except for the MM-003 pomalidomide trial [14] which included patients with a median of five prior lines of therapies. In total 9080 patients were included in this NMA. The smallest study enrolled 131 patients (Hjorth 2012 [16]) and the largest enrolled 768 patients (PANORAMA1 [18]).

The number of patients in the defined three response categories were extracted for the different studies. The details are shown in the columns # CR-group, # PR-group and # < PR-group respectively of Table 1. In total, 1079 patients in the CR-group, 4070 in the PR-group and 3931 in the < PR-group were included. In one study (OPTIMUM [27]) the responses were presented in rates only, while all the others presented them in both rates and numbers. In three studies [14,15,16] there were no patients in the CR-group. For these studies, a zero-correction factor of 1 has been applied to run the NMA. The complete response rates of dexamethasone alone ranged from 0% (GMY302 [15] and MM-003[14]) to 5% (MM-010 [28]), while lenalidomide plus dexamethasone ranged from 7% (in ELOQUENT-2 [29] and Tourmaline-MM1[30]) to 24% (in MM-009 [31] and MM-010 [28]) and of bortezomib with or without dexamethasone ranged from 0% (in Hjörth 2012 [16]) to 16% (in PANORAMA1 [18]).

Network meta-analysis

Figure 1 presents the complete network for RRMM treatments. We assumed that: i) the relative efficacy of bortezomib [26, 32] versus dexamethasone is identical to bortezomib plus dexamethasone [16, 18, 33,34,35] versus dexamethasone, ii) the relative efficacy of thalidomide [27] versus dexamethasone is identical to thalidomide plus dexamethasone [16, 36] versus dexamethasone, iii) no difference in efficacy due to administration method (intravenous [16, 18, 26, 32] versus subcutaneous [34, 35] bortezomib) and dosage scheme (100 versus 200 versus 400 mg thalidomide [27]). Consequently, the three thalidomide treatment arms (i.e. 100 mg, 200 mg and 400 mg thalidomide) in the OPTIMUM trial [27] were pooled by summing up the number of patients in the three thalidomide arms.

Fig. 1
figure 1

Network of relapsed/refractory MM RCTs used for the multinomial network meta-analysis based on response. Legend: format of dark grey results box = `RCT name’: %CR/%PR/% < PR (N = `total number of patients’), * indicates estimated from other values, and black box indicates the reference treatment. Abbreviations: WB WinBUGS, NMA result, Bo bortezomib, Dex dexamethasone, Tha thalidomide, Car carfilzomib, Obl oblimersen, Dara daratumumab, Len lenalidomide, Pom pomalidomide, Ixa ixazomib, Elo elotuzumab, Pano panobinostat, Vorino = vorinostat, PLD pegylated liposomal doxorubicin

Full size image

The WinBUGS code to run the full NMA is presented in Appendix B. Three different chains were simulated. Each chain produced 25,000 iterations as burn-in samples and the following 80,000 were used for parameter estimations. Inspection of the Brooks-Gelman-Rubin plots showed convergence of the model parameters within these samples.

Complete response rates

Figure 2 presents the NMA results in which dexamethasone was used as reference treatment in a forest plot. All treatments were sorted based on their SUCRA ranking and accompanied by their CRR with the 95% Credible Intervals (CrIs). The distribution of the probabilities of being at each rank, together with the mean rank for CRR are presented in Appendix C.

Fig. 2
figure 2

Forest plot of NMA results proportion of complete response patients. The treatments are ranked from highest to lowest, with the best treatment on top. Abbreviations: Bor bortezomib, Car carfilzomib, Dara daratumumab, Dex dexamethasone, Elo elotuzumab, Ixa ixazomib, Len lenalidomide, Obl oblimersen, Pano panobinostat, PLD pegylated liposomal doxorubicin, Pom pomalidomide, Thal thalidomide, Vorino vorinostat

Full size image

Pomalidomide, bortezomib plus dexamethasone and carfilzomib, lenalidomide plus dexamethasone dominated the top of the ranking in the forest plot indicating the best treatments with regards to CRRs in RRMM. The triplet pomalidomide, bortezomib plus dexamethasone was identified as the treatment with on average the highest CRR, while the triplet carfilzomib, lenalidomide plus dexamethasone had a narrower CrI indicating less uncertainty around the CRR point estimate. However, all 95% CrIs were wide, and a lot of the CrIs overlapped with other treatments. Four treatments, i.e. 1: lenalidomide plus dexamethasone, 2: elotuzumab, lenalidomide plus dexamethasone, 3: thalidomide with or without dexamethasone, and 4: dexamethasone mono therapy had no overlapping CrIs with carfilzomib, lenalidomide plus dexamethasone.

In the POLLUX trial a significant difference in PFS HR between daratumumab, lenalidomide plus dexamethasone versus lenalidomide plus dexamethasone was observed and a significant difference in CRR was expected as well. However, in the NMA results the 95% CrI of the triplet overlaps with the doublet lenalidomide plus dexamethasone’s with respect to the CRR outcome.

The older regimens were at the bottom of the forest plot indicating being the less effective treatments with regards to CRRs. However, also the newer elotuzumab, lenalidomide plus dexamethasone triplet is ranked in the bottom half.

Objective response rates

Figure 3 presents the NMA results based on the ORRs. All treatments were ranked on their SUCRA ranking and accompanied by their ORR with the 95% CrI. The distribution of the probabilities of being at each rank, together with the mean rank for ORR and the SUCRA curve are presented in Appendix C.

Fig. 3
figure 3

Forest plot of NMA results proportion of objective response patients. The treatments are ranked from highest to lowest, with the best treatment on top. Abbreviations: Bor bortezomib, Car carfilzomib, Dara daratumumab, Dex dexamethasone, Elo elotuzumab, Ixa ixazomib, Len lenalidomide, Obl oblimersen, Pano panobinostat, PLD pegylated liposomal doxorubicin, Pom pomalidomide, Thal thalidomide, Vorino vorinostat

Full size image

The treatment ranking changed slightly for the majority of the treatments when comparing the ranking based on ORR with those seen in CRR. The triplet daratumumab, lenalidomide plus dexamethasone moved from third rank to first. However, this triplet tied with the triplet carfilzomib, lenalidomide plus dexamethasone with an average of 79% ORRs. Daratumumab, lenalidomide plus dexamethasone is now ranked first and identified as the treatment with on average the highest ORR with slightly narrower CrI. Pomalidomide, bortezomib plus dexamethasone took the third rank compared to first in CRR results. The CrI of nine treatments did not overlap with the top 2 triplets. Elotuzumab, lenalidomide plus dexamethasone triplet is ranked 4th in the ORR results opposed to the 12th position in the CRR results.

Comparing PFS HR results with response rates results

The Van Beurden-Tan et al. [3] network (PFS NMA ranking) has been updated to match the present network in Fig. 1 and to enable a comparison between the two NMAs on SUCRA. The VANTAGE-88 (vorinostat) trial was deemed irrelevant and therefore removed from the network, while the OPTIMISMM (pomalidomide, bortezomib plus dexamethasone) trial was included as a highly relevant new trial that was not included in the previously conducted PFS NMA. The distribution of the probabilities of being at each rank, together with the mean rank for PFS and the SUCRA curve are presented in Appendix C.

Figure 4 and Fig. 5 are scatterplots showing the relationship between the PFS NMA SUCRA ranking and the CRR and ORR SUCRA rankings respectively. For every treatment combination the PFS NMA ranking is plotted on the x-axis and the response ranking is plotted on the y-axis: CRR in Fig. 4 and ORR in Fig. 5. A dotted trend line is drawn in both figures indicating perfect alignment of the PFS and response ranking when points resided on this line in the graph.

Fig. 4
figure 4

CRR ranking versus PFS ranking. Comparing the ranking of RRMM treatment combinations of binomial NMA of PFS HR NMA versus multinomial NMA of CRR

Full size image
Fig. 5
figure 5

ORR ranking versus PFS ranking. Comparing the ranking of RRMM treatment combinations of binomial NMA of PFS HR NMA versus multinomial NMA of ORR

Full size image

Pomalidomide, bortezomib plus dexamethasone ranked 9th in the PFS HR NMA opposed to 3rd in ORRs ranking and even 1st in CRR. In addition, elotuzumab, lenalidomide plus dexamethasone appeared to be an outlier in the CRRs results with a big drop in ranking. Some other shifts of rankings were visible in the bottom ranks; however, these were small.

Scenario analyses

The scenario analyses results are presented in the Supplemental material. In none of the scenarios the order of treatment ranking changed. When the doublet lenalidomide plus dexamethasone was selected as reference treatment (scenario 2) in the NMA the width of the credible intervals for lenalidomide-based treatments decreased (implying less uncertainties around the point estimates) while those of bortezomib-based (Appendix D) increased. Although treatment ranking order did not change in the scenarios, the absolute values did change, and the biggest change was seen in scenario 4 when the RCTs with zero events were removed from the network (Appendix D). The highest absolute CRR was seen in scenario 3 (51% versus 42% in base case), while the highest absolute ORR was seen in scenario 2 (88% versus 79% in base case).

Discussion

With the ever-evolving RRMM treatment playing field, it is essential to help doctors and others involved in the choice of treatment for patients by quantifying all available data as best we can. There are many treatment choices at first relapse in MM and the choice and sequence depends also on prior drug exposures, drug-refractoriness, patient comorbidities, and high-risk cytogenetics, among others. However, the first step in helping is getting an overall sense of the on average best treatment and how all treatments compare against each other. It is common practice to synthesize the available efficacy evidence in a binomial Bayesian NMA. Common outcomes for such NMAs are HRs for survival outcomes (i.e. PFS, time to progression and OS), or odds ratios for response (CRR versus < CRR or response versus no response). However, since response is categorized in more than two categories (i.e., non-binomial), it resulted in the question whether it would make sense to synthesize the data in a multinomial NMA.

Our study used seventeen phase III RCTs resulting in sixteen RRMM treatment regimens using a Bayesian multinomial logistic NMA calculating three response rates categories: CR, PR and < PR. This NMA showed it is possible to deviate from the classical binomial NMA with PFS HRs. Treatments were either compared on CRRs or ORRs (i.e. ≥ PR). The triplet pomalidomide, bortezomib plus dexamethasone was the best treatment option when considering CRR in contrast to the triplet daratumumab, lenalidomide plus dexamethasone when ORR was the main outcome parameter. However, the credible intervals of these two regimens overlap and therefore interpretation of the results should be done with caution.

To our knowledge, this study is the first to present a multinomial NMA on response in RRMM. One study by Botta et al. [9] presented overall survival (OS) HRs, odds ratios of complete response (CR), odds ratios of objective response (OR), and relative risk ratios of adverse events. They also included three phase II RCTs [37,38,39] in order to include siltuximab plus bortezomib, bortezomib plus bevacizumab and elotuzumab, bortezomib plus dexamethasone in their network. They concluded IMiDs plus new anti-MM monoclonal antibodies-containing regimens (i.e. lenalidomide plus dexamethasone in combination with daratumumab or elotuzumab) were the best therapeutic options in RRMM. Another study by Luo et al. [10] extended the Van Beurden-Tan et al. NMA by including the three treatments from the phase II RCTs (which were included in Botta et al. [9]), and compared all treatment combinations on nonresponse rate (NRR) odds ratios, time to progression HR, PFS HR and OS HR. The triplet combination daratumumab, lenalidomide plus dexamethasone remained the overall best treatment option, however the triplet ixazomib, lenalidomide plus dexamethasone had the best OS efficacy according to their results. Other NMA studies did not include response rates and none of the studies used multinomial logistic NMAs for the response outcome.

This study’s results were similar to the results presented by Botta et al. [9]. A direct comparison of the SUCRA ranks of their CR and ORR NMAs is due to the different included treatments therefore not directly feasible. However, similar trends in ranks were shown; having the triplets daratumumab, lenalidomide plus dexamethasone and carfilzomib, lenalidomide plus dexamethasone in the top ranking and the older doublet regimens at the bottom. The triplet elotuzumab, lenalidomide plus dexamethasone rank was also substantially lower in their CR outcome than compared to their ORR NMA.

The most obvious strength of our study is the practical exercise of conducting a different type of NMA for RRMM treatments. Other researchers can use this study to perform a multinomial NMA in for instance other hematological cancers. It can also encourage others to perform a multinomial NMA additionally to the binomial NMAs already published to compare the difference in conclusions using a different NMA method.

Although every NMA has limitations with respect to comparability of included trials, our study aimed to show the impact of selecting a different NMA type (multinomial versus binomial). Two list of rankings (one based on CRR and the other on ORR) were compared to the ranking based on PFS HRs presented previously [3]. First, this study’s ORR ranking was very similar to the PFS HR ranking with pomalidomide, bortezomib plus dexamethasone as an exception. Second, the CRR ranking showed more differences when compared to the PFS HR rankings. In the CRR ranking the best treatment option was pomalidomide, bortezomib plus dexamethasone and a lot of movements in ranks were seen partly explained by the lower ranking for the triplet elotuzumab, lenalidomide plus dexamethasone. This lower ranking was expected as this triplet also resulted in a substantially lower CRR in the ELOQUENT-2 trial. The lower percentage of CR or higher in patients treated with elotuzumab, lenalidomide, dexamethasone may at least be partly explained by interference of the antibody with serum protein electrophoresis and/or immunofixation, which may result in false-positive results. Therefore, the true CR rate of elotuzumab, lenalidomide plus dexamethasone may have been higher.

Considering limitations for the current study, the most important assumption was assigning a similar response profile for bortezomib with or without dexamethasone (and for consistency also for thalidomide with or without dexamethasone). The assumption that the relative efficacy of bortezomib monotherapy and the doublet bortezomib plus dexamethasone being similar, has been often challenged by other researchers. This assumption was made by Van Beurden-Tan et al. to bridge the bortezomib-based regimens with the lenalidomide-based regimens to obtain a singular network containing all RRMM regimens [3]. This assumption was justified by the findings by Ludwig et al. [40] that elderly RRMM patients should be administered dexamethasone at a lower dose and for a shorter duration of time because of a statistically significant increase in early deaths. It was decided not to change the network by adding observational studies [11], because of uncertain quality of data. Thus, the results of this NMA could be compared with our previous NMA [3] after updating the original network by removing the VANTAGE-88 [41] and adding the OPTIMISMM [33] trial.

Another limitation of our study lies in the choice for three response categories. The IMWG response criteria [22] listed more than three response categories. However, in this study it was decided to group all available responses into three categories. First, additional response grading was added with the introduction of the IMWG response criteria which were not available before [22]. Secondly, since the aim was to conduct a multinomial NMA we required more than two outcome categories. It was decided to use three to have enough granularity to show that CR-group and PR-group patients might be different. Using more than three outcome categories would have resulted in too low number of patients per category.

Very important to mention is the significant heterogeneity in the patient populations, particularly in relation to exposure and refractory status to specific agents as the trials included span over 15 years in time. Some patients were never exposed to the newer agents that entered the RRMM treatment paradigm later in time.

We also expect that in the future the multinomial NMA might be used in synthesizing data on MRD (minimal residual disease) status in combination with classical responses. A classification based on MRD status (i.e. negative versus positive) in combination with the classical responses (e.g. MRD-negativity [MRD(-)] in VGPR patients [42]) can result in more than two outcome categories (i.e. MRD(-) in CR, MRD( +) in CR, MRD(-) in VGPR, MRD( +) in VGPR). A multinomial NMA can support this type of outcome as it supports more than two outcome categories.

Not only do physicians have to decide which treatment combination is the best, with the ever-pressing health care budgets there is also a high need to choose the most optimal treatment in terms of cost-effectiveness. Carlson et al. investigated the cost-effectiveness of RRMM treatment regimens in the US [7]. They concluded that only the addition of daratumumab or panobinostat may be considered cost-effective options according to commonly cited thresholds. It would therefore be interesting to quantify the impact of the choice of NMA type (binomial versus multinomial) and/or different outcomes (PFS/OS versus response rates) on the conclusion of a cost-effectiveness analysis. Since we did not find a big difference in results between the PFS and ORR NMAs, we also do not expect a major difference in cost-effectiveness results based on one of these two. However, some prominent differences were seen between the PFS and CRR NMA results, therefore differences in cost-effectiveness results may be expected, and should therefore be investigated in future research.

Conclusion

This research showed that NMAs based on ORRs and PFS HRs resulted in similar treatment rankings of RRMM treatments in terms of efficacy. Differences in treatment rankings were only observed when comparing the ranking results of the PFS NMA with those from the CRRs NMA and was only driven by the lower ranking position of the elotuzumab triplet.

Therefore, selection of NMA type and outcome should be done sensibly since this might a priori influence the direction of the cost-effectiveness results and decision makers should be aware of the possible differences and therefore consequences when selecting NMA type and outcomes.

Availability of data and materials

All data generated or analysed during this study are included in this published article (and its supplementary information files).

References

  1. Röllig C, Knop S, Bornhäuser M. Multiple myeloma. The Lancet. 2015;385(9983):2197–208.

    Article  Google Scholar 

  2. National Institute for Health and Care Excellence (NICE) (2013) Guide to the methods of technology appraisal 2013.

  3. van Beurden-Tan CHY, Franken MG, Blommestein HM, Uyl-de Groot CA, Sonneveld P. Systematic Literature Review and Network Meta-Analysis of Treatment Outcomes in Relapsed and/or Refractory Multiple Myeloma. J Clin Oncol. 2017;35(12):1312–9. https://doi.org/10.1200/jco.2016.71.1663.

    Article  CAS  PubMed  Google Scholar 

  4. Maiese EM, Ainsworth C, Le Moine JG, Ahdesmaki O, Bell J, Hawe E. Comparative Efficacy of Treatments for Previously Treated Multiple Myeloma: A Systematic Literature Review and Network Meta-analysis. Clin Ther. 2018;40(3):480-494 e423. https://doi.org/10.1016/j.clinthera.2018.01.014.

    Article  PubMed  Google Scholar 

  5. Dimopoulos MA, Kaufman JL, White D, Cook G, Rizzo M, Xu Y, Fahrbach K, Gaudig M, Slavcev M, Dearden L, Lam A. A Comparison of the Efficacy of Immunomodulatory-containing Regimens in Relapsed/Refractory Multiple Myeloma: A Network Meta-analysis. Clin Lymphoma Myeloma Leuk. 2018;18(3):163-173 e166. https://doi.org/10.1016/j.clml.2017.12.011.

    Article  PubMed  Google Scholar 

  6. Weisel K, Sonneveld P, Spencer A, Beksac M, Rizzo M, Xu Y, Fahrbach K, Gaudig M, Slavcev M, Dearden L, Lam A. A comparison of the efficacy of immunomodulatory-free regimens in relapsed or refractory multiple myeloma: a network meta-analysis. Leuk Lymphoma. 2019;60(1):151–62. https://doi.org/10.1080/10428194.2018.1466392.

    Article  CAS  PubMed  Google Scholar 

  7. Carlson JJ, Guzauskas GF, Chapman RH, Synnott PG, Liu S, Russo ET, Pearson SD, Brouwer ED, Ollendorf DA. Cost-effectiveness of Drugs to Treat Relapsed/Refractory Multiple Myeloma in the United States. J Manag Care Spec Pharm. 2018;24(1):29–38. https://doi.org/10.18553/jmcp.2018.24.1.29.

    Article  PubMed  Google Scholar 

  8. Armoiry X, Connock M, Tsertsvadze A, Cummins E, Melendez-Torres GJ, Royle P, Clarke A. Ixazomib for Relapsed or Refractory Multiple Myeloma: Review from an Evidence Review Group on a NICE Single Technology Appraisal. Pharmacoeconomics. 2018;36(9):1073–81. https://doi.org/10.1007/s40273-018-0644-3.

    Article  PubMed  Google Scholar 

  9. Botta C, Ciliberto D, Rossi M, Staropoli N, Cuce M, Galeano T, Tagliaferri P, Tassone P. Network meta-analysis of randomized trials in multiple myeloma: efficacy and safety in relapsed/refractory patients. Blood Adv. 2017;1(7):455–66. https://doi.org/10.1182/bloodadvances.2016003905.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Luo XW, Du XQ, Li JL, Liu XP, Meng XY. Treatment options for refractory/relapsed multiple myeloma: an updated evidence synthesis by network meta-analysis. Cancer Manag Res. 2018;10:2817–23. https://doi.org/10.2147/CMAR.S166640.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Schmitz S, Maguire A, Morris J, Ruggeri K, Haller E, Kuhn I, Leahy J, Homer N, Khan A, Bowden J, Buchanan V, O’Dwyer M, Cook G, Walsh C. The use of single armed observational data to closing the gap in otherwise disconnected evidence networks: a network meta-analysis in multiple myeloma. BMC Med Res Methodol. 2018;18(1):66. https://doi.org/10.1186/s12874-018-0509-7.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Ades AE, Mavranezouli I, Dias S, Welton NJ, Whittington C, Kendall T. Network meta-analysis with competing risk outcomes. Value Health. 2010;13(8):976–83. https://doi.org/10.1111/j.1524-4733.2010.00784.x.

    Article  CAS  PubMed  Google Scholar 

  13. Dias S, Welton NJ, Sutton AJ, Ades AE. In: NICE DSU Technical Support Document 2: A Generalised Linear Modelling Framework for Pairwise and Network Meta-Analysis of Randomised Controlled Trials. London: NICE Decision Support Unit Technical Support Documents; 2014.

    Google Scholar 

  14. Miguel JS, Weisel K, Moreau P, Lacy M, Song K, Delforge M, Karlin L, Goldschmidt H, Banos A, Oriol A, Alegre A, Chen C, Cavo M, Garderet L, Ivanova V, Martinez-Lopez J, Belch A, Palumbo A, Schey S, Sonneveld P, Yu X, Sternas L, Jacques C, Zaki M, Dimopoulos M. Pomalidomide plus low-dose dexamethasone versus high-dose dexamethasone alone for patients with relapsed and refractory multiple myeloma (MM-003): A randomised, open-label, phase 3 trial. Lancet Oncol. 2013;14(11):1055–66.

    Article  CAS  Google Scholar 

  15. Chanan-Khan AA, Niesvizky R, Hohl RJ, Zimmerman TM, Christiansen NP, Schiller GJ, Callander N, Lister J, Oken M, Jagannath S. Phase III randomised study of dexamethasone with or without oblimersen sodium for patients with advanced multiple myeloma. Leuk Lymphoma. 2009;50(4):559–65. https://doi.org/10.1080/10428190902748971.

    Article  CAS  PubMed  Google Scholar 

  16. Hjorth M, Hjertner O, Knudsen LM, Gulbrandsen N, Holmberg E, Pedersen PT, Andersen NF, Andreasson B, Billstrom R, Carlson K, Carlsson MS, Flogegard M, Forsberg K, Gimsing P, Karlsson T, Linder O, Nahi H, Othzen A, Swedin A, Nordic Myeloma Study G (2012) Thalidomide and dexamethasone vs. bortezomib and dexamethasone for melphalan refractory myeloma: a randomized study. European Journal of Haematology 88 (6):485–496. doi:https://doi.org/10.1111/j.1600-0609.2012.01775.x

  17. European Medicines Agency (2013) Vorinostat for the treatment of multiple myeloma. https://www.ema.europa.eu/en/documents/orphan-designation/eu/3/11/854-public-summary-positive-opinion-orphan-designation-vorinostat-treatment-multiple-myeloma_en.pdf. Accessed 20 April 2020

  18. San-Miguel JF, Hungria VTM, Yoon SS, Beksac M, Dimopoulos MA, Elghandour A, Jedrzejczak WW, Günther A, Nakorn TN, Siritanaratkul N, Corradini P, Chuncharunee S, Lee JJ, Schlossman RL, Shelekhova T, Yong K, Tan D, Numbenjapon T, Cavenagh JD, Hou J, LeBlanc R, Nahi H, Qiu L, Salwender H, Pulini S, Moreau P, Warzocha K, White D, Bladé J, Chen W, de la Rubia J, Gimsing P, Lonial S, Kaufman JL, Ocio EM, Veskovski L, Sohn SK, Wang MC, Lee JH, Einsele H, Sopala M, Corrado C, Bengoudifa BR, Binlich F, Richardson PG. Panobinostat plus bortezomib and dexamethasone versus placebo plus bortezomib and dexamethasone in patients with relapsed or relapsed and refractory multiple myeloma: A multicentre, randomised, double-blind phase 3 trial. Lancet Oncol. 2014;15(11):1195–206.

    Article  CAS  Google Scholar 

  19. Stewart AK, Rajkumar SV, Dimopoulos MA, Masszi T, Špicka I, Oriol A, Hajek R, Rosinol L, Siegel DS, Mihaylov GG, Goranova-Marinova V, Rajnics P, Suvorov A, Niesvizky R, Jakubowiak AJ, San-Miguel JF, Ludwig H, Wang M, Maisnar V, Minarik J, Bensinger WI, Mateos MV, Ben-Yehuda D, Kukreti V, Zojwalla N, Tonda ME, Yang X, Xing B, Moreau P, Palumbo A. Carfilzomib, lenalidomide, and dexamethasone for relapsed multiple myeloma. N Engl J Med. 2015;372(2):142–52.

    Article  Google Scholar 

  20. Proposed guidelines for protocol studies. II. Plasma cell myeloma. Prepared by a Committee of the Chronic Leukemia--Myeloma Task Force, National Cancer Institute (1968). Cancer Chemother Rep 3 1 (1):17–39

  21. Blade J, Samson D, Reece D, Apperley J, Bjorkstrand B, Gahrton G, Gertz M, Giralt S, Jagannath S, Vesole D. Criteria for evaluating disease response and progression in patients with multiple myeloma treated by high-dose therapy and haemopoietic stem cell transplantation. Myeloma Subcommittee of the EBMT. European Group for Blood and Marrow Transplant. Br J Haematol. 1998;102(5):1115–23.

    Article  CAS  Google Scholar 

  22. Durie BG, Harousseau JL, Miguel JS, Blade J, Barlogie B, Anderson K, Gertz M, Dimopoulos M, Westin J, Sonneveld P, Ludwig H, Gahrton G, Beksac M, Crowley J, Belch A, Boccadaro M, Cavo M, Turesson I, Joshua D, Vesole D, Kyle R, Alexanian R, Tricot G, Attal M, Merlini G, Powles R, Richardson P, Shimizu K, Tosi P, Morgan G, Rajkumar SV, International Myeloma Working G. International uniform response criteria for multiple myeloma. Leukemia. 2006;20(9):1467–73. https://doi.org/10.1038/sj.leu.2404284.

    Article  Google Scholar 

  23. Kyle RA, Rajkumar SV. Criteria for diagnosis, staging, risk stratification and response assessment of multiple myeloma. Leukemia. 2009;23(1):3–9. https://doi.org/10.1038/leu.2008.291.

    Article  CAS  PubMed  Google Scholar 

  24. Rajkumar SV, Harousseau JL, Durie B, Anderson KC, Dimopoulos M, Kyle R, Blade J, Richardson P, Orlowski R, Siegel D, Jagannath S, Facon T, Avet-Loiseau H, Lonial S, Palumbo A, Zonder J, Ludwig H, Vesole D, Sezer O, Munshi NC, San Miguel J, International Myeloma Workshop Consensus P. Consensus recommendations for the uniform reporting of clinical trials: report of the International Myeloma Workshop Consensus Panel 1. Blood. 2011;117(18):4691–5. https://doi.org/10.1182/blood-2010-10-299487.

    Article  CAS  Google Scholar 

  25. Richardson PG, Barlogie B, Berenson J, Singhal S, Jagannath S, Irwin D, Rajkumar SV, Srkalovic G, Alsina M, Alexanian R, Siegel D, Orlowski RZ, Kuter D, Limentani SA, Lee S, Hideshima T, Esseltine DL, Kauffman M, Adams J, Schenkein DP, Anderson KC. A phase 2 study of bortezomib in relapsed, refractory myeloma. N Engl J Med. 2003;348(26):2609–17. https://doi.org/10.1056/NEJMoa030288.

    Article  CAS  PubMed  Google Scholar 

  26. Richardson PG, Sonneveld P, Schuster MW, Irwin D, Stadtmauer EA, Facon T, Harousseau JL, Ben-Yehuda D, Lonial S, Goldschmidt H, Reece D, San-Miguel JF, Blade J, Boccadoro M, Cavenagh J, Dalton WS, Boral AL, Esseltine DL, Porter JB, Schenkein D, Anderson KC, Assessment of Proteasome Inhibition for Extending Remissions I. Bortezomib or high-dose dexamethasone for relapsed multiple myeloma. N Engl J Med. 2005;352(24):2487–98. https://doi.org/10.1056/NEJMoa043445.

    Article  Google Scholar 

  27. Kropff M, Baylon HG, Hillengass J, Robak T, Hajek R, Liebisch P, Goranov S, Hulin C, Blade J, Caravita T, Avet-Loiseau H, Moehler TM, Pattou C, Lucy L, Kueenburg E, Glasmacher A, Zerbib R, Facon T. Thalidomide versus dexamethasone for the treatment of relapsed and/or refractory multiple myeloma: results from OPTIMUM, a randomized trial. Haematologica. 2012;97(5):784–91. https://doi.org/10.3324/haematol.2011.044271.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Dimopoulos M, Spencer A, Attal M, Prince HM, Harousseau JL, Dmoszynska A, San Miguel J, Hellmann A, Facon T, Foa R, Corso A, Masliak Z, Olesnyckyj M, Yu Z, Patin J, Zeldis JB, Knight RD, Multiple Myeloma Study I. Lenalidomide plus dexamethasone for relapsed or refractory multiple myeloma. N Engl J Med. 2007;357(21):2123–32. https://doi.org/10.1056/NEJMoa070594.

    Article  Google Scholar 

  29. Lonial S, Dimopoulos M, Palumbo A, White D, Grosicki S, Spicka I, Walter-Croneck A, Moreau P, Mateos MV, Magen H, Belch A, Reece D, Beksac M, Spencer A, Oakervee H, Orlowski RZ, Taniwaki M, Röllig C, Einsele H, Wu KL, Singhal A, San-Miguel J, Matsumoto M, Katz J, Bleickardt E, Poulart V, Anderson KC, Richardson P. Elotuzumab therapy for relapsed or refractory multiple myeloma. N Engl J Med. 2015;373(7):621–31.

    Article  CAS  Google Scholar 

  30. Moreau P, Masszi T, Grzasko N, Bahlis NJ, Hansson M, Pour L, Sandhu I, Ganly P, Baker BW, Jackson S, Stoppa AM, Simpson DR, Gimsing P, Palumbo A, Garderet L, Cavo M, Kumar SK, Touzeau C, Buadi F, Laubach JP, Lin J, Berg D, DiBacco A, Hui AM, Richardson PG. Ixazomib, an investigational oral proteasome inhibitor (PI), in combination with lenalidomide and dexamethasone (IRD), significantly extends progression-free survival (PFS) for patients (PTS) with relapsed and/or refractory multiple myeloma (RRMM): The phase 3 tourmaline-MM1 study (NCT01564537). Blood. 2015;126(23):727.

    Article  Google Scholar 

  31. Weber DM, Chen C, Niesvizky R, Wang M, Belch A, Stadtmauer EA, Siegel D, Borrello I, Rajkumar SV, Chanan-Khan AA, Lonial S, Yu Z, Patin J, Olesnyckyj M, Zeldis JB, Knight RD, Multiple Myeloma Study I. Lenalidomide plus dexamethasone for relapsed multiple myeloma in North America. N Engl J Med. 2007;357(21):2133–42. https://doi.org/10.1056/NEJMoa070596.

    Article  Google Scholar 

  32. Orlowski RZ, Nagler A, Sonneveld P, Blade J, Hajek R, Spencer A, Robak T, Dmoszynska A, Horvath N, Spicka I, Sutherland HJ, Suvorov AN, Xiu L, Cakana A, Parekh T, San-Miguel JF. Final overall survival results of a randomized trial comparing bortezomib plus pegylated liposomal doxorubicin with bortezomib alone in patients with relapsed or refractory multiple myeloma. Cancer. 2016;122(13):2050–6. https://doi.org/10.1002/cncr.30026.

    Article  CAS  PubMed  Google Scholar 

  33. Richardson PG, Oriol A, Beksac M, Liberati AM, Galli M, Schjesvold F, Lindsay J, Weisel K, White D, Facon T, San Miguel J, Sunami K, O’Gorman P, Sonneveld P, Robak P, Semochkin S, Schey S, Yu X, Doerr T, Bensmaine A, Biyukov T, Peluso T, Zaki M, Anderson K, Dimopoulos M, investigators Ot,. Pomalidomide, bortezomib, and dexamethasone for patients with relapsed or refractory multiple myeloma previously treated with lenalidomide (OPTIMISMM): a randomised, open-label, phase 3 trial. Lancet Oncol. 2019;20(6):781–94. https://doi.org/10.1016/S1470-2045(19)30152-4.

    Article  CAS  PubMed  Google Scholar 

  34. Palumbo A, Chanan-Khan A, Weisel K, Nooka AK, Masszi T, Beksac M, Spicka I, Hungria V, Munder M, Mateos MV, Mark TM, Qi M, Schecter J, Amin H, Qin X, Deraedt W, Ahmadi T, Spencer A, Sonneveld P, Investigators C. Daratumumab, Bortezomib, and Dexamethasone for Multiple Myeloma. N Engl J Med. 2016;375(8):754–66. https://doi.org/10.1056/NEJMoa1606038.

    Article  CAS  PubMed  Google Scholar 

  35. Dimopoulos MA, Moreau P, Palumbo A, Joshua D, Pour L, Hájek R, Facon T, Ludwig H, Oriol A, Goldschmidt H, Rosiñol L, Straub J, Suvorov A, Araujo C, Rimashevskaya E, Pika T, Gaidano G, Weisel K, Goranova-Marinova V, Schwarer A, Minuk L, Masszi T, Karamanesht I, Offidani M, Hungria V, Spencer A, Orlowski RZ, Gillenwater HH, Mohamed N, Feng S, Chng WJ (2015) Carfilzomib and dexamethasone versus bortezomib and dexamethasone for patients with relapsed or refractory multiple myeloma (ENDEAVOR): A randomised, phase 3, open-label, multicentre study. The Lancet Oncology

  36. Garderet L, Iacobelli S, Moreau P, Dib M, Caillot D, Niederwieser D, Masszi T, Fontan J, Michallet M, Gratwohl A, Milone G, Doyen C, Pegourie B, Hajek R, Casassus P, Kolb B, Chaleteix C, Hertenstein B, Onida F, Heinz L, Vekemans MC, Ketterer N, Daguenel A, Koenecke C, Mohty M, Gorin NC, Harousseau JL, De Witte T, Morris C, Gahrton G. Bortezomib (velcade)-thalidomide-dexamethasone (VTD) is superior to thalidomide-dexamethasone (TD) in patients with multiple myeloma (MM) progressing or relapsing after autologous transplantation. Haematologica. 2011;96:S72–3.

    Google Scholar 

  37. Jakubowiak A, Offidani M, Pegourie B, De La Rubia J, Garderet L, Laribi K, Bosi A, Marasca R, Laubach J, Mohrbacher A, Carella AM, Singhal AK, Tsao LC, Lynch M, Bleickardt E, Jou YM, Robbins M, Palumbo A. Randomized phase 2 study: elotuzumab plus bortezomib/dexamethasone vs bortezomib/dexamethasone for relapsed/refractory MM. Blood. 2016;127(23):2833–40. https://doi.org/10.1182/blood-2016-01-694604.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  38. Orlowski RZ, Gercheva L, Williams C, Sutherland H, Robak T, Masszi T, Goranova-Marinova V, Dimopoulos MA, Cavenagh JD, Spicka I, Maiolino A, Suvorov A, Blade J, Samoylova O, Puchalski TA, Reddy M, Bandekar R, van de Velde H, Xie H, Rossi JF. A phase 2, randomized, double-blind, placebo-controlled study of siltuximab (anti-IL-6 mAb) and bortezomib versus bortezomib alone in patients with relapsed or refractory multiple myeloma. Am J Hematol. 2015;90(1):42–9. https://doi.org/10.1002/ajh.23868.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  39. White D, Kassim A, Bhaskar B, Yi J, Wamstad K, Paton VE. Results from AMBER, a randomized phase 2 study of bevacizumab and bortezomib versus bortezomib in relapsed or refractory multiple myeloma. Cancer. 2013;119(2):339–47. https://doi.org/10.1002/cncr.27745.

    Article  CAS  PubMed  Google Scholar 

  40. Ludwig H, Hajek R, Tothova E, Drach J, Adam Z, Labar B, Egyed M, Spicka I, Gisslinger H, Greil R, Kuhn I, Zojer N, Hinke A. Thalidomide-dexamethasone compared with melphalan-prednisolone in elderly patients with multiple myeloma. Blood. 2009;113(15):3435–42. https://doi.org/10.1182/blood-2008-07-169565.

    Article  CAS  PubMed  Google Scholar 

  41. Dimopoulos M, Siegel DS, Lonial S, Qi J, Hajek R, Facon T, Rosinol L, Williams C, Blacklock H, Goldschmidt H, Hungria V, Spencer A, Palumbo A, Graef T, Eid JE, Houp J, Sun L, Vuocolo S, Anderson KC. Vorinostat or placebo in combination with bortezomib in patients with multiple myeloma (VANTAGE 088): A multicentre, randomised, double-blind study. Lancet Oncol. 2013;14(11):1129–40.

    Article  CAS  Google Scholar 

  42. Shah N, Alsina M, Siegel DS, Jagannath S, Madduri D, Kaufman JL, Turka A, Lam LP, Massaro M, Hege K, Petrocca F, Berdeja JG, Raje N. Initial Results from a Phase 1 Clinical Study of bb21217, a Next-Generation Anti Bcma CAR T Therapy. Blood. 2018;132(Supplement 1):488–488. https://doi.org/10.1182/blood-2018-99-116953.

    Article  Google Scholar 

Download references

Acknowledgements  

Not applicable

Code availability (software application or custom code)

WinBUGS code used presented in Appendix A of this manuscript

Funding

This work was supported by the European Myeloma Network EMN and a grant from ZonMw, the Netherlands Organisation for Health Research and Development, project number 152001020, project title “Treatment Sequencing in Multiple Myeloma: modeling the disease and evaluating cost-efficacy vs. cost-effectiveness”. The funding source had no role in writing the manuscript or decision to submit for publication. CvB is currently employed as contract worker at Amgen; however, all the analyses for this work have been conducted prior to initiating employment at Amgen. ZonMw,152001020

Author information

Authors and Affiliations

  1. Erasmus MC Cancer Institute, Rotterdam, The Netherlands

    Chrissy H. Y. van Beurden-Tan & Pieter Sonneveld

  2. Erasmus School of Health Policy & Management /Institute for Medical Technology Assessment, Erasmus University Rotterdam, The Netherlands, Rotterdam

    Carin A. Uyl-de Groot

Authors
  1. Chrissy H. Y. van Beurden-Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pieter Sonneveld
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Carin A. Uyl-de Groot
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

CB: Conceptualization, Methodology, Software, Validation, Formal analysis, Investigation, Data Curation, Writing—Original Draft, Writing—Review & Editing, Visualization PS: Conceptualization, Validation, Writing—Review & Editing, Visualization, Supervision, Funding acquisition CU: Conceptualization, Validation, Writing—Review & Editing, Visualization, Supervision. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Chrissy H. Y. van Beurden-Tan.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication.

Not applicable.

Competing interests

Dr. Uyl-de Groot reports grants from Boehringer Ingelheim, Astellas, Celgene, Sanofi, Janssen-Cilag, Bayer, Amgen, Gemzyme, Merck, Gilead, Novartis, Glycostem Therapeutics, Astra Zeneca, and Roche, outside the submitted work. Dr. Sonneveld reports research support from Amgen, Celgene, Janssen, Karyopharm, and SkylineDx, reports participation in advisory boards of Amgen, Celgene, Genentech, Janssen, Karyopharm, and SkylineDx, outside the submitted work. Van Beurden-Tan is full-time employed as contract worker at Amgen since November 1st, 2018, reports no grants and research funding, no consultancies, no travel grants, no speaking fees, no writing fees and other honoraria, outside the submitted work.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

 Appendix A. Multinomial network meta-analysis WinBUGS code, init and data files

Additional file 2:

 Appendix B. Detailed description and numerical example of multinomial network meta-analysis 

Additional file 3:

 Appendix C. SUCRA results

Additional file 4: Appendix D. 

Results scenario analyses

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

van Beurden-Tan, C.H.Y., Sonneveld, P. & Groot, C.A.Ud. Multinomial network meta-analysis using response rates: relapsed/refractory multiple myeloma treatment rankings differ depending on the choice of outcome. BMC Cancer 22, 591 (2022). https://doi.org/10.1186/s12885-022-09571-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12885-022-09571-8

Keywords

BMC Cancer

ISSN: 1471-2407

Contact us