- Research article
- Open Access
A novel nomogram to predict the reliability of estimated glomerular filtration rate formulae in oncology patients
BMC Cancer volume 20, Article number: 530 (2020)
Formulae of estimated glomerular filtration rate (eGFR) based on serum creatinine (Scr) are routinely used in oncology patients, however, they are inaccurate in some populations. Our aim was to assess the agreement of eGFR formulae and thereby build a nomogram to predict the reliability of estimates.
Measured GFR (mGFR) using isotope from 445 oncology patients were compared with eGFR from six formulae (Cockcroft-Gault, Modification of Diet in Renal Disease (MDRD), modified MDRD formulae for Chinese (C-MDRD), Chronic Kidney Disease Epidemiology (CKD-EPI) Collaboration, Wright and full age spectrum (FAS)). Bias, precision and accuracy of eGFR formulae were examined. We also evaluated statistics of agreement: the total deviation index (TDI), the concordance correlation coefficient (CCC) and the coverage probability (CP). Multivariate logistic regression was applied to identify characteristics associated with inaccurate eGFR and construct a predictive nomogram.
All eGFR formulae tended to overestimate the eGFR. The percentage of patients with eGFR within 30% the mGFR ranged from 38.0 to 62.8%. Cockcroft-Gault and MDRD showed low bias and high precision. The MDRD formula exhibited lowest TDI, meaning that 90% of estimations ranged from − 36 to 36% of mGFR. Multivariate logistic regression showed that inaccuracy of MDRD was found in elderly patients or in patients with eGFR greater than 120 ml/min. A nomogram was constructed to help oncologists to predict the risk of inaccuracy of eGFR. The calibration curve showed good agreement.
Our results suggest that the error of eGFR by any formulae was common and wide in Chinese oncology patients. Our nomogram may assist oncologists in decision-making when mGFR is needed.
Accurate assessment of the glomerular filtration rate (GFR) is important in drug dosing, decision making and assessing the prognosis of oncology patients. Radioisotopic methods have been used as accurate GFR measurements in clinical practice [1, 2]. However, these methods are relatively costly, time consuming and require blood sampling. As a substitute, several formulae have been developed to calculate the estimated glomerular filtration rate (eGFR) based on serum creatinine (Scr) concentration, as well as on age, sex and weight of the patient [3,4,5,6,7,8].
There have been some reports about the accuracy of these creatinine-based eGFR formulae in oncology patients. However, most of them showed that the performance of the eGFR formulae were unacceptable and thus the precision of chemotherapy dosing was low in some oncology patients [9,10,11]. Such inaccuracy may result in severe side effects, including death. Therefore, it is necessary to recognize the population where eGFR formulae are unreliable and alternative GFR measurements should be employed. Some studies indicated that creatinine-based eGFR formulae were less accurate in elderly and obese populations [12,13,14]. However, a limited number of studies were based on an oncology population . Furthermore, to our best knowledge, none of these studies took into account other potential confounding factors, such as sex, nutritional status and comorbidities.
To bridge the gap in current knowledge, we determined to evaluate the performance of the Cockcroft-Gault , Modification of Diet in Renal Disease (MDRD) , modified MDRD formulae for Chinese (C-MDRD) , Chronic Kidney Disease Epidemiology (CKD-EPI) Collaboration , Wright  and Full Age Spectrum (FAS)  formulae in estimating GFR compared with the measurement of the GFR using technetium-99 m diethyl triamine penta-acetic acid (99mTc-DTPA). More importantly, we aimed to identify the characteristics influencing the accuracy of eGFR formulae. A clinically applicable nomogram was constructed to recognize the populations at high risk of inaccurate eGFR and thereby measurements of GFR should be used.
We enrolled oncology patients with histologically confirmed and measured GFR (mGFR) by 99mTc-DTPA in the Tongji Hospital of Huazhong University of Science and Technology (Wuhan, China) from January 2013 to December 2016.
Patients younger than 18 years old or with missing information were excluded. Patients with acute kidney injury or on any kind of renal replacement therapy were also excluded. Finally, the population consisted of 445 patients.
Laboratory method and GFR calculations
GFR was measured by radioisotopic method using 99mTc-DTPA, which was reported to had virtually identical clearances with inulin and can be used for measuring GFR [15, 16]. All procedures were performed at the Nuclear Medicine Department of Tongji Hospital of Huazhong University of Science and Technology. Patients were hydrated with 300 ml of water 30mins before the examination. Radioactivity of the syringe containing 99mTc-DTPA was counted before injection. Then, patients were given a bolus of intravenous injection of approximately 185 MBq DTPA into the forearm and the dynamic renal flow images were collected immediately. The post-injection syringe was also counted. The exact dosage of administered 99mTc-DTPA was defined as the difference of the syringe’s radioactivity between pre- and post-injection. The calculation of GFR values was done by the Xeleris™3 Functional Imaging Workstation automatically according to the modified Gate’s equation . The mGFR was reported as ml/min.
Serum creatinine was measured by Roche enzymatic assay (Shanghai Roche Diagnostic Products Co, Ltd., China) within a week before measurement of GFR. The last one was chosen for patients with multiple records. We selected eGFR formulae that had been applicated widely or derived from cancer patients. Although Cockcroft–Gault  and MDRD  formulae were developed in western population, it has been widely applicated in clinical routine in China for past decades. In recent years, CKD-EPI formula  was derived in a large dataset and recognized widely in China. Besides, Wright formula  was developed from cancer patients. We also validated C-MDRD formulae, which was designed for Chinese population . FAS formula was developed for full age spectrum in 2016. However, we cannot obtain appropriate Q-value for Chinese population from previous studies, thus, we added validation of FAS formula by introducing Q-value listed in the original publication . The details of formulae used in this study are presented in Table 1.
Continuous variables are described as mean and standard deviation (SD), with univariate comparisons performed using the Student’s t-tests. Categorical variables were assessed by χ2 or Fisher’s exact test, as appropriate.
The degree of bias for each formula was quantified by percentage error (PE) between the eGFR and mGFR, that is, (eGFR-mGFR)/mGFR in %. Precision was assessed by absolute percentage error (APE), that is, the absolute value of PE. Accuracy was assessed as the percentage of patients with within 30 and 10% of the mGFR (P30 and P10). The agreement between eGFR and mGFR was also assessed by specific statistics for continuous data, including the concordance correlation coefficient (CCC), total deviation index (TDI), coverage probability (CP) [18, 19]. We defined a priori that acceptable bias between eGFR and mGFR should be at least 10%, and that 90% of the estimations should be included within these limits. Bland-Altman plots were used to study the relationship between the difference between eGFR and mGFR and the mean of both .
We used logistic regression to find the risk factors of inaccurate eGFR, which was defined as the eGFR outside 30% of mGFR. To be able to construct a prediction model that is clinically relevant while also being simple to use, categorization were performed for continuous variables. We used the cut-points which were widely recognized and adopted in previous studies or the quantile. The significant factors on univariate logistic regression analysis along with clinically relevant factors were entered into a multivariate logistic regression analysis. Backward selection based on the Akaike information criterion (AIC) was used to filter out factors that were entered into a predictive model . The final model equation was then organized as a nomogram. Discrimination of the nomogram was assessed using the area under the receiver operating characteristic curve (ROC). Calibration was assessed using a calibration curve. Given that the predictive model tends to be overfitted to the original sample, a bootstrapping resampling (200 repetitions) was used for internal validation to obtain relatively unbiased estimates.
Statistical analyses and were performed with R version 3.4.0. For agreement analyses, we used a software (AGP Agreement Program v1.0 IGEKO, SP) available at: www.ecihucan.es/lfr/apps/?dir=agreement_installer . All tests were two-sided and P < 0.050 was considered statistically significant.
General demographic and clinical characteristics for the 445 identified patients are given in Table 2. Mean age was 57 ± 12 years old and 66.7% patients were women. The mean mGFR was 68 ± 21 ml/min.
Performance of eGFR formulae
The distribution of eGFR for the six formulae was shifted to the right, compared with the mGFR (Fig. 1). For all formulae, the eGFR tended to overestimate the mGFR. Furthermore, description of the agreement between eGFR and mGFR was shown in Bland-Altman plot (Fig. 2).
The MAPE of eGFR formulae varies from 27.8 and 34.5%, Cockcroft-Gault and MDRD formulae showed low MAPE. The absolute difference between eGFR and mGFR was greater than 30% in more than one third of the oncology patients (Table 3). CCC ranged from 0.42 to 0.61 in all formulae, reflecting low precision and accuracy. TDI ranging from 36 to 55%. MDRD formula showed lowest TDI, that is, the 90% of estimations errored from − 36 to 36% of mGFR for eGFR calculated with MDRD. Besides, the CP of MDRD formula was 35, which is highest in six formulae, indicating that more than 65% of the estimation had an error greater than ±10%.
Given that MDRD formula exhibited best performance among four formulae, we explored factors that would affect the accuracy of eGFR based on the MDRD formula.
Prediction model for inaccurate eGFR calculated by the MDRD formula
Using multivariate logistic regression analysis, we noted that the poor accuracy of the MDRD was independently associated with age and eGFR level (Table 4). A nomogram was generated based on four variables, including age, sex, eGFR level and BUN/Scr ratio (Fig. 3). A higher total point scores as calculated by the sum of the assigned number of points for each predictor in the nomogram was associated with a higher likelihood of inaccurate eGFR as calculated by the MDRD formula in oncology patients. For example, a man (1.3 points) with age over 65 years (3.8 points), eGFR between 80 and 120 ml/min (2.8 points) and BUN/Scr ratio over 20 (2.0 points) would have a total of 9.9 points score, and therefore have a 63% predicted risk of inaccurate eGFR as calculated by the MDRD formula.
The predictive model had an area under curve (AUC) of 0.732 (95% CI, 0.661–0.802) after the 200 repetitions of bootstrap sample corrections. The goodness-of-fit of the nomogram was assessed by producing a calibration plot, which revealed good agreement between the predicted and observed probabilities (Fig. 4).
An accurate assessment of the renal function is essential in oncology patients to ensure safe prescribing of chemotherapy drugs, detecting kidney injury and assessing prognosis. Oncologists often rely on formulae to estimate the GFR on the basis of serum creatinine and other parameters. In this study, we assessed the performance of six eGFR formulae, including Cockcroft-Gault, MDRD, C-MDRD, CKD-EPI and FAS. We found that all formulae performed poorly and MDRD formula showed best agreements with mGFR. Furthermore, we found that inaccuracy of eGFR estimated using MDRD formula were more likely observed in elderly patients, as well as patients with higher eGFR. Besides, we constructed a nomogram to predict the risk of inaccuracy of eGFR.
Oncologists should pay attention to the limitation of eGFR formulae. In our study, the fraction of patients with eGFR absolute percentage error > 30% is more than one-third in all formulae. Besides, all six formulae showed positive MPE, demonstrating that these eGFR formulae tended to overestimate mGFR in Chinese cancer patients, which is inconsistence with previous studies [10, 23]. MDRD showed lowest bias and lowest agreements with mGFR, nevertheless, 90% of the estimations calculated using MDRD formula showing an error of about ±36% of mGFR. Therefore, the accuracy of eGFR formulae was unacceptable in some cases and it is inappropriate to estimate kidney function using eGFR formulae in all oncology patients. Previous studies also have criticized the performance of eGFR in estimating real renal function . Oncologists should identify populations where eGFR formulae based on serum creatinine is not likely to provide an accurate estimate and thus alternative measurements of the GFR should be considered. We also assessed the modified MDRD formula for Chinese population in our study, however, C-MDRD did not perform better than original MDRD in our study. Larger population is needed to validate C-MDRD formula and further studies may focus on developing eGFR formula for Chinese cancer patients.
There are multiple possible explanations of poor performance of eGFR in Chinese cancer patients, including the lack of an ethnic factors, different serum creatinine test methods and daily changing GFR in cancer patient. Besides, oncology patients tended to have low muscle mass and reduced dietary protein intake, which would also influence the concentration of serum creatinine and thus the performance of eGFR formulae . Some studies have demonstrated that the performance of eGFR formulae may be affected by age, weight and GFR [13, 14, 26].
BUN/Scr ratio may be an indicator of the accuracy of eGFR formulae. BUN/SCr ratio greater than 20 is known as a marker of pre-renal renal dysfunction . Poggio et al. found that the MDRD formulae were not reliable in sick hospitalized patients, especially those with high BUN/SCr ratio . However, little is known about the association of elevated BUN/SCr ratio and accuracy of eGFR formulae in oncology patients. We found that the MDRD formula was likely to be inaccurate in oncology patients with high BUN/SCr ratio. Possible explanation for our observations is that BUN/SCr ratio may rise in oncology patients with low rate of creatinine generation, and creatinine-based eGFR formulae would perform poorly accordingly.
Normal estimates of the GFR might not be actually that normal. In patients of higher eGFR, eGFR formula showed low accuracy and great degree of overestimation, which is consistent with reports from studies consisting of population with normal renal function, such as kidney donors [29, 30]. Most of the eGFR equations were derived from subjects with kidney disease, or in combined healthy/diseased populations. This may explain the overestimation of GFR in subjects with normal kidney function. Furthermore, kidney injury will be wrongly labeled as normal kidney function and the degree of renal damage will be underestimated, which encourages oncologists to make wrong decisions regarding the administration of iodinated contrast medium, employment of nephrotoxic drugs and the time to initiate renal replacement therapy. Besides, narrow therapeutic index is a pharmacokinetic characteristic of most chemotherapy agents. A well-known example of such agents is carboplatin, whose dose is adjusted by Calvert formula incorporating the GFR as an important variable . As a consequence, overestimated GFR may result in overdosage of chemotherapy agents, particularly those agents which are entirely eliminated by the kidneys in unchanged active form. Ultimately, inaccurate assessment of the GFR means severe side effects, as well as increasing incidence of renal insufficiency, or even death.
An important facet of this study is that a nomogram was developed to predict the reliability of eGFR as calculated by the MDRD formula in oncology patients. The nomogram is a simple graphical prediction tool. By assigning points to the four variables, oncologists can assess the predictive risk of individuals. This provides clinically useful information and guide personalized clinical decision-making regarding whether to use accurate GFR measurements for oncology patients. Furthermore, our nomogram is constructed on the basis of readily available clinical data making it easy for clinicians to use. Internal validation indicated good performance with area under ROC of 0.732 and accurate calibration.
We acknowledge several limitations of this study. First, due to the retrospective nature of our study, there might have been selection bias and unknown confounders in the analysis. Second, we used enzymatic creatinine assay in our study, and it may lead to bias when assessed Cockcroft-Gault formula which was developed by Jaffe assay. Third, the difference of accurate GFR measurement method in our study is different from those previous studies eGFR formulae development, which may contribute to the poor correspondence between eGFR and mGFR. mGFR in our study was gained by 99mTc-DTPA, which was used in development of Chinese MDRD formula. However, mGFR was determined by 24-h urine creatinine excretion in Cockcroft–Gault formula and measured by iohexol in FAS formula. Fourth, imprecision GFR measurements may lead to error between GFR estimates versus measurements. Finally, although the nomogram was validated internally by bootstrap resampling, external validation using an independent data set was required before routine use.
On the basis of our findings, oncologists must be aware of the limitations of eGFR formulae when treating elderly patients, as well as patients with eGFR greater than 120 ml/min. We constructed a nomogram that could help clinicians to predict the reliability of eGFR as calculated by the MDRD formula.
Availability of data and materials
The datasets used during the current study are available from the corresponding author on reasonable request.
Glomerular Filtration Rate
Estimated Glomerular Filtration Rate
Modification of Diet in Renal Disease
Modified MDRD for Chinese population
Chronic Kidney Disease Epidemiology
Full Age Spectrum
Technetium-99 m diethyl triamine penta-acetic acid
Body Surface Area
Body Mass Index
Absolute Percentage Error
Akaike Information Criterion
Receiver Operating Characteristic
Blood Urea Nitrogen
Area Under Curve
Chromium 51 Ethylene Diamine Tetra-acetic Acid
Chantler C, Garnett ES, Parsons V, Veall N. Glomerular filtration rate measurement in man by the single injection methods using 51Cr-EDTA. Clin Sci. 1969;37(1):169–80.
Bianchi C, Bonadio M, Donadio C, Tramonti G, Figus S. Measurement of glomerular filtration rate in man using DTPA-99mTc. Nephron. 1979;24:174–8.
Cockcroft DW, Gault MH. Prediction of creatinine clearance from serum creatinine. Nephron. 1976;16(1):31–41.
Levey AS, Bosch JP, Lewis JB, Greene T, Rogers N, Roth D. A More Accurate Method To Estimate Glomerular Filtration Rate from Serum Creatinine. A New Prediction Equation. Ann Intern Med. 1999;130:461–70.
Wright JG, Boddy AV, Highley M, Fenwick J, McGill A, Calvert AH. Estimation of glomerular filtration rate in cancer patients. Br J Cancer. 2001;84(4):452–9.
Ma YC, Zuo L, Chen JH, Luo Q, Yu XQ, Li Y, Xu JS, Huang SM, Wang LN, Huang W, et al. Modified glomerular filtration rate estimating equation for Chinese patients with chronic kidney disease. J Am Soc Nephrol. 2006;17(10):2937–44.
Levey AS, Stevens LA, Schmid CH, Zhang YL, CastroIII AF, Feldman HI, Kusek JW, Eggers P, Lente FV, Greene T, et al. CKD-EPI (chronic kidney disease epidemiology collaboration): a new equation to estimate glomerular filtration rate. Ann Intern Med. 2009;150:604–12.
Pottel H, Hoste L, Dubourg L, Ebert N, Schaeffner E, Eriksen BO, Melsom T, Lamb EJ, Rule AD, Turner ST, et al. An estimated glomerular filtration rate equation for the full age spectrum. Nephrol Dial Transplant. 2016;31(5):798–806.
Poole SG, Dooley MJ, Rischin D. A comparison of bedside renal function estimates and measured glomerular filtration rate (Tc99mDTPA clearance) in cancer patients. Ann Oncol. 2002;13(6):949–55.
Craig AJ, Samol J, Heenan SD, Irwin AG, Britten A. Overestimation of carboplatin doses is avoided by radionuclide GFR measurement. Br J Cancer. 2012;107(8):1310–6.
Lauritsen J, Gundgaard MG, Mortensen MS, Oturai PS, Feldt-Rasmussen B, Daugaard G. Reliability of estimated glomerular filtration rate in patients treated with platinum containing therapy. Int J Cancer. 2014;135(7):1733–9.
Verhave JC, Fesler P, Ribstein J, du Cailar G, Mimran A. Estimation of renal function in subjects with normal serum creatinine levels:influence of age and body mass index. Am J Kidney Dis. 2005;46(2):233–41.
Michels WM, Grootendorst DC, Verduijn M, Elliott EG, Dekker FW, Krediet RT. Performance of the Cockcroft-Gault, MDRD, and new CKD-EPI formulas in relation to GFR, age, and body size. Clin J Am Soc Nephrol. 2010;5(6):1003–9.
Nelson WK, Formica RN, Cooper DL, Schwartz PE, Rutherford TJ. An analysis of measured and estimated creatinine clearance rates in normal weight, overweight, and obese patients with gynecologic cancers. J Oncol Pharm Pract. 2012;18(3):323–32.
Teo BW, Xu H, Wang D, Li J, Sinha AK, Shuter B, Sethi S, Lee EJ. GFR estimating equations in a multiethnic Asian population. Am J Kidney Dis. 2011;58(1):56–63.
Klopper JF, Houser W, Atkins HL, Eckelman WC, Richards P. Evaluation of 99mTc-DTPA forvthe measurement of glomerular filtration rate. J Nucl Med. 1972;13:107–10.
Gates GF. Split renal function testing using Tc-99mDTPA. A rapid technique for determining differential glomerular filtration. Clin Nucl Med. 1983;8:400–7.
Lin LI-K. A concordance correlation coefficient to evaluate reproducibility. Biometrics. 1989;45:255–68.
Lin L, Hedayat AS, Sinha B, Yang M. Statistical methods in assessing agreement. J Am Stat Assoc. 2002;97:257.
Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–10.
Akaike H. Data analysis by statistical models. No To Hattatsu. 1992;24(2):127–33.
Luis-Lima S, Higueras Linares T, Henriquez-Gomez L, Alonso-Pescoso R, Jimenez A, Lopez-Hijazo AM, Negrin-Mena N, Martin C, Sanchez-Gallego M, Galindo-Hernandez SJ, et al. The error of estimated GFR in type 2 diabetes mellitus. J Clin Med. 2019;8(10):1543.
Shepherd ST, Gillen G, Morrison P, Forte C, Macpherson IR, White JD, Mark PB. Performance of formulae based estimates of glomerular filtration rate for carboplatin dosing in stage 1 seminoma. Eur J Cancer. 2014;50(5):944–52.
Porrini E, Ruggenenti P, Luis-Lima S, Carrara F, Jimenez A, de Vries APJ, Torres A, Gaspari F, Remuzzi G. Estimated GFR: time for a critical appraisal. Nat Rev Nephrol. 2019;15(3):177–90.
Shemesh O, Golbetz H, Kriss JP, Myers BD. Limitations of creatinine as a filtration marker in glomerulopathic patients. Kidney Int. 1985;28:830–8.
Lopez-Martinez M, Luis-Lima S, Morales E, Navarro-Diaz M, Negrin-Mena N, Folgueras T, Escamilla B, Estupinan S, Delgado-Mallen P, Marrero-Miranda D, et al. The estimation of GFR and the adjustment for BSA in overweight and obesity. a dreadful combination of two errors. Int J Obes (Lond). 2020;44(5):1129–40.
Blantz RC. Nephrology forum: pathophysiology of pre-renal azotemia. Kidney Int. 1998;53:512–23.
Poggio ED, Nef PC, Wang X, Greene T, Van Lente F, Dennis VW, Hall PM. Performance of the Cockcroft-Gault and modification of diet in renal disease equations in estimating GFR in ill hospitalized patients. Am J Kidney Dis. 2005;46(2):242–52.
Poggio ED, Wang X, Greene T, Van Lente F, Hall PM. Performance of the modification of diet in renal disease and Cockcroft-Gault equations in the estimation of GFR in health and in chronic kidney disease. J Am Soc Nephrol. 2005;16(2):459–66.
Gonzalez-Rinne A, Luis-Lima S, Escamilla B, Negrin-Mena N, Ramirez A, Morales A, Vega N, Garcia P, Cabello E, Marrero-Miranda D, et al. Impact of errors of creatinine and cystatin C equations in the selection of living kidney donors. Clin Kidney J. 2019;12(5):748–55.
Calvert AH, Newell DR, Gumbrel LLA, O’Reilly S, Burnell M, Boxall FE, Siddik ZH, Judson IR, Gore ME, Wiltshaw E. Carboplatin dosage:prospective evaluation of a simple formula based on renal function. J Clin Oncol. 1989;7(11):1748–56.
The authors are grateful to the Department of Nuclear Medicine, Tongji Hospital, Tongji medical College, Huazhong University of Science and Technology for their kind help.
This work was financially supported by the International (regional) cooperation and exchange projects, (NSFC-DFG, Grant No. 81761138041); National Natural Science Foundation of China (Grants 81570667, 81470948, 81670633); Major Research Plan of the National Natural Science Foundation of China (Grant No. 91742204); The National Key R&D Program of China (Grants 2018YFC1314003–1, 2015BAI12B07), and National key research and development program (Grant 2016YFC0906103). The funding bodies played no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Ethics approval and consent to participate
The study protocol was approved by the medical ethics committee of Tongji Hospital. Because of the retrospective nature, plus no individually identifiable or sensitive information was involved, informed consents from all patients had been waived.
Consent for publication
The authors have declared no conflicts of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Cheng, Y., Huang, L., Han, Y. et al. A novel nomogram to predict the reliability of estimated glomerular filtration rate formulae in oncology patients. BMC Cancer 20, 530 (2020). https://doi.org/10.1186/s12885-020-06997-w
- Estimated glomerular filtration rate
- Measured glomerular filtration rate
- MDRD formula