- Research article
- Open Access
Predictive score for estimating cancer after venous thromboembolism: a cohort study
BMC Cancer volume 13, Article number: 352 (2013)
Venous thromboembolism (VTE) has been associated with a higher risk of developing malignancy and mortality, and patients with VTE may therefore benefit from increased surveillance. We aimed to construct a clinical predictive score that could classify patients with VTE according to their risk for developing these outcomes.
Observational cohort study using an existing clinical registry in a tertiary academic teaching hospital in Buenos Aires, Argentina. 1264 adult patients greater than 17 years of age presented new VTE between June 2006 and December 2011 and were included in the registry. We excluded patients with previous or incident cancer, those who died during the first month, and those with less than one year of follow up (< 5%). 540 patients were included. Primary outcome was new cancer diagnosis during one year of follow-up, secondary composite outcome was any new cancer diagnosis or death. The score was developed using a multivariable logistic regression model to predict cancer or death.
During follow-up, one-quarter (26.4%) of patients developed cancer (9.2%) or died (23.7%). Patients with the primary outcome had more comorbidities, were more likely to have previous thromboembolism and less likely to have recent surgery. The final score developed for predicting cancer alone included previous episode of VTE, recent surgery and comorbidity (Charlson comorbidity score), [AUC of 0.75 (95% CI 0.66-0.84) and 0.79 (95% CI 0.63-0.95) in the derivation and validation cohorts, respectively]. The version of this score developed to predict cancer or death included age, albumin level, comorbidity, previous episode of VTE, and recent surgery [AUC = 0.72 (95% CI 0.66-0.78) and 0.71 (95% CI 0.63-0.79) in the derivation and validation cohorts, respectively].
A simple clinical predictive score accurately estimates patients’ risk of developing cancer or death following newly diagnosed VTE. This tool could be used to help reassure low risk patients, or to identify high-risk patients that might benefit from closer surveillance and additional investigations.
Venous thromboembolism (VTE) includes deep vein thrombosis (DVT) or pulmonary embolism (PE) and is an important cause of morbidity and mortality . VTE is also associated with other conditions that influence patient’s mortality prognosis, in particular cancer [2–5]. VTE may complicate the course of a patient with known cancer, but it may also be its first manifestation . According to a systematic review, up to 10% of patients presenting with idiopathic VTE are subsequently diagnosed with cancer during the first year of follow up [7, 8]. Moreover, mortality at one year is higher in patients with VTE that develop cancer compared to those that do not [5, 9, 10].
Suspicion of underlying cancer may lead clinicians to screen for cancer and provide closer surveillance following an acute episode of VTE [7, 9, 11, 12]. However, unselected screening can lead to a higher rate of false positive results, inducing unnecessary anxiety and increasing costs . Conversely, no surveillance after the diagnosis of VTE may delay detection of potentially treatable cancers [8, 9]. At present, clinicians typically assess patients’ cancer risk after VTE using conventional approaches to cancer screening that are based on classic risk factors [14–18]. Recent guidelines have proposed specific work up strategies for these patients including computed tomography . However, little evidence exists to help target which individuals should undergo such screening from the entire population of patients with VTE.
We therefore sought to construct a clinical predictive score that could stratify patients according to their risk of subsequent cancer or death. Our overall goal was to identify patients that might benefit from a more intensive screening strategy and surveillance.
We conducted our study using an institutional registry of 1264 consecutive patients that were admitted between June 2006 and December 2011 to Hospital Italiano, a tertiary teaching hospital in Buenos Aires, Argentina . All adult patients (both inpatients and outpatients, age > 17 years of age) presenting with a new diagnosis of VTE were included in the registry database (Microsoft ACCESS, Redmond, Washington) after providing informed consent. The study protocol was approved by the ethics review board of the Hospital Italiano de Buenos Aires. A full-time research fellow screened all patients at initial diagnosis and updated the database during all follow-up visits. The registry contains information on baseline demographics, clinical history and co-morbidities, physical examination, and laboratory and radiological data. It also contains information on vital status and cancer diagnosis during follow up; cancer diagnosis was ascertained from electronic charts, as a clinical or pathology-based diagnosis. The routine practice at the institution is to continue to follow these patients until death or until they are lost to follow-up. Frequency of follow up and cancer screening was left to the discretion of the individual physicians.
As patients with overt cancer that develop VTE are different from those that present with VTE as a first manifestation of malignancy we excluded patients with cancer diagnosis that preceded VTE, those that were diagnosed with VTE and cancer at the same time (during the same month) and patients who died during the first month following VTE diagnosis. Finally, we excluded those with less than one year of follow up. From the entire sample we created a derivation cohort by randomly selecting two-thirds of the patients, and the remaining third became the validation cohort.
We used available variables to construct models that would predict the outcome cancer (primary outcome) and cancer and death (secondary outcome). Death was included as part of the secondary composite outcome as it may act as a competing event regarding the development of cancer. We first selected potentially useful baseline characteristic predictor variables for the multivariable model based on clinical experience and previous literature. Candidate variables included demographic characteristics (age, sex), classic risk factors for thromboembolic disease (major surgery, previous VTE, family history), coexisting illnesses (Charlson comorbidity index score ), body mass index (BMI), and laboratory tests (albumin, hemoglobin). We dichotomized continuous variables using their median values as follows: age ≥ 70 years; score on the Charlson comorbidity index ≥ 2; albumin level ≤ 2.5 g/l. Variables were retained only if they remained associated with the primary outcome in a multivariable logistic model using the full model fit .
We assigned point scores for each variable in the final model by rounding the corresponding coefficients to integers . We then calculated a total score for every patient by adding the individual points for each risk factor that was present. We calculated sensitivity, specificity, negative and positive predictive values (with 95% confidence intervals) for each cut-off point of the score in order to predict cancer or death at one year . We also calculated negative and positive likelihood ratios (with 95% confidence intervals) .
Validation of the prediction rule
We assessed calibration and discrimination in both the derivation and validation cohorts. Calibration was determined using the Hosmer-Lemeshow test  and compared the actual and predicted outcomes within each point stratum for the development and validation cohorts. We evaluated discrimination using receiver operating characteristic curves (ROC) . We compared ROC curves for both cohorts according to the method described by Haney et al. .
The institutional registry contained 1264 patients that were diagnosed with new VTE between June 2006 to December 2011, and complete follow-up information was available on 1211 (95.8%). Of these, we excluded 494 (40.8%) patients who had previously been diagnosed with cancer, 132 (10.9%) who died during the incident hospital admission or during the first month of follow-up, and 45 (3.7%) who were diagnosed with VTE during the last year of the study. A random selection of 349 (two thirds) of the 540 remaining patients comprised the derivation cohort and 191 patients (one third) comprised the validation cohort.
During one-year of follow-up, nearly one-quarter (92; 26.4%, 95% CI 21.4% - 30.6%) of patients died (83; 23.7%, 95% CI 18.5% – 27.4%) or developed cancer (32; 9.2%, 95% CI 18.5% – 27.4%). Lung cancer was the most common diagnosed malignancy (21.9%, 95% CI 7.6% - 36.2%) followed by haematogical disorders (18.7%, 95% CI 5.2% - 32.2%). Nearly one third of patients developed metastatic disease (Additional file 1). Patients with the primary outcome of cancer had more comorbidities and previous VTE, and were less likely to have had recent surgery (Table 1). The patients who developed cancer during follow-up had higher mortality than patients who did not develop cancer (71.9% vs. 18.9%; p < 0.0001) (Table 2).
The multivariable logistic regression model to predict one-year risk of cancer retained the following variables: Charlson comorbidity score, previous VTE, and recent surgery. In the model predicting cancer or death, age and albumin were also retained (Additional file 1). The resulting score values derived from rounding the beta coefficients were the same for both outcomes (Table 3).
We estimated the predicted probability of developing the primary and secondary outcomes using a logistic regression model in both the derivation and validation cohorts (Additional file 1). Hosmer-Lemeshow goodness of fit testing showed good calibration (p=0.65 and p=0.94 in the derivation and validation cohorts, respectively). The final score to predict cancer alone had an AUC of 0.75 (95% CI 0.66-0.84) and 0.79 (95% CI 0.63-0.95) in the derivation and validation cohorts, respectively. The final score to predict the combined outcome of cancer and death had an area under the curve (AUC) of 0.72 (95% CI 0.66-0.78) and 0.71 (95% CI 0.63-0.79) in the derivation and validation cohorts, respectively (ROC curves in Additional file 1). The sensitivities, specificities, positive and negative predictive values, and likelihood ratios associated with each point of the final scores are shown in Table 4 and Table 5.
We developed clinical scores to classify patients according to their risk of cancer, or of cancer and mortality, at one year of follow up after developing a new VTE. The final scores employ common and readily available clinical variables and can be easily calculated at the bedside at the time of VTE diagnosis. In our cohort, the scores had good discrimination and calibration, and could differentiate across a wide range of risks for developing cancer, from only 2% (0 points) to greater than 90% risk (5 points). In addition, our score was able to stratify patients’ cancer or mortality risk from 6% (0 points) to greater than 70 % (6 points or more). These simple scores therefore not only provide important prognostic information but might also be used to identify patients that would benefit from closer surveillance and additional investigations.
The ultimate goal of estimating prognosis is to improve clinical decision-making and thereby improve patient outcomes. Our scores may lead to the diagnosis of some malignancies at an earlier stage, and could therefore result in earlier cancer treatments. In addition, some experts have advocated for alterations to anticoagulation strategies in patients with VTE who also have underlying cancer . Conversely, excluding patients who are at low risk for developing cancer or death from screening strategies and investigations should lead to fewer false positive results, avoid unnecessary treatment strategies, and reduce overall costs. Our score also identifies patients that are at higher risk of death, regardless of their risk of cancer, and this could in turn motivate clinicians to address other conditions such as chronic heart failure or coronary heart disease that might be contributing to this higher mortality risk. We provide an example of potential responses to different score results using hypothetical scenarios in Table 6.
Our study has several strengths. We used a large and comprehensive clinical dataset that was developed specifically to follow consecutive patients with newly diagnosed VTE. The initial evaluation and data collection occurred soon after the VTE diagnosis, increasing the clinical utility of our final scoring system. The loss to follow-up at one year remained very low, decreasing the risk of selection bias. Finally, our cohort includes a large number of patients from across Argentina and from different social backgrounds, increasing the generalizability of our final score.
Our study also has several limitations. We could only evaluate variables that were contained in our database, and it is likely that other clinical variables could increase the predictive accuracy of our score. However, the variables in our final scores are widely available and easily obtained, which should improve the external validity of our model. We included only baseline variables in our model, and were unable to evaluate characteristics that evolve over time and that might further influence a patient’s risk of cancer or death. Our model had high discrimination in both the derivation and validation cohort, similar to that observed for other widely used predictive models , but it still will lead to some misclassification of patients. In addition, our validation cohort was derived from the initial sample and was not an independent cohort; it is likely that some loss in discrimination will occur when our scores are applied in other populations. Another limitation is the lack of standardized cancer screening, making it possible that our study is biased by physicians’ decisions to request additional screening tests for patients having the same risk factors identified in our study. However, surveillance using radiological imaging was common throughout the study, with 80% and 34% of patients receiving chest and abdominal computed tomography, respectively, in the first year following VTE diagnosis. Although our scores should help physicians identify patients at higher risk of cancer, it remains unknown whether earlier diagnosis will lead to improved survival , especially considering that cancers associated with VTE often have a relatively poor prognosis . Finally, interpreting intermediate risk scores is a challenge common to most predictive models; the optimal approach to surveillance and investigation of these patients is even more uncertain than for those at low or high risk.
We have developed a simple and clinically relevant score that can predict risk of developing cancer in patients with newly diagnosed VTE. This score could be used to help reassure low risk patients, or to identify high-risk patients that might benefit from increased surveillance and additional investigations. However, our tool should be validated in an externally derived cohort to evaluate its generalizability before it is routinely adopted into clinical practice.
- ROC curves:
Receiver operating characteristic curves
Deep vein thrombosis
Area under the curve
Body mass index.
Deitelzweig SB, Johnson BH, Lin J, Schulman KL: Prevalence of clinical venous thromboembolism in the USA: current trends and future projections. Am J Hematol. 2011, 86 (2): 217-220. 10.1002/ajh.21917.
Castelli R, Porro F: Cancer and thromboembolism: from biology to clinics. Minerva Med. 2006, 97 (2): 175-189.
Langer F, Bokemeyer C: Crosstalk between cancer and haemostasis. Implications for cancer biology and cancer-associated thrombosis with focus on tissue factor. Hämostaseologie. 2012, 32 (2): 95-104.
Noble S, Pasi J: Epidemiology and pathophysiology of cancer-associated thrombosis. Br J Cancer. 2010, 102 (Suppl 1): S2-9.
Prandoni P, Falanga A, Piccioli A: Cancer and venous thromboembolism. Lancet Oncol. 2005, 6 (6): 401-410. 10.1016/S1470-2045(05)70207-2.
Lee AY, Levine MN: Venous thromboembolism and cancer: risks and outcomes. Circulation. 2003, 107 (23 Suppl 1): I17-21.
Carrier M, Le Gal G, Wells PS, Fergusson D, Ramsay T, Rodger MA: Systematic review: the Trousseau syndrome revisited: should we screen extensively for cancer in patients with venous thromboembolism?. Ann Intern Med. 2008, 149 (5): 323-333. 10.7326/0003-4819-149-5-200809020-00007.
Sorensen HT, Mellemkjaer L, Steffensen FH, Olsen JH, Nielsen GL: The risk of a diagnosis of cancer after primary deep venous thrombosis or pulmonary embolism. N Engl J Med. 1998, 338 (17): 1169-1173. 10.1056/NEJM199804233381701.
Flinterman LE, Van Hylckama VA, Cannegieter SC, Rosendaal FR: Long-term survival in a large cohort of patients with venous thrombosis: incidence and predictors. PLoS Med. 2012, 9 (1): e1001155-10.1371/journal.pmed.1001155.
Trujillo-Santos J, Prandoni P, Rivron-Guillot K, Roman P, Sanchez R, Tiberio G, Monreal M, Investigators R: Clinical outcome in patients with venous thromboembolism and hidden cancer: findings from the RIETE Registry. J Thromb Haemost. 2008, 6 (2): 251-255.
Gaitini DE, Brenner B: Do we need a cancer screening in patients with idiopathic deep vein thrombosis?. Ultraschall Med. 2008, 29 (Suppl 5): 220-225.
Van Doormaal FF, Terpstra W, Van Der Griend R, Prins MH, Nijziel MR, Van De Ree MA, Buller HR, Dutilh JC, Ten Cate-Hoek A, Van Den Heiligenberg SM, et al: Is extensive screening for cancer in idiopathic venous thromboembolism warranted?. J Thromb Haemost. 2011, 9 (1): 79-84. 10.1111/j.1538-7836.2010.04101.x.
DIN M, Otten HM, Piccioli A, Lensing AW, Prandoni P, Buller HR, Prins MH: Decision analysis for cancer screening in idiopathic venous thromboembolism. J Thromb Haemost. 2005, 3 (11): 2391-2396. 10.1111/j.1538-7836.2005.01606.x.
Rosovsky R, Lee AY: Evidence-based mini-review: should all patients with idiopathic venous thromboembolic events be screened extensively for occult malignancy?. Hematology Am Soc Hematol Educ Program. 2010, 2010: 150-152. 10.1182/asheducation-2010.1.150.
Prandoni P, Lensing AW, Buller HR, Cogo A, Prins MH, Cattelan AM, Cuppini S, Noventa F, Ten Cate JW: Deep-vein thrombosis and the incidence of subsequent symptomatic cancer. N Engl J Med. 1992, 327 (16): 1128-1133. 10.1056/NEJM199210153271604.
Kaatz S, Qureshi W, Lavender RC: Venous thromboembolism: what to do after anticoagulation is started. Cleve Clin J Med. 2011, 78 (9): 609-618. 10.3949/ccjm.78a.10175.
Fennerty T: Screening for cancer in venous thromboembolic disease. BMJ. 2001, 323 (7315): 704-705. 10.1136/bmj.323.7315.704.
Monreal M: Screening for occult cancer in patients with acute venous thromboembolism. J Thromb Haemost. 2005, 3 (11): 2389-2390. 10.1111/j.1538-7836.2005.01627.x.
Chong LY, Fenu E, Stansby G, Hodgkinson S: Management of venous thromboembolic diseases and the role of thrombophilia testing: summary of NICE guidance. BMJ. 2012, 344: e3979-10.1136/bmj.e3979.
Giunta D, Quiros F, Vazquez F: Institutional Registry of Thromboembolic disease (IRTD). ClinicalTrials.gov Identifier: NCT01372514
Charlson ME, Pompei P, Ales KL, MacKenzie CR: A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987, 40 (5): 373-383. 10.1016/0021-9681(87)90171-8.
Sun GW, Shook TL, Kay GL: Inappropriate use of bivariable analysis to screen risk factors for use in multivariable analysis. J Clin Epidemiol. 1996, 49 (8): 907-916. 10.1016/0895-4356(96)00025-X.
Moons KG, Harrell FE, Steyerberg EW: Should scoring rules be based on odds ratios or regression coefficients?. J Clin Epidemiol. 2002, 55 (10): 1054-1055. 10.1016/S0895-4356(02)00453-5.
Newcombe RG: Two-sided confidence intervals for the single proportion: comparison of seven methods. Stat Med. 1998, 17 (8): 857-872. 10.1002/(SICI)1097-0258(19980430)17:8<857::AID-SIM777>3.0.CO;2-E.
Simel DL, Samsa GP, Matchar DB: Likelihood ratios with confidence: sample size estimation for diagnostic test studies. J Clin Epidemiol. 1991, 44 (8): 763-770. 10.1016/0895-4356(91)90128-V.
Lemeshow S, Hosmer DW: A review of goodness of fit statistics for use in the development of logistic regression models. Am J Epidemiol. 1982, 115 (1): 92-106.
Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982, 143 (1): 29-36.
Hanley JA, McNeil BJ: A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology. 1983, 148 (3): 839-843.
Lee AY, Levine MN, Baker RI, Bowden C, Kakkar AK, Prins M, Rickles FR, Julian JA, Haley S, Kovacs MJ, et al: Low-molecular-weight heparin versus a coumarin for the prevention of recurrent venous thromboembolism in patients with cancer. N Engl J Med. 2003, 349 (2): 146-153. 10.1056/NEJMoa025313.
Fine MJ, Auble TE, Yealy DM, Hanusa BH, Weissfeld LA, Singer DE, Coley CM, Marrie TJ, Kapoor WN: A prediction rule to identify low-risk patients with community-acquired pneumonia. N Engl J Med. 1997, 336 (4): 243-250. 10.1056/NEJM199701233360402.
Wolf AM: Prostate-cancer mortality after PSA screening. N Engl J Med. 2012, 366: 23-2230. 10.1056/NEJMicm1108474. author reply 2231
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2407/13/352/prepub
The authors (BLF and FA) would like to acknowledge the ATS MECOR training course.
The authors declare that they have no competing interests.
BLF and FA: concept and study design, data analysis and interpretation, drafting of the manuscript. DG and MLPM: participant recruitment, data acquisition and analysis. FGBQ: participant recruitment, data acquisition and study supervision. FV: participant recruitment, data acquisition, study supervision, critical review of manuscript. AA and DS: data analysis and interpretation, drafting and critical review of manuscript. All authors read and approved the final manuscript.
Bruno L Ferreyro, Federico Angriman contributed equally to this work.
Electronic supplementary material
About this article
Cite this article
Ferreyro, B.L., Angriman, F., Giunta, D. et al. Predictive score for estimating cancer after venous thromboembolism: a cohort study. BMC Cancer 13, 352 (2013). https://doi.org/10.1186/1471-2407-13-352
- Venous thromboembolism
- Pulmonary embolism