Skip to main content
Download PDF

Completeness and selection bias of a Belgian multidisciplinary, registration-based study on the EFFectiveness and quality of Endometrial Cancer Treatment (EFFECT)

BMC Cancer volume 22, Article number: 600 (2022) Cite this article

Abstract

Background

With the aim of obtaining more uniformity and quality in the treatment of corpus uteri cancer in Belgium, the EFFECT project has prospectively collected detailed information on the real-world clinical care offered to 4063 Belgian women with primary corpus uteri cancer. However, as data was collected on a voluntary basis, data may be incomplete and biased. Therefore, this study aimed to assess the completeness and potential selection bias of the EFFECT database.

Methods

Five databases were deterministically coupled by use of the patient’s national social security number. Participation bias was assessed by identifying characteristics associated with hospital participation in EFFECT, if any. Registration bias was assessed by identifying patient, tumor and treatment characteristics associated with patient registration by participating hospitals, if any. Uni- and multivariable logistic regression were applied.

Results

EFFECT covers 56% of all Belgian women diagnosed with primary corpus uteri cancer between 2012 and 2016. These women were registered by 54% of hospitals, which submitted a median of 86% of their patients. Participation of hospitals was found to be biased: low-volume and Walloon-region centers were less likely to participate. Registration of patients by participating hospitals was found to be biased: patients with a less favorable risk profile, with missing data for several clinical-pathological risk factors, that did not undergo curative surgery, and were not discussed in a multidisciplinary tumor board were less likely to be registered.

Conclusions

Due to its voluntary nature, the EFFECT database suffers from a selection bias, both in terms of the hospitals choosing to participate and the patients being included by participating institutions. This study, therefore, highlights the importance of assessing the selection bias that may be present in any study that voluntarily collects clinical data not otherwise routinely collected. Nevertheless, the EFFECT database covers detailed information on the real-world clinical care offered to 56% of all Belgian women diagnosed with corpus uteri cancer between 2012 and 2016, and may therefore act as a powerful tool for measuring and improving the quality of corpus uteri cancer care in Belgium.

Highlights

• This study highlights the feasibility of voluntarily collecting detailed information on the real-world clinical care offered to cancer patients, from diagnosis to follow-up.

• The advantage of this approach is that it enables a more detailed assessment of clinical practice.

• The disadvantage of this approach is that data is at risk of being somewhat incomplete and biased.

Peer Review reports

Background

Cancer of the uterine corpus is a common disease worldwide, particularly in high- and middle-income countries where the highest incidence rates are seen [1]. In Belgium, with 1352 new cases in 2019, it is the most common cancer of the female genital tract and the fifth most frequent female cancer overall [2]. Furthermore, with 382 related deaths in 2018, it is also the seventh most common cause of cancer-related mortality among Belgian females [3]. This burden is projected to further increase for women over the age of 70 years [4].

In recent years, the management of corpus uteri cancer has changed and improved substantially. However, several aspects of its treatment remain highly controversial [5,6,7,8], such as the role of lymphadenectomy in staging and treatment [9, 10]. As a result, wide variations in clinical practice are noticed between hospitals in Belgium, whereby many patients receive a suboptimal quality of care not according to guidelines [11]. In our opinion, this constitutes one of the major concerns for women diagnosed with corpus uteri cancer in Belgium.

The EFFECT (EFFectiveness and quality of Endometrial Cancer Treatment) project was launched with the objective of obtaining more uniformity and quality in the treatment of corpus uteri cancer in Belgium [12]. Quality of care (from diagnosis to follow-up) will be measured by means of quality indicators [13], and improved by means of feedback and benchmarking to the hospitals involved [14]. For this purpose, EFFECT has prospectively collected detailed information on the real-world clinical care offered to 4063 Belgian women diagnosed with primary corpus uteri cancer between 2012 and 2016. This information was collected via an online registration module of the Belgian Cancer Registry, and this on a voluntary basis. The major advantage of this approach is that it enables a highly detailed and meaningful assessment of the clinical care that was offered by hospitals and healthcare teams [15]. However, due to its voluntary nature, the major disadvantage of this approach is that data may potentially be incomplete and suffer from selection bias, as was demonstrated in a highly similar quality of care initiative that was performed in Belgium in the context of rectal cancer (i.e., PROject on CAncer of the REctum; PROCARE) [16, 17]. The presence of such a selection bias is not necessarily problematic, as long as you identify it, characterize it, and take it into account in the analyzation and interpretation of the data. Therefore, this present study aimed to assess and characterize the completeness and potential selection bias of the EFFECT database.

Methods

Data sources

Four databases were deterministically coupled by use of the patient’s national social security number as unique identifier: the Belgian Cancer Registry (BCR) database, the database from the InterMutualistic Agency (IMA), the Crossroads Bank for Social Security (CBSS), and the EFFECT database. Due to cancer registration being compulsory in Belgium, the BCR is a national population-based registry that covers basic information (regarding both the patient and the tumor) on at least 98% of all incident cancer diagnoses in Belgium [18, 19]. Consequently, the BCR serves as the gold standard for cancer registration in Belgium. The IMA is a national registry covering information on the (cancer-related) diagnostic and therapeutic procedures, as well as pharmaceuticals, reimbursed to the patient by the Belgian compulsory health insurance. The CBSS covers data on the vital status of the patient, amongst other things. Finally, a fifth database was provided by the public health authorities covering the characteristics of all Belgian hospitals that were recognized as a general acute hospital on December 31st, 2016 [20].

Study population

The following patients were retrieved from the BCR database: all 7239 Belgian women that were diagnosed between 2012 and 2016 with a primary corpus uteri cancer (C54-C55; International Classification of Diseases for Oncology, third edition) eligible for EFFECT. See the online manual for the in- and exclusion criteria of the EFFECT project [21]. Patients for whom IMA data was not available (n = 152) were excluded. Furthermore, patients for whom IMA data was less reliable were also excluded: cases with a synchronous malignancy (n = 471) or an uncertain incidence date (n = 8). Finally, patients for whom the center of main treatment could not be identified were also excluded (n = 9) (see below). A synchronous malignancy was defined as a second primary cancer diagnosed in the timeframe of 3 months prior to until 12 months after corpus uteri cancer incidence, regardless of topography and morphology, except non-melanoma skin cancer. This way, a final cohort of 6599 patients was included.

Hospital allocation and hospital volume

IMA data allowed us to identify the hospital(s) where the patient was treated. By use of the following algorithm, patients were allocated to one specific hospital defined as the center of main treatment: first, if all care was performed in one single hospital, this center was considered as the center of main treatment; second, if care was performed in more than one hospital, the following priority rules were applied for defining the center of main treatment: center of (a) curative surgery, (b) chemotherapy, (c) radiation therapy, (d) hormone therapy, (e) multidisciplinary tumor board (MDT), (f) diagnostic biopsy, and (g) diagnostic imaging. If no treatment centers were known, the patient was assigned to the hospital that registered the patient to the BCR. The center of main treatment could not be identified for nine patients.

A hospital’s volume was then defined as the number of patients that underwent their main treatment in that specific hospital over the period 2012–2016. Volume was categorized in low-, medium-, and high-volume based on the average annual volume and by use of the following cut-off values: < 10, 10–19, and ≥ 20 patients treated on average per year, respectively. Cut-off values are arbitrary and based on expert opinion, as well as on the need to have a balanced repartition of centers and patients over the volume categories.

Patient subgroups

The study population was categorized into four patient subgroups: (a) patients registered for EFFECT (Registered EFFECT-Patients, REP); (b) patients not registered for EFFECT that underwent their main treatment during a participating center’s active registration period, and therefore should have been registered (Non-Registered EFFECT-Patients, Non-REP); (c) patients not registered for EFFECT that underwent their main treatment outside of a participating center’s active registration period, and therefore could not have been registered (Non-EFFECT-A); and (d) patients not registered for EFFECT that underwent their main treatment in a non-participating center, and therefore could not have been registered (Non-EFFECT-B). A participating center’s active registration period was determined by chronologically ranking all its registered cases based on their incidence date, and defined as starting from the first until the last incidence date. See Fig. 1 for more detailed information.

Fig. 1
figure 1

Patient subgroups (flowchart). The objective is to identify those patients that were registered for EFFECT by the participating centers, and those that were not but also should have been. First, based on EFFECT data, the study population was categorized in patients registered and not registered for EFFECT. Next, within the group of non-registered cases, a further distinction was made based on whether main treatment was performed in an EFFECT-participating center and, if yes, whether the patient’s incidence date falls inside the hospital’s active registration period. This way, four patient subgroups were defined: (a) patients registered for EFFECT by the participating centers (Registered EFFECT-Patients; REP); (b) non-registered patients that underwent their main treatment during a participating center’s active registration period, and therefore also should have been registered (Non-Registered EFFECT-Patients; Non-REP); (c) non-registered patients that underwent their main treatment outside of a participating center’s active registration period, and therefore could not have been registered (Non-EFFECT-A); and (d) non-registered patients that underwent their main treatment in a non-participating center, and therefore could not have been registered (Non-EFFECT-B). A participating center’s active registration period was determined by chronologically ranking all its registered cases based on their incidence date, and defined as starting from the first until the last incidence date

Full size image

Participation and registration bias

Hospital participation bias was assessed and characterized by identifying characteristics associated with the (non-)participation of hospitals in EFFECT. Patient registration bias was assessed and characterized by identifying patient, tumor and treatment characteristics associated with the (non-)registration of patients by participating hospitals. For the latter, only REP and Non-REP patients were taken into account.

Statistical analyses

Summary statistics are expressed as medians and (interquartile) ranges for continuous data, and as frequencies and percentages for categorical data. Uni- and multivariable logistic regression were applied for assessing characteristics associated with hospital participation and patient registration in EFFECT. Characteristics to include in the multivariable model were selected based on clinical relevance and results of the univariable analysis (p < 0.10 was considered interesting). Goodness-of-fit was assessed by the Hosmer-Lemeshow goodness-of-fit test, the chi-squared test of the Pearson and deviance residuals, and by visual inspection of model residuals. For assessing registration bias, clustering of patients within hospitals (intra-cluster correlations) was taken into account by adding the ‘center of main treatment’ as random effect term to the final model. All statistical tests were two-sided and p-values below 0.05 were considered statistically significant. Statistical analyses were performed using SAS 9.4 (SAS Institute, Cary, NC, USA).

Results

Descriptives

During the 2012–2016 period, 101 Belgian hospitals were involved in the treatment of corpus uteri cancer, of which 49.5% (n = 50) were low-volume, 30.7% (n = 31) medium-volume, and 19.8% (n = 20) high-volume (Table 1). These hospitals took care of 22.7% (n = 1496), 31.9% (n = 2106), and 45.4% (n = 2997) of cases, respectively (Table 2). Considering the entire study population (n = 6599), 60.6% (n = 3998) of cases were diagnosed between the age of 60 years and 79 years. When known, 79.4% (n = 4948) of cases were diagnosed with early-stage disease (stage 0-II). Endometrial carcinomas and uterine sarcomas accounted for 95.5% (n = 6302) and 4.5% (n = 297) of cases, respectively. 64.6% (n = 4073) of the carcinomas were of the type I subclass, and 28.8% (n = 1812) of the type II subclass. Curative surgery was the primary treatment for 86.9% (n = 5732) of patients, with total hysterectomy (TH) being performed most frequently (n = 3084; 53.8%). Finally, 92.7% (n = 6119) of patients were discussed in at least one MDT meeting (Table 2).

Table 1 Center characteristics
Full size table
Table 2 Patient, tumor and treatment characteristics
Full size table

Hospital participation

Of the 101 hospitals treating corpus uteri cancer in the period 2012–2016, 55 (54.5%) did participate in EFFECT. Low-volume centers and centers from the Walloon region were significantly less likely to participate, and are therefore underrepresented in EFFECT. Based on the multivariable model, volume and region were found as the main independent, explanatory factors for the (non-)participation of hospitals in EFFECT (Tables 1 and 3).

Table 3 Center characteristics associated with hospital participation in EFFECT
Full size table

Patient registration

Of the 7239 corpus uteri cancer cases that were retrieved from the BCR database, 4063 (56.1%) were registered in the EFFECT database. Patient registration rate varies widely between the participating centers, which registered a median of 85.7% of cases that were treated during their active registration period (interquartile range = 80.4%-94.4%, range = 41.2%-100.0%) (Fig. 2). Patients aged 80 years and older, with a WHO (World Health Organization) score of ≥ 2 or missing, with a multiple tumor, with stage IV disease or missing stage, and those diagnosed with a uterine sarcoma or other carcinoma (i.e., could not be classified as either a type I or type II carcinoma) were all significantly less likely to be registered for EFFECT by the participating centers. Likewise for patients who did not undergo curative surgery as primary treatment, who were not discussed in an MDT meeting, and who died within the first 30 days post-surgery. Based on the multivariable model; WHO score, combined stage, type of primary treatment, and discussion in an MDT meeting were identified as the main independent, explanatory factors for the (non-)registration of patients by the participating centers (Table 4; Supplementary table 1).

Fig. 2
figure 2

Patient registration rate for the 55 participating centers individually. Each dot represents one individual participating center. The dashed, horizontal line represents the median registration rate (85.7%). The dashed, vertical lines represent the cut-off values applied for making a distinction between low- (< 10 cases/year), medium- (10–19 cases/year), and high-volume (≥ 20 cases/year) centers. A center's registration rate was calculated as the percentage of patients that were registered for EFFECT by that specific hospital (REP) out of the total number of patients that underwent their main treatment during the active registration period of that particular hospital (REP + non-REP). Min = minimum; max = maximum; Q1 = first quartile; Q3 = third quartile

Full size image
Table 4 Patient, tumor and treatment characteristics associated with patient registration in EFFECT
Full size table

Significant differences were also found between patients from participating centers (REP + Non-REP + Non-EFFECT-A) and those from non-participating centers (Non-EFFECT-B). The latter are older (odds ratio (OR)≥80 years = 1.16, 95% confidence interval (CI) = 1.02–1.32), less frequently underwent treatment (ORtreatment = 0.80, 95% CI = 0.64–1.00), and were less often discussed at an MDT meeting (ORMDT = 0.52, 95% CI = 0.43–0.63). Surgery rate is not different, but patients from non-participating centers more frequently underwent total radical hysterectomy (TRH) (ORTRH = 1.32, 95% CI = 1.17–1.49) and adjuvant treatment (ORadj. treat. = 1.20, 95% CI = 1.06–1.35). Finally, they also more frequently have missing data for WHO score (ORmissing = 2.20, 95% CI = 1.90–2.55), combined stage (ORmissing = 1.54, 95% CI = 1.24–1.92), and differentiation grade (ORmissing = 1.92, 95% CI = 1.57–2.35) (ORs and CIs are calculated based on the data presented in Table 2).

Discussion

Because of its voluntary nature, this study found the EFFECT database to be incomplete and somewhat biased, both in terms of the hospitals choosing to participate and the patients being registered by participating centers. More precisely, low-volume and Walloon-region centers were less likely to participate in EFFECT. Furthermore, participating hospitals were less likely to include patients with a less favorable risk profile, with missing data for several clinical-pathological risk factors, that did not undergo curative surgery, and that were not discussed in a multidisciplinary tumor board. Finally, clinical practice patterns were found to be different for participating and non-participating institutions.

The observed participation bias could potentially be explained by the following two mechanisms. First, despite our efforts to inform all hospitals about EFFECT, low-volume and Walloon-region centers might have been informed to a lesser extent. Second, particularly low-volume centers might not have disposed of the resources necessary to participate (e.g., time, funding, personnel and technical support). Furthermore, the observed registration bias could potentially be explained by the following three mechanisms. First, in some to many of the participating institutions, EFFECT registration might have been performed by the healthcare team itself, which might have preferred to particularly include patients that they curatively treated. Second, as many aspects of the patient’s treatment scheme were known at the time of first registration, this information might have biased one’s decision whether to include the patient. For instance, when standard of care was offered but refused, one could have decided not to include the patient. Third, EFFECT registration might have been more time-consuming and labor intensive for certain cases. At this point, these mechanisms are merely theoretical and therefore require further investigation.

PROCARE is a quality of care initiative that was performed in Belgium in the context of rectal cancer and was also relying on hospitals to voluntarily register healthcare data [16]. A study by Jegou et al. found the PROCARE database to be incomplete and biased in a highly similar way as EFFECT. More precisely, they also found that low-volume, Walloon-region and non-university centers were less likely to participate. Furthermore, participating centers were less likely to include patients with a less favorable risk profile and who did not undergo surgical resection. This way, the PROCARE database was found to cover 37% of all Belgian rectal cancer patients. These were registered by 72% of centers involved, which included 56% of their cases [17]. Furthermore, a similar underreporting of hospitals and cases has also been described by other clinical audit programs relying on voluntary participation [24,25,26,27].

In line with the facilitators and barriers of clinical audit as previously described [28, 29], two survey-based studies by Cornish et al. and Voeten et al. recently found that hospitals and healthcare providers generally think clinical audit programs to be a powerful and relevant tool for improving clinical practice and patient outcomes. However, lack of resources (e.g., technical support, time, personnel and funding) was found to be one of the major reasons for non-participation [30, 31]. Our results reflect these findings, as most hospitals and healthcare teams had a positive attitude towards EFFECT. However, many might not have disposed of the resources necessary to participate, particularly low-volume centers.

Conflicting results have been reported by studies comparing the performance of hospitals and healthcare providers that do participate voluntarily in clinical audit with the performance of those that do not [24, 26, 32, 33]. Similarly, although differences were found in the clinical practice of centers participating and not participating in EFFECT, whether this reflects real differences in quality of care warrants further investigation.

Altogether, for the purpose of measuring and improving the quality of cancer care, these findings highlight the feasibility of voluntarily collecting detailed information on the real-world clinical care offered to the patient, from diagnosis to follow-up. Compared to the use of routinely available administrative data, the major advantage of this approach is that it enables a more detailed and meaningful assessment of clinical practice [15]. Nevertheless, in contrast to administrative databases that are highly complete and free of bias, the major disadvantage of this approach is that such clinical databases are at risk of being incomplete and biased, both in terms of the hospitals choosing to participate and the patients being registered by the participating institutions. As a result, hospitals that would arguably benefit most from quality improvement (i.e., low-volume hospitals) tend not to participate [34,35,36,37]. Furthermore, assessing the clinical practice of participating hospitals may be complicated substantially by the bias that tends to be present in their registration of patients. Consequently, to enable meaningful interpretation and feedback, this bias should always be characterized and taken into account. Furthermore, for clinical audit programs to promote quality improvement on the national level, measures should be taken to prevent such selection bias as much as possible, as this requires coverage of all hospitals and patients involved.

Based on the aforementioned mechanisms that could be driving the observed selection bias, we present a couple of methods to potentially reduce the risk of bias in the registration of data, as this would further enhance the potential of clinical audit programs to promote quality improvement. We first suggest to make participation in clinical audit less resource intensive, so that centers and healthcare providers with less resources may also be able to participate. This could potentially be done by making the data extraction and registration process more automated or by giving technical and/or financial support to participating institutions [28,29,30,31]. Second, we suggest to ensure that all centers and healthcare teams involved are sufficiently informed about the project. This could possibly be achieved by presenting in person the rationale and importance of the project, which should preferably be done by a colleague renowned in the field [14]. Third, we suggest patient registration to be performed by someone independent from the healthcare team, preferably a data manager specifically trained in cancer registration. Fourth, we suggest the patient to be registered at time of diagnosis, not when many aspects of the treatment scheme are already known. Finally, we suggest rewarding institutions and healthcare teams for their active participation in clinical audit, on the condition that their participation is of sufficient quality (i.e., when a high enough proportion of patients are registered without selection bias). This could potentially be achieved by some sort of accreditation. However, these suggestions are merely theoretical and therefore require further investigation.

The work presented has a couple of limitations that are mainly associated with the databases used. First, although the BCR database has an excellent coverage of nearly all incident cancer cases in Belgium, its data on WHO score, combined stage and differentiation grade was missing for a substantial number of patients. Second, although IMA data was pivotal for this study, it had some major limitations: (a) miscoding or misuse of nomenclature might have occurred; (b) nomenclature was often vague and unspecific, which made detailed analyses and interpretation of data difficult; and (c) the number of patients that underwent a certain medical procedure may have been under- or overestimated due to the impossibility to unambiguously link nomenclature to one specific indication, or to the fact that not all procedures are reimbursed (e.g., when performed in the context of a clinical trial). Different measures were taken to tackle these limitations. For example, cases with missing data were included in the analyses as a separate category within the respective variable, and patients with less reliable IMA data were excluded.

At the same time, these national population-based databases are the major strength of our study: as they are highly complete covering all corpus uteri cancer cases and institutions involved, they allowed us to accurately assess the completeness and potential selection bias of the EFFECT database.

Future studies should focus on unraveling the underlying mechanisms that are driving the selection bias observed in clinical audit programs, as well as on effective ways to counteract these mechanisms. This knowledge could then be applied to further enhance the potential of clinical audit programs to promote quality improvement in healthcare on the national level.

Conclusion

For the purpose of measuring and improving the quality of cancer care, the present study highlights the feasibility of voluntarily collecting detailed information on the real-world clinical care offered to cancer patients, from diagnosis to follow-up. Compared to the use of routinely available administrative data, the major advantage of this approach is that it enables a more detailed and meaningful assessment of clinical practice. However, in contrast to administrative databases that are highly complete and free of bias, the major disadvantage of this approach is that such clinical databases are at risk of being incomplete and to suffer from selection bias, both in terms of the hospitals choosing to participate and the patients being registered by participating institutions. This bias should therefore always be assessed and characterized, as well as taken into account in the analyzation and interpretation of the data. Furthermore, to really promote quality improvement on the national level, measures should be taken to prevent such bias as much as possible. To conclude, regardless of the observed selection bias, the EFFECT database covers detailed information on the real-world clinical care offered to 56% of all Belgian women diagnosed with corpus uteri cancer between 2012 and 2016. The database may therefore act as a unique and powerful tool for measuring and improving the quality of corpus uteri cancer treatment in Belgium.

Availability of data and materials

The data that support the findings and conclusions of this study are presented in the paper, but are not publicly available due to privacy or ethical restrictions. However, data can be made available from the corresponding author upon reasonable request. More concretely, pseudonymized data can be provided within the secured environment of the Belgian Cancer Registry after having been guaranteed that applicable GDPR regulations are taken into account.

Abbreviations

EFFECT:

EFFectiveness and quality of Endometrial Cancer Treatment

PROCARE:

PROject on CAncer of the REctum

BCR:

Belgian Cancer Registry

IMA:

InterMutualistic Agency

CBSS:

Crossroads Bank for Social Security

MDT:

Multidisciplinary tumor board

REP:

Registered EFFECT-patient

Non-REP:

Non-registered EFFECT-patient

WHO:

World Health Organization

TH:

Total hysterectomy

TRH:

Total radical hysterectomy

OR:

Odds ratio

CI:

Confidence interval

References

  1. Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. Ca-a Cancer Journal for Clinicians. 2021;71(3):209–49. https://doi.org/10.3322/caac.21660.

    Article  PubMed  Google Scholar 

  2. Belgian Cancer Registry. Absolute number of invasive tumors by primary site and age group among Belgian females in 2019. https://kankerregister.org/media/docs/SKRstats/2019/2019-F-BEL-Abs.pdf. Accessed 15 Dec 2021.

  3. Statbel, the Belgian statistical office. Causes of death in Belgium for the period 2010–2018. https://statbel.fgov.be/en/themes/population/mortality-life-expectancy-and-causes-death/causes-death#figures. Accessed 15 Dec 2021.

  4. Belgian Cancer Registry. Cancer Incidence Projections in Belgium, 2015 to 2025. https://kankerregister.org/media/docs/publications/IncidenceProj2015-2025_finaal_171120.pdf. Accessed 15 Dec 2021.

  5. Morice P, Leary A, Creutzberg C, Abu-Rustum N, Darai E. Endometrial cancer. Lancet. 2016;387(10023):1094–108. https://doi.org/10.1016/s0140-6736(15)00130-0.

    Article  PubMed  Google Scholar 

  6. Amant F, Mirza MR, Koskas M, Creutzberg CL. Cancer of the corpus uteri. Int J Gynecol Obstet. 2018;143:37–50. https://doi.org/10.1002/ijgo.12612.

    Article  Google Scholar 

  7. Mbatani N, Olawaiye AB, Prat J. Uterine sarcomas. Int J Gynecol Obstet. 2018;143:51–8. https://doi.org/10.1002/ijgo.12613.

    Article  Google Scholar 

  8. Brooks RA, Fleming GF, Lastra RR, Lee NK, Moroney JW, Son CH, et al. Current recommendations and recent progress in endometrial cancer. Ca-a Cancer Journal for Clinicians. 2019;69(4):258–79. https://doi.org/10.3322/caac.21561.

    Article  PubMed  Google Scholar 

  9. Koskas M, Rouzier R, Amant F. Staging for endometrial cancer: The controversy around lymphadenectomy - Can this be resolved? Best Pract Res Clin Obstet Gynaecol. 2015;29(6):845–57. https://doi.org/10.1016/j.bpobgyn.2015.02.007.

    Article  PubMed  Google Scholar 

  10. Bogani G, Dowdy SC, Cliby WA, Ghezzi F, Rossetti D, Mariani A. Role of pelvic and para-aortic lymphadenectomy in endometrial cancer: Current evidence. Journal of Obstetrics and Gynaecology Research. 2014;40(2):301–11. https://doi.org/10.1111/jog.12344.

    Article  PubMed  Google Scholar 

  11. Belgian Cancer Registry. EFFECT: General feedback report 2015. https://kankerregister.org/media/docs/Projecten/Effect/NL/EFFECT_FB2015_General.pdf. Accessed 15 Dec 2021.

  12. Belgian Cancer Registry. EFFECT: A study on the quality and effectiveness of endometrial cancer treatment in Belgium. http://kankerregister.org/EFFectiveness of Endometrial Cancer Treatment (EFFECT). Accessed 15 Dec 2021.

  13. Werbrouck J, Bouche G, de Jonge E, Jacomen G, D’Hondt V, Denys H, et al. Evaluation of the quality of the management of cancer of the corpus uteri - Selection of relevant quality indicators and implementation in Belgium. Gynecol Oncol. 2013;131(3):512–9. https://doi.org/10.1016/j.ygyno.2013.10.001.

  14. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6:229. https://doi.org/10.1002/14651858.CD000259.pub3.

    Article  Google Scholar 

  15. Vlayen J, Stordeur S, Vrijens F, Van Eycken E. Kwaliteitsindicatoren in oncologie: voorwaarden voor het opzetten van een kwaliteitssysteem. Good Clinical Practice (GCP). Brussel: Federaal Kenniscentrum voor de Gezondheidszorg (KCE). 2011. KCE Reports 152A. https://kce.fgov.be/sites/default/files/2021-11/kce_152a_kwaliteitsindicatoren_in_oncologie.pdf. Accessed 15 Dec 2021.

  16. Belgian Cancer Registry. Project on cancer of the rectum (PROCARE). http://procare.kankerregister.org/procare.aspx?url=Procare. Accessed 15 Dec 2021.

  17. Jegou D, Penninckx F, Vandendael T, Bertrand C, Van Eycken E, Procare. Completeness and registration bias in PROCARE, a Belgian multidisciplinary project on cancer of the rectum with participation on a voluntary basis. Eur J Cancer. 2015;51(9):1099–108. https://doi.org/10.1016/j.ejca.2014.02.025.

    Article  CAS  PubMed  Google Scholar 

  18. Henau K, Van Eycken E, Silversmit G, Pukkala E. Regional variation in incidence for smoking and alcohol related cancers in Belgium. Cancer Epidemiol. 2015;39(1):55–65. https://doi.org/10.1016/j.canep.2014.10.009.

    Article  PubMed  Google Scholar 

  19. Cancer burden in Belgium 2004–2013, Belgian Cancer Registry, Brussels, 2015. https://kankerregister.org/media/docs/publications/BCR_publicatieCancerBurden2016_web160616.pdf. Accessed 15 Dec 2021.

  20. Gegevens uit de databank CIC, de dato 27 01 2021; Dienst Data en Beleidsinformatie, FOD Volksgezondheid, Veiligheid van de Voedselketen en Leefmilieu, België. / Data from the CIC database, dated 27 01 2021; Data and Policy Information Service, FPS of Health, Food Chain Safety and Environment, Belgium.

  21. Belgian Cancer Registry. EFFECT: Manual. https://kankerregister.org/media/docs/Projecten/Effect/NL/HandleidingEFFECT.pdf. Accessed 15 Dec 2021.

  22. Oken MM, Creech RH, Tormey DC, Horton J, Davis TE, McFadden ET, et al. TOXICITY AND RESPONSE CRITERIA OF THE EASTERN-COOPERATIVE-ONCOLOGY-GROUP. Am J Clin Oncol-Cancer Clin Trials. 1982;5(6):649–55. https://doi.org/10.1097/00000421-198212000-00014.

    Article  CAS  Google Scholar 

  23. Jegou D, Dubois C, Schillemans V, Stordeur S, De Gendt C, Camberlin C, et al. Use of health insurance data to identify and quantify the prevalence of main comorbidities in lung cancer patients. Lung Cancer. 2018;125:238–44. https://doi.org/10.1016/j.lungcan.2018.10.002.

    Article  PubMed  Google Scholar 

  24. Aylin P, Lees T, Baker S, Prytherch D, Ashley S. Descriptive study comparing routine hospital administrative data with the vascular society of Great Britain and Ireland’s National Vascular Database. Eur J Vasc Endovasc Surg. 2007;33(4):461–5. https://doi.org/10.1016/j.ejvs.2006.10.033.

  25. Garout M, Tilney HS, Tekkis PP, Aylin P. Comparison of administrative data with the Association of Coloproctology of Great Britain and Ireland (ACPGBI) colorectal cancer database. Int J Colorectal Dis. 2008;23(2):155–63. https://doi.org/10.1007/s00384-007-0390-z.

    Article  PubMed  Google Scholar 

  26. Almoudaris AM, Burns EM, Bottle A, Aylin P, Darzi A, Faiz O. A colorectal perspective on voluntary submission of outcome data to clinical registries. Br J Surg. 2011;98(1):132–9. https://doi.org/10.1002/bjs.7301.

    Article  CAS  PubMed  Google Scholar 

  27. Voeten SC, Arends AJ, Wouters M, Blom BJ, Heetveld MJ, Slee-Valentijn MS, et al. The Dutch Hip Fracture Audit: evaluation of the quality of multidisciplinary hip fracture care in the Netherlands. Arch Osteoporos. 2019;14(1):16. https://doi.org/10.1007/s11657-019-0576-3.

    Article  Google Scholar 

  28. Johnston G, Crombie IK, Davies HTO, Alder EM, Millard A. Reviewing audit: barriers and facilitating factors for effective clinical audit. Qual Health Care. 2000;9(1):23–36. https://doi.org/10.1136/qhc.9.1.23.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Bowie P, Bradley NA, Rushmer R. Clinical audit and quality improvement - time for a rethink? J Eval Clin Pract. 2012;18(1):42–8. https://doi.org/10.1111/j.1365-2753.2010.01523.x.

    Article  PubMed  Google Scholar 

  30. Cornish JA, Tilney HS, Tan E, Thompson MR, Smith JJ, Tekkis PP. The National Bowel Cancer Audit Project: what do trusts think of the National Bowel Cancer Audit and how can it be improved? Tech Coloproctol. 2011;15(1):53–9. https://doi.org/10.1007/s10151-010-0661-5.

    Article  CAS  PubMed  Google Scholar 

  31. Voeten SC, van Bodegom-Vos L, Hegeman JH, Wouters M, Krijnen P, Schipper IB. Hospital staff participation in a national hip fracture audit: facilitators and barriers. Arch Osteoporos. 2019;14(1):10. https://doi.org/10.1007/s11657-019-0652-8.

    Article  Google Scholar 

  32. Thompson JW, Pinidiya SD, Ryan KW, McKinley ED, Alston S, Bost JE, et al. Health plan quality-of-care information is undermined by voluntary reporting. Am J Prev Med. 2003;24(1):62–70. https://doi.org/10.1016/s0749-3797(02)00569-x.

    Article  PubMed  Google Scholar 

  33. Ghaferi AA, Osborne NH, Dimick JB. Does Voluntary Reporting Bias Hospital Quality Rankings? J Surg Res. 2010;161(2):190–4. https://doi.org/10.1016/j.jss.2009.07.033.

    Article  PubMed  Google Scholar 

  34. Diaz-Montes TP, Zahurak ML, Giuntoll RL, Gardner GJ, Bristow RE. Uterine cancer in Maryland: Impact of surgeon case volume and other prognostic factors on short-term mortality. Gynecol Oncol. 2006;103(3):1043–7. https://doi.org/10.1016/j.ygyno.2006.06.018.

    Article  PubMed  Google Scholar 

  35. Seagle BLL, Strohl AE, Dandapani M, Nieves-Neira W, Shahabi S. Survival Disparities by Hospital Volume Among American Women With Gynecologic Cancers. Jco Clini Cancer Inform. 2017;1:1–15. https://doi.org/10.1200/CCI.16.00053.

    Article  Google Scholar 

  36. Wright JD, Ruiz MP, Chen L, Gabor LR, Tergas AI, St Clair CM, et al. Changes in Surgical Volume and Outcomes Over Time for Women Undergoing Hysterectomy for Endometrial Cancer. Obstet Gynecol. 2018;132(1):59–69. https://doi.org/10.1097/AOG.0000000000002691.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Killeen SD, O’Sullivan MJ, Coffey JC, Kirwan WO, Redmond HP. Provider volume and outcomes for oncological procedures. Br J Surg. 2005;92(4):389–402. https://doi.org/10.1002/bjs.4954.

Download references

Acknowledgements

The authors would like to thank all participating hospitals, physicians and data managers for all efforts they made in the context of EFFECT, and for their many years of active collaboration. Also thanks to the Anticancer Fund and Kom op tegen Kanker for financially supporting the EFFECT project. The authors are also grateful to all employees of the Belgian Cancer Registry involved in EFFECT, in particular Julie Verbeeck (data analyst) for her methodological and technical support in the linkage of databases. Finally, we would like to thank other members of the EFFECT steering group for their contributions to the design, execution and/or supervision of the EFFECT project: Erik Van Limbergen, Bruno Vandermeersch, Marcella Baldewijns, Mathijs Goossens, and Didier Vander Steichel.

Funding

The EFFECT project was financially supported by the Anticancer Fund from 2012–2016 and is currently being funded by Kom op tegen Kanker from 2019–2023 (grant number: KotK/2018/11467/1). Through Gauthier Bouche’s employment as Director of Clinical Research, the Anticancer Fund was involved in study design and the writing of the report (i.e., review & editing). Kom op tegen Kanker had no such involvement.

Author information

Authors and Affiliations

  1. Biomedical Sciences Group, Department of Oncology, Unit of Gynecological Oncology, KU Leuven, ON4 Herestraat 49, box 1045, 3000, Leuven, Belgium

    Joren Vanbraband & Frédéric Amant

  2. Belgian Cancer Registry, Koningsstraat 215, box 7, 1210, Brussels, Belgium

    Nancy Van Damme, Geert Silversmit & Anke De Geyndt

  3. The Anticancer Fund, Brusselsesteenweg 11, 1860, Meise, Belgium

    Gauthier Bouche

  4. Department of Obstetrics and Gynecology, Ziekenhuis Oost-Limburg, Campus Sint-Jan, Schiepse Bos 6, 3600, Genk, Belgium

    Eric de Jonge

  5. Laboratory of Pathological Anatomy, AZ Sint-Maarten, Liersesteenweg 435, 2800, Mechelen, Belgium

    Gerd Jacomen

  6. Department of Obstetrics and Gynecology, CHR de La Citadelle, Boulevard du 12ème de Ligne 1, 4000, Liège, Belgium

    Frédéric Goffin

  7. Department of Medical Oncology, University Hospital Ghent, Corneel Heymanslaan 10, 9000, Ghent, Belgium

    Hannelore Denys

  8. Department of Surgery, Netherlands Cancer Institute, Plesmanlaan 121, 1066CX, Amsterdam, The Netherlands

    Frédéric Amant

Authors
  1. Joren Vanbraband
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nancy Van Damme
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gauthier Bouche
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Geert Silversmit
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Anke De Geyndt
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Eric de Jonge
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Gerd Jacomen
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Frédéric Goffin
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Hannelore Denys
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Frédéric Amant
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

J.V.: Software, Formal analysis, Writing - Original draft & Editing, Visualization; N.V.D.: Conceptualization, Writing - Review & Editing, Supervision, Project administration, Funding acquisition; G.B.: Conceptualization, Writing - Review & Editing, Funding acquisition; G.S.: Methodology, Software, Formal analysis, Writing - Review & Editing; A.D.G.: Resources, Data curation; E.d.J.: Conceptualization, Writing - Review & Editing, Funding acquisition; G.J.: Conceptualization, Writing - Review & Editing, Funding acquisition; F.G.: Conceptualization, Writing - Review & Editing, Funding acquisition; H.D.: Conceptualization, Writing - Review & Editing, Supervision, Project administration, Funding acquisition; F.A.: Conceptualization, Writing - Review & Editing, Supervision, Project administration, Funding acquisition. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Frédéric Amant.

Ethics declarations

Ethics approval and consent to participate

This study was performed within the legal and ethical framework of the Belgian Cancer Registry (BCR), for which we like to refer to the following laws and regulations: (a) the specific BCR law (i.e., the law of December 13th, 2006 on various health-related provisions, chapter 6, article 39; Belgian Official Gazette of December 22nd, 2006, p 73786); (b) the Belgian privacy law (i.e., the law of July 30th, 2018 on the protection of natural persons with regard to the processing of personal data; Belgian Official Gazette of September 5th, 2018); (c) deliberation no. 09/071 of September 15th, 2009 with regard to the communication of personal data by the insurance institutions to the Foundation Cancer Registry in the context of article 45 quinquies of the Royal Decree no. 78 of November 10th, 1967 concerning the exercise of the health professions (Belgian Privacy Commission; last amended on February 18th, 2014).

Based on these laws and regulations, the BCR was authorized by national law to collect, analyze and report all data included in this particular study. More precisely, based on the specific BCR law, the BCR was authorized to use the patient’s national social security number as unique patient identifier in order to link its own routinely-collected data with the Crossroads Bank for Social Security (vital status data) and the EFFECT database. Furthermore, through the abovementioned authorization from the Belgian Privacy Commission, the BCR was also authorized to use this unique patient identifier for linking its data with health insurance data from the InterMutualistic Agency.

Before analysis, all data was pseudonymized by the BCR. In order to gain access to this pseudonymized data, everyone involved in the formal data analysis of this study had to (a) take part in a privacy training and the accompanying examination (provided by the BCR), (b) sign a data confidentiality clause, and (c) sign a research agreement with the BCR. This to guarantee the safety and confidentiality of the data.

All authors declare to have followed the ethical code of scientific research in Belgium (http://www.belspo.be/belspo/organisation/publ/pub_ostc/Eth_code/ethcode_nl.pdf).

As a result, this study was carried out in accordance with all relevant guidelines and regulations, and no additional ethical approval nor informed consent was required for this study.

Consent for publication

Not applicable.

Competing interests

H.D.: (a) Consulting or Advisory Role: Pfizer (Inst), Roche (Inst), PharmaMar (Inst), AstraZeneca (Inst), Eli Lilly (Inst), Novartis (Inst), Amgen (Inst), GSK (Inst); (b) Travel, Accommodations, Expenses: Pfizer (Inst), Roche (Inst), PharmaMar (Inst), Teva (Inst), AstraZeneca (Inst). All other authors: no known competing interests to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Supplementary Table 1.

Patient registration rate, overall and specific.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vanbraband, J., Van Damme, N., Bouche, G. et al. Completeness and selection bias of a Belgian multidisciplinary, registration-based study on the EFFectiveness and quality of Endometrial Cancer Treatment (EFFECT). BMC Cancer 22, 600 (2022). https://doi.org/10.1186/s12885-022-09671-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12885-022-09671-5

Keywords

  • Corpus uteri cancer
  • Endometrial cancer
  • Cancer registration
  • Completeness
  • Selection bias
  • EFFECT

BMC Cancer

ISSN: 1471-2407

Contact us