Variation in guideline adherence in non-Hodgkin’s lymphoma care: impact of patient and hospital characteristics

Abstract

Background

The objective of this observational study was to assess the influence of patient, tumor, professional and hospital related characteristics on hospital variation concerning guideline adherence in non-Hodgkin’s lymphoma (NHL) care.

Methods

Validated, guideline-based quality indicators (QIs) were used as a tool to assess guideline adherence for NHL care. Multilevel logistic regression analyses were used to calculate variation between hospitals and to identify characteristics explaining this variation. Data for the QIs regarding diagnostics, therapy, follow-up and organization of care, together with patient, tumor and professional related characteristics were retrospectively collected from medical records; hospital characteristics were derived from questionnaires and publically available data.

Results

Data of 423 patients diagnosed with NHL between October 2010 and December 2011 were analyzed. Guideline adherence, as measured with the QIs, varied considerably between the 19 hospitals: >20 % variation was identified in all 20 QIs and high variation between the hospitals (>50 %) was seen in 12 QIs, most frequently in the treatment and follow-up domain.

Hospital variation in NHL care was associated more than once with the characteristics age, extranodal involvement, multidisciplinary consultation, tumor type, tumor aggressiveness, LDH level, therapy used, hospital region and availability of a PET-scanner.

Conclusion

Fifteen characteristics identified at the patient level and at the hospital level could partly explain hospital variation in guideline adherence for NHL care. Particularly age was an important determinant: elderly were less likely to receive care as measured in the QIs. The identification of determinants can be used to improve the quality of NHL care, for example, for standardizing multidisciplinary consultations in daily practice.

Background

Non-Hodgkin’s lymphoma (NHL) is the most common hematologic neoplasm worldwide, and affects over 300,000 people each year [1]. In the United States, NHL is the sixth most common cancer with an estimated number of almost 70,000 new cases in 2013 [2]. This heterogeneous group of malignant proliferations of lymphocytes consists of more than 40 disease entities. Approximately 50 % of the cases comprises the types diffuse large B-cell lymphoma (DLBCL) and follicular lymphoma [3].

Treatment of NHL is highly dependent on the type and stage of the tumor. Primary therapy options include chemotherapy, radiation therapy, immunotherapy and wait-and-see policy. More effective therapy options are emerging, partly due to many randomized controlled trials in this field. Despite these improvements, the five-year relative survival rate is still rather low for DLBCL patients (55–60 %), and for patients diagnosed with follicular lymphoma this is 74–86 % [4, 5].

The emerging diagnostic and therapy options require evidence-based guidelines to assist professionals and patients in their decision-making process for NHL care. These guidelines should be in line with the description of care of the Institute of Medicine (IOM): care should be safe, effective, patient-centered, timely, efficient and equitable [6]. However, previous studies showed variation in care for NHL patients based on discrepancies between daily practice and recommendations in guidelines [7–9]. Actual guideline adherence was assessed with quality indicators, defined as ‘measurable elements of practice performance for which there is evidence or consensus that they can assess the quality of the care provided’ [10]. The suboptimal adherence to guidelines in NHL patient management can be an indication of suboptimal quality of care and therefore may require tailored interventions, since quality of care does not improve by itself. In order to develop tailored improvement strategies, it is important to gain more insight into factors that influence guideline adherence in daily practice on patient and hospital level. In previous studies, determinants of NHL care focused on patient and tumor characteristics, such as age, tumor stage and co-morbidity score [7–9, 11, 12]. However, little is known about the possible influence of hospital factors. In other healthcare settings, patients’ age and diagnosis are often associated with guideline adherence [13–15], however, hospital factors (e.g. hospital size) seem important to consider as well [13, 16–19].

In the current study, we assessed hospital variation in guideline adherence in NHL care and to what extent these variations can be explained by differences on patient and hospital level. This report builds upon previous work where quality indicators were developed and measured to provide insight into guideline adherence for NHL care [9, 20]. Together with insight into variation in guideline adherence and accompanying determinants, tailored strategies to improve NHL care can be designed.

Methods

Study design and population

This observational study was performed using baseline measurements of the PEARL study (improvement of patients’ hospital care for non-Hodgkin’s lymphoma), a cluster randomized controlled trial (cRCT) to test and evaluate tailored strategies to improve hospital care for patients with NHL (registered at ClinicalTrial.gov: NCT01562509) [21].

The extent of hospital variation was assessed in 19 hospitals across three regions of the Netherlands (north, east and south), including university, teaching and non-teaching hospitals. Patients eligible for this study were defined as patients diagnosed with a mature B-, T- or NK-cell neoplasm between October 2010 and December 2011, and older than 18 years at diagnosis. Patients with cutaneous lymphomas or leukemia-type neoplasms were excluded. The Dutch cancer registry was used by the Netherlands Comprehensive Cancer Organisation (IKNL) to make a list of potentially eligible patients in the participating hospitals. For each hospital a random sample of 25–30 patients was selected for data collection.

Data collection

Quality indicators

Data were assessed using systematically developed and validated quality indicators (QIs), based on (inter)national evidence-based guidelines [9]. This set of 20 QIs was developed by professionals involved in NHL care and covers important processes and structures in management of NHL care in the domains diagnosis and staging, treatment and follow-up, and organization and coordination of care. In short, the QIs reflect quality of NHL care as described in guidelines. Trained registration employees, from the IKNL, collected data from medical records for the QIs using predefined registration forms. Room for improvement was defined if quality indicator scores were less than 90 % [9, 22–24].

Patient, tumor, professional and hospital related characteristics

The characteristics were selected because of their potential association with guideline adherence and quality of NHL care, based on prior research findings [9, 11, 12, 25]. Potentially relevant patient and tumor related characteristics were age (continuous), gender (male/female), co-morbidities (yes/no), performance status (good/bad, good indicating a WHO score <2 or Karnofsky score ≥60), patients’ preferences (yes/no objections), previous malignancies (yes/no), tumor aggressiveness (yes/no), extranodal involvement (yes/no, this term is used if the disease is not in the lymph nodes (extranodal) or has spread from lymph nodes to extranodal sites), Ann Arbor disease stage (I/II or III/IV), tumor type (yes/no DLBCL), International Prognostic Index (IPI) score (low/intermediate/high), lactate-dehydrogenase level (LDH, yes/no high level (>250 u/L)) and hemoglobin level (Hb, yes/no aberrant level (<7.5/8.5 or >10/11, females/males)). Factors related to professionals (dichotomous, yes/no) included multidisciplinary team consultation (MTC), discussion in pathology panel, in-hospital referral and therapy used (watch-and-wait was defined as ‘no therapy used’). Patient, tumor and professional related factors were all collected from medical records at patient level.

The hospital characteristics include type of hospital (yes/no teaching hospital), region of hospital (north/east/south), availability of an in-hospital pathology laboratory (yes/no) and PET-scanner (yes/no) and availability of professionals specialized in hematology, including a specialized oncology nurse (yes/no). Hospital characteristics were collected for each hospital from publically available data as well as from a short, digital questionnaire (multiple choice questions) sent to the contact person (oncologist or hematologist) at each hospital.

Statistical analysis

Quality indicator scores and hospital variation were calculated to provide insight into guideline adherence in NHL care, which gives an indication of the quality of care as delivered to NHL patients. Patient, tumor, professional and hospital related characteristics were described by calculating frequencies and means. Univariate analyses (X²-test and t-test) were performed to study correlations between the QI scores (dependent variables) and the selected characteristics (independent variables). Single correlations were only tested for QIs and characteristics if the link between the two factors is clinically explicable (e.g. radiology related QIs were not tested for pathology related characteristics, since these processes are independently performed from each other).

Multivariate logistic regression was performed to study correlations for those characteristics with P < 0.20 in univariate analyses. Correlations between the independent variables were also tested. If a correlation (>0.8) was detected, only one variable was included in the multivariate analyses.

Finally, multilevel logistic regression analysis was used to determine to what extent the QI scores were influenced by the characteristics [26]. Multivariate backwards regression models, including random coefficients, were constructed for each quality indicator. The reason for using this analysis was the hierarchical nature of the characteristics, as patients (level 1) were nested in hospitals (level 2). We considered P < 0.05 as statistically significant and calculated the explained variance (R²) per multilevel model with the Glimmix procedure using SAS software (SAS12.0 for Windows; SAS Institute, Cary, North Carolina, USA). Odds ratios (OR) were used to describe the association between the characteristics and quality indicator. An OR >1 indicates a positive association with the quality indicator (greater relative chance of guideline adherence if the determinant is present).

Ethics

On behalf of the research ethics committee (CMO) of the Radboud university medical center, we hereby let you know that the current study has been carried out in accordance with the applicable rules concerning the review of research ethics committees and informed consent (registration number 2011/560).

The IKNL has contracts with each Dutch Hospital about the Cancer Registry that all patients are informed about the registration and are registered unless the patient has objected to be registered. The Netherlands Cancer Registry is obliged to work according to the law about protection of privacy data and the law “Geneeskundige BehandelOvereenkomst”. All procedures to privacy of doctors and patients is fixed in regulations. An independent Committee of Privacy reassures that the Netherlands Cancer Registry works is compliant to these regulations. Based on this, consent of the patients for this specific study was not applicable; according to the Dutch law all cancer patients are included in the Netherlands Cancer Registry as maintained by the IKNL, unless the patient has objected to be registered.

Results

Patient, tumor and professional related characteristics

Table 1 shows the patient, tumor and professional related characteristics included in this study, measured at patient level. In total, data were collected for 423 patients diagnosed with NHL between 2010–2011 across 19 Dutch hospitals. The mean age of the patients was 66 years (range 22–94), 57 % was male and 61 % had at least one co-morbidity. Tumor related characteristics showed that 61 % had extranodal involvement, 60 % was diagnosed with an aggressive tumor and Ann Arbor stage III of IV was observed in 68 % of the patients. Professional related factors as discussion in a pathology panel and an MTC were performed in 33 and 41 % of the patients, respectively. Of the 423 patients in this study, 75 % received therapy, either chemotherapy, radiotherapy or a combination of these two, as initial treatment. Three factors were excluded from further analyses: performance status and IPI score because of too many missing values (respectively, 83 and 58 % missings) and patient preferences because of <10 % variation (only 6 % had objections concerning diagnostics or therapy).

Table 1 Patient related characteristics

Hospital characteristics

Table 2 outlines the characteristics of the participating hospitals, measured at hospital level. Of the 19 hospitals, 47 % was situated in the Northern region and 53 % comprised teaching hospitals. An in-hospital pathology laboratory was present in 47 % of the hospitals and 42 % had the availability of an in-hospital PET-scanner. Most hospitals (87 %) had a specialized pathologist, whereas 78 % had a specialized oncologist or hematologist and 47 % a specialized radiologist/nuclear physician. In 68 % of the hospitals a specialized oncology nurse was available. Two factors were excluded from further analyses because of high correlation with at least one other hospital characteristic: trial participation and hospital size.

Table 2 Hospital characteristics

Quality indicators

Guideline adherence in NHL care was measured with a set of 20 QIs, presented in Table 3. Room for improvement (<90 % adherence) was seen in 18 out of 20 QIs. Regarding diagnosis and staging, the indicator with the lowest score was performance of all staging techniques (QI4, 48 %) and the indicator with the highest score was diagnosis based on morphology and immune phenotype (QI3, 96 %). Indicators for treatment and follow-up showed a range of 62–82 %, including complete evaluation after chemotherapy (QI11) as lowest score and reporting dose reduction for chemotherapy RCHOP (QI13) as highest score. In the domain of organization and coordination, the lowest score was for complete pathology reports (QI16, 14 %) and the highest score for integrated reporting of pathology techniques (QI15, 89 %).

Table 3 Indicator scores and determinants for guideline adherence concerning NHL care

In all three domains, QI scores differed considerably between the 19 participating hospitals; variation in guideline adherence (>20 %) among the hospitals was noted in all 20 QIs. The lowest hospital variation was seen for QIs concerning diagnosis of NHL based on morphology and immune phenotype (QI3) and assessment of LDH level (QI6), respectively 26 % (range 74–100) and 30 % (range 70–100). High variation (>50 %) between the hospitals was seen in 12 of the 20 QIs, most frequently (N = 5) in the treatment and follow-up domain.

Determinants of guideline adherence in NHL care

Table 3 displays, per quality indicator, the determinants that significantly influence hospital variation concerning guideline adherence for NHL care. In multilevel modeling, 15 of the 22 characteristics were involved with variation in guideline adherence: 13 at patient level and 2 at hospital level. Several characteristics influenced hospital variation in only 1 quality indicator, including gender, co-morbidities, previous malignancies, referral to another specialist, presence of a pathology panel and PET-scanner.

Determinants associated with 2 to 5 quality indicators were extranodal involvement, MTC, DLBCL tumor type, tumor aggressiveness, LDH and Hb level, therapy used and hospital region. Of these 8 determinants, only therapy showed a clear direction of effect: patients receiving therapy were more likely to receive care as described in the guidelines, including Ann Arbor classification (QI2), performing all staging techniques (QI4) and assessment of IPI (QI5) and LDH level (QI6). The other determinants were both negatively (OR < 1) and positively (OR > 1) linked to guideline adherence. For example, patients discussed in an MTC were less likely to receive an LDH level assessment (QI6), whereas they were more likely to receive all staging techniques (QI4).

The main patient characteristic associated with guideline adherence was age (5 out of 20 quality indicators). In particular, older people were less likely to receive care as measured by the QIs, including correct diagnostic biopsy performance (QI1), Ann Arbor staging (QI2), performing all staging techniques (QI4), assessment of IPI risk factor (QI5), and receiving R-CHOP chemotherapy (QI12), compared to younger patients.

Hospital characteristics associated with QI scores in this dataset included hospital region and an in-hospital PET-scanner. Hospitals in region 2 showed more documentation of target lesions in radiology reports after therapy (QI10) and more complete reports therapy evaluations (QI11), whereas they showed less complete reports for pathology (QI16), compared to the other two regions. The availability of an in-hospital PET-scanner was positively associated with a multidisciplinary discussion of patients (QI17). Participation in trials and hospital size were not included in multivariate analysis, because of the high correlation with hospital type, and availability of an in-hospital pathology laboratory and PET-scanner.

Table 3 also shows the explained variance of the determinants included in the final multilevel model. A substantial part of the variation in guideline adherence can be explained by patient and/or hospital characteristics: ten QIs showed that determinants could explain the variation for at least 10 %. Variation regarding Ann Arbor staging (QI2), evaluation with CT-scans after therapy (QI11) and R-CHOP chemotherapy for DLBCL patients (QI12) showed relatively large explained variances of, respectively, 35, 30 and 26 %.

Discussion

This study demonstrated substantial hospital variation in guideline adherence for NHL care. Fifteen characteristics at the patient level could partly explain this variation, such as extranodal involvement, multidisciplinary consultation, tumor type, therapy used and hospital region. Hospital characteristics contributed less to the variation in adherence than patient, tumor and professional related characteristics. Patients’ age was involved most frequently as determinant, illustrating that older people are less likely to receive NHL care as described in the guidelines.

Our study showed large gaps between daily practice performance and care as described in the evidence-based guidelines. Large variation in guideline adherence between hospitals is often associated with lower quality of care, since guidelines aim to assist professionals to deliver the most optimal care. However, less adherence does not always indicate lower quality of care: complying with patient preferences or performing less diagnostics due to a low performance status can also point towards patient-centered, safe and deliberately delivered care. It is believed that variation due to deliberately deviate from guidelines is reflected in the upper 10 % of QI scores (90–100 %). Therefore, many studies indicate room for improvement if guideline adherence, as measured by indicators, is below 90 % [9, 22–24]. In our study, 18 out of 20 QIs showed room for improvement, of which 12 QIs demonstrated high hospital variation (>50 %), indicating other factors than patient preferences or performance status might play a role. Similar to our study, Weeks et al. [27] found high variation in NHL management decisions, for example in performing a PET-scan (range 38–95 %) or a bone marrow biopsy (range 21–99 %). Studies concerning other tumor types also showed variation in delivered care between hospitals [18, 28–31].

While this is the first study to investigate determinants at patient as well as hospital level for guideline adherence, and indirectly for the quality of care for NHL patients, other studies examining multilevel determinants have been carried out in several areas, including lung, prostate and (colo)rectal cancer [18, 29, 32–34]. Schroeck et al. [33] provided insight into adherence to QIs for prostate cancer and its regional variation. Most measures showed low adherence rates and high regional variation, for example 72 % variation in follow-up with radiation oncologists (range 14–86 %). They showed that characteristics such as age, clinical stage and number of urologists explained the differences for 5–20 %. Etzioni et al. [32] showed that characteristics as higher-volume surgeons and teaching hospitals contributed to long-term survival in rectal cancer patients, whereas Sacerdote et al. [34] found several social, clinical and hospital characteristics to be associated with the treatment of colorectal cancer, for example, age, gender, hospital volume and an in-hospital radiotherapy service. Mathoulin et al. [29] investigated the quality of colorectal cancer surgery and found several associations with patient, tumor and hospital related factors, such as age, disease stage and hospital type. Finally, Ouwens et al. [18] found patient characteristics to have a greater influence on quality of integrated care than professional or hospital characteristics for patients with non-small cell lung cancer.

Several determinants of guideline adherence and NHL care were found in our study as well. Regarding patient factors, especially patients’ age appeared to influence variation in guideline adherence for NHL care most. For older patients, it can be argued that suboptimal diagnostics and suboptimal but better tolerated therapies sometimes are the best achievable care. However, the reasons for deviation from the guideline should be well thought out and documented by the professionals, which may be influenced by available information for decision making, professionals’ choice or patient preferences. Unfortunately, we were not able to include arguments to deliberately deviate from guideline recommendations, since these are frequently not documented (in a standardized way) in medical records.

Previous studies found patients’ age as an important factor for delivered NHL care: they studied elderly DLBCL patients, defined as patients aged over 60 or 75 years [11, 12, 25]. Younger age and better performance status were associated with receiving CHOP-like chemotherapy. Van de Schans et al. [12] showed age as the only factor associated with receiving less than six cycles of CHOP-like chemotherapy (adjusted for variables as gender and co-morbidity). Concerning overall survival, all three studies concluded that optimal therapy for elderly was associated with better outcomes, after case-mix corrections [11, 12, 25]. After multivariate analyses, Trebouet et al. [35] found also a relation between treatment administration and improved survival in patients over 90 years of age with aggressive NHL. An important drawback of intensive chemotherapy is treatment related toxicity. The elderly are more susceptible to complications, which makes it even more important to accurately select patients for therapy [11]. They stated that elderly are more susceptible to develop complications, which makes it even more important to accurately select patients for therapy. The judgment of professionals must be underscored in this selection process. A possible option to optimize outcomes was proposed by Lin et al. [25]; they opted implementation of tailored interventions to improve the performance status of patients before the start of therapy. In addition, in other fields of oncology lower guideline adherence was seen for elderly as well [34, 36]. Suggested reasons for the lower rates were that elderly patients receive less diagnostics and/or therapy for medical reasons, such as higher burden of co-morbidities [34], or diagnosis of advanced disease stages [36], which was initially seen in our dataset as well (data not explicitly shown). However, co-morbidities and disease stage were included in our analyses and age remained a determinant in the final models.

Besides age, several other tumor and patient related determinants were involved in explaining hospital variation, including previous malignancies, LDH and Hb level, gender, co-morbidity, extranodal involvement, tumor type and tumor aggressiveness. Most of these aspects are common factors measured in NHL research concerning prognostic factors and survival analyses [11, 12, 25, 35]. Unfortunately, this literature shows involvement of the factors with survival in univariate analyses, but not in multivariate analyses. Tumor type and aggressiveness are often not assessed, since studies regularly select only DLBCL or aggressive tumors as subjects of interest [11, 25, 37]. Kuper-Hommel et al. [37, 38] investigated differences in therapy and outcome between patients with nodal and extranodal lymphomas in two large population-based studies. They showed that patients with extranodal lymphomas were less often optimally treated but did not find clear differences in overall survival. In our study, patients with extranodal involvement received less often all required staging techniques and showed more often dose reductions during R-CHOP chemotherapy or reductions without reporting the reason.

Not all determinants found seem directly relevant for clinical practice, such as the influence of the Hb level on QI18: pathology results have to be known before the start of treatment. A possible explanation could be that the urge of starting therapy is higher for patients with a aberrant Hb level and an aggressive tumor. It seems valuable to explore these determinants in other NHL populations.

Of the professional and hospital related determinants for hospital variation in NHL care, treatment is an important factor in relation to better survival, as discussed above. Factors as MTC, hospital region, in-hospital referral, PET-scanner and discussion in a pathology panel are often not taken into account in survival analyses. The possible relation of these factors with overall survival is an interesting issue to address in future research. Hospital region will probably be one of the most challenging determinants, since hospitals cannot move to another geographical region and regional collaborations are embedded, which might be tough to effect change upon. Nevertheless, guideline adherence and quality of care described per region can give valuable insight into regional differences concerning interpretation and rating of the guideline recommendations and provide possible points of interest for improving quality of care.

Strengths of this study are the large study sample (N = 423) derived from a population-based cancer registry and the validated guideline-based QIs used for the assessment of variation in guideline adherence for NHL care. These factors contribute to the reliability of our results. Another factor contributing to a reliable dataset is that trained registration employees of the IKNL collected the data independently of the project team. An additional strength of our study is that 2 levels of potential determinants were included, namely patient and hospital level. Multilevel analyses made it possible to include these factors in one regression model per quality indicator.

There are also some limitations that need to be addressed. First, characteristics at the level of professionals were not taken into account, since NHL care is provided by a multidisciplinary team of a hematologist and/or (radiation)oncologist, radiologist, nuclear physician, pathologist and oncology nurse. It was not possible to relate one professional to one patient, which is necessary for inclusion of characteristics at professional level. However, some professional related factors measured at patients level were included in our study, such as patients discussed in MTC and therapy used. Second, only two of eight hospital characteristics included for analyses were found to have significant impact in the final multilevel models. This can be caused by the limited sample size of 19 hospitals, indicating more hospitals may be needed for possible future research. Third, no hospitals from the Western part of the Netherlands were included in our study, which might have introduced some selection bias. However, we did include 19 of the 91 Dutch hospitals, including three different regions, representing 21 % of the Dutch hospital population. Last, a significant amount (>50 %) of data was missing for the parameters performance status and IPI score. One of the reasons for this could be that only official WHO scores and Karnofsky scores were collected, excluding general terms as ‘healthy man’ or ‘vital women’. Arguments for not calculating the IPI score included that therapy choices do not change for most patients based on the IPI score, except for patients participating in clinical trials.

Conclusion

In conclusion, this study showed considerable hospital variation in guideline adherence, as an indication for quality of delivered NHL care, including the domains diagnosis and staging, treatment and follow-up and organization and coordination of care. Our study demonstrated that patient characteristics appear to have more influence on guideline adherence than hospital characteristics, especially patients’ age. Tailored strategies to optimize NHL care should take into account the determinants identified in this study. Especially for older patients, reasons for not performing all necessary diagnostics and staging techniques should be a topic of interest, taking into account safe and patient-centered care as well.