Ranking hospitals on surgical mortality: the importance of reliability adjustment

Measuring Childbirth Outcomes Using Administrative and Birth Certificate Data

BACKGROUND

The number of pregnancy-related deaths and severe maternal complications continues to rise in the United States, and the quality of obstetrical care across U.S. hospitals is uneven. Providing hospitals with performance feedback may help reduce the rates of severe complications in mothers and their newborns. The aim of this study was to develop a risk-adjusted composite measure of severe maternal morbidity and severe newborn morbidity based on administrative and birth certificate data.

METHODS

This study was conducted using linked administrative data and birth certificate data from California. Hierarchical logistic regression prediction models for severe maternal morbidity and severe newborn morbidity were developed using 2011 data and validated using 2012 data. The composite metric was calculated using the geometric mean of the risk-standardized rates of severe maternal morbidity and severe newborn morbidity.

RESULTS

The study was based on 883,121 obstetric deliveries in 2011 and 2012. The rates of severe maternal morbidity and severe newborn morbidity were 1.53% and 3.67%, respectively. Both the severe maternal morbidity model and the severe newborn models exhibited acceptable levels of discrimination and calibration. Hospital risk-adjusted rates of severe maternal morbidity were poorly correlated with hospital rates of severe newborn morbidity (intraclass correlation coefficient, 0.016). Hospital rankings based on the composite measure exhibited moderate levels of agreement with hospital rankings based either on the maternal measure or the newborn measure (κ statistic 0.49 and 0.60, respectively.) However, 10% of hospitals classified as average using the composite measure had below-average maternal outcomes, and 20% of hospitals classified as average using the composite measure had below-average newborn outcomes.

CONCLUSIONS

Maternal and newborn outcomes should be jointly reported because hospital rates of maternal morbidity and newborn morbidity are poorly correlated. This can be done using a childbirth composite measure alongside separate measures of maternal and newborn outcomes.

Comparison of administrative data and the American College of Surgeons National Surgical Quality Improvement Program data in a New South Wales Hospital

BACKGROUND

The National Surgical Quality Improvement Program (NSQIP) is widely used in North America for benchmarking. In 2015, NSQIP was introduced to four New South Wales public hospitals. The aim of this study is to investigate the agreement between NSQIP and administrative data in the Australian setting; to compare the performance of models derived from each data set to predict 30-day outcomes.

METHODS

The NSQIP and administrative data variables were mapped to select variables available in both data sets where coding may be influenced by interpretation of the clinical information. These were compared for agreement. Logistic regression models were fitted to estimate the probability of adverse outcomes within 30 days. Models derived from NSQIP and administrative data were compared by receiver operating characteristic curve analysis.

RESULTS

A total of 2240 procedures over 21 months had matching records. Functional status demonstrated poor agreement (kappa 0.02): administrative data recorded only one (1%) patient with partial- or total-dependence as recorded by NSQIP data. The American Society of Anesthesiologists class demonstrated excellent agreement (kappa 0.91). Other perioperative variables demonstrated poor to fair agreement (kappa 0.12-0.61). Predictive model based on NSQIP data was excellent at predicting mortality but was less accurate for complications and readmissions. The NSQIP model was better in predicting mortality and complications (receiver operating characteristic curve 0.93 versus 0.87; P = 0.029 and 0.71 versus 0.64; P = 0.027).

CONCLUSIONS

There is poor agreement between NSQIP data and administrative data. Predictive models associated with NSQIP data were more accurate at predicting surgical outcomes than those from administrative data. To drive quality improvement in surgery, high-quality clinical data are required and we believe that NSQIP fulfils this function.

Variation in expenditure for common, high cost surgical procedures in a working age population: implications for reimbursement reform

BACKGROUND

In the move toward value-based care, bundled payments are believed to reduce waste and improve coordination. Some commercial insurers have addressed this through the use of bundled payment, the provision of one fee for all care associated with a given index procedure. This system was pioneered by Medicare, using a population generally over 65 years of age, and despite its adoption by mainstream insurers, little is known of bundled payments' ability to reduce variation or cost in a working-age population. This study uses a universally-insured, nationally-representative population of adults aged 18-65 to examine the effect of bundled payments for five high-cost surgical procedures which are known to vary widely in Medicare reimbursement: hip replacement, knee replacement, coronary artery bypass grafting (CABG), lumbar spinal fusion, and colectomy.

METHODS

Five procedures conducted on adults aged 18-65 were identified from the TRICARE database from 2011 to 2014. A 90-day period from index procedure was used to determine episodes of associated post-acute care. Data was sorted by Zip code into hospital referral regions (HRR). Payments were determined from TRICARE reimbursement records, they were subsequently price standardized and adjusted for patient and surgical characteristics. Variation was assessed by stratifying the HRR into quintiles by spending for each index procedure.

RESULTS

After adjusting for case mix, significant inter-quintile variation was observed for all procedures, with knee replacement showing the greatest variation in both index surgery (107%) and total cost of care (75%). Readmission was a driver of variation for colectomy and CABG, with absolute cost variation of $17,257 and $13,289 respectively. Other post-acute care spending was low overall (≤$1606, for CABG).

CONCLUSIONS

This study demonstrates significant regional variation in total spending for these procedures, but much lower spending for post-acute care than previously demonstrated by similar procedures in Medicare. Targeting post-acute care spending, a common approach taken by providers in bundled payment arrangements with Medicare, may be less fruitful in working aged populations.

Emergency department telemedicine consults decrease time to interpret computed tomography of the head in a multi-network cohort

INTRODUCTION

Telemedicine can improve access to emergency stroke care in rural areas, but the benefit of telemedicine across different types and models of telemedicine networks is unknown. The objectives of this study were to (a) identify the impact of telemedicine on emergency department (ED) stroke care, (b) identify if telemedicine impact varied by network and (c) describe the variation in process outcomes by telemedicine across EDs.

METHODS

A prospective cohort study identified stroke patients in four telemedicine networks between November 2015 and December 2017. Primary exposure was telemedicine consultation during ED evaluation. Outcomes included: (a) interpretation of computed tomography (CT) of the head within 45 minutes and (b) time to administer tissue plasminogen activator (tPA). An interaction term tested for differences in telemedicine effect on stroke care by network and hospital.

RESULTS

Of the 932 stroke subjects, 36% received telemedicine consults. For subjects with a last known well time within two hours of ED arrival (27.9%), recommended CT interpretation within 45 minutes was met for 66.8%. Telemedicine was associated with higher odds of timely head CT interpretation (adjusted odds ratio = 3.03; 95% confidence interval (CI) 1.69-5.46). The magnitude of the association between telemedicine and time to interpret a CT of the head differed between telemedicine networks (interaction term p = 0.033). Among eligible patients, telemedicine was associated with faster time to administer tPA (adjusted hazard ratio = 1.81; 95% CI 1.31-2.50).

DISCUSSION

Telemedicine consultation during the ED encounter decreased the time to interpret at CT of the head among stroke patients, with differing magnitudes of benefit across telemedicine networks. The effect of heterogeneity of telestroke affects across different networks should be explored in future analyses.

Variation in Utilization of Intensive Care for Pediatric Diabetic Ketoacidosis

OBJECTIVE

To examine the hospital-level variation in intensive care unit (ICU) utilization and quantify the relative contribution of patient and hospital characteristics versus individual hospital factors to the variation in ICU admission rates among pediatric hospitalizations with diabetic ketoacidosis (DKA).

METHODS

The Texas Inpatient Public Use Data File was used to identify hospitalizations of state residents aged 1 month to 19 years with a primary diagnosis of DKA between 2005 and 2014. Multilevel, mixed-effects logistic regression modeling was performed to examine the association of patient- and hospital-level factors with ICU admission. Risk and reliability adjustment was then performed to assess hospital-level variation in ICU utilization. Intraclass correlation coefficient was used to quantify variation in use of ICU attributable to individual hospitals. The association between adjusted rates of ICU admission and total hospital charges and length of stay was examined using linear regression.

RESULTS

Of the 23 585 DKA hospitalizations, 14 638 (62.1%) were admitted to ICU. On multilevel analysis, the odds of ICU admission progressively decreased with rising volume of DKA hospitalizations (adjusted odds ratio: 0.08 [highest vs lowest quartile]; 95% confidence interval [CI]: 0.03-0.24). The crude median (interquartile range [IQR]; range) of ICU admissions across hospitals was 82.6% (73%-90%; 11.1%-100%). The median (IQR) risk- and reliability-adjusted ICU admission rate was 81.0% (73.0%-86.9%), ranging from 11.2% to 94%. Following risk and reliability adjustment, the intraclass correlation coefficient was 0.005 (95% CI: 0.004-0.006). For each 10% increase in adjusted ICU admission rate, total hospital charges rose by 7% (95% CI: 3%-11%). There was no association between ICU admission rates and hospital length of stay.

CONCLUSION

Although high variation in ICU utilization was noted across hospitals among pediatric DKA hospitalizations, the proportion of variation attributable to individual hospitals was negligible, once adjusted for patient mix and hospital characteristics.

Hospital differences in mortality rates after hip fracture surgery in Denmark

Background

Thirty-day mortality after hip fracture is widely used when ranking hospital performance, but the reliability of such hospital ranking is seldom calculated. We aimed to quantify the variation in 30-day mortality across hospitals and to determine the hospital general contextual effect for understanding patient differences in 30-day mortality risk.

Methods

Patients aged ≥65 years with an incident hip fracture registered in the Danish Multidisciplinary Fracture Registry between 2007 and 2016 were identified (n=60,004). We estimated unadjusted and patient-mix adjusted risk of 30-day mortality in 32 hospitals. We performed a multilevel analysis of individual heterogeneity and discriminatory accuracy with patients nested within hospitals. We expressed the hospital general contextual effect by the median odds ratio (MOR), the area under the receiver operating characteristics curve and the variance partition coefficient (VPC).

Results

The overall 30-day mortality rate was 10%. Patient characteristics including high sociodemographic risk score, underweight, comorbidity, a subtrochanteric fracture, and living at a nursing home were strong predictors of 30-day mortality (area under the curve=0.728). The adjusted differences between hospital averages in 30-day mortality varied from 5% to 9% across the 32 hospitals, which correspond to a MOR of 1.18 (95% CI: 1.12-1.25). However, the hospital general context effect was low, as the VPC was below 1% and adding the hospital level to a single-level model with adjustment for patient-mix increased the area under the receiver operating characteristics curve by only 0.004 units.

Conclusions

Only minor hospital differences were found in 30-day mortality after hip fracture. Mortality after hip fracture needs to be lowered in Denmark but possible interventions should be patient oriented and universal rather than focused on specific hospitals.

Ranking hospital performance based on individual indicators: can we increase reliability by creating composite indicators?

BACKGROUND

Report cards on the health care system increasingly report provider-specific performance on indicators that measure the quality of health care delivered. A natural reaction to the publishing of hospital-specific performance on a given indicator is to create 'league tables' that rank hospitals according to their performance. However, many indicators have been shown to have low to moderate rankability, meaning that they cannot be used to accurately rank hospitals. Our objective was to define conditions for improving the ability to rank hospitals by combining several binary indicators with low to moderate rankability.

METHODS

Monte Carlo simulations to examine the rankability of composite ordinal indicators created by pooling three binary indicators with low to moderate rankability. We considered scenarios in which the prevalences of the three binary indicators were 0.05, 0.10, and 0.25 and the within-hospital correlation between these indicators varied between - 0.25 and 0.90.

RESULTS

Creation of an ordinal indicator with high rankability was possible when the three component binary indicators were strongly correlated with one another (the within-hospital correlation in indicators was at least 0.5). When the binary indicators were independent or weakly correlated with one another (the within-hospital correlation in indicators was less than 0.5), the rankability of the composite ordinal indicator was often less than at least one of its binary components. The rankability of the composite indicator was most affected by the rankability of the most prevalent indicator and the magnitude of the within-hospital correlation between the indicators.

CONCLUSIONS

Pooling highly-correlated binary indicators can result in a composite ordinal indicator with high rankability. Otherwise, the composite ordinal indicator may have lower rankability than some of its constituent components. It is recommended that binary indicators be combined to increase rankability only if they represent the same concept of quality of care.

Role of Hospital Volumes in Identifying Low-Performing and High-Performing Aortic and Mitral Valve Surgical Centers in the United States

Importance

Identifying high-performing surgical valve centers with the best surgical outcomes is challenging. Hospital surgical volume is a frequently used surrogate for outcomes. However, its ability to distinguish low-performing and high-performing hospitals remains unknown.

Objective

To examine the association of hospital procedure volume with hospital performance for aortic and mitral valve (MV) surgical procedures.

Design, Setting, and Participants

Within an all-payer nationally representative data set of inpatient hospitalizations, this study identified 682 unique hospitals performing surgical aortic valve replacement (SAVR) and MV replacement and repair with or without coronary artery bypass grafting (CABG) between 2007 and 2011. Procedural outcomes were further assessed for a 10-year period (2005-2014) to assess representativeness of study period.

Main Outcomes and Measures

In-hospital risk-standardized mortality rate (RSMR) calculated using hierarchical models and an empirical bayesian approach with volume-based shrinkage that allowed for reliability adjustment.

Results

At 682 US hospitals, 70 295 SAVR, 19 913 MV replacement, and 17 037 MV repair procedures were performed between 2007 and 2011, with a median annual volume of 43 (interquartile range [IQR], 23-76) SAVR, 13 (IQR, 6-22) MV replacement, and 9 (IQR, 4-19) MV repair procedures. Of 225 SAVR hospitals in the highest-volume tertile, 34.7% and 36.0% were in the highest-RSMR tertile for SAVR + CABG and isolated SAVR procedures, respectively, while 21.5% and 17.5% of the 228 SAVR hospitals in the lowest-volume tertile were in the lowest respective RSMR tertile. Similarly, 36.8% and 43.5% of hospitals in the highest tertile of volume for MV replacement and repair, respectively, were in the corresponding highest-RSMR tertile, and 17.4% and 11.2% of the low-volume hospitals were in the lowest-RSMR tertile for MV replacement and repair, respectively. There was limited correlation between outcomes for SAVR and MV procedures at an institution. If solely volume-based tertiles were used to categorize hospitals for quality, 44.7% of all valve hospitals would be misclassified (as either low performing or high performing) when assessing performance based on tertiles of RSMR.

Conclusions and Relevance

Hospital procedure volume alone frequently misclassifies hospital performance with regard to risk-standardized outcomes after aortic and MV surgical procedures. Valve surgery quality improvement endeavors should focus on a more comprehensive assessment that includes risk-adjusted outcomes rather than hospital volume alone.

Facility Variation in Local Staging of Rectal Adenocarcinoma and its Contribution to Underutilization of Neoadjuvant Therapy

BACKGROUND

Guidelines recommend neoadjuvant therapy (NT) for clinical stage II-III (locally advanced) rectal adenocarcinoma, but utilization remains suboptimal. The causes of NT omission remain poorly understood.

METHODS

The main outcomes in this study of patients with resected clinically non-metastatic rectal adenocarcinoma in the 2010-2015 National Cancer Database were local staging utilization in patients with non-metastatic tumors (i.e., undocumented clinical stage/pathologic stage I-III) and NT utilization for locally advanced tumors. Multivariable regression was used to examine predictors of these outcomes. Facility-specific risk- and reliability-adjusted local staging and NT rates were calculated. Positive margins and overall survival (OS) were examined as secondary outcomes.

RESULTS

Local staging was omitted in 7737/43,819 (17.7%) patients with clinically non-metastatic tumors and NT was omitted in 5199/31,632 (16.4%) patients with locally advanced tumors. NT was utilized in 24,826 (91.1%) locally advanced patients who had local staging vs. 1607 (36.6%) patients who did not; 2785 (53.6%) locally advanced patients with NT omitted also had local staging omitted. Treatment at facilities with lowest quintile local staging rates was associated with NT omission (relative risk 2.41, 95% confidence interval 2.11, 2.75). Adjusted facility local staging rates varied sixfold (16.1-98.0%), facility NT rates varied twofold (43.9-95.9%), and they were correlated (r = 0.58; P < 0.001). Local staging omission and NT omission were independently associated with positive margins and decreased OS.

CONCLUSIONS

Local staging omission is a common care process in over half of cases of omitted NT. These data emphasize the need for quality improvement efforts directed at providing facilities feedback about their local staging rates.

County-level Variation in Use of Surgery and Cancer-specific Survival for Stage I-II Pancreatic Adenocarcinoma

OBJECTIVE

The aim of the study was to describe county-level variation in use of surgery for stage I-II pancreatic ductal adenocarcinoma (PDAC) and the association between county surgery rates and cancer-specific survival (CSS).

BACKGROUND

The degree of small geographic area variation in use of surgery for stage I-II PDAC and the association between area surgery rates and CSS remain incompletely defined.

METHODS

This is a retrospective cohort study of patients aged 18 to 80 years in the 2007 to 2015 Surveillance, Epidemiology, and End Results database with stage I-II PDAC without contraindications to surgery or refusal. Multilevel models were used to characterize county-level variation in use of surgery and CSS. County-specific risk- and reliability-adjusted surgery rates and CSS rates were calculated.

RESULTS

Of 18,100 patients living in 581 counties, 10,944 (60.5%) underwent surgery. Adjusted county-specific surgery rates varied 1.5-fold from 49.9% to 74.6%. Median CSS increased in a graded fashion from 13 months [interquartile range (IQR) 13-14] in counties with surgery rates of 49.9% to 56.9% to 18 months (IQR 17-19) in counties with surgery rates of 68.0% to 74.6%. Results were similar in multivariable analyses. Adjusted county 18-month CSS rates varied 1.6-fold from 32.7% to 53.7%. Adjusted county surgery and 18-month CSS rates were correlated (r = 0.54; P < 0.001) and county surgery rates explained approximately half of county-level variation in CSS. Only 18 (3.1%) counties had adjusted surgery rates of 68.0% to 74.6%, which was associated with the longest CSS.

CONCLUSIONS

County-specific rates of surgery varied substantially, and patients living in areas with higher surgery rates lived longer. These data suggest that increasing use of surgery in stage I-II PDAC could lead to improvements in survival.

Surgeon-Level Variation in Utilization of Local Staging and Neoadjuvant Therapy for Stage II-III Rectal Adenocarcinoma

INTRODUCTION

Neoadjuvant therapy (NT) is the standard of care for clinical stage II-III rectal adenocarcinoma, but utilization remains suboptimal. We aimed to determine the underlying reasons for omission of local staging and NT.

METHODS

We conducted a retrospective study of patients with clinical stage II-III or undocumented clinical stage/pathologic stage II-III rectal adenocarcinoma who were treated in 2010-2016 in one of nine Intermountain Healthcare hospitals. The outcomes of omission of local staging and NT were examined with multivariable models. Risk- and reliability-adjusted rates of local staging and NT were calculated for surgeons who treated ≥ 3 patients. Pathologic and long-term outcomes were examined after excluding patients who were not resected or who underwent local excision (N = 11).

RESULTS

Local staging was omitted in 43/240 (17.9%) patients and NT was omitted in 41/240 (17.1%). The strongest risk factors for local staging and NT omission were upper rectal tumors and surgeons who treated ≤ 3 cases/year. Thirty-six of 41 (87.8%) cases of omitted NT had local staging omitted. Adjusted surgeon-specific local staging rates varied 1.6-fold (56.3-92.4%) and NT rates varied 2.8-fold (34.1-97.1%). Surgeon local staging and NT rates were strongly correlated (r = 0.92). NT was associated with lower rates of positive circumferential radial margins (7.9 vs. 20.0%; P = 0.02), node positivity (33.3 vs. 55.0%; P = 0.01), and local recurrences (7.6 vs. 14.9% at 5 years; P = 0.0176).

CONCLUSIONS

NT omission should be understood as a consequence of surgeon failure to perform local staging in most cases. Quality improvement efforts should focus on improving utilization of local staging.

Statewide Clinic Registries: The Michigan Surgical Quality Collaborative

Regional clinical registries provide a unique opportunity for shared learning and population-based analyses of the quality of surgical care. Through the "Michigan Model" of pay for participation in strategic Value Partnerships, exemplified by the Michigan Surgical Quality Collaborative (MSQC), the state's dominant private insurer, Blue Cross Blue Shield of Michigan, has sponsored 20 statewide clinical quality improvement collaboratives. MSQC represents a partnership among 73 Michigan hospitals with a robust data infrastructure and flexible platform for the promulgation of best practices in surgical quality improvement. This article will describe the organizational structure of the MSQC, the contributions the registry has made to quality improvement in colorectal surgery, and how future work will align to improve the reliability of improvement-relevant registry data.

Comparison of hospital surgical site infection rates and rankings using claims versus National Healthcare Safety Network surveillance data

National policies target healthcare-associated infections using medical claims and National Healthcare Safety Network surveillance data. We found low concordance between the 2 data sources in rates and rankings for surgical site infection following colon surgery in 155 hospitals, underscoring the limitations in evaluating hospital quality by claims data.

The relationship of hospital market concentration, costs, and quality for major surgical procedures

BACKGROUND

Our objective was to determine the association between indicators of surgical quality - incidence of major complications and failure-to-rescue - and hospital market concentration in light of differences in costs of care.

METHODS

Patients undergoing coronary artery bypass graft (CABG), colon resection, pancreatic resection, or liver resection in the 2008-2011 Nationwide Inpatient Sample were identified. The effect of hospital market concentration on major complications, failure-to-rescue, and inpatient costs was estimated at the lowest and highest mortality hospitals using multivariable regression techniques.

RESULTS

A weighted total of 527,459 patients were identified. Higher market concentration was associated with between 4% and 6% increased odds of failure-to-rescue across all four procedures. Across procedures, more concentrated markets had decreased inpatient costs (average marginal effect ranging from -$3064 (95% CI: -$5812 - -$316) for CABG to -$4876 (-$7773 - -$1980) for liver resection.

CONCLUSION

In less competitive (more concentrated) hospital markets, higher overall risk of failure-to-rescue after complications was accompanied by lower inpatient costs, on average. These data suggest that market controls may be leveraged to influence surgical quality and costs.

Association Between the New York Sepsis Care Mandate and In-Hospital Mortality for Pediatric Sepsis

IMPORTANCE

The death of a pediatric patient with sepsis motivated New York to mandate statewide sepsis treatment in 2013. The mandate included a 1-hour bundle of blood cultures, broad-spectrum antibiotics, and a 20-mL/kg intravenous fluid bolus. Whether completing the bundle elements within 1 hour improves outcomes is unclear.

OBJECTIVE

To determine the risk-adjusted association between completing the 1-hour pediatric sepsis bundle and individual bundle elements with in-hospital mortality.

DESIGN, SETTINGS, AND PARTICIPANTS

Statewide cohort study conducted from April 1, 2014, to December 31, 2016, in emergency departments, inpatient units, and intensive care units across New York State. A total of 1179 patients aged 18 years and younger with sepsis and septic shock reported to the New York State Department of Health who had a sepsis protocol initiated were included.

EXPOSURES

Completion of a 1-hour sepsis bundle within 1 hour compared with not completing the 1-hour sepsis bundle within 1 hour.

MAIN OUTCOMES AND MEASURES

Risk-adjusted in-hospital mortality.

RESULTS

Of 1179 patients with sepsis reported at 54 hospitals (mean [SD] age, 7.2 [6.2] years; male, 54.2%; previously healthy, 44.5%; diagnosed as having shock, 68.8%), 139 (11.8%) died. The entire sepsis bundle was completed in 1 hour in 294 patients (24.9%). Antibiotics were administered to 798 patients (67.7%), blood cultures were obtained in 740 patients (62.8%), and the fluid bolus was completed in 548 patients (46.5%) within 1 hour. Completion of the entire bundle within 1 hour was associated with lower risk-adjusted odds of in-hospital mortality (odds ratio [OR], 0.59 [95% CI, 0.38 to 0.93], P = .02; predicted risk difference [RD], 4.0% [95% CI, 0.9% to 7.0%]). However, completion of each individual bundle element within 1 hour was not significantly associated with lower risk-adjusted mortality (blood culture: OR, 0.73 [95% CI, 0.51 to 1.06], P = .10; RD, 2.6% [95% CI, -0.5% to 5.7%]; antibiotics: OR, 0.78 [95% CI, 0.55 to 1.12], P = .18; RD, 2.1% [95% CI, -1.1% to 5.2%], and fluid bolus: OR, 0.88 [95% CI, 0.56 to 1.37], P = .56; RD, 1.1% [95% CI, -2.6% to 4.8%]).

CONCLUSIONS AND RELEVANCE

In New York State following a mandate for sepsis care, completion of a sepsis bundle within 1 hour compared with not completing the 1-hour sepsis bundle within 1 hour was associated with lower risk-adjusted in-hospital mortality among patients with pediatric sepsis and septic shock.

Variation in prostate cancer treatment and spending among Medicare shared savings program accountable care organizations

BACKGROUND

Accountable care organizations (ACOs) have been shown to reduce prostate cancer treatment among men unlikely to benefit because of competing risks (ie, potential overtreatment). This study assessed whether the level of engagement in ACOs by urologists affected rates of treatment, overtreatment, and spending.

METHODS

A 20% sample of national Medicare data was used to identify men diagnosed with prostate cancer between 2012 and 2014. The extent of urologist engagement in an ACO, as measured by the proportion of patients in an ACO managed by an ACO-participating urologist, served as the exposure. The use of treatment, potential overtreatment (ie, treatment in men with a ≥75% risk of 10-year noncancer mortality), and average payments in the year after diagnosis for each ACO were modeled.

RESULTS

Among 2822 men with newly diagnosed prostate cancer, the median rates of treatment and potential overtreatment by an ACO were 71.3% (range, 23.6%-79.5%) and 53.6% (range, 12.4%-76.9%), respectively. Average Medicare payments among ACOs in the year after diagnosis ranged from $16,523.52 to $34,766.33. Stronger urologist-ACO engagement was not associated with treatment (odds ratio, 0.87; 95% confidence interval, 0.6-1.2; P = .4) or spending (9.7% decrease in spending; P = .08). However, urologist engagement was associated with a lower likelihood of potential overtreatment (odds ratio, 0.29; 95% confidence interval, 0.1-0.86; P = .03).

CONCLUSIONS

ACOs vary widely in treatment, potential overtreatment, and spending for prostate cancer. ACOs with stronger urologist engagement are less likely to treat men with a high risk of noncancer mortality, and this suggests that organizations that better engage specialists may be able to improve the value of specialty care. Cancer 2018. © 2018 American Cancer Society.

Predictors and variation of routine home discharge in critically ill adults with cystic fibrosis

BACKGROUND

The short-term outcomes of patients with cystic fibrosis (CF) surviving critical illness were not examined systematically.

OBJECTIVES

To determine the factors associated with and variation in rates of routine home discharge among ICU-managed adult CF patients.

METHODS

Predictors of routine home discharge and its hospital-level variation were examined in ICU-managed adults with cystic fibrosis in Texas during 2004-2013.

RESULTS

Older age, rural residence, and severity of illness decreased odds of routine home discharge, while hospitalization in facilities accredited as part of the Cystic Fibrosis Foundation Care Center Network nearly doubled the odds of routine home discharge. The median (interquartile) adjusted rate of routine home discharge was 62.0% (31.5-82.5).

CONCLUSIONS

The identified determinants of routine home discharge can inform clinical decision-making, while the demonstrated wide variation in adjusted across-hospital rates of routine home discharge of ICU-managed adults with CF can provide benchmark data for future quality improvement efforts.

The association between outcome-based quality indicators for intensive care units

Purpose

To assess and improve the effectiveness of ICU care, in-hospital mortality rates are often used as principal quality indicator for benchmarking purposes. Two other often used, easily quantifiable, quality indicators to assess the efficiency of ICU care are based on readmission to the ICU and ICU length of stay. Our aim was to examine whether there is an association between case-mix adjusted outcome-based quality indicators in the general ICU population as well as within specific subgroups.

Materials and methods

We included patients admitted in 2015 of all Dutch ICUs. We derived the standardized in-hospital mortality ratio (SMR); the standardized readmission ratio (SRR); and the standardized length of stay ratio (SLOSR). We expressed association through Pearson’s correlation coefficients.

Results

The SMR ranged from 0.6 to 1.5; the SRR ranged from 0.7 to 2.1; and the SLOSR ranged from 0.7 to 1.3. For the total ICU population we found no significant associations. We found a positive, non-significant, association between SMR and SLOSR for admissions with low-mortality risk, (r = 0.25; p = 0.024), and a negative association between these indicators for admissions with high-mortality risk (r = -0.49; p<0.001).

Conclusion

Overall, we found no association at ICU population level. Differential associations were found between performance on mortality and length of stay within different risk strata. We recommend users of quality information to take these three outcome indicators into account when benchmarking ICUs as they capture different aspects of ICU performance. Furthermore, we suggest to report quality indicators for patient subgroups.

Ranking hospitals: do we gain reliability by using composite rather than individual indicators?

Background

Despite widespread use of quality indicators, it remains unclear to what extent they can reliably distinguish hospitals on true differences in performance. Rankability measures what part of variation in performance reflects ‘true’ hospital differences in outcomes versus random noise.

Objective

This study sought to assess whether combining data into composites or including data from multiple years improves the reliability of ranking quality indicators for hospital care.

Methods

Using the Dutch National Medical Registration (2007–2012) for stroke, colorectal carcinoma, heart failure, acute myocardial infarction and total hiparthroplasty (THA)/ total knee arthroplasty (TKA) in osteoarthritis (OA), we calculated the rankability for in-hospital mortality, 30-day acute readmission and prolonged length of stay (LOS) for single years and 3-year periods and for a dichotomous and ordinal composite measure in which mortality, readmission and prolonged LOS were combined. Rankability, defined as (between-hospital variation/between-hospital+within hospital variation)×100% is classified as low (<50%), moderate (50%–75%) and high (>75%).

Results

Admissions from 555 053 patients treated in 95 hospitals were included. The rankability for mortality was generally low or moderate, varying from less than 1% for patients with OA undergoing THA/TKA in 2011 to 71% for stroke in 2010. Rankability for acute readmission was low, except for acute myocardial infarction in 2009 (51%) and 2012 (62%). Rankability for prolonged LOS was at least moderate. Combining multiple years improved rankability but still remained low in eight cases for both mortality and acute readmission. Combining the individual indicators into the dichotomous composite, all diagnoses had at least moderate rankability (range: 51%–96%). For the ordinal composite, only heart failure had low rankability (46% in 2008) (range: 46%–95%).

Conclusion

Combining multiple years or into multiple indicators results in more reliable ranking of hospitals, particularly compared with mortality and acute readmission in single years, thereby improving the ability to detect true hospital differences. The composite measures provide more information and more reliable rankings than combining multiple years of individual indicators.

Application of HARM Score to Measure Surgical Quality and Outcomes in Bariatric Patients

BACKGROUND

The HospitAl stay, Readmission, and Mortality rates (HARM) score is a quality indicator that is easily determined from routine administrative data. However, the HARM score has not yet been applied to patients undergoing bariatric surgery.

OBJECTIVE

The aims of the present study were to adjust the HARM score to the bariatric population and to validate the ability of the modified HARM score to serve as an inexpensive tool to measure the quality of bariatric surgery.

METHODS

A MBSAQIP 2015 PUF database was reviewed. For each discharge, a 1 to 10 score was calculated on the basis of length of stay (LOS), discharge status, and 30-day readmissions. We adjusted the LOS categories to the distribution of LOS in the MBSQIP database. The new LOS categories were used to calculate the modified HARM score, referred to as the BARiatric HARM (BAR-HARM) score. The association between HARM and BAR-HARM scores and complication rate was assessed.

RESULTS

A total of 197,141 cases were evaluated: 98.8% were elective and 1.2% were emergent admissions. The mean individual patient BAR-HARM score was 1.75 ± 1.04 for elective cases, and 2.02 ± 1.45 for emergency cases. The complication rates for the respective BAR-HARM categories ≤ 2, > 2 to 3, > 3 to 4, and > 4 were 3.95, 27.53, 40.14, and 79.97% (p < 0.001).

CONCLUSIONS

The quality of bariatric surgery can be reliably and validly assessed using the BAR-HARM score, which is a modification of the HARM score.

Should interventions to reduce variation in care quality target doctors or hospitals?

•

Performance management initiatives are increasingly targeting individual doctors as well as hospitals.

•

Less than 25% of variation in clinical outcomes is attributable to providers.

•

More variation in clinical outcomes is associated with doctors than with hospitals.

•

Performance estimates for individual doctors are unreliable due to small samples.

Interventions to reduce variation in care quality are increasingly targeted at both individual doctors and the organisations in which they work. Concerns remain about the scope and consequences for such performance management, the relative contribution of individuals and organisations to observed variation, and whether performance can be measured reliably.

This study explores these issues in the context of the English National Health Service by analysing comprehensive administrative data for all patients treated for four clinical conditions (acute myocardial infarction, hip fracture, pneumonia, ischemic stroke) and two surgical procedures (coronary artery bypass, hip replacement) during April 2010–February 2013. Performance indicators are defined as 30-day mortality, 28-day emergency readmission and inpatient length of stay. Three-level hierarchical generalised linear mixed models are estimated to attribute variation in case-mix adjusted indicators to individual doctors and hospital organisations.

Except for length of stay after hip replacement, no more than 11% of variation in case-mix adjusted performance indicators can be attributed to doctors and organisations with the rest reflecting random chance and unobserved patient factors. Doctor variation exceeds hospital variation by a factor of 1.2 or more. However, identifying poor performance amongst doctors is hampered by insufficient numbers of cases per doctor to reliably estimate their individual performances. Policy makers and regulators should therefore be cautious when targeting individual doctors in performance improvement initiatives.

Variability in invasive mediastinal staging for lung cancer: A multicenter regional study

OBJECTIVE

Prior studies have reported underuse of-but not variability in-invasive mediastinal staging in the pretreatment evaluation of patients with lung cancer. We sought to compare rates of invasive mediastinal staging for lung cancer across hospitals participating in a regional quality improvement and research collaborative.

METHODS

We conducted a retrospective study (2011-2013) of patients undergoing resected lung cancer from the Surgical Clinical Outcomes and Assessment Program in Washington State. Invasive mediastinal staging included mediastinoscopy and/or endobronchial/esophageal ultrasound-guided nodal aspiration. We used a mixed-effects model to mitigate the influence of small sample sizes at any 1 hospital on rates of invasive staging and to adjust for hospital-level differences in the frequency of clinical stage IA disease.

RESULTS

A total of 406 patients (mean age, 68 years; 69% clinical stage IA; and 67% lobectomy) underwent resection at 5 hospitals (4 community and 1 academic). Invasive staging occurred in 66% of patients (95% confidence interval [CI], 61%-71%). CI inspection revealed that 2 hospitals performed invasive staging significantly more often than the overall average (94%, [95% CI, 89%-96%] and 84% [95% CI, 78%-88%]), whereas 2 hospitals performed invasive staging significantly less often than overall average (31% [95% CI, 21%-44%] and 17% [95% CI, 7%-36%]).

CONCLUSIONS

Rates of invasive mediastinal staging varied significantly across hospitals providing surgical care for patients with lung cancer. Future studies that aim to understand the reasons underlying variability in care may inform quality improvement initiatives or lead to the development of novel staging algorithms.

Hospital Variation in Renal Replacement Therapy for Sepsis in the United States

OBJECTIVES

Acute renal replacement therapy in patients with sepsis has increased dramatically with substantial costs. However, the extent of variability in use across hospitals-and whether greater use is associated with better outcomes-is unknown.

DESIGN

Retrospective cohort study.

SETTING

Nationwide Inpatient Sample in 2011.

PATIENTS

Eighteen years old and older with sepsis and acute kidney injury admitted to hospitals sampled by the Nationwide Inpatient Sample in 2011.

INTERVENTIONS

We estimated the risk- and reliability-adjusted rate of acute renal replacement therapy use for patients with sepsis and acute kidney injury at each hospital. We examined the association between hospital-specific renal replacement therapy rate and in-hospital mortality and hospital costs after adjusting for patient and hospital characteristics.

MEASUREMENTS AND MAIN RESULTS

We identified 293,899 hospitalizations with sepsis and acute kidney injury at 440 hospitals, of which 6.4% (n = 18,885) received renal replacement therapy. After risk and reliability adjustment, the median hospital renal replacement therapy rate for patients with sepsis and acute kidney injury was 3.6% (interquartile range, 2.9-4.5%). However, hospitals in the top quintile of renal replacement therapy use had rates ranging from 4.8% to 13.4%. There was no significant association between hospital-specific renal replacement therapy rate and in-hospital mortality (odds ratio per 1% increase in renal replacement therapy rate: 1.03; 95% CI, 0.99-1.07; p = 0.10). Hospital costs were significantly higher with increasing renal replacement therapy rates (absolute cost increase per 1% increase in renal replacement therapy rate: $1,316; 95% CI, $157-$2,475; p = 0.03).

CONCLUSIONS

Use of renal replacement therapy in sepsis varied widely among nationally sampled hospitals without associated differences in mortality. Improving renal replacement standards for the initiation of therapy for sepsis may reduce healthcare costs without increasing mortality.

Variation in Postsepsis Readmission Patterns: A Cohort Study of Veterans Affairs Beneficiaries

RATIONALE

Rehospitalization is common after sepsis, but little is known about the variation in readmission patterns across patient groups and care locations.

OBJECTIVES

To examine the variation in postsepsis readmission rates and diagnoses by patient age, nursing facility use, admission year, and hospital among U.S. Veterans Affairs (VA) beneficiaries.

METHODS

Observational cohort study of VA beneficiaries who survived a sepsis hospitalization (2009-2011) at 114 VA hospitals, stratified by age (<65 vs. ≥65 yr), nursing home usage (none, chronic, or acute), year of admission (2009, 2010, 2011), and hospital. In the primary analysis, sepsis hospitalizations were identified using a previously validated method. Sensitivity analyses were performed using alternative definitions with explicit International Classification of Diseases, Ninth Revision, Clinical Modification, codes for sepsis, and separately for severe sepsis and septic shock.

MEASUREMENTS AND MAIN RESULTS

The primary outcomes were rate of 90-day all-cause hospital readmission after sepsis hospitalization and proportion of readmissions resulting from specific diagnoses, including the proportion of "potentially preventable" readmissions. Readmission diagnoses were similar from 2009 to 2011, with little variation in readmission rates across hospitals. The top six readmission diagnoses (heart failure, pneumonia, sepsis, urinary tract infection, acute renal failure, and chronic obstructive pulmonary disease) accounted for 30% of all readmissions. Although about one in five readmissions had a principal diagnosis for infection, 58% of all readmissions received early systemic antibiotics. Infection accounted for a greater proportion of readmissions among patients discharged to nursing facilities compared with patients discharged to home (25.0-27.1% vs. 16.8%) and among older vs. younger patients (22.2% vs. 15.8%). Potentially preventable readmissions accounted for a quarter of readmissions overall and were more common among older patients and patients discharged to nursing facilities.

CONCLUSIONS

Hospital readmission rates after sepsis were similar by site and admission year. Heart failure, pneumonia, sepsis, and urinary tract infection were common readmission diagnoses across all patient groups. Readmission for infection and potentially preventable diagnoses were more common in older patients and patients discharged to nursing facilities.

[Do laymen understand information about hospital quality? An empirical verification using risk-adjusted mortality rates as an example]

INTRODUCTION

The effect of public reporting to improve quality in healthcare is reduced by the limited intelligibility of information about the quality of healthcare providers. This may result in worse health-related choices especially for older people and those with lower levels of education. There is, as yet, little information as to whether laymen understand the concepts behind quality comparisons and if this comprehension is correlated with hospital choices.

METHODS

An instrument with 20 items was developed to analyze the intelligibility of five technical terms which were used in German hospital report cards to explain risk-adjusted death rates. Two online presentations of risk-adjusted death rates for five hospitals in the style of hospital report cards were developed. An online survey of 353 volunteers tested the comprehension of the risk-adjusted mortality rates and included an experimental hospital choice.

RESULTS

The intelligibility of five technical terms was tested: risk-adjusted, actual and expected death rate, reference range and national average. The percentages of correct answers for the five technical terms were in the range of 75.0-60.2%. Between 23.8% and 5.1% of the respondents were not able to answer the question about the technical term itself. The least comprehensible technical terms were "risk-adjusted death rate" and "reference range". The intelligibility of the 20 items that were used to test the comprehension of the risk-adjusted mortality was between 89.5% and 14.2%. The two items that proved to be least comprehensible were related to the technical terms "risk-adjusted death rate" and "reference range". For all five technical terms it was found that a better comprehension correlated significantly with better hospital choices.

DISCUSSION

We found a better than average intelligibility for the technical terms "actual and expected death rate" and for "national average". The least understandable were "risk-adjusted death rate" and "reference range". Since the self-explanatory technical terms "actual and expected death rate" and "national average" are easy to understand and the comprehension is correlated with hospitals choices, we recommend using them for the presentation of measures which contain risk-adjusted mortality. The technical terms "risk-adjusted death rate" and "reference range" should stay in the background, since comprehension problems can be expected and explanations would have to be provided.

Surgical Treatment for Early Small Cell Lung Cancer: Variability in Practice and Impact on Survival

BACKGROUND

Surgical resection with lobectomy is recommended for T1/T2 N0 small cell lung cancer (SCLC) patients after negative mediastinal staging. We sought to characterize variation in surgical therapy for early SCLC and determine the effect of a hospital's practice patterns on patient survival.

METHODS

The National Cancer Database was examined from 2004 to 2013. Risk- and reliability-adjusted hierarchical logistic regression was used to estimate the adjusted odds of resection by hospital. Hospitals were then grouped into quartiles by observed-to-expected rates of surgical treatment. Patient, tumor, and hospital characteristics were compared across quartiles. Kaplan-Meier plots and Cox proportional hazard models were built to compare patient survival as a function of a hospital's tendency to use surgical intervention.

RESULTS

We identified 5,079 patients with T1/T2 N0 SCLC in 317 hospitals, and 1,260 underwent resection. Analysis after adjusting for demographic, comorbidity, and tumor factors showed patients treated at hospitals in the highest quartile of surgical use were 17 times more likely to undergo surgical resection than those in the lowest quartile (44.8% vs 7.6%; odds ratio, 16.7l; 95% confidence interval, 12.59 to 22.18). Hospitals in the highest quartile were more likely to be academic centers (48% vs 21%), more likely to perform lobectomy (28.3% vs 5.0%), and treated more mixed-histology tumors (11.1% vs 4.5%). Survival was significantly longer for patients treated at hospitals most likely to use surgical therapy (median, 25.3 vs. 18.8 months; p < 0.0001). Hazard ratio differences in mortality persisted in multivariate Cox models (hazard ratio, 0.80; 95% confidence interval, 0.72 to 0.89; p < 0.0001).

CONCLUSIONS

Large variation exists in the use of surgical therapy for early SCLC in the United States, which may represent a significant quality improvement opportunity for patients with early SCLC.

Reoperation and Medicare Expenditures After Laparoscopic Gastric Band Surgery

Importance

Following the US Food and Drug Administration approval for laparoscopic gastric band surgery in 2001, as many as 96 000 devices have been placed annually. The reported rates of reoperation range from 4% to 60% in short-term studies; however, to our knowledge, few long-term population-level data on outcomes or expenditures are known.

Objective

To describe the rate of device-related reoperations occurring after laparoscopic gastric band surgery as well as the associated payments in a longitudinal national cohort.

Design, Settings, and Participants

This retrospective review of 25 042 Medicare beneficiaries who underwent gastric band placement between 2006 and 2013 identifies gastric band-related reoperations, including device removal, device replacement, or revision to a different bariatric procedure (eg, a gastric bypass or sleeve gastrectomy). The rates of reoperation were risk adjusted using a multivariable logistic regression model that included patient age, sex, race/ethnicity, Elixhauser comorbidities, and the year that the operation was performed.

Main Outcomes and Measures

Rate of device-related reoperation nationally and across individual hospital referral regions. Thirty-day total episode Medicare payments to hospitals for the index operation and any subsequent reoperations.

Results

Of the 25 042 patients who underwent gastric band placement, 20 687 (82.61%) were white, 18 143 (72.45%) were women, and the mean age was 57.56 years. Patients (mean age, 57.5; 76.2% women) requiring reoperation had lower rates of hypertension (64.9% vs 73.4%; P < .001) and diabetes (40.4% vs 44.6%; P < .001) and were more likely to have their index operation at a for-profit hospital (34.6% vs 22.0%; P < .001). With an average of 4.5-year follow-up, 4636 patients (18.5%) underwent 17 539 reoperations (an average of 3.8 procedures/patient). Hospital referral regions demonstrated a 2.9-fold variation in risk- and reliability-adjusted rates of reoperation (lower quartile average, 13.3%; upper quartile average, 39.1%). During the study period, Medicare paid $470 million for laparoscopic gastric band associated procedures, of which $224 million (47.6%) of the payments were for reoperations. From 2006 to 2013, the proportion of payments from Medicare for reoperations increased from 16.4% to 77.3% of their annual spending on the gastric band device.

Conclusions and Relevance

Among Medicare beneficiaries undergoing gastric band surgery, device-related reoperation was common, costly, and varied widely across hospital referral regions. These findings suggest that payers should reconsider their coverage of the gastric band device.

Variation in Outcomes at Bariatric Surgery Centers of Excellence

Importance

In the United States, reports about perioperative complications associated with bariatric surgery led to the establishment of accreditation criteria for bariatric centers of excellence and many bariatric centers obtaining accreditation. Currently, most bariatric procedures occur at these centers, but to what extent they uniformly provide high-quality care remains unknown.

Objective

To describe the variation in surgical outcomes across bariatric centers of excellence and the geographic availability of high-quality centers.

Design, Setting, and Participants

This retrospective review analyzed the claims data of 145 527 patients who underwent bariatric surgery at bariatric centers of excellence between January 1, 2010, and December 31, 2013. Data were obtained from the Healthcare Cost and Utilization Project's State Inpatient Database. This database included unique hospital identification numbers in 12 states (Arkansas, Arizona, Florida, Iowa, Massachusetts, Maryland, North Carolina, Nebraska, New Jersey, New York, Washington, and Wisconsin), allowing comparisons among 165 centers of excellence located in those states. Participants were identified using International Classification of Diseases, Ninth Revision, Clinical Modification codes. Those included in the study cohort were patients with a primary diagnosis of morbid obesity and who underwent laparoscopic Roux-en-Y gastric bypass, open Roux-en-Y gastric bypass, laparoscopic gastric band placement, or laparoscopic sleeve gastrectomy. Excluded from the cohort were patients younger than 18 years or who had an abdominal malignant neoplasm. Data were analyzed July 1, 2016, through January 10, 2017.

Main Outcomes and Measures

Risk-adjusted and reliability-adjusted serious complication rates within 30 days of the index operation were calculated for each center. Centers were stratified by geographic location and operative volume.

Results

In this analysis of claims data from 145 527 patients, wide variation in quality was found across 165 bariatric centers of excellence, both nationwide and statewide. At the national level, the risk-adjusted and reliability-adjusted serious complication rates at each center varied 17-fold, ranging from 0.6% to 10.3%. At the state level, variation ranged from 2.1-fold (Wisconsin decile range, 1.5%-3.3%) to 9.5-fold (Nebraska decile range, 1.0%-10.3%). After dividing hospitals into quintiles of quality on the basis of their adjusted complication rates, 38 of 132 (28.8%) had a center in a higher quintile of quality located within the same hospital service area. Variation in rates of complications existed at centers with low volume (annual mean [SD] procedure volume, 156 [20] patients; complication range, 0.6%-6.4%; 9.8-fold variation), medium volume (annual mean [SD] procedure volume, 239 [27] patients; complication range, 0.6%-10.3%; 17.5-fold variation), and high volume (annual mean [SD] procedure volume, 448 [131] patients; complication range, 0.6%-4.9%; 7.5-fold variation).

Conclusions and Relevance

Even among accredited bariatric surgery centers, wide variation exists in rates of postoperative serious complications across geographic location and operative volumes. Given that a large proportion of centers are geographically located near higher-performing centers, opportunities for improvement through regional collaboratives or selective referral should be considered.

Does early return to theatre add value to rates of revision at 3 years in assessing surgeon performance for elective hip and knee arthroplasty? National observational study

BACKGROUND

Joint replacement revision is the most widely used long-term outcome measure in elective hip and knee surgery. Return to theatre (RTT) has been proposed as an additional outcome measure, but how it compares with revision in its statistical performance is unknown.

METHODS

National hospital administrative data for England were used to compare RTT at 90 days (RTT90) with revision rates within 3 years by surgeon. Standard power calculations were run for different scenarios. Funnel plots were used to count the number of surgeons with unusually high or low rates.

RESULTS

From 2006 to 2011, there were 297 650 hip replacements (HRs) among 2952 surgeons and 341 226 knee replacements (KRs) among 2343 surgeons. RTT90 rates were 2.1% for HR and 1.5% for KR; 3-year revision rates were 2.1% for HR and 2.2% for KR. Statistical power to detect surgeons with poor performance on either metric was particularly low for surgeons performing 50 cases per year for the 5 years. The correlation between the risk-adjusted surgeon-level rates for the two outcomes was +0.51 for HR and +0.20 for KR, both p<0.001. There was little agreement between the measures regarding which surgeons had significantly high or low rates.

CONCLUSION

RTT90 appears to provide useful and complementary information on surgeon performance and should be considered alongside revision rates, but low case loads considerably reduce the power to detect unusual performance on either metric.

Cancer Center Volume and Type Impact Stage-Specific Utilization of Neoadjuvant Therapy in Rectal Cancer

BACKGROUND

Neoadjuvant chemoradiation reduces local recurrence in locally advanced rectal cancer, and adherence to national and societal recommendations remains unknown.

OBJECTIVE

To determine variability in guideline adherence in rectal cancer treatment and investigate whether hospital volume correlated with variability seen.

DESIGN

We performed a retrospective analysis using the National Cancer Database rectal cancer participant user files from 2005 to 2010. Stage-specific predictors of neoadjuvant chemotherapy and radiation use were determined, and variation in use across hospitals analyzed. Hospitals were ranked based on likelihood of preoperative therapy use by stage, and observed-to-expected ratios for neoadjuvant therapy use calculated. Hospital outliers were identified, and their center characteristics compared.

RESULTS

A total of 23,488 patients were identified at 1183 hospitals. There was substantial variability in the use of neoadjuvant chemoradiation across hospitals. Patients managed outside clinical guidelines for both stage 1 and stage 3 disease tended to receive treatment at lower-volume, community cancer centers.

CONCLUSIONS

There is substantial variability in adherence to national guidelines in the use of neoadjuvant chemoradiation for rectal cancer across all stages. Both hospital volume and center type are associated with over-treatment of early-stage tumors and under-treatment of more invasive tumors. These findings identify a clear need for national quality improvement efforts in the treatment of rectal cancer.

Severe Maternal Morbidity Among Hispanic Women in New York City: Investigation of Health Disparities

OBJECTIVE

To investigate differences in severe maternal morbidity between Hispanic mothers and three major Hispanic subgroups compared with non-Hispanic white mothers and the extent to which differences in delivery hospitals may contribute to excess morbidity among Hispanic mothers.

METHODS

We conducted a population-based cross-sectional study using linked 2011-2013 New York City discharge and birth certificate data sets (n=353,773). Rates of severe maternal morbidity were calculated using a published algorithm based on diagnosis and procedure codes. Mixed-effects logistic regression with a random hospital-specific intercept was used to generate risk-standardized severe maternal morbidity rates for each hospital taking into consideration patient sociodemographic characteristics and comorbidities. Differences in the distribution of Hispanic and non-Hispanic white deliveries were assessed among these hospitals in relation to their risk-adjusted morbidity. Sensitivity analyses were conducted after excluding isolated blood transfusion from the morbidity composite.

RESULTS

Severe maternal morbidity occurred in 4,541 deliveries and was higher among Hispanic than non-Hispanic white women (2.7% compared with 1.5%, P<.001); this rate was 2.9% among those who were Puerto Rican, 2.7% among those who were foreign-born Dominican, and 3.3% among those who were foreign-born Mexican. After adjustment for patient characteristics, the risk remained elevated for Hispanic women (odds ratio [OR] 1.42, 95% confidence interval [CI] 1.22-1.66) and for all three subgroups compared with non-Hispanic white women (P<.001). Risk for Hispanic women was attenuated in sensitivity analyses (OR 1.17, 95% CI 1.02-1.33). Risk-standardized morbidity across hospitals varied sixfold. We estimate that Hispanic-non-Hispanic white differences in delivery location may contribute up to 37% of the ethnic disparity in severe maternal morbidity rates in New York City hospitals.

CONCLUSION

Hispanic compared with non-Hispanic white mothers are more likely to deliver at hospitals with higher risk-adjusted severe maternal morbidity rates and these differences in site of delivery may contribute to excess morbidity among Hispanic mothers. Our results suggest improving quality at the lowest performing hospitals could benefit both non-Hispanic white and Hispanic women and reduce ethnic disparities in severe maternal morbidity rates.

Hospital Quality and Medicare Expenditures for Bariatric Surgery in the United States

OBJECTIVE

To examine the relationship between hospital outcomes and expenditures in patients undergoing bariatric surgery in the United States.

BACKGROUND

As one of the most common surgical procedures in the United States, bariatric surgery is a major focus of policy reforms aimed at reducing surgical costs. These policy mechanisms have made it imperative to understand the potential cost savings of quality-improvement initiatives.

METHODS

We performed a retrospective review of 38,374 Medicare beneficiaries undergoing bariatric surgery between 2011 and 2013. We ranked hospitals into quintiles by their risk and reliability-adjusted postoperative serious complications. We then examined the relationship between upper and lower outcome quintiles with risk-adjusted total episode payments. Additionally, we stratified patients by their risk (low, medium, high) of developing a complication to understand how this impacted payment.

RESULTS

We found a strong correlation between hospital complication rates and episode payments. For example, hospitals in the lowest quintile of complication rates had average total episode payments that were $1321 per patient less than hospitals in the highest quintile ($11,112 vs $12,433; P < 0.005). Cost savings was more prominent amongst high-risk patients where the difference of total episode payments per patient between lowest and highest quintile hospitals was $2160 ($12,960 vs $15,120; P < 0.005). In addition to total episode payment savings, hospitals with the lowest complication rates also had decreased costs for index hospitalization, readmissions, physician services, and postdischarge ancillary care compared with hospitals with the highest complication rates.

CONCLUSIONS

Medicare payments for bariatric surgery are significantly lower at hospitals with low complication rates. These findings suggest that efforts to improve bariatric surgical quality may ultimately help reduce costs. Additionally, these cost savings may be most prominent amongst the patients at the highest risk for complications.

Cost comparison of laparoscopic colectomy versus open colectomy in colon cancer

BACKGROUND

Laparoscopic colectomy has been shown to be safe, oncologically comparable, and clinically beneficial over open colectomy for colon cancer, but utilization remains low. Objectives To evaluate the cost of laparoscopic colectomy vs open colectomy for colon cancer.

METHODS

The authors conducted a retrospective claims data analysis using the 2012 and 2013 Truven Health Analytics MarketScan Commercial Claims and Encounter Database. The denominator population consisted of individuals who had commercial insurance coverage in all months of 2012 and >1 month in 2013 and pharmacy coverage throughout eligibility. The study population included individuals aged 18-64 years who were identified with colon cancer in 2013 and underwent an elective inpatient open colectomy or laparoscopic colectomy between January and November 2013. The cost and re-admission rate of open vs laparoscopic colectomy were compared after risk, adjusting for comorbidities, demographics, and geographic region.

RESULTS

During the study period, 1299 elective inpatient colon cancer colectomies were performed (open, n = 558; laparoscopic, n = 741). After risk adjustment, the laparoscopic vs open group was shown to have lower re-admission rates (6.61 and 10.93 per 100 cases, respectively, p = .0165), lower average re-admission costs ($1676 and $3151, respectively, p = .0309), and lower 30-day post-discharge healthcare utilization costs ($4842 and $7121, respectively, p = .0047). Average allowed cost for the combined inpatient and 30-day post-discharge period was lower for laparoscopic vs open colectomy cases ($36,395 and $44,226, respectively, p < .001).

CONCLUSIONS

The cost of laparoscopic colectomy was found to be statistically significantly less than that of open colectomy in patients undergoing elective surgery for colon cancer.

Time to Treatment and Mortality during Mandated Emergency Care for Sepsis

BACKGROUND

In 2013, New York began requiring hospitals to follow protocols for the early identification and treatment of sepsis. However, there is controversy about whether more rapid treatment of sepsis improves outcomes in patients.

METHODS

We studied data from patients with sepsis and septic shock that were reported to the New York State Department of Health from April 1, 2014, to June 30, 2016. Patients had a sepsis protocol initiated within 6 hours after arrival in the emergency department and had all items in a 3-hour bundle of care for patients with sepsis (i.e., blood cultures, broad-spectrum antibiotic agents, and lactate measurement) completed within 12 hours. Multilevel models were used to assess the associations between the time until completion of the 3-hour bundle and risk-adjusted mortality. We also examined the times to the administration of antibiotics and to the completion of an initial bolus of intravenous fluid.

RESULTS

Among 49,331 patients at 149 hospitals, 40,696 (82.5%) had the 3-hour bundle completed within 3 hours. The median time to completion of the 3-hour bundle was 1.30 hours (interquartile range, 0.65 to 2.35), the median time to the administration of antibiotics was 0.95 hours (interquartile range, 0.35 to 1.95), and the median time to completion of the fluid bolus was 2.56 hours (interquartile range, 1.33 to 4.20). Among patients who had the 3-hour bundle completed within 12 hours, a longer time to the completion of the bundle was associated with higher risk-adjusted in-hospital mortality (odds ratio, 1.04 per hour; 95% confidence interval [CI], 1.02 to 1.05; P<0.001), as was a longer time to the administration of antibiotics (odds ratio, 1.04 per hour; 95% CI, 1.03 to 1.06; P<0.001) but not a longer time to the completion of a bolus of intravenous fluids (odds ratio, 1.01 per hour; 95% CI, 0.99 to 1.02; P=0.21).

CONCLUSIONS

More rapid completion of a 3-hour bundle of sepsis care and rapid administration of antibiotics, but not rapid completion of an initial bolus of intravenous fluids, were associated with lower risk-adjusted in-hospital mortality. (Funded by the National Institutes of Health and others.).

Variations in survival after cardiac arrest among academic medical center-affiliated hospitals

Background

Variation exists in cardiac arrest (CA) survival among institutions. We sought to determine institutional-level characteristics of academic medical centers (AMCs) associated with CA survival.

Methods

We examined discharge data from AMCs participating with Vizient clinical database–resource manager. We identified cases using ICD-9 diagnosis code 427.5 (CA) or procedure code 99.60 (CPR). We estimated hospital-specific risk-standardized survival rates (RSSRs) using mixed effects logistic regression, adjusting for individual mortality risk. Institutional and community characteristics of AMCs with higher than average survival were compared with those with lower survival.

Results

We analyzed data on 3,686,296 discharges in 2012, of which 33,700 (0.91%) included a CA diagnosis. Overall survival was 42.3% (95% CI 41.8–42.9) with median institutional RSSR of 42.6% (IQR 35.7–51.0; Min-Max 19.4–101.6). We identified 28 AMCs with above average survival (median RSSR 61.8%) and 20 AMCs with below average survival (median RSSR 26.8%). Compared to AMCs with below average survival, those with high CA survival had higher CA volume (median 262 vs.119 discharges, p = 0.002), total beds (722 vs. 452, p = 0.02), and annual surgical volume (24,939 vs. 13,109, p<0.001), more likely to offer cardiac catheterization (100% vs. 72%, p = 0.007) or cardiac surgery (93% vs. 61%, p = 0.02) and cared for catchment areas with higher household income ($61,922 vs. $49,104, p = 0.004) and lower poverty rates (14.6% vs. 17.3%, p = 0.03).

Conclusion

Using discharge data from Vizient, we showed AMCs with higher CA and surgical case volume, cardiac catheterization and cardiac surgery facilities, and catchment areas with higher socioeconomic status had higher risk-standardized CA survival.

Hospital Analgesia Practices and Patient-reported Pain After Colorectal Resection

OBJECTIVE

The aim of the study was to characterize patient-reported outcomes of analgesia practices in a population-based surgical collaborative.

BACKGROUND

Pain control among hospitalized patients is a national priority and effective multimodal pain management is an essential component of postoperative recovery, but there is little understanding of the degree of variation in analgesia practice and patient-reported pain between hospitals.

METHODS

We evaluated patient-reported pain scores after colorectal operations in 52 hospitals in a state-wide collaborative. We stratified hospitals by quartiles of average pain scores, identified hospital characteristics, pain management practices, and clinical outcomes associated with highest and lowest case-mix-adjusted pain scores, and compared against Hospital Consumer Assessment of Healthcare Providers and Systems pain management metrics.

RESULTS

Hospitals with the lowest pain scores were larger (503 vs 452 beds; P < 0.001), higher volume (196 vs 112; P = 0.005), and performed more laparoscopy (37.7% vs 27.2%; P < 0.001) than those with highest scores. Their patients were more likely to receive local anesthesia (31.1% vs 12.9%; P < 0.001), nonsteroidal anti-inflammatory drugs (33.5% vs 14.4%; P < 0.001), and patient-controlled analgesia (56.5% vs 22.8%; P < 0.001). Adverse postoperative outcomes were less common in hospitals with lowest pain scores, including complications (20.3% vs 26.4%; P < 0.001), emergency department visits (8.2% vs 15.8%; P < 0.001), and readmissions (11.3% vs 16.2%; P = 0.01).

CONCLUSIONS

Pain management after colorectal surgery varies widely and predicts significant differences in patient-reported pain and clinical outcomes. Enhanced postoperative pain management requires dissemination of multimodal analgesia practices. Attention to patient-reported outcomes often omitted from surgical outcomes registries is essential to improving quality from the patient's perspective.

On-demand Reporting of Risk-adjusted and Smoothed Rates for Quality Profiling in ACS NSQIP

BACKGROUND

Surgical quality improvement depends on hospitals having accurate and timely information about comparative performance. Profiling accuracy is improved by risk adjustment and shrinkage adjustment to stabilize estimates. These adjustments are included in ACS NSQIP reports, where hospital odds ratios (OR) are estimated using hierarchical models built on contemporaneous data. However, the timeliness of feedback remains an issue.

STUDY DESIGN

We describe an alternative, nonhierarchical approach, which yields risk- and shrinkage-adjusted rates. In contrast to our "Traditional" NSQIP method, this approach uses preexisting equations, built on historical data, which permits hospitals to have near immediate access to profiling results. We compared our traditional method to this new "on-demand" approach with respect to outlier determinations, kappa statistics, and correlations between logged OR and standardized rates, for 12 models (4 surgical groups by 3 outcomes).

RESULTS

When both methods used the same contemporaneous data, there were similar numbers of hospital outliers and correlations between logged OR and standardized rates were high. However, larger differences were observed when the effect of contemporaneous versus historical data was added to differences in statistical methodology.

CONCLUSIONS

The on-demand, nonhierarchical approach provides results similar to the traditional hierarchical method and offers immediacy, an "over-time" perspective, application to a broader range of models and data subsets, and reporting of more easily understood rates. Although the nonhierarchical method results are now available "on-demand" in a web-based application, the hierarchical approach has advantages, which support its continued periodic publication as the gold standard for hospital profiling in the program.

Hospital Ownership of a Postacute Care Facility Influences Discharge Destinations After Emergent Surgery

OBJECTIVE

The aim of the study was to identify hospital characteristics associated with variation in patient disposition after emergent surgery.

SUMMARY BACKGROUND DATA

Colon resections in elderly patients are often done in emergent settings. Although these operations are known to be riskier, there are limited data regarding postoperative discharge destination.

METHODS

We evaluated Medicare beneficiaries who underwent emergent colectomy between 2008 and 2010. Using hierarchical logistic regression, we estimated patient and hospital-level risk-adjusted rates of nonhome discharges. Hospitals were stratified into quintiles based on their nonhome discharge rates. Generalized linear models were used to identify hospital structural characteristics associated with nonhome discharges (comparing discharge to skilled nursing facilities vs home with/without home health services).

RESULTS

Of the 122,604 patients surviving to discharge after emergent colectomy at 3012 hospitals, 46.7% were discharged to a nonhome destination. There was a wide variation in risk and reliability-adjusted nonhome discharge rates across hospitals (15% to 80%). Patients at hospitals in the highest quintile of nonhome discharge rates were more likely to have longer hospitalizations (15.1 vs 13.2; P < 0.001) and more complications (43.2% vs 34%; P < 0.001). On multivariable analysis, only hospital ownership of a skilled nursing facility (P < 0.001), teaching status (P = 0.025), and low nurse-to-patient ratios (P = 0.002) were associated with nonhome discharges.

CONCLUSIONS

Nearly half of Medicare beneficiaries are discharged to a nonhome destination after emergent colectomy. Hospital ownership of a skilled nursing facility and low nurse-to-patient ratios are highly associated with nonhome discharges. This may signify the underlying financial incentives to preferentially utilize postacute care facilities under the traditional fee-for-service payment model.

Hospital Contributions to Variability in the Use of ICUs Among Elderly Medicare Recipients

OBJECTIVE

Hospitals vary widely in ICU admission rates across numerous medical diagnoses. The extent to which variability in ICU use is specific to individual diagnoses or is a function of the hospital, regardless of disease, is unknown.

DESIGN

Retrospective cohort study.

SETTING

A total of 1,120 acute care hospitals with ICU capabilities.

PATIENTS

Medicare beneficiaries 65 years old or older admitted for five medical diagnoses (acute myocardial infarction, congestive heart failure, stroke, pneumonia, and chronic obstructive pulmonary disease) and a surgical diagnosis (hip fracture treated with arthroplasty) in 2010.

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

We used multilevel models to calculate risk- and reliability-adjusted ICU admission rates, examined the correlation in ICU admission rates across diagnosis and calculated intraclass correlation coefficients and median odds ratios to quantify the variability in ICU admission rate that was attributable to hospitals. We also examined the ability of a high ICU-use hospital for one condition to predict high ICU use for other conditions. We identified 348,462 patients with one of the eligible conditions. ICU admission rates were positively correlated within hospitals for included medical diagnoses (r range, 0.38-0.59; p < 0.01). The top hospital quartile of ICU use for congestive heart failure had a sensitivity of 50-60% and specificity of 79-81% for detecting top quartile hospitals for each other conditions. After adjustment for patient and hospital characteristics, hospitals accounted for 17.6% (95% CI, 16.2-19.1%) of variability in ICU admission, corresponding to a median odds ratio of 2.3, compared to 25.8% (95% CI, 24.5-27.1%) and median odds ratio 2.8 for diagnosis. This suggests a patient with median baseline risk of ICU admission would more than double his/her odds of ICU admission if moving to a higher utilizing hospital.

CONCLUSIONS

Hospitals account for a significant proportion of variation independent of measured patient and hospital characteristics, suggesting the need for further work to evaluate the causes of variation at the hospital level and potential consequences of variation across hospitals.

Comparing the Contributions of Acute and Postacute Care Facility Characteristics to Outcomes After Hospitalization for Hip Fracture

OBJECTIVE

To quantify the contribution of acute versus postacute care factors to survival and functional outcomes after hip fracture.

DESIGN, SETTING, AND PARTICIPANTS

Retrospective cohort study using Medicare data; subjects included previously ambulatory nursing home residents hospitalized for hip fracture between 2005 and 2009.

METHODS

We used logistic regression to measure the associations of hospital and nursing home factors with functional and survival outcomes at 30 and 180 days among patients discharged to a nursing facility; we quantified the contribution of hospital versus nursing home factors to outcomes by the ω statistic.

RESULTS

Among 45,996 hospitalized patients, 1814 (3.9%) died during hospitalization. A total of 42,781 (93%) were discharged alive to a nursing home. Of these, 12,126 (28%) died within 180 days and 20,479 (48%) died or were newly unable to walk within 180 days. Hospital characteristics were not consistently associated with outcomes. Multiple nursing home characteristics predicted 30- and 180-day outcomes, including bed count, chain membership, and performance on selected quality measures. Nursing home factors explained 3 times more variation in the odds of 30-day mortality than did hospital factors [ω, hospital vs. nursing home: 0.32; 95% confidence interval (CI), 0.11, 0.96], 7 times more variation in the odds of 180-day mortality (ω: 0.15; 95% CI, 0.04, 0.61), and 8 times more variation in the odds of 180-day death or new dependence in locomotion (ω: 0.12; 95% CI, 0.05, 0.31).

CONCLUSIONS

Nursing home factors explain a larger proportion of the variation in clinical outcomes following hip fracture than do hospital factors.

Differences in Hospital Risk-standardized Mortality Rates for Acute Myocardial Infarction When Assessed Using Transferred and Nontransferred Patients

BACKGROUND

One in 5 patients with acute myocardial infarction (AMI) are transferred between hospitals. However, current hospital performance measures based on AMI mortality exclude these patients from the evaluation of referral hospitals.

OBJECTIVE

To determine the relationship between risk-standardized mortality for transferred and nontransferred patients at referral hospitals.

RESEARCH DESIGN

This is a retrospective cohort study.

SUBJECTS

Fee-for-service Medicare claims from 2011 for patients hospitalized with a primary diagnosis of AMI, at hospitals admitting at least 15 patients in transfer.

MEASURES

Hospital-specific risk-standardized 30-day mortality rates (RSMRs) for 2 groups of patients: those admitted through transfer from another hospital, and those natively admitted without a preceding or subsequent interhospital transfer.

RESULTS

There were 304 hospitals admitting at least 15 patients in transfer. These hospitals cared for 77,711 natively admitted patients (median, 254; interquartile range, 162-321), and 11,829 patients admitted in transfer (median, 26; interquartile range, 19-46). Risk-standardized mortality rates were higher for natively admitted patients than for those admitted in transfer (mean, 11.5%±1.2% vs. 7.2%±1.1%). There was weak correlation between hospital performance as assessed by RSMR for patients natively admitted versus those admitted in transfer (Pearson r=0.24, P<0.001); when performance was arrayed by quartile, 102 hospitals (33.6%) differed at least 2 quartiles of performance across the 2 patient groups.

CONCLUSIONS

For Medicare patients with AMI, hospital-specific RSMRs for natively admitted patients are only weakly associated with RSMRs for patients transferred in from another hospital. Current AMI performance metrics may fail to provide guidance about hospital quality for transferred patients.

Quantifying Geographic Variation in Health Care Outcomes in the United States before and after Risk-Adjustment

BACKGROUND

Despite numerous studies of geographic variation in healthcare cost and utilization at the local, regional, and state levels across the U.S., a comprehensive characterization of geographic variation in outcomes has not been published. Our objective was to quantify variation in US health outcomes in an all-payer population before and after risk-adjustment.

METHODS AND FINDINGS

We used information from 16 independent data sources, including 22 million all-payer inpatient admissions from the Healthcare Cost and Utilization Project (which covers regions where 50% of the U.S. population lives) to analyze 24 inpatient mortality, inpatient safety, and prevention outcomes. We compared outcome variation at state, hospital referral region, hospital service area, county, and hospital levels. Risk-adjusted outcomes were calculated after adjusting for population factors, co-morbidities, and health system factors. Even after risk-adjustment, there exists large geographical variation in outcomes. The variation in healthcare outcomes exceeds the well publicized variation in US healthcare costs. On average, we observed a 2.1-fold difference in risk-adjusted mortality outcomes between top- and bottom-decile hospitals. For example, we observed a 2.3-fold difference for risk-adjusted acute myocardial infarction inpatient mortality. On average a 10.2-fold difference in risk-adjusted patient safety outcomes exists between top and bottom-decile hospitals, including an 18.3-fold difference for risk-adjusted Central Venous Catheter Bloodstream Infection rates. A 3.0-fold difference in prevention outcomes exists between top- and bottom-decile counties on average; including a 2.2-fold difference for risk-adjusted congestive heart failure admission rates. The population, co-morbidity, and health system factors accounted for a range of R2 between 18-64% of variability in mortality outcomes, 3-39% of variability in patient safety outcomes, and 22-70% of variability in prevention outcomes.

CONCLUSION

The amount of variability in health outcomes in the U.S. is large even after accounting for differences in population, co-morbidities, and health system factors. These findings suggest that: 1) additional examination of regional and local variation in risk-adjusted outcomes should be a priority; 2) assumptions of uniform hospital quality that underpin rationale for policy choices (such as narrow insurance networks or antitrust enforcement) should be challenged; and 3) there exists substantial opportunity for outcomes improvement in the US healthcare system.