Public reporting on hospital process improvements is linked to better patient outcomes

Lack of associations between hospital rating and outcomes in patients with an acute coronary syndrome

BACKGROUND

Public reporting of performance data has become a common tool in evaluation of healthcare providers. The rating may be misleading if the association between the measured variables and the outcome is weak.

METHODS AND RESULTS

Nationwide, register-based, cohort study. All Swedish patients hospitalised with an acute coronary syndrome during the time periods 2006-2010 and 2015-2017 were included in the study. Possible associations between cardiovascular morbidity and mortality for these patients and ranking scores for each hospital in a Swedish healthcare quality register for acute coronary syndromes were analysed. We found no association between the ranking score and mortality, and no or weak associations between the ranking score and readmissions.

CONCLUSIONS

Lack of associations between quality measurements and patient outcomes warrants improvement in ranking scores. Cautious use of the ranking results is necessary in comparisons between healthcare providers.

Learning From England's Best Practice Tariff: Process Measure Pay-for-Performance Can Improve Hip Fracture Outcomes

OBJECTIVE

The objective of this study was to evaluate England's Best Practice Tariff (BPT) and consider potential implications for Medicare patients should the US adopt a similar plan.

SUMMARY BACKGROUND DATA

Since the beginning of the Affordable Care Act, Medicare has renewed efforts to improve the outcomes of older adults through introduction of an expanding set of alternative-payment models. Among trauma patients, recommended arrangements met with mixed success given concerns about the heterogeneous nature of trauma patients and resulting outcome variation. A novel approach taken for hip fractures in England could offer a viable alternative.

METHODS

Linear regression, interrupted time-series, difference-in-difference, and counterfactual models of 2000 to 2016 Medicare (US), HES-APC (England) death certificate-linked claims (≥65 years) were used to: track US hip fracture trends, look at changes in English hip fracture trends before-and-after BPT implementation, compare changes in US-versus-English mortality, and estimate total/theoretical lives saved.

RESULTS

A total of 806,036 English and 3,221,109 US hospitalizations were included. After BPT implementation, England's 30-day mortality decreased by 2.6 percentage-points (95%CI: 1.7-3.5) from a baseline of 9.9% (relative reduction 26.3%). 90- and 365-day mortality decreased by 5.6 and 5.4 percentage-points. 30/90/365-day readmissions also declined with a concurrent shortening of hospital length-of-stay. From 2000 to 2016, US outcomes were stagnant (P > 0.05), resulting in an inversion of the countries' mortality and >38,000 potential annual US lives saved.

CONCLUSIONS

Process measure pay-for-performance led to significant improvements in English hip fracture outcomes. As efforts to improve US older adult health continue to increase, there are important lessons to be learned from a successful initiative like the BPT.

Low-value care and excess out-of-pocket expenditure among older adults with incident cancer - A machine learning approach

OBJECTIVE

To evaluate the association of low-value care with excess out-of-pocket expenditure among older adults diagnosed with incident breast, prostate, colorectal cancers, and Non-Hodgkin's Lymphoma.

METHODS

We used a retrospective cohort study design with 12-month baseline and follow-up periods. We identified a cohort of older adults (age ≥ 66 years) diagnosed with breast, prostate, colorectal cancers, or Non-Hodgkin's lymphoma between January 2014 and December 2014. We assessed low-value care and patient out-of-pocket expenditure in the follow-up period. We identified relevant low-value services using ICD9/ICD10 and CPT/HCPCS codes from the linked health claims and patient out-of-pocket expenditure from Medicare claim files and expressed expenditure in 2016 USD.

RESULTS

About 29 % of older adults received at least one low-value care procedure during the follow-up period. Low-value care differed by gender, and rates were higher in women with colorectal cancer (32.7 %) vs. (28.8 %) and NHL (40 %) vs. (39 %) compared to men. Individuals who received one or more low-value care procedures had significantly higher mean out-of-pocket expenditure ($8,726 ± $7,214) vs. ($6,802 ± $6,102). XGBOOST, a machine learning algorithm revealed that low-value care was among the five leading predictors of OOP expenditure.

CONCLUSION

One in four older adults with incident cancer received low-value care in 12-months after a cancer diagnosis. Across all cancer populations, individuals who received low-value care had significantly higher out-of-pocket expenditure. Excess out-of-pocket expenditure was driven by low-value care, fragmentation of care, and an increasing number of pre-existing chronic conditions.

POLICY STATEMENT

This study focuses on health policy issues, specifically value-based care and its findings have important clinical and policy implications for Centers for Medicare and Medicaid Services (CMS) which has issued a roadmap for states to accelerate the adoption of value-based care, with the Department of Health and Human Services (HHS) setting a goal of converting 50 % of traditional Medicare payment systems to alternative payment models tied to value-based care by 2022.

A decade of commitment to hospital quality of care: overview of and perceptions on multicomponent quality improvement policies involving accreditation, public reporting, inspection and pay-for-performance

Background

Quality improvement (QI) initiatives such as accreditation, public reporting, inspection and pay-for-performance are increasingly being implemented globally. In Flanders, Belgium, a government policy for acute-care hospitals incorporates aforementioned initiatives. Currently, questions are raised on the sustainability of the present policy.

Objective

First, to summarise the various initiatives hospitals have adopted under government encouragement between 2008 and 2019. Second, to study the perspectives of healthcare stakeholders on current government policy.

Methods

In this multi-method study, we collected data on QI initiative implementation from governmental and institutional sources and through an online survey among hospital quality managers. We compiled an overview of QI initiative implementation for all Flemish acute-care hospitals between 2008 (n = 62) and 2019 (n = 53 after hospital mergers). Stakeholder perspectives were assessed via a second survey available to all healthcare employees and a focus group with healthcare policy experts was consulted. Variation between professions was assessed.

Results

QI initiatives have been increasingly implemented, especially from 2016 onwards, with the majority (87%) of hospitals having obtained a first accreditation label and all hospitals publicly reporting performance indicators, receiving regular inspections and having entered the pay-for-performance initiative. On the topic of external international accreditation, overall attitudes within the survey were predominantly neutral (36.2%), while 34.5% expressed positive and 29.3% negative views towards accreditation. In examining specific professional groups in-depth, we learned 58% of doctors regarded accreditation negatively, while doctors were judged to be the largest contributors to quality according to the majority of respondents.

Conclusions

Hospitals have demonstrated increased efforts into QI, especially since 2016, while perceptions on currently implemented QI initiatives among healthcare stakeholders are heterogeneous. To assure quality of care remains a top-priority for acute-care hospitals, we recommend a revision of the current multicomponent quality policy where the adoption of all initiatives is streamlined and co-created bottom-up.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-07007-w.

Quality Improvement and Public Reporting in STEMI Care

Mortality rates for patients with ST-segment elevation myocardial infarction (STEMI) remain high despite development of novel drugs and interventions over the past several decades. There is significant variability between hospitals in use of evidence-based treatments, and substantial opportunities exist to optimize care pathways and reduce disparities in care delivery. Quality improvement interventions implemented at local, regional, and national levels have improved care processes and patient outcomes. This article reviews evidence for quality improvement interventions along the spectrum of STEMI care, describes existing systems for quality measurement, and examines local and national policy interventions, with special attention to public reporting programs.

Is a hospital quality policy based on a triad of accreditation, public reporting and inspection evidence-based? A narrative review

BACKGROUND

Since 2009, hospital quality policy in Flanders, Belgium, is built around a quality-of-care triad, which encompasses accreditation, public reporting (PR) and inspection. Policy makers are currently reflecting on the added value of this triad.

METHODS

We performed a narrative review of the literature published between 2009 and 2020 to examine the evidence base of the impact accreditation, PR and inspection, both individually and combined, has on patient processes and outcomes. The following patient outcomes were examined: mortality, length of stay, readmissions, patient satisfaction, adverse outcomes, failure to rescue, adherence to process measures and risk aversion. The impact of accreditation, PR and inspection on these outcomes was evaluated as either positive, neutral (i.e. no impact observed or mixed results reported) or negative.

OBJECTIVES

To assess the current evidence base on the impact of accreditation, PR and inspection on patient processes and outcomes.

RESULTS

We identified 69 studies, of which 40 were on accreditation, 24 on PR, three on inspection and two on accreditation and PR concomitantly. Identified studies reported primarily low-level evidence (level IV, n = 53) and were heterogeneous in terms of implemented programmes and patient populations (often narrow in PR research). Overall, a neutral categorization was determined in 30 articles for accreditation, 23 for PR and four for inspection. Ten of these recounted mixed results. For accreditation, a high number (n = 12) of positive research on adherence to process measures was discovered.

CONCLUSION

The individual impact of accreditation, PR and inspection, the core of Flemish hospital quality, was found to be limited on patient outcomes. Future studies should investigate the combined effect of multiple quality improvement strategies.

Development of Resident-Sensitive Quality Measures for Inpatient General Internal Medicine

BACKGROUND

Graduate medical education (GME) training has long-lasting effects on patient care quality. Despite this, few GME programs use clinical care measures as part of resident assessment. Furthermore, there is no gold standard to identify clinical care measures that are reflective of resident care. Resident-sensitive quality measures (RSQMs), defined as "measures that are meaningful in patient care and are most likely attributable to resident care," have been developed using consensus methodology and piloted in pediatric emergency medicine. However, this approach has not been tested in internal medicine (IM).

OBJECTIVE

To develop RSQMs for a general internal medicine (GIM) inpatient residency rotation using previously described consensus methods.

DESIGN

The authors used two consensus methods, nominal group technique (NGT) and a subsequent Delphi method, to generate RSQMs for a GIM inpatient rotation. RSQMs were generated for specific clinical conditions found on a GIM inpatient rotation, as well as for general care on a GIM ward.

PARTICIPANTS

NGT participants included nine IM and medicine-pediatrics (MP) residents and six IM and MP faculty members. The Delphi group included seven IM and MP residents and seven IM and MP faculty members.

MAIN MEASURES

The number and description of RSQMs generated during this process.

KEY RESULTS

Consensus methods resulted in 89 RSQMs with the following breakdown by condition: GIM general care-21, diabetes mellitus-16, hyperkalemia-14, COPD-13, hypertension-11, pneumonia-10, and hypokalemia-4. All RSQMs were process measures, with 48% relating to documentation and 51% relating to orders. Fifty-eight percent of RSQMs were related to the primary admitting diagnosis, while 42% could also be related to chronic comorbidities that require management during an admission.

CONCLUSIONS

Consensus methods resulted in 89 RSQMs for a GIM inpatient service. While all RSQMs were process measures, they may still hold value in learner assessment, formative feedback, and program evaluation.

Mechanisms and impact of public reporting on physicians and hospitals' performance: A systematic review (2000-2020)

BACKGROUND

Public performance reporting (PPR) of physician and hospital data aims to improve health outcomes by promoting quality improvement and informing consumer choice. However, previous studies have demonstrated inconsistent effects of PPR, potentially due to the various PPR characteristics examined. The aim of this study was to undertake a systematic review of the impact and mechanisms (selection and change), by which PPR exerts its influence.

METHODS

Studies published between 2000 and 2020 were retrieved from five databases and eight reviews. Data extraction, quality assessment and synthesis were conducted. Studies were categorised into: user and provider responses to PPR and impact of PPR on quality of care.

RESULTS

Forty-five studies were identified: 24 on user and provider responses to PPR, 14 on impact of PPR on quality of care, and seven on both. Most of the studies reported positive effects of PPR on the selection of providers by patients, purchasers and providers, quality improvement activities in primary care clinics and hospitals, clinical outcomes and patient experiences.

CONCLUSIONS

The findings provide moderate level of evidence to support the role of PPR in stimulating quality improvement activities, informing consumer choice and improving clinical outcomes. There was some evidence to demonstrate a relationship between PPR and patient experience. The effects of PPR varied across clinical areas which may be related to the type of indicators, level of data reported and the mode of dissemination. It is important to ensure that the design and implementation of PPR considered the perspectives of different users and the health system in which PPR operates in. There is a need to account for factors such as the structural characteristics and culture of the hospitals that could influence the uptake of PPR.

Quality of Care for Patients Hospitalized for Heart Failure in China

IMPORTANCE

Given the emerging heart failure (HF) epidemic in China, monitoring and improving the quality of care for heart failure is a top priority.

OBJECTIVES

To assess the quality of HF care provided to inpatients by examining the adherence to quality measures for HF care at the hospital level and to identify factors associated with the quality of care.

DESIGN, SETTING, AND PARTICIPANTS

In this multicenter, hospital-based, retrospective cross-sectional study in China, medical records of patients hospitalized for HF from January 1, 2015, to December 31, 2015, were analyzed from January 1, 2018, to May 20, 2019. In the first stage, simple random sampling stratified by economic-geographical regions in China was used to generate a list of participating hospitals. In the second stage, 15 538 hospitalizations from the 189 selected hospitals were systematically sampled, and 10 004 HF hospitalizations were included in the final sample.

MAIN OUTCOMES AND MEASURES

Adherence to the following 4 core performance measures at the hospital level: (1) left ventricular ejection fraction assessment during hospitalization; (2) evidence-based β-blocker (bisoprolol, carvedilol, or metoprolol succinate) for eligible patients at discharge; (3) angiotensin-converting enzyme inhibitors or angiotensin receptor blockers for eligible patients at discharge; and (4) scheduled follow-up appointment at discharge. At the hospital level, a composite performance score (ranging from 0-1) was also calculated by averaging these measures.

RESULTS

In total, 10 004 hospital admissions for HF at 189 hospitals were included in this study. The median (interquartile range [IQR]) patient age at admission was 73 (65-80) years, and 5117 (51.1%) of the patients were men. Among all hospitals, the median rate of adherence to measure 1 was 66.7% (IQR, 45.5%-80.7%; range, 0%-100%). The rate for adherence to measure 2 was 14.8% (IQR, 0%-37.5%; range, 0%-81.8%), and the rate for measure 3 was 57.1% (IQR, 36.4%-75.0%; range, 0%-100%). For measure 4, the median rate of adherence was 11.5% (IQR, 3.3%-32.8%; range, 0%-96.7%). The median (IQR) composite performance score across all hospitals was 40.0% (26.9%-51.9%), with a range from 2.2% to 85.4%. The median odds ratios of adherence were 2.2 (95% CI, 2.0-2.4) for measure 1, 2.1 (95% CI, 1.8-2.4) for measure 2, 2.4 (95% CI, 2.0-2.9 for measure 3, and 4.8 (95% CI, 3.9-5.8) for measure 4 among hospitals.

CONCLUSIONS AND RELEVANCE

The findings of this study suggest that quality of care for patients with HF in China may be substandard, and there is wide heterogeneity in the quality of care for HF among hospitals. The findings also suggest the need for a national strategy to improve and standardize the quality of HF care in China.

Voluntary Hospital Reporting of Performance in Cancer Care: Does Volume Make a Difference?

Little is known about which hospitals participate in voluntary public reporting of quality processes and what influences their performance, particularly in cancer care. We hypothesize that patient volume is positively associated with both reporting and performance. In 2014, when Pennsylvania became the first and only state to have public reporting for cancer care, it became possible to test these hypotheses, which we did in cross-sectional study of the 72 Pennsylvania hospitals accredited by the Commission on Cancer. Hospitals that publicly reported their performance (57 of 72) had higher patient volumes than hospitals that did not release performance. Among reporting hospitals, no association was found between patient volume and performance on process of care metrics. These findings suggest the importance of attending to volume effects in public reporting of cancer care and recognizing that volume is not a predictor of performance for reporting hospitals, which indicates the need for research to identify other factors that differentiate performance within and across reporting and nonreporting hospitals.

Relation Between Statewide Hospital Performance Reports on Myocardial Infarction and Cardiovascular Outcomes

Healthcare systems may be judged on quality of care and access to health services. Studies on the association of hospital quality of care scores and clinical outcomes have yielded mixed results. With the help of a richer and more representative database, the aim of our study was to shed light on these inconsistencies. We examined the association of 4 process of care scores (prescription of aspirin, β blocker, angiotensin-converting enzyme inhibitor or angiotensin receptor blocker used for left ventricular systolic dysfunction, and an overall composite score) for acute myocardial infarction (AMI), reported in the Hospital Performance Reports, with 30-day and 1-year rates of readmission for AMI and cardiovascular (CV) death. Clinical outcomes were from the Myocardial Infarction Data Acquisition System, an administrative database that comprises all patient CV disease admissions to acute care hospitals in New Jersey. CV death was related with overall score (adjusted odds ratio [OR] 0.821, 95% confidence interval [CI] 0.726 to 0.930, p = 0.002) at 30 days and with all 4 scores at 1 year (OR ranging from 0.829 to 0.997, p <0.01). Readmission due to AMI was associated with the overall score (OR 0.789, 95% CI 0.691 to 0.902, p <0.0001) and the aspirin score (OR 0.995, 95% CI 0.990 to 1, p = 0.046) at 30 days. Low hospital performance scores for AMI were associated with increased CV death and readmission for AMI. In conclusion, healthcare providers should allocate their resources to improving hospital performance to decrease AMI case fatality, AMI readmissions, and CV-related healthcare spending.

Effects of Public Reporting Legislation of Nurse Staffing: A Trend Analysis

Public reporting is a tactic that hospitals and other health care facilities use to provide data such as outcomes to clinicians, patients, and payers. Although inadequate registered nurse (RN) staffing has been linked to poor patient outcomes, only eight states in the United States publicly report staffing ratios-five mandated by legislation and the other three electively. We examine nurse staffing trends after the New Jersey (NJ) legislature and governor enacted P.L.1971, c.136 (C.26:2 H-13) on January 24, 2005, mandating that all health care facilities compile, post, and report staffing information. We conduct a secondary analysis of reported data from the State of NJ Department of Health on 73 hospitals in 2008 to 2009 and 72 hospitals in 2010 to 2015. The first aim was to determine if NJ hospitals complied with legislation, and the second was to identify staffing trends postlegislation. On the reports, staffing was operationalized as the number of patients per RN per quarters. We obtained 30 quarterly reports for 2008 through 2015 and cross-checked these reports for data accuracy on the NJ Department of Health website. From these data, we created a longitudinal data set of 13 inpatient units for each hospital (14,158 observations) and merged these data with American Hospital Association Annual Survey data. The number of patients per RN decreased for 10 specialties, and the American Hospital Association data demonstrate a similar trend. Although the number of patients does not account for patient acuity, the decrease in the patients per RN over 7 years indicated the importance of public reporting in improving patient safety.

Defying public expectations: Publicly reported hospital scores do not always correlate with clinical outcomes

BACKGROUND

Publicly reported hospital scores are used by patients to make health care-related decisions; however, their relationship to clinical outcomes is unknown.

METHODS

Through the use of the New York Statewide Planning and Research Cooperative System database, the association between two commonly used scores (Healthgrades and Centers for Medicare & Medicaid Services Hospital Compare) and four clinical outcomes was evaluated in several surgical fields (general, colorectal, hepatobiliary, foregut, and bariatric).

RESULTS

After adjusting for patient-level factors, patients from facilities with greater Healthgrades scores were less likely to develop any complication after general surgery operations (P = .0013). Also, greater Healthgrades scores were associated with less 30-day readmissions and emergency department visits for general surgery operations only (P = .0061 and P = .0013, respectively). In addition, greater Healthgrades scores were significantly associated with a lesser hospital length of stay for colorectal, foregut, and general surgery operations. Greater Centers for Medicare & Medicaid Services Hospital Compare scores were significantly associated with less 30-day readmissions and lesser hospital length of stay for specific operative groups.

CONCLUSION

Although some specialties demonstrated a correlation, there was no consistent relationship between publicly reported hospital scores and surgical outcomes that contributed to clinically meaningful use for patients or operations.

Correlation of Subjective Hospital Compare Metrics With Objective Outcomes of Cranial Neurosurgical Procedures in New York State

Background

Public reporting is at the forefront of health care reform.

Objective

To investigate whether patient satisfaction as expressed in a public reporting platform correlates with objective outcomes for cranial neurosurgery patients.

Methods

We performed a cohort study involving patients undergoing cranial neurosurgery from 2009 to 2013 who were registered in the Statewide Planning and Research Cooperative System database. This cohort was merged with the corresponding data from the Centers for Medicare and Medicaid Services Hospital Compare website. The association of patient satisfaction metrics with outcomes was examined with the use of a propensity-adjusted regression model.

Results

Overall, 19 591 patients underwent cranial neurosurgery during the study. Using a propensity-adjusted multivariable regression analysis, we demonstrated that hospitals with a greater percentage of patient-assigned "high" scores had decreased mortality (OR, 0.60; 95% CI, 0.53-0.67), rate of discharge to rehabilitation (OR, 0.93; 95% CI, 0.88-0.98), length of stay (adjusted difference, -1.29; 95% CI, -1.46 to -1.13), and hospitalization charges (adjusted difference, -23%; 95% CI, -36% to -9%) after cranial neurosurgery. Similar associations were identified for hospitals with a higher percentage of patients, who would recommend these institutions to others.

Conclusion

In a Centers for Medicare and Medicaid Services Hospital Compare-Statewide Planning and Research Cooperative System merged dataset, we observed an association of higher performance in patient satisfaction measures with decreased mortality, rate of discharge to rehabilitation, hospitalization charges, and length of stay.

Association of Changing Hospital Readmission Rates With Mortality Rates After Hospital Discharge

IMPORTANCE

The Affordable Care Act has led to US national reductions in hospital 30-day readmission rates for heart failure (HF), acute myocardial infarction (AMI), and pneumonia. Whether readmission reductions have had the unintended consequence of increasing mortality after hospitalization is unknown.

OBJECTIVE

To examine the correlation of paired trends in hospital 30-day readmission rates and hospital 30-day mortality rates after discharge.

DESIGN, SETTING, AND PARTICIPANTS

Retrospective study of Medicare fee-for-service beneficiaries aged 65 years or older hospitalized with HF, AMI, or pneumonia from January 1, 2008, through December 31, 2014.

EXPOSURE

Thirty-day risk-adjusted readmission rate (RARR).

MAIN OUTCOMES AND MEASURES

Thirty-day RARRs and 30-day risk-adjusted mortality rates (RAMRs) after discharge were calculated for each condition in each month at each hospital in 2008 through 2014. Monthly trends in each hospital's 30-day RARRs and 30-day RAMRs after discharge were examined for each condition. The weighted Pearson correlation coefficient was calculated for hospitals' paired monthly trends in 30-day RARRs and 30-day RAMRs after discharge for each condition.

RESULTS

In 2008 through 2014, 2 962 554 hospitalizations for HF, 1 229 939 for AMI, and 2 544 530 for pneumonia were identified at 5016, 4772, and 5057 hospitals, respectively. In January 2008, mean hospital 30-day RARRs and 30-day RAMRs after discharge were 24.6% and 8.4% for HF, 19.3% and 7.6% for AMI, and 18.3% and 8.5% for pneumonia. Hospital 30-day RARRs declined in the aggregate across hospitals from 2008 through 2014; monthly changes in RARRs were -0.053% (95% CI, -0.055% to -0.051%) for HF, -0.044% (95% CI, -0.047% to -0.041%) for AMI, and -0.033% (95% CI, -0.035% to -0.031%) for pneumonia. In contrast, monthly aggregate changes across hospitals in hospital 30-day RAMRs after discharge varied by condition: HF, 0.008% (95% CI, 0.007% to 0.010%); AMI, -0.003% (95% CI, -0.005% to -0.001%); and pneumonia, 0.001% (95% CI, -0.001% to 0.003%). However, correlation coefficients in hospitals' paired monthly changes in 30-day RARRs and 30-day RAMRs after discharge were weakly positive: HF, 0.066 (95% CI, 0.036 to 0.096); AMI, 0.067 (95% CI, 0.027 to 0.106); and pneumonia, 0.108 (95% CI, 0.079 to 0.137). Findings were similar in secondary analyses, including with alternate definitions of hospital mortality.

CONCLUSIONS AND RELEVANCE

Among Medicare fee-for-service beneficiaries hospitalized for heart failure, acute myocardial infarction, or pneumonia, reductions in hospital 30-day readmission rates were weakly but significantly correlated with reductions in hospital 30-day mortality rates after discharge. These findings do not support increasing postdischarge mortality related to reducing hospital readmissions.

Hospital quality variation matters - A time-trend and cross-section analysis of outcomes in German hospitals from 2006 to 2014

Awareness of care variation and associated differences in outcome quality is important for patients to recognize and leverage the benefits of hospital choice and for policy makers, providers, and suppliers to adapt initiatives to improve hospital quality of care. We examine panel data on outcome quality in German hospitals between 2006 and 2014 for cholecystectomy, pacemaker implantation, hip replacement, percutaneous coronary intervention (PCI), stroke, and acute myocardial infarction (AMI). We use risk-adjusted and unadjusted outcomes based on 16 indicators. Median outcome and outcome variation trends are examined via box plots, simple linear regressions and quintile differences. Outcome trends differ across treatment areas and indicators. We found positive quality trends for hip replacement surgery, stroke and AMI 30-day mortality, and negative quality trends for 90-day stroke and AMI readmissions and PCI inpatient mortality. Variation of risk-adjusted outcomes ranges by a factor of 3-12 between the 2nd and 5th quintile of hospitals, both at the national and regional level. Our results show that simply measuring and reporting hospital outcomes without clear incentives or regulation - "carrots and sticks" - to improve performance and to centralize care in high performing hospitals has not led to broad quality improvements. More substantial efforts must be undertaken to narrow the outcome spread between high- and low-quality hospitals.

Hospital Rating Systems and Implications For Patient Travel to Better-rated Hospitals

Publicly reported hospital ratings aim to encourage transparency, spur quality improvement, and empower patient choice. Travel burdens may limit patient choice, particularly for older adults (aged 65 years and more) who receive most medical care. For 3 major hospital ratings systems, we estimated travel burden as the additional 1-way travel distance to receive care at a better-rated hospital.Distances were estimated from publicly available data from the US Census, US News Top Hospitals, Society of Thoracic Surgeons composite rating for coronary artery bypass grafting (STS-CABG), and Centers for Medicare and Medicaid Services Hospital Consumer Assessment of Healthcare Providers and Services (HCAHPS).Hospitals were rated for HCAHPS (n = 4656), STS-CABG (n = 470), and US News Top Hospitals (n = 15). Older adults were commonly located within 25 miles of their closest HCAHPS hospital (89.6%), but less commonly for STS-CABG (62.9%). To receive care at a better-rated hospital, travel distances commonly exceeded 25 miles: HCAHPS (39.2%), STS-CABG (62.7%), and US News Top Hospital (85.2%). Additional 1-way travel distances exceeded 25 miles commonly: HCAHPS (23.7%), STS-CABG (36.7%), US News Top Hospitals (81.8%).Significant travel burden is common for older adults seeking "better" care and is an important limitation of current hospital ratings for empowering patient choice.

Does Objective Quality of Physicians Correlate with Patient Satisfaction Measured by Hospital Compare Metrics in New York State?

BACKGROUND

It is unclear whether publicly reported benchmarks correlate with quality of physicians and institutions. We investigated the association of patient satisfaction measures from a public reporting platform with performance of neurosurgeons in New York State.

METHODS

This cohort study comprised patients undergoing neurosurgical operations from 2009 to 2013 who were registered in the Statewide Planning and Research Cooperative System database. The cohort was merged with publicly available data from the Centers for Medicare and Medicaid Services Hospital Compare website. Propensity-adjusted regression analysis was used to investigate the association of patient satisfaction metrics with neurosurgeon quality, as measured by the neurosurgeon's individual rate of mortality and average length of stay.

RESULTS

During the study period, 166,365 patients underwent neurosurgical procedures. Using propensity-adjusted multivariable regression analysis, we demonstrated that undergoing neurosurgical operations in hospitals with a greater percentage of patient-assigned "high" scores was associated with higher chance of being treated by a physician with superior performance in terms of mortality (odds ratio 1.90, 95% confidence interval 1.86-1.95), and a higher chance of being treated by a physician with superior performance in terms of length of stay (odds ratio 1.24, 95% confidence interval 1.21-1.27). Similar associations were identified for hospitals with a higher percentage of patients who claimed they would recommend these institutions to others.

CONCLUSIONS

Merging a comprehensive all-payer cohort of neurosurgery patients in New York State with data from the Hospital Compare website, we observed an association of superior hospital-level patient satisfaction measures with objective performance of individual neurosurgeons in the corresponding hospitals.

Hospital Performance on Percutaneous Coronary Intervention Process and Outcomes Measures

BACKGROUND

The Physician Consortium for Performance Improvement recently proposed percutaneous coronary intervention (PCI)-specific process measures. However, information about hospital performance on these measures and the association of PCI process and outcomes measures are not available.

METHODS AND RESULTS

We linked the National Cardiovascular Data Registry (NCDR) CathPCI Registry with Medicare claims data to assess hospital performance on established PCI process measures (aspirin, thienopyridines, and statins on discharge; door-to-balloon time; and referral to cardiac rehabilitation), newly proposed PCI process measures (documentation of contrast dose, glomerular filtration rate, and PCI indication; appropriate indication for elective PCI; and use of embolic protection device), and a composite of all process measures. We calculated weighted pair-wise correlations between each set of process metrics and performed weighted correlation analyses to assess the association between composite measure performance with corresponding 30-day risk-standardized mortality and readmission rates. We reported the variance in risk-standardized 30-day outcome rates explained by process measures. We analyzed 1 268 860 PCIs from 1331 hospitals. For many process measures, median hospital performance exceeded 90%. We found strong correlations between medication-specific process measures (P<0.01) and weak correlations between hospital performance on the newly proposed and established process measures. The composite process measure explained only 1.3% and 2.0% of the observed variation in mortality and readmission rates, respectively.

CONCLUSIONS

Hospital performance on many PCI-specific process measures demonstrated little opportunity for improvement and explained only a small percentage of hospital variation in 30-day outcomes. Efforts to measure and improve hospital quality for PCI patients should focus on both process and outcome measures.

Does the ranking of surgeons in a publicly available online platform correlate with objective outcomes?

OBJECTIVE The accuracy of public reporting in health care, especially from private vendors, remains an issue of debate. The authors investigated the association of the publicly reported physician complication rates in an online platform with real-world adverse outcomes of the same physicians for patients undergoing posterior lumbar fusion. METHODS The authors performed a cohort study involving physicians performing posterior lumbar fusions between 2009 and 2013 who were registered in the Statewide Planning and Research Cooperative System database. This cohort was merged with publicly available data over the same time period from ProPublica, a private company. Mixed-effects multivariable regression models were used to investigate the association of publicly available complication rates with the rate of discharge to a rehabilitation facility, length of stay, mortality, and hospitalization charges for the same surgeons. RESULTS During the selected study period, there were 8,457 patients in New York State who underwent posterior lumbar fusion performed by the 56 surgeons represented in the ProPublica Surgeon Scorecard over the same time period. Using a mixed-effects multivariable regression model, the authors demonstrated that publicly reported physician-level complication rates were not associated with the rate of discharge to a rehabilitation facility (OR 0.97, 95% CI 0.72-1.31), length of stay (adjusted difference -0.1, 95% CI -0.5 to 0.2), mortality (OR 0.87, 95% CI 0.49-1.55), and hospitalization charges (adjusted difference $18,735, 95% CI -$59,177 to $96,647). Similarly, no association was observed when utilizing propensity score-adjusted models, and when restricting the cohort to a predefined subgroup of Medicare patients. CONCLUSIONS After merging a comprehensive all-payer posterior lumbar fusion cohort in New York State with data from the ProPublica Surgeon Scorecard over the same time period, the authors observed no association of publicly available physician complication rates with objective outcomes.

Does the ranking of surgeons in a publicly available online platform correlate with objective outcomes?

OBJECTIVE The accuracy of public reporting in health care, especially from private vendors, remains an issue of debate. The authors investigated the association of the publicly reported physician complication rates in an online platform with real-world adverse outcomes of the same physicians for patients undergoing posterior lumbar fusion. METHODS The authors performed a cohort study involving physicians performing posterior lumbar fusions between 2009 and 2013 who were registered in the Statewide Planning and Research Cooperative System database. This cohort was merged with publicly available data over the same time period from ProPublica, a private company. Mixed-effects multivariable regression models were used to investigate the association of publicly available complication rates with the rate of discharge to a rehabilitation facility, length of stay, mortality, and hospitalization charges for the same surgeons. RESULTS During the selected study period, there were 8,457 patients in New York State who underwent posterior lumbar fusion performed by the 56 surgeons represented in the ProPublica Surgeon Scorecard over the same time period. Using a mixed-effects multivariable regression model, the authors demonstrated that publicly reported physician-level complication rates were not associated with the rate of discharge to a rehabilitation facility (OR 0.97, 95% CI 0.72-1.31), length of stay (adjusted difference -0.1, 95% CI -0.5 to 0.2), mortality (OR 0.87, 95% CI 0.49-1.55), and hospitalization charges (adjusted difference $18,735, 95% CI -$59,177 to $96,647). Similarly, no association was observed when utilizing propensity score-adjusted models, and when restricting the cohort to a predefined subgroup of Medicare patients. CONCLUSIONS After merging a comprehensive all-payer posterior lumbar fusion cohort in New York State with data from the ProPublica Surgeon Scorecard over the same time period, the authors observed no association of publicly available physician complication rates with objective outcomes.

Public Reporting of Hospital-Specific Breastfeeding Measures

BACKGROUND

Establishing breastfeeding in the first days of an infant's life is important for longer term success in breastfeeding. In 2009, New York State (NYS) was the second state to require maternity care facilities to collect infant feeding information and to publicly disseminate hospital-specific infant feeding statistics. Public reporting of these statistics as performance measures is a strategy to prompt hospitals to improve breastfeeding support.

OBJECTIVE

This qualitative study sought to explore how maternity care administrators and clinical staff responded to the mandate for publicly reported performance measures and whether they used this information to improve maternity care practices.

METHODS

This study used a stratified random sample of NYS hospitals with maternity care units. Participants were recruited by email and telephone calls. A total of 25 hospitals participated in the study, and 37 hospital administrators and staff completed in-depth interviews by telephone. The interviews were analyzed using an explanatory framework in NVivo 8.

RESULTS

Publicly reported hospital-specific breastfeeding measures increased attention to breastfeeding performance. Hospital administrators and staff reported comparing their relative rankings to other hospitals in the state. Some hospitals used publicly reported breastfeeding measures to monitor performance, whereas others were prompted to generate additional measures for more frequent monitoring. Hospitals with relatively low breastfeeding statistics took certain actions to improve their maternity care practices to support breastfeeding. Limitations of the usefulness of publicly reported measures were reported by interview participants.

CONCLUSION

Publicly reported, hospital-specific breastfeeding measures may prompt hospitals to monitor and improve maternity care practices related to supporting breastfeeding.

Public Reporting of Mortality Rates for Hospitalized Medicare Patients and Trends in Mortality for Reported Conditions

BACKGROUND

Public reporting is seen as a powerful quality improvement tool, but data to support its efficacy are limited. The Centers for Medicare & Medicaid Services' Hospital Compare program initially reported process metrics only but started reporting mortality rates for acute myocardial infarction, heart failure, and pneumonia in 2008.

OBJECTIVE

To determine whether public reporting of mortality rates was associated with lower mortality rates for these conditions among Medicare beneficiaries.

DESIGN

For 2005 to 2007, process-only reporting was considered; for 2008 to 2012, process and mortality reporting was considered. Changes in mortality trends before and during reporting periods were estimated by using patient-level hierarchical modeling. Nonreported medical conditions were used as a secular control.

SETTING

U.S. acute care hospitals.

PARTICIPANTS

20 707 266 fee-for-service Medicare beneficiaries hospitalized from January 2005 through November 2012.

MEASUREMENTS

30-day risk-adjusted mortality rates.

RESULTS

Mortality rates for the 3 publicly reported conditions were changing at an absolute rate of -0.23% per quarter during process-only reporting, but this change slowed to a rate of -0.09% per quarter during process and mortality reporting (change, 0.13% per quarter; 95% CI, 0.12% to 0.14%). Mortality for nonreported conditions was changing at -0.17% per quarter during process-only reporting and slowed slightly to -0.11% per quarter during process and mortality reporting (change, 0.06% per quarter; CI, 0.05% to 0.07%).

LIMITATION

Administrative data may have limited ability to account for changes in patient complexity over time.

CONCLUSION

Changes in mortality trends suggest that reporting in Hospital Compare was associated with a slowing, rather than an improvement, in the ongoing decline in mortality among Medicare patients.

PRIMARY FUNDING SOURCE

National Heart, Lung, and Blood Institute.

The impact of Public Reporting on clinical outcomes: a systematic review and meta-analysis

Background

To assess both qualitatively and quantitatively the impact of Public Reporting (PR) on clinical outcomes, we carried out a systematic review of published studies on this topic.

Methods

Pubmed, Web of Science and SCOPUS databases were searched to identify studies published from 1991 to 2014 that investigated the relationship between PR and clinical outcomes. Studies were considered eligible if they investigated the relationship between PR and clinical outcomes and comprehensively described the PR mechanism and the study design adopted. Among the clinical outcomes identified, meta-analysis was performed for overall mortality rate which quantitative data were exhaustively reported in a sufficient number of studies. Two reviewers conducted all data extraction independently and disagreements were resolved through discussion. The same reviewers evaluated also the quality of the studies using a GRADE approach.

Results

Twenty-seven studies were included. Mainly, the effect of PR on clinical outcomes was positive. Meta-analysis regarding overall mortality included, in a context of high heterogeneity, 10 studies with a total of 1,840,401 experimental events and 3,670,446 control events and resulted in a RR of 0.85 (95 % CI, 0.79-0.92).

Conclusions

The introduction of PR programs at different levels of the healthcare sector is a challenging but rewarding public health strategy. Existing research covering different clinical outcomes supports the idea that PR could, in fact, stimulate providers to improve healthcare quality.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-016-1543-y) contains supplementary material, which is available to authorized users.

Relationship between hospital financial performance and publicly reported outcomes

BACKGROUND

Hospitals that have robust financial performance may have improved publicly reported outcomes.

OBJECTIVES

To assess the relationship between hospital financial performance and publicly reported outcomes of care, and to assess whether improved outcome metrics affect subsequent hospital financial performance.

DESIGN

Observational cohort study.

SETTING AND PATIENTS

Hospital financial data from the Office of Statewide Health Planning and Development in California in 2008 and 2012 were linked to data from the Centers for Medicare and Medicaid Services Hospital Compare website.

MEASUREMENTS

Hospital financial performance was measured by net revenue by operations, operating margin, and total margin. Outcomes were 30-day risk-standardized mortality and readmission rates for acute myocardial infarction (AMI), congestive heart failure (CHF), and pneumonia (PNA).

RESULTS

Among 279 hospitals, there was no consistent relationship between measures of financial performance in 2008 and publicly reported outcomes from 2008 to 2011 for AMI and PNA. However, improved hospital financial performance (by any of the 3 measures) was associated with a modest increase in CHF mortality rates (ie, 0.26% increase in CHF mortality rate for every 10% increase in operating margin [95% confidence interval: 0.07%-0.45%]). Conversely, there were no significant associations between outcomes from 2008 to 2011 and subsequent financial performance in 2012 (P > 0.05 for all).

CONCLUSIONS

Robust financial performance is not associated with improved publicly reported outcomes for AMI, CHF, and PNA. Financial incentives in addition to public reporting, such as readmissions penalties, may help motivate hospitals with robust financial performance to further improve publicly reported outcomes. Reassuringly, improved mortality and readmission rates do not necessarily lead to loss of revenue. Journal of Hospital Medicine 2016;11:481-488. © 2016 Society of Hospital Medicine.

How well do subjective Hospital Compare metrics reflect objective outcomes in spine surgery?

OBJECTIVE The accuracy of public reporting in health care is an issue of debate. The authors investigated the association of patient satisfaction measures from a public reporting platform with objective outcomes for patients undergoing spine surgery. METHODS The authors performed a cohort study involving patients undergoing elective spine surgery from 2009 to 2013 who were registered in the New York Statewide Planning and Research Cooperative System database. This cohort was merged with publicly available data from the Centers for Medicare and Medicaid Services (CMS) Hospital Compare website. A mixed-effects regression analysis, controlling for clustering at the hospital level, was used to investigate the association of patient satisfaction metrics with outcomes. RESULTS During the study period, 160,235 patients underwent spine surgery. Using a mixed-effects multivariable regression analysis, the authors demonstrated that undergoing elective spine surgery in hospitals with a higher percentage of patient-assigned high satisfaction scores was not associated with a decreased rate of discharge to rehabilitation (OR 0.77, 95% CI 0.57-1.06), mortality (OR 0.96, 95% CI 0.90-1.01), or hospitalization charges (β 0.04, 95% CI -0.16 to 0.23). However, it was associated with decreased length of stay (LOS; β -0.19, 95% CI -0.33 to -0.05). Similar associations were identified for hospitals with a higher percentage of patients who claimed they would recommend these institutions to others. CONCLUSIONS Merging a comprehensive all-payer cohort of spine surgery patients in New York state with data from the CMS Hospital Compare website, the authors were not able to demonstrate an association of improved performance in patient satisfaction measures with decreased mortality, rate of discharge to rehabilitation, and hospitalization charges. Increased patient satisfaction was associated with decreased LOS.

Quality and Outcomes of Treatment of Hypercalcemia of Malignancy

Using a nationwide database, 4,874 patients with hypercalcemia of malignancy were identified. The in-hospital mortality rate was 6.8%. Overall, 1,971 (40.4%) patients received pamidronate and 1,399 (28.7%) received zoledronic acid during hospitalization. Calcitonin was utilized in 1,337 (27.4%) patients while glucocorticoids were administered to 1,311 (26.9%). Use of contraindicated medications was noted in 136 (2.8%) patients who received thiazide diuretics and 12 (0.2%) who received lithium. Tumor site, presence of bone metastases, and severity of illness were predictors of treatment. There was no association between treatment with bisphosphonates, calcitonin, or glucocorticoids and morbidity or mortality.

The dysfunctional consequences of a performance measurement system: the case of the Iranian national hospital grading programme

Objectives

Performance measurement systems are increasingly used to reward and improve provider performance. However, such initiatives may also inadvertently induce a range of unintended and dysfunctional side-effects. This study explores the unintended and adverse consequences induced by the Iranian national hospital grading programme, which incorporates financial incentives for meeting nationally defined standards.

Methods

We interviewed key informants across four key groups with a legitimate interest in healthcare performance: four purposively selected hospitals; four health insurance organizations; the Iranian hospital accreditation body; and one grading agency. The transcribed interviews and field notes were analysed thematically, and subsequently, member checking was conducted.

Results

Seven dysfunctional consequences were identified: misrepresentation of data by hospitals; increased anxiety and stress among hospital employees; tunnel vision; financial pressures on poorly graded hospitals; incentives to purchase unnecessary equipment; erosion of public trust; and restricting access to hospital services by patients. These were caused by the way the grading system was implemented: poor standards of audit; the way in which the audit process was conducted; and the timing of audits. The pay for performance element of the grading system and the focus on structural aspects in the standards made improvement in grading particularly difficult for those hospitals that had been assessed as under-performing.

Conclusion

Although the Iranian hospital grading system has resulted in a significant increase in the adoption of national standards, it has nevertheless induced a range of perverse outcomes. To mitigate these requires further refinement and recalibration of the system.

Challenges in assessing the process-outcome link in practice

The expanded use of clinical process-of-care measures to assess the quality of health care in the context of public reporting and pay-for-performance applications has led to a desire to demonstrate the value of such efforts in terms of improved patient outcomes. The inability to observe associations between improved delivery of clinical processes and improved clinical outcomes in practice has raised concerns about the value of holding providers accountable for delivery of clinical processes of care. Analyses that attempt to investigate this relationship are fraught with many challenges, including selection of an appropriate outcome, the proximity of the outcome to the receipt of the clinical process, limited power to detect an effect, small expected effect sizes in practice, potential bias due to unmeasured confounding factors, and difficulties due to changes in measure specification over time. To avoid potentially misleading conclusions about an observed or lack of observed association between a clinical process of care and an outcome in the context of observational studies, individuals conducting and interpreting such studies should carefully consider, evaluate, and acknowledge these types of challenges.

Relationship between surgical oncologic outcomes and publically reported hospital quality and satisfaction measures

BACKGROUND

Hospital-level measures of patient satisfaction and quality are now reported publically by the Centers for Medicare and Medicaid Services. There are limited metrics specific to cancer patients. We examined whether publically reported hospital satisfaction and quality data were associated with surgical oncologic outcomes.

METHODS

The Nationwide Inpatient Sample was utilized to identify patients with solid tumors who underwent surgical resection in 2009 and 2010. The hospitals were linked to Hospital Compare, which collects data on patient satisfaction, perioperative quality, and 30-day mortality for medical conditions (pneumonia, myocardial infarction [MI], and congestive heart failure [CHF]). The risk-adjusted hospital-level rates of morbidity and mortality were calculated for each hospital and the means compared between the highest and lowest performing hospital quartiles and reported as absolute reduction in risk (ARR), the difference in risk of the outcome between the two groups. All statistical tests were two-sided.

RESULTS

A total of 63197 patients treated at 448 hospitals were identified. For patients at high vs low performing hospitals based on Hospital Consumer Assessment of Healthcare Providers and Systems scores, the ARR in perioperative morbidity was 3.1% (95% confidence interval [CI] = 0.4% to 5.7%, P = .02). Similarly, the ARR for mortality based on the same measure was -0.4% (95% CI = -1.5% to 0.6%, P = .40). High performance on perioperative quality measures resulted in an ARR of 0% to 2.2% for perioperative morbidity (P > .05 for all). Similarly, there was no statistically significant association between hospital-level mortality rates for MI (ARR = 0.7%, 95% CI = -1.0% to 2.5%), heart failure (ARR = 1.0%, 95% CI = -0.6% to 2.7%), or pneumonia (ARR = 1.6%, 95% CI = -0.3% to 3.5%) and complications for oncologic surgery patients.

CONCLUSION

Currently available measures of patient satisfaction and quality are poor predictors of outcomes for cancer patients undergoing surgery. Specific metrics for long-term oncologic outcomes and quality are needed.

Collaborative quality improvement in surgery

Collaborative quality improvement has demonstrated success in improving quality and reducing health care costs in several state-based examples. Professional societies and payers are keen on identifying the most effective strategies to improve the safety and efficiency of surgical care. This review highlights the development and features of collaborative quality improvement programs, their advantages and examples of successful collaborations for several surgical conditions, and their potential application for surgeons caring for patients with upper extremity trauma and disability.

Evaluation of an emergency department lean process improvement program to reduce length of stay

STUDY OBJECTIVE

In recent years, lean principles have been applied to improve wait times in the emergency department (ED). In 2009, an ED process improvement program based on lean methods was introduced in Ontario as part of a broad strategy to reduce ED length of stay and improve patient flow. This study seeks to determine the effect of this program on ED wait times and quality of care.

METHODS

We conducted a retrospective cohort study of all ED visits at program and control sites during 3 program waves from April 1, 2007, to June 30, 2011, in Ontario, Canada. Time series analyses of outcomes before and after the program and difference-in-differences analyses comparing changes in program sites with control sites were conducted.

RESULTS

In before-after models among program sites alone, 90th percentile ED length of stay did not change in wave 1 (-14 minutes [95% confidence interval {CI} -47 to 20]) but decreased after wave 2 (-87 [95% CI -108 to -66]) and wave 3 (-33 [95% CI -50 to -17]); median ED length of stay decreased after wave 1 (-18 [95% CI -24 to -12]), wave 2 (-23 [95% CI -27 to -19]), and wave 3 (-15 [95% CI -18 to -12]). In all waves, decreases were observed in time to physician assessment, left-without-being-seen rates, and 72-hour ED revisit rates. In the difference-in-difference models, in which changes in program sites were compared with controls, the program was associated with no change in 90th percentile ED length of stay in wave 2 (17 [95% CI -0.2 to 33]) and increases in wave 1 (23 [95% CI 0.9 to 45]) and wave 3 (31 [95% CI 10 to 51]), modest reductions in median ED length of stay in waves 2 and 3 alone, and a decrease in time to physician assessment in wave 3 alone.

CONCLUSION

Although the program reduced ED waiting times, it appeared that its benefits were diminished or disappeared when compared with that of control sites, which were exposed to system-wide initiatives such as public reporting and pay for performance. This study suggests that further evaluation of the effectiveness of lean methods in the ED is warranted before widespread implementation.

The association of hospital characteristics and quality improvement activities in inpatient medical services

BACKGROUND

Quality of U.S. health care has been the focus of increasing attention, with deficiencies in patient care well recognized and documented. However, relatively little is known about the extent to which hospitals engage in quality improvement activities (QIAs) or factors influencing extent of QIAs.

OBJECTIVE

To identify 1) the extent of QIAs in Veterans Administration (VA) inpatient medical services; and 2) factors associated with widespread adoption of QIAs, in particular use of hospitalists, non-physician providers, and extent of goal alignment between the inpatient service and senior managers on commitment to quality.

DESIGN

Cross-sectional, descriptive study of QIAs using a survey administered to Chiefs of Medicine (COM) at all 124 VA acute care hospitals. We conducted hierarchical regression, regressing QIA use on facility contextual variables, followed by use of hospitalists, non-physician providers, and goal alignment/quality commitment.

MAIN MEASURES

Outcome measures pertained to use of a set of 27 QIAs and to three dimensions--infrastructure, prevention, and information gathering--that were identified by factor analysis among the 27 QIAs overall.

KEY RESULTS

Survey response rate was 90 % (111/124). Goal alignment/quality commitment was associated with more widespread use of all four QIA categories [infrastructure (b = 0.42; p < 0.001); prevention (b = 0.24; p < 0.001); information gathering (b = 0.28; p = <0.001); and overall QIA (b = 0.31; p < 0.001)], as was greater use of hospitalists [infrastructure (b = 0.55; p = 0.03); prevention (b = 0.61; p < 0.001); information gathering (b = 0.75; p = 0.01); and overall QIAs (b = 0.61; p < 0.001)]; higher occupancy rate was associated with greater infrastructure QIAs (b = 1.05, p = 0.02). Non-physician provider use, hospital size, university affiliation, and geographic region were not associated with QIAs.

CONCLUSION

As hospitals respond to changes in healthcare (e.g., pay for performance, accountable care organizations), this study suggests that practices such as use of hospitalists and leadership focus on goal alignment/quality commitment may lead to greater implementation of QIAs.

Sustainability of quality improvement following removal of pay-for-performance incentives

BACKGROUND

Although pay-for-performance (P4P) has become a central strategy for improving quality in US healthcare, questions persist about the effectiveness of these programs. A key question is whether quality improvement that occurs as a result of P4P programs is sustainable, particularly if incentives are removed.

OBJECTIVE

To investigate sustainability of performance levels following removal of performance-based incentives.

DESIGN, SETTING, AND PARTICIPANTS

Observational cohort study that capitalized on a P4P program within the Veterans Health Administration (VA) that included adoption and subsequent removal of performance-based incentives for selected inpatient quality measures. The study sample comprised 128 acute care VA hospitals where performance was assessed between 2004 and 2010.

INTERVENTION

VA system managers set annual performance goals in consultation with clinical leaders, and report performance scores to medical centers on a quarterly basis. These scores inform performance-based incentives for facilities and their managers. Bonuses are distributed based on the attainment of these performance goals.

MEASUREMENTS

Seven quality of care measures for acute coronary syndrome, heart failure, and pneumonia linked to performance-based incentives.

RESULTS

Significant improvements in performance were observed for six of seven quality of care measures following adoption of performance-based incentives and were maintained up to the removal of the incentive; subsequently, the observed performance levels were sustained.

LIMITATIONS

This is a quasi-experimental study without a comparison group; causal conclusions are limited.

CONCLUSION

The maintenance of performance levels after removal of a performance-based incentive has implications for the implementation of Medicare's value-based purchasing initiative and other P4P programs. Additional research is needed to better understand human and system-level factors that mediate sustainability of performance-based incentives.

Can public reporting impact patient outcomes and disparities? A systematic review

OBJECTIVE

Recent US healthcare reforms aim to improve quality and access. We synthesized evidence assessing the impact that public reporting (PR), which will be extended to the outpatient setting, has on patient outcomes and disparities.

METHODS

A systematic review using PRISMA guidelines identified studies addressing the impact of PR on patient outcomes and disparities.

RESULTS

Of the 1970 publications identified, 25 were relevant, spanning hospitals (16), nursing homes (5), emergency rooms (1), health plans (2), and home health agencies (1). Evidence of effect on patient outcomes was mixed, with 6 studies reporting a favorable effect, 9 a mixed effect, 9 a null effect, and 1 a negative effect. One study found a mixed effect of PR on disparities.

CONCLUSION

The evidence of the impact of PR on patient outcomes is lacking, with limited evidence that PR has a favorable effect on outcomes in nursing homes. There is little evidence supporting claims that PR will have an impact on disparities or in the outpatient setting.

PRACTICE IMPLICATIONS

Health systems should collect information on patient-relevant outcomes. The lack of evidence does not necessarily imply a lack of effect, and a research gap exists regarding patient-relevant outcomes and PR.

Current medical management of stable coronary artery disease before and after elective percutaneous coronary intervention

BACKGROUND

Percutaneous coronary intervention (PCI) for stable coronary artery disease (CAD) is not superior to optimal medical therapy. It remains unclear if patients who receive PCI for stable CAD are receiving appropriate medical therapy.

METHODS

We evaluated the medical management of 60,386 patients who underwent PCI for stable CAD between 2004 and 2009. We excluded patients with contraindications to aspirin, clopidogrel, statins, or β-blockers (BBs). We defined essential medical therapy of stable CAD as treatment with aspirin, statin, and BB before PCI and treatment with aspirin, clopidogrel, and statin after PCI.

RESULTS

Essential medical therapy was used in 53.0% of patients before PCI and 82.1% at discharge. Aspirin was used in 94.8% patients before PCI and 98.3% of after PCI. Statins were used in 69.5% of patients before PCI and 84.5% after PCI. β-Blockers were used in 72.8% of patients before PCI. Clopidogrel was used in 97.3% of patients after PCI. Patients with a history of myocardial infarction or revascularization before PCI had better medical therapy compared with patients without such a history (62.8% vs 34.3% [P < .001] before PCI and 83.6% vs 79.1% [P < .001] after PCI). After adjusting for confounders and clustering, women (odds ratio 0.74, 95% CI 0.71-0.78) and patients on dialysis (odds ratio 0.68, 95% CI 0.57-0.80) were less likely to receive a statin at discharge.

CONCLUSIONS

Medical therapy remains underused before and after PCI for stable CAD. Women are less likely to receive statin therapy. There are significant opportunities to optimize medical therapy in patients with stable CAD.

Are AMI patients with comorbid mental illness more likely to be admitted to hospitals with lower quality of AMI care?

Objective

Older patients with comorbid mental illness are shown to receive less appropriate care for their medical conditions. This study analyzed Medicare patients hospitalized for acute myocardial infarction (AMI) and determined whether those with comorbid mental illness were more likely to present to hospitals with lower quality of AMI care.

Methods

Retrospective analyses of Medicare claims in 2008. Hospital quality was measured using the five “Hospital Compare” process indicators (aspirin at admission/discharge, beta-blocker at admission/discharge, and angiotension-converting enzyme inhibitor or angiotension receptor blocker for left ventricular dysfunction). Multinomial logit model determined the association of mental illness with admission to low-quality hospitals (rank of the composite process score <10^th percentile) or high-quality hospitals (rank>90^th percentile), compared to admissions to other hospitals with medium quality. Multivariate analyses further determined the effects of hospital type and mental diagnosis on outcomes.

Results

Among all AMI admissions to 2,845 hospitals, 41,044 out of 287,881 patients were diagnosed with mental illness. Mental illness predicted a higher likelihood of admission to low-quality hospitals (unadjusted rate 2.9% vs. 2.0%; adjusted odds ratio [OR]1.25, 95% confidence interval [CI] 1.17–1.34, p<0.01), and an equal likelihood to high-quality hospitals (unadjusted rate 9.8% vs. 10.3%; adjusted OR 0.97, 95% CI 0.93–1.01, p = 0.11). Both lower hospital quality and mental diagnosis predicted higher rates of 30-day readmission, 30-day mortality, and 1-year mortality.

Conclusions

Among Medicare myocardial infarction patients, comorbid mental illness was associated with an increased risk for admission to lower-quality hospitals. Both lower hospital quality and mental illness predicted worse post-AMI outcomes.