Measuring Risk-Adjusted Value Using Medicare and ACS-NSQIP: Is High-Quality, Low-Cost Surgical Care Achievable Everywhere?

Analysis of a modified surgical desirability of outcome ranking (mDOOR) among patients undergoing surgery for Hepatocellular carcinoma

BACKGROUND

Composite measures represent a validated method for evaluating surgical care quality. We defined a modified Desirability Of Outcome Ranking (mDOOR) and compared it with textbook outcome (TO).

METHODS

In this cohort study, patients undergoing curative-intent surgery for HCC were identified from an international cohort. The performance and agreement of mDOOR, TO, and other measures of postoperative course with respect to overall survival (OS) were compared using Harrell's Concordance-index (C-index) and Cohen's kappa.

RESULTS

Among 2181 patients, 77.6 % (n = 1692) achieved the most desirable outcome (i.e., DOOR1), whereas roughly one-half of patients achieved TO (n = 1,171, 53.7 %). Patients with lower mDOOR had a better 5-year OS compared with patients with higher mDOOR (64.7 % vs. 51.9 %; p < 0.001). On multivariable analysis, higher mDOOR was associated with worse OS (HR 1.35, 95%CI 1.28-1.44; p < 0.001). The mDOOR demonstrated improved performance compared with the comprehensive complication index (C-index: 0.696 vs. 0.649; p < 0.001) and the Accordion score (C-index: 0.696 vs. 0.653; p = 0.002).

CONCLUSION

Roughly 4 out of 5 patients achieved the most desirable outcome. Higher mDOOR was associated with worse long-term outcomes. A composite outcome ranking may provide more insight on surgical outcomes, complementing traditional metrics.

Analysis of textbook outcomes for ampullary carcinoma patients following pancreaticoduodenectomy

BACKGROUND

Textbook outcomes (TOs) have been used to assess the quality of surgical treatment for many digestive tumours but not ampullary carcinoma (AC).

AIM

To discuss the factors associated with achieving a TO and further explore the prognostic value of a TO for AC patients undergoing curative pancreaticoduodenectomy (PD).

METHODS

Patients who underwent PD at the China National Cancer Center between 1998 and 2020 were identified. A TO was defined by R0 resection, examination of ≥ 12 Lymph nodes, no prolonged hospitalization, no intensive care unit treatment, no postoperative complications, and no 30-day readmission or mortality. Cox regression analysis was used to identify the prognostic value of a TO for overall survival (OS) and recurrence-free survival (RFS). Logistic regression was used to identify predictors of a TO. The rate of a TO and of each indicator were compared in patients who underwent surgery before and after 2010.

RESULTS

Ultimately, only 24.3% of 272 AC patients achieved a TO. A TO was independently associated with improved OS [hazard ratio (HR): 0.443, 95% confidence interval (95%CI): 0.276-0.711, P = 0.001] and RFS (HR: 0.379, 95%CI: 0.228-0.629, P < 0.001) in the Cox regression analysis. Factors independently associated with a TO included a year of surgery between 2010 and 2020 (OR: 4.549, 95%CI: 2.064-10.028, P < 0.001) and N1 stage disease (OR: 2.251, 95%CI: 1.023-4.954, P = 0.044). In addition, the TO rate was significantly higher in patients who underwent surgery after 2010 (P < 0.001) than in those who underwent surgery before 2010.

CONCLUSION

Only approximately a quarter (24.3%) of AC patients achieved a TO following PD. A TO was independently related to favourable oncological outcomes in AC and should be considered as an outcome measure for the quality of surgery. Further multicentre research is warranted to better elucidate its impact.

Quality Versus Costs Related to Gastrointestinal Surgery: Disentangling the Value Proposition

BACKGROUND

There has been a dramatic increase in worldwide health care spending over the last several decades. Operative procedures and perioperative care in the USA represent some of the most expensive episodes per patient. In view of both the rising cost of health care in general and the rising cost of surgical care specifically, policymakers and stakeholders have sought to identify ways to increase the value-improving quality of care while controlling (or diminishing) costs. In this context, we reviewed data relative to achieving the "value proposition" in the delivery of gastrointestinal surgical care.

METHODS

The National Library of Medicine online repository (PubMed) was text searched for human studies including "cost," "quality," "outcomes," "health care," "surgery," and "value." Results from this literature framed by the Donabedian conceptual model (identifying structures, processes, and outcomes), and the resulting impact of efforts to improve quality on costs.

RESULTS

The relationship between quality and costs was nuanced. Better quality care, though associated with better outcomes, was not always reported as concomitant with low costs. Moreover, some centers reported higher costs of surgical care commensurate with higher quality. Conversely, higher costs in health care delivery were not always linked to improved outcomes. While higher quality surgical care can lead to lower costs, higher costs of care were not necessarily associated with better outcomes. Strategies to improve quality, reduce cost, or achieve both simultaneously included regionalization of complex operations to high-volume centers of excellence, overall reduction in complications, introducing evidence-based improvements in perioperative care pathways including as enhanced recovery after surgery (ERAS), and elimination of inefficient or low-value care.

CONCLUSIONS

The relationship between quality and cost following gastrointestinal surgical procedure is complex. Data from the current study should serve to highlight the various means available to improve the value proposition related to surgery, as well as encourage surgeons to become more engaged in the national conversation around the Triple Aim of better health care quality, lower costs, and improved health care outcomes.

Hospital variation in Textbook Outcomes following curative-intent resection of hepatocellular carcinoma: an international multi-institutional analysis

BACKGROUND

Composite measures such as "Textbook Outcome" (TO) may be superior to individual quality metrics to assess surgical care and hospital performance. However, the incidence and factors associated with TO after resection of HCC remain poorly defined.

METHODS

Hospital variation in the rates of TO, factors associated with achieving a TO and the impact of TO on long-term survival following resection for HCC were examined using an international multi-institutional database.

RESULTS

Among 605 patients who underwent curative-intent resection of HCC, the unadjusted incidence of TO ranged from 50.9% to 77.7%. While achievement of each individual quality metric was relatively high (range, 74.5-98.0%), an overall TO was achieved among only 62.3% (n = 377) of patients. At the hospital level, TO ranged from 54.3% to 72.9%. Patients with BCLC-0 HCC (referent BCLC-B/C; OR: 4.17, 95%CI: 1.62-10.7) and ALBI grade 1 (referent ALBI grade 2/3; OR: 1.49, 95%CI: 1.06-2.11) had higher odds of achieving a TO. On multivariable analysis, TO was associated with improved overall survival (HR: 0.60, 95% CI: 0.42-0.85).

CONCLUSION

Roughly 6 in 10 patients achieved a TO following resection for HCC. When achieved, TO was associated with better long-term outcomes. TO is a simple composite measure of both short- and long-term outcomes among patients undergoing resection for HCC.

Textbook Outcomes Among Medicare Patients Undergoing Hepatopancreatic Surgery

OBJECTIVE

To define and test "Textbook Outcome" (TO)-a composite measure for healthcare quality-among Medicare patients undergoing hepatopancreatic resections. Hospital variation in TO and Medicare payments were analyzed.

BACKGROUND

Composite measures of quality may be superior to individual measures for the analysis of hospital performance.

METHODS

The Medicare Provider Analysis and Review (MEDPAR) Inpatient Files were reviewed to identify Medicare patients who underwent pancreatic and liver procedures between 2013 and 2015. TO was defined as: no postoperative surgical complications, no prolonged length of hospital stay, no readmission ≤ 90 days after discharge, and no postoperative mortality ≤ 90 days after surgery. Medicare payments were compared among patients who achieved TO versus patients who did not. Multivariable logistic regression was used to investigate patient factors associated with TO. A nomogram to predict probability of TO was developed and validated.

RESULTS

TO was achieved in 44% (n = 5919) of 13,467 patients undergoing hepatopancreatic surgery. Adjusted TO rates at the hospital level varied from 11.1% to 69.6% for pancreatic procedures and from 16.6% to 78.7% for liver procedures. Prolonged length of hospital stay represented the major obstacle to achieve TO. Average Medicare payments were substantially higher among patients who did not have a TO. Factors associated with TO on multivariable analysis were age, sex, Charlson comorbidity score, previous hospital admissions, procedure type, and surgical approach (all P > 0.05).

CONCLUSIONS

Less than one-half of Medicare patients achieved a TO following hepatopancreatic procedures with a wide variation in the rates of TO among hospitals. There was a discrepancy in Medicare payments for patients who achieved a TO versus patients who did not. TO could be useful for the public reporting of patient level hospital performance and hospital variation.

Defining Value for Pancreatic Surgery in Early-Stage Pancreatic Cancer

Importance

Value-based care is increasingly important, with rising health care costs and advances in cancer treatment leading to greater survival for patients with cancer. Regionalization of surgical care for pancreatic cancer has been extensively studied as a strategy to improve perioperative outcomes, but investigation of long-term outcomes relative to health care costs (ie, value) is lacking.

Objective

To identify patient and hospital characteristics associated with improved overall survival, decreased costs, and greater value among patients with pancreatic cancer undergoing curative resection.

Design, Setting, and Participants

This retrospective cohort study identified 2786 patients with stages I to II pancreatic cancer who underwent pancreatic resection at 157 hospitals from January 1, 2004, through December 31, 2012. The study used the California Cancer Registry, which collects data from all California residents newly diagnosed with cancer, linked to the Office of Statewide Health Planning and Development database, which collects administrative data from all California licensed hospitals. Data were analyzed from November 11, 2017, through September 4, 2018.

Exposures

Pancreatic resection at high-volume and/or National Cancer Institute (NCI)-designated cancer centers.

Main Outcomes and Measures

The primary outcomes were overall survival, surgical hospitalization costs, and value. High value was defined as the fourth quintile or higher for survival and the second quintile or less for costs. Costs were calculated from charges using cost-charge ratios and adjusted for geographic variation and inflation. Multivariable regression models were used to determine factors associated with overall survival, costs, and high value.

Results

Among the 2786 patients included (1394 [50.0%] male; mean [SD] age, 67.0 [10.7] years), postoperative chemotherapy (adjusted hazard ratio [aHR], 0.71; 95% CI, 0.64-0.79; P < .001) and high-volume centers (aHR, 0.78; 95% CI, 0.61-0.99; P = .04) were associated with greater overall survival. Higher Elixhauser comorbidity index scores (estimate, 0.006; 95% CI, 0.003-0.008), complications (estimate, 0.22; 95% CI, 0.17-0.27), readmissions (estimate, 0.34; 95% CI, 0.29-0.39), and longer lengths of stay (estimate, 0.03; 95% CI, 0.03-0.04) were associated with higher costs (P < .001), whereas postoperative chemotherapy was associated with lower costs (estimate, -0.06; 95% CI, -0.11 to -0.02; P = .006). National Cancer Institute-designated and high-volume centers were not associated with costs. Although grades III and IV tumors (odds ratio [OR], 0.65; 95% CI, 0.39-0.91; P = .001), T3 category disease (OR, 0.71; 95% CI, 0.46-0.95; P = .005), complications (OR, 0.68; 95% CI, 0.49-0.86; P < .001), readmissions (OR, 0.64; 95% CI, 0.44-0.84; P < .001), and length of stay (OR, 0.82; 95% CI, 0.78-0.85; P < .001) were inversely associated with high-value care, NCI designation (OR, 1.07; 95% CI, 0.66-1.49; P = .74) and high-volume centers (OR, 1.08; 95% CI, 0.54-1.61; P = .07) were not.

Conclusions and Relevance

In this study, high-value care was associated with important patient characteristics and postoperative outcomes. However, NCI-designated and high-volume centers were not associated with greater value. These data suggest that targeted measures to enhance value may be needed in these centers.

A Multi-institutional International Analysis of Textbook Outcomes Among Patients Undergoing Curative-Intent Resection of Intrahepatic Cholangiocarcinoma

Importance

Composite measures may be superior to individual measures for the analysis of hospital performance and quality of surgical care.

Objective

To determine the incidence of a so-called textbook outcome, a composite measure of the quality of surgical care, among patients undergoing curative-intent resection of intrahepatic cholangiocarcinoma.

Design, Setting, and Participants

This cohort study involved an analysis of a multinational, multi-institutional cohort of patient from 15 major hepatobiliary centers in North America, Europe, Australia, and Asia who underwent curative-intent resection of intrahepatic cholangiocarcinoma between 1993 and 2015. Data analysis was conducted from April 2018 to May 2018.

Main Outcomes and Measures

Hospital variation in the composite end point of textbook outcome, defined as negative margins, no perioperative transfusion, no postoperative surgical complications, no prolonged length of stay, no 30-day readmissions, and no 30-day mortality. Secondary end points were factors associated with achieving textbook outcomes.

Results

Among 687 patients (of whom 370 [53.9%] were men; median patient age, 61 [range, 18-86] years) undergoing curative-intent resection of intrahepatic cholangiocarcinoma, a textbook outcome was achieved in 175 patients (25.5%). Being 60 years or younger (odds ratio [OR], 1.61 [95% CI, 1.04-2.49]; P = .03), absence of preoperative jaundice (OR, 4.40 [95% CI, 1.28-15.15]; P = .02), no neoadjuvant chemotherapy (OR, 2.57 [95% CI, 1.05-6.29]; P = .04), T1a/T1b-stage disease (OR, 1.58 [95% CI, 1.01-2.49]; P = .049), N0 status (OR, 3.89 [95% CI, 1.77-8.54]; P = .001), and no bile duct resection (OR, 2.46 [95% CI, 1.25-4.84]; P = .009) were independently associated with achieving a textbook outcome after resection. A prolonged length of stay had the greatest negative association with a textbook outcome. A nomogram to assess the probability of textbook outcome was developed and had good accuracy in both the training data set (area under the curve, 0.755) and validation data set (area under the curve, 0.763).

Conclusions and Relevance

In this study, while hepatic resection for intrahepatic cholangiocarcinoma was performed with less than 5% mortality in specialized centers, a textbook outcome was achieved in only approximately 26% of patients. A textbook outcome may be useful for the reporting of patient-level hospital performance and hospital variation, leading to quality improvement efforts after resection of intrahepatic cholangiocarcinoma.

Variation in the cost-of-rescue among medicare patients with complications following hepatopancreatic surgery

BACKGROUND

The relationship of expenditures related to rescuing patients from complications and hospital quality has not been well characterized. We sought to examine the relationship between payments for treating post-operative complications after liver and pancreas surgery and hospital quality.

METHODS

A retrospective cohort study of patients who underwent hepatopancreatic surgery was performed using claims data from 2013 to 2015 in the Medicare Provider Analysis and Review (MEDPAR) database. Medicare payments for index hospitalization and readmissions, as well as perioperative clinical outcomes were analyzed. Hospitals were stratified using average payments for patients who were rescued from complications (cost-of-rescue).

RESULTS

A total of 13,873 patients and 737 hospitals were included in the analyses. Patient characteristics were similar across hospitals. Risk-adjusted rates of overall complications were higher at the highest cost-of-rescue hospitals (relative risk [RR], 1.35, 95% confidence interval [CI] 1.16-1.58), as well as rates of serious complications (RR, 1.78, 95% CI 1.51-2.09), 30-day readmission (RR 1.21 95% CI 1.06-1.39), 90-day mortality (RR, 1.29, 95% CI 1.01-1.64), and rates of failure-to-rescue (RR, 1.50, 95% CI 1.14-1.97).

CONCLUSION

Highest cost-of-rescue hospitals demonstrated worse quality metrics, including higher rates of serious complications, failure-to-rescue, 30-day readmission, and 90-day mortality.

Is More Really Better? An Examination of Services and Payment Patterns among Urologists from the Centers for Medicare & Medicaid Services

INTRODUCTION

We examined provider and regional variation in services provided and payments made to urologists by CMS (Centers for Medicare & Medicaid Services) by linking payments to individual beneficiaries and examining the proportion of submitted charges resulting in payments.

METHODS

We analyzed Medicare Part B Provider Utilization and Payment Data released by CMS for 2012, the last year of the purely fee-for-service reimbursement model. For each provider we determined the ratio of number of services provided to individual beneficiaries as well as the ratio of total submitted charges-to-total Medicare payments. Each provider was stratified into deciles of total Medicare payments and the mean per decile of total Medicare payment was calculated. Finally, to elucidate the potential association between the ratio of services-to-beneficiaries, we conducted multivariate linear regressions.

RESULTS

The 20th, 40th, 60th and 80th percentiles for the ratio of number of services per individual beneficiary ratios to total Medicare Part B payments are 2.8, 4.0, 5.2 and 7.4, respectively. Urologists with greater payments received provided more services to individual beneficiaries. Submitted charges exceeded payments by 3:1. Finally, female providers had lower ratios (p <0.01) and there was significant regional variation in the ratio of services per unique beneficiary (p <0.001 for each of the 10 Standard Federal Regions).

CONCLUSIONS

We found significant variation in services and payment in CMS. Reimbursement models replacing fee-for-service should be tailored to ensure appropriate health care resource utilization.

Postoperative Complications and Hospital Payment: Implications for Achieving Value

BACKGROUND

As the current healthcare structure moves toward value-based purchasing, it is helpful for stakeholders to understand costs, particularly for those associated with postoperative complications. The objectives of this study were to assess hospital reimbursements for postoperative complications and generate insight into sustainability of quality.

STUDY DESIGN

American College of Surgeons NSQIP and Medicare claims data from 2009 to 2012 were merged for elective colectomy, total knee arthroplasty, and carotid endarterectomy. Payments associated with 7 postoperative complications across each operation were estimated from multivariable regression models. The impact on hospital marginal costs was estimated from the regression results by accounting for complication incidence rates.

RESULTS

Mean hospital payments per uncomplicated procedure were approximately $13,500 for colectomy (n = 19,089), $12,300 for total knee arthroplasty (n = 17,834), and $7,300 for carotid endarterectomy (n = 16,207). The payment amount per complication increased at a rate of $10,996 for colectomy, $13,732 for total knee arthroplasty, and $8,435 for carotid endarterectomy. When distinguishing between types of complications, the most expensive complication was prolonged ventilation, increasing mean payment by approximately $14,100 (colectomy) and $6,700 (carotid endarterectomy), respectively. Hospital marginal costs accounting for complication rates added additional amounts ranging from 0.82% to 9.2%.

CONCLUSIONS

Postoperative complications add an important marginal cost to Medicare payments, and lead to a substantial portion of payments to hospitals. Using high-quality clinical registry data to measure complication rates, we estimated the cost of complications for 3 commonly performed operations among the Medicare population. Harmonizing financial incentives for both payers and providers are needed to improve the delivery of high-quality surgical care.

Solving the Value Equation: Assessing Surgeon Performance Using Risk-Adjusted Quality-Cost Diagrams and Surgical Outcomes

Quality-cost diagrams have been used previously to assess interventions and their cost-effectiveness. This study explores the use of risk-adjusted quality-cost diagrams to compare the value provided by surgeons by presenting cost and outcomes simultaneously. Colectomy cases from a single institution captured in the National Surgical Quality Improvement Program database were linked to hospital cost-accounting data to determine costs per encounter. Risk adjustment models were developed and observed average cost and complication rates per surgeon were compared to expected cost and complication rates using the diagrams. Surgeons were surveyed to determine if the diagrams could provide information that would result in practice adjustment. Of 55 surgeons surveyed on the utility of the diagrams, 92% of respondents believed the diagrams were useful. The diagrams seemed intuitive to interpret, and making risk-adjusted comparisons accounted for patient differences in the evaluation.

Variations in payment patterns for surgical care in the centers for Medicare and Medicaid Services

BACKGROUND

We investigated provider and regional variation in payments made to surgeons by the Centers for Medicare & Medicaid Services (CMS) by indexing payments to unique beneficiaries treated and examined the proportion of charges that resulted in payments. Understanding variation in care within CMS may prove actionable by identifying modifiable, and potentially unwarranted, variations.

METHODS

We analyzed the Medicare Part B Provider Utilization and Payment Data released by CMS for 2012. We included Medicare B participants in the fee-for-service program. We calculated for each provider the ratio of number of services provided to individual beneficiaries, and the ratio of total submitted charges to total Medicare payments. We also categorized each provider into deciles of total Medicare payments, and calculated the means per decile of total Medicare payment for surgeons and urologists. To determine any associations with ratio of services to beneficiaries, we conducted multivariate linear regressions.

RESULTS

The 20th, 40th, 60th, and 80th percentiles for the services-per-beneficiary ratios are 1.6, 2.2, 3.1, and 5.0, respectively (n = 83,376). Greater-earning surgeons offered more services per beneficiary, with a precipitous increase from the lowest decile to the highest. Charges were consistently greater than payments by a factor of 3. In our multivariate analysis of services per beneficiary ratio, female providers had lower ratios (P < .01), and we noted significant regional variation in the ratio of services per unique beneficiary (P < .001 for each of the 10 Standard Federal Regions).

CONCLUSION

We found significant variation in patterns of payments for surgical care in CMS.

Cost variation in a laparoscopic cholecystectomy and the association with outcomes across a single health system: implications for standardization and improved resource utilization

BACKGROUND

Payers and regulatory bodies are increasingly placing emphasis on cost containment, quality/outcome measurement and transparent reporting. Significant cost variation occurs in many operative procedures without a clear relationship with outcomes. Clear cost-benefit associations will be necessary to justify expenditures in the era of bundled payment structures.

METHODS

All laparoscopic cholecystectomies (LCCKs) performed within a single health system over a 1-year period were analysed for operating room (OR) supply cost. The cost was correlated with American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) outcomes.

RESULTS

From July 2013 to June 2014, 2178 LCCKs were performed by 55 surgeons at seven hospitals. The median case OR supply cost was $513 ± 156. There was variation in cost between individual surgeons and within an individual surgeon's practice. There was no correlation between cost and ACS NSQIP outcomes. The majority of cost variation was explained by selection of trocar and clip applier constructs.

CONCLUSIONS

Significant case OR cost variation is present in LCCK across a single health system, and there is no clear association between increased cost and NSQIP outcomes. Placed within the larger context of overall cost, the opportunity exists for improved resource utilization with no obvious risk for a reduction in the quality of care.

Putting the value framework to work in surgery

BACKGROUND

Health policy experts have proposed a framework defining value as outcomes achieved per dollar spent on health care. However, few institutions quantify their delivery of care along these dimensions. Our objective was to measure the value of our surgical services over time.

STUDY DESIGN

We reviewed the data of patients undergoing general and vascular surgery from 2002 through 2012 at a tertiary care university hospital as abstracted by the American College of Surgeons NSQIP. Morbidity and mortality data from the American College of Surgeons NSQIP database were risk adjusted to calculate observed-to-expected ratios, which were then inverted into a numerator as a surrogate for quality. Costs, the denominator of the value equation, were determined for each patient's hospitalization. The ratio was then transformed by a constant and analyzed with linear regression to analyze and compare values from 2002 through 2012.

RESULTS

A total of 25,453 patients met criteria for inclusion. Overall, the value of surgical services increased from 2002 through 2012. The observed increase in value was greater in general surgery than in vascular surgery, and value actually decreased in vascular procedures. Although there was a similar increase in outcomes in vascular surgery compared with general surgery, costs rose significantly higher ($474/year vs -$302/year; p < 0.001). These increased costs were mostly observed from 2006 through 2010 with the adoption of endovascular technology.

CONCLUSIONS

Despite the challenges posed by current information systems, calculating risk-adjusted value in surgical services represents a critical first step for providers seeking to improve outcomes, avoid ill-advised cost containment, and determine the costs of innovation.