Using risk-adjusted cumulative sum to evaluate surgeon, divisional, and institutional outcomes-a feasibility study

BACKGROUND

Few objective, real-time measurements of surgeon performance exist. The risk-adjusted cumulative sum is a novel method that can track surgeon-level outcomes on a continuous basis. The objective of this study was to demonstrate the feasibility of using risk-adjusted cumulative sum to monitor outcomes after colorectal operations and identify clinically relevant performance variations.

METHODS

The National Surgical Quality Improvement Program was queried to obtain patient-level data for 1,603 colorectal operations at a high-volume center from 2011 to 2020. For each case, expected risks of morbidity, mortality, reoperation, readmission, and prolonged length of stay were estimated using the National Surgical Quality Improvement Program risk calculator. Risk-adjusted cumulative sum curves were generated to signal observed-to-expected odds ratios of 1.5 (poor performance) and 0.5 (exceptional performance). Control limits were set based on a false positive rate of 5% (α = 0.05).

RESULTS

The cohort included data on 7 surgeons (those with more than 20 cases in the study period). Institutional observed versus expected outcomes were the following: morbidity 12.5% (vs 15.0%), mortality 2.5% (vs 2.0%), prolonged length of stay 19.7% (vs 19.1%), reoperation 11.1% (vs 11.3%), and 30-day readmission 6.1% (vs 4.8%). Risk-adjusted cumulative sum accurately demonstrated within- and between-surgeon performance variations across these metrics and proved effective when considering division-level data.

CONCLUSION

Risk-adjusted cumulative sum adjusts for patient-level risk factors to provide real-time data on surgeon-specific outcomes. This approach enables prompt identification of performance outliers and can contribute to quality assurance, root-cause analysis, and incentivization not only at the surgeon level but at divisional and institutional levels as well.

Laparoscopic surgery for adrenocortical carcinoma: Estimating the risk of margin-positive resection

BACKGROUND

Over recent years, there has been increasing adoption of minimally invasive surgery (MIS) in the treatment of adrenocortical carcinoma (ACC). However, MIS has been associated with noncurative resection and locoregional recurrence. We aimed to identify risk factors for margin-positivity among patients who undergo MIS resection for ACC. We hypothesized that a simple nomogram can accurately identify patients most suitable for curative MIS resection.

METHODS

Curative-intent resections for ACC were identified through the National Cancer Database spanning 2010-2018. Trends in MIS utilization were reported using Pearson correlation coefficients. Factors associated with margin-positive resection were identified among preoperatively available variables using multivariable logistic regression, then incorporated into a predictive model. Model quality was cross validated using an 80% training data set and 20% test data set.

RESULTS

Among 1260 ACC cases, 38.6% (486) underwent MIS resection. MIS utilization increased over time at nonacademic centers (R = 0.818, p = 0.007), but not at academic centers (R = 0.009, p = 0.982). Factors associated with margin-positive MIS resection were increasing age, nonacademic center (odds ratio [OR]: 1.8, p = 0.006), cT3 (OR: 4.7, p < 0.001) or cT4 tumors (OR: 14.6, p < 0.001), and right-sided tumors (OR: 2.0, p = 0.006). A predictive model incorporating these four factors produced favorable c-statistics of 0.75 in the training data set and 0.72 in the test data set. A pragmatic nomogram was created to enable bedside risk stratification.

CONCLUSIONS

An increasing proportion of ACC are resected via minimally invasive operations, particularly at nonacademic centers. Patient selection based on a few key factors can minimize the risk of noncurative surgery.

Real-Time Reporting of Complications in Hospitalized Surgical Patients by Surgical Team Members Using a Smartphone Application

BACKGROUND

The surgical morbidity and mortality (M&M) conference is a vital part of a resident's surgical education, but methods to collect and store M&M data are often rudimentary and unreliable. The authors propose a Health Insurance Portability and Accountability Act (HIPAA)-compliant, electronic health record (EHR)-connected application and database to report and store complication data.

METHODS

The app is linked to the patient's EHR, and as a result, basic data on each surgical case-including diagnosis, surgery type, and surgeon-are automatically uploaded to the app. In addition, all data are stored in a secure SQL database-with communications between the app and the database end-to-end encrypted for HIPAA compliance. The full surgical team has access to the app, democratizing complications reporting and allowing for reporting in both the inpatient and outpatient settings. This complication information can then be automatically pulled from the app with a premade presentation for the M&M conference. The data can also be accessed by a Power BI dashboard, allowing for easy quality improvement analyses.

RESULTS

When implemented, the app improved data collection for the M&M conference while providing a database for institutional quality improvement use. The authors also identified additional utility of the app, including ensuring appropriate revenue capture. The general appearance of the app and the dashboard can be found in the article.

CONCLUSION

The app developed in this project significantly improves on more common methods for M&M conference complication reporting-transforming M&M data into a valuable resource for resident education and quality improvement.

Sex-Based Differences in IBD Surgical Outcomes

BACKGROUND

Although there are discrepancies in the development and progression of IBD based on biologic sex, little is known about differences in postoperative outcomes between men and women undergoing surgery for this condition.

OBJECTIVE

To compare rates of anastomotic leaks, wound complications, and serious adverse events between men and women undergoing surgery for IBD.

DESIGN

This was a retrospective cohort study.

SETTINGS

Data were obtained from the American College of Surgeons National Surgical Quality Improvement Program IBD Collaborative database, which includes 15 high-volume IBD surgery centers.

PATIENTS

All adult patients undergoing surgery for IBD were included. Participants with missing data for exposure or outcome variables were excluded.

MAIN OUTCOME MEASURES

Rates of anastomotic leaks, wound complications, and serious adverse events were compared between women and men.

RESULTS

A total of 3143 patients were included. There was a significant association between sex and BMI, IBD type, and preoperative medication use. Women had decreased odds of serious adverse events compared to men (OR 0.73; 95% CI, 0.55-0.96), but there was no significant association between sex and anastomotic leaks or wound complications. IBD type was found to be an effect measure modifier of the relationship between sex and serious adverse events. Among patients with ulcerative colitis, women had a 54% decrease in the odds of serious adverse events compared to men, whereas there was no significant difference between women and men with Crohn's disease.

LIMITATIONS

This study was limited by capturing only 30 days of postoperative outcomes.

CONCLUSIONS

Women undergoing surgery for ulcerative colitis had decreased odds of serious adverse events compared to men. Understanding sex-based differences in outcomes allows clinicians to make patient-centered decisions regarding surgical planning and perioperative management for patients with IBD. See Video Abstract .

DIFERENCIAS BASADAS EN EL SEXO EN LOS RESULTADOS QUIRRGICOS DE LA ENFERMEDAD INFLAMATORIA INTESTINAL

ANTECEDENTES:Aunque existen discrepancias en el desarrollo y la progresión de la enfermedad inflamatoria intestinal según el sexo biológico, se sabe poco sobre las diferencias en los resultados postoperatorios entre hombres y mujeres sometidos a cirugía por esta afección.OBJETIVO:Nuestro objetivo fue comparar las tasas de fugas anastomóticas, complicaciones de las heridas y eventos adversos graves entre hombres y mujeres sometidos a cirugía por enfermedad inflamatoria intestinal.DISEÑO:Este fue un estudio de cohorte retrospectivo.AJUSTES:Los datos se obtuvieron de la base de datos del Programa Nacional de Mejora de la Calidad Quirúrgica del Colegio Americano de Cirujanos para la Enfermedad Inflamatoria Intestinal, que incluye 15 centros de cirugía de enfermedad inflamatoria intestinal de alto volumen.PACIENTES:Se incluyeron todos los pacientes adultos sometidos a cirugía por enfermedad inflamatoria intestinal. Se excluyeron los sujetos a los que les faltaban datos sobre exposición o variables de resultado.PRINCIPALES MEDIDAS DE RESULTADO:Se compararon las tasas de fugas anastomóticas, complicaciones de las heridas y eventos adversos graves entre mujeres y hombres.RESULTADOS:Se incluyeron un total de 3.143 pacientes. Hubo una asociación significativa entre el sexo y el índice de masa corporal, el tipo de enfermedad inflamatoria intestinal y el uso de medicación preoperatoria. Las mujeres tuvieron menores probabilidades de sufrir eventos adversos graves en comparación con los hombres (OR = 0,73; IC del 95 %: 0,55 a 0,96), pero no hubo una relacion significativa entre el sexo y las fugas anastomóticas o las complicaciones de las heridas. Se encontró que el tipo de enfermedad inflamatoria intestinal era un modificador de la medida del efecto de la relación entre el sexo y los eventos adversos graves. Entre los pacientes con colitis ulcerosa, las mujeres tuvieron una disminución del 54 % en las probabilidades de sufrir eventos adversos graves en comparación con los hombres, mientras que no hubo diferencias significativas entre mujeres y hombres con enfermedad de Crohn.LIMITACIONES:Este estudio estuvo limitado al capturar solo 30 días de resultados posoperatorios.CONCLUSIONES:Las mujeres sometidas a cirugía por colitis ulcerosa tuvieron menores probabilidades de sufrir eventos adversos graves en comparación con los hombres. Comprender las diferencias en los resultados basadas en el sexo permite a los médicos tomar decisiones centradas en el paciente con respecto a la planificación quirúrgica y el manejo perioperatorio de los pacientes con enfermedad inflamatoria intestinal. (Traducción-Dr Yolanda Colorado).

Early Implementation of Robotic Training in Surgical and Surgical Subspecialty Residency

BACKGROUND

Robotic surgery has emerged as an operative tool for many elective and urgent surgical procedures. The purpose of this study was to evaluate early surgical trainees' experiences and opinions of robotic surgery.

METHODS

An introductory robotic training course consisting of online da Vinci Xi/X training and in-person, hands on training was implemented for residents and medical students across surgical subspecialties at a single institution. A voluntary survey evaluating perceptions of and interest in robotic surgery and prior robotic surgery experience, as well as a basics of robotics quiz, was distributed to participants prior to the start of the in-person session. Descriptive statistics were used to evaluate the cohort.

RESULTS

85 trainees participated in the course between 2020 and 2023, including 58 first- and second-year surgical residents (general surgery, urology, OB/GYN, and thoracic surgery) and 27 fourth-year medical students. 9.4% of participants reported any formal robotic surgery training prior to the session, with only 19% of participants reporting robotic operative experience. 52% of the participants knew of and/or had completed the da Vinci online course modules prior to the scheduled training session. Participants unanimously (100%) agreed that robotic surgery should be implemented into surgical training.

CONCLUSIONS

There is rising enthusiasm for robotic surgery, yet early exposure and training remain infrequent and inconsistent amongst medical students and new surgical residents. A standardized introduction of multi-disciplinary robotic surgery training should be incorporated into medical school and/or early residency education to ensure surgical residents receive appropriate exposure and training to achieve competency.

Outcomes of thoracoabdominal aortic aneurysm repair in patients with a previous myocardial infarction

OBJECTIVE

Many patients undergoing thoracoabdominal aortic aneurysm (TAAA) repair have had a previous myocardial infarction (MI). To address the paucity of data regarding outcomes in such patients, we aimed to compare outcomes after open TAAA repair in patients with and without previous MI.

METHODS

From 1986 to 2022, we performed 3737 consecutive open TAAA repairs. Of these, 706 (18.9%) were in patients with previous MI. We used multivariable logistic regression to identify predictors of operative death. Propensity score matching analyzed preoperative and select operative variables to create matched groups of patients with or without a previous MI (n = 704 pairs). Late survival was determined by Kaplan-Meier analysis and compared by log rank test.

RESULTS

Overall, operative mortality was 8.5% and the adverse event rate was 15.2%; these were elevated in patients with MI (11.0% vs 7.9% [P = .01] and 18.0% vs 14.6% [P = .02], respectively). In the propensity score-matching cohort, the MI group had a greater rate of cardiac complications (32.4% vs 25.4%; P = .005) and delayed paraparesis (5.1% vs 2.4%; P = .1); however, there was no difference in operative mortality (11.1% vs 10.9%; P = 1) or adverse event rate (18.0% vs 16.8%; P = .6). Overall, previous MI was not independently associated with operative mortality in multivariable analysis (P = .1). The matched MI group trended toward poorer 10-year survival (29.8% ± 1.9% non-MI vs 25.0% ± 1.8% MI; P = .051).

CONCLUSIONS

Although previous MI was not associated with early mortality after TAAA repair, patients with a previous MI had greater rates of cardiac complications and delayed paraparesis. Patients with a previous MI also trended toward poorer survival.

Monitoring performance in laparoscopic gastric bypass surgery using risk-adjusted cumulative sum at 2 high-volume centers

BACKGROUND

Traditional surgical outcomes are measured retrospectively and intermittently, limiting opportunities for early intervention.

OBJECTIVES

The objective of this study was to use risk-adjusted cumulative sum (RA-CUSUM) to track perioperative surgical outcomes for laparoscopic gastric bypass. We hypothesized that RA-CUSUM could identify performance variations between surgeons.

SETTING

Two mid-Atlantic quaternary care academic centers.

METHODS

Patient-level data from the Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program (MBSAQIP) were abstracted for laparoscopic gastric bypasses performed by 3 surgeons at 2 high-volume centers from 2014 to 2021. Estimated probabilities of serious complications, reoperation, and readmission were derived from the MBSAQIP risk calculator. RA-CUSUM curves were generated to signal observed-to-expected odds ratios (ORs) of 1.5 (poor performance) and .5 (superior performance). Control limits were set based on a false positive rate of 5% (α = .05).

RESULTS

We included 1192 patients: Surgeon A = 767, Surgeon B = 188, and Surgeon C = 237. Overall rates of serious complications, 30-day reoperations, and 30-day readmissions were 3.9%, 2.5%, and 5.2% respectively, with expected rates of 4.7%, 2.2%, and 5.8%. RA-CUSUM signaled lower-than-expected (OR < .5) rates of readmission and serious complication in Surgeon A, and higher-than-expected (OR > 1.5) readmission rate in Surgeon C. Surgeon A further demonstrated an early period of higher-than-expected (OR > 1.5) reoperation rate before April 2015, followed by superior performance thereafter (OR < .5). Surgeon B's performance generally reflected expected standards throughout the study period.

CONCLUSIONS

RA-CUSUM adjusts for clinical risk factors and identifies performance outliers in real-time. This approach to analyzing surgical outcomes is applicable to quality improvement, root-cause analysis, and surgeon incentivization.

Lessons in liability: Examining medical malpractice suits against general surgeons in Maryland

BACKGROUND

Although medical malpractice lawsuits pose a significant burden, there is a paucity of research on physician-specific characteristics influencing lawsuits against surgeons. Our objective was to identify factors associated with general surgeons being named in malpractice cases.

METHODS

This was a cross sectional study of Maryland general surgeons, using malpractice data from a publicly accessible judiciary database. Case number per decade and lifetime lawsuit status were modeled with linear and logistic regression.

RESULTS

Male surgeons had a higher average lawsuit volume (p = 0.002) and were more likely to be named in a malpractice case (p < 0.001). In regression analysis, a second graduate degree was a predictor of average cases per 10 years (p = 0.008) and male gender predicted lifetime lawsuit status (OR = 1.73, p = 0.046).

CONCLUSIONS

Male gender was associated with increased odds of being named in a malpractice lawsuit. Identifying this difference is a preliminary step in developing interventions to reduce lawsuits amongst surgeons.

Treat Now or Treat Later: Comparative Effectiveness of Adjuvant Therapy in Resected Stage IIIA Melanoma

BACKGROUND

Adjuvant therapy for most sentinel-node-positive (stage IIIA) melanoma may have limited clinical benefit for older patients given the competing risk of non-cancer death. The objective of this study is to model the clinical effect and cost of adjuvant therapy in stage IIIA melanoma across age groups.

STUDY DESIGN

A Markov decision analysis model simulated the overall survival of patients with resected stage IIIA melanoma treated with adjuvant therapy vs observation. In the adjuvant approach, patients are modeled to receive adjuvant pembrolizumab (BRAF wild type) or dabrafenib/trametinib (BRAF mutant). In the observation approach, treatment is deferred until recurrence. Transition variables were derived from landmark randomized trials in adjuvant and salvage therapy. The model was analyzed for age groups spanning 40 to 89 years. The primary outcome was the number needed to treat (NNT) to prevent one melanoma-related death at 10 years. Cost per mortality avoided was estimated using Medicare reimbursement rates.

RESULTS

Projections for NNT among BRAF wild type patients increased by age from 14.71 (age 40 to 44) to 142.86 (age 85 to 89), with patients in cohorts over the age of 75 having an NNT over 25. The cost per mortality avoided ranged from $2.75 million (M) (age 40 to 44) to $27.57M (age 85 to 89). Corresponding values for BRAF mutant patients were as follows: NNT 18.18 to 333.33; cost per mortality avoided ranged from $2.75M to $54.70M.

CONCLUSION

Universal adjuvant therapy for stage IIIA melanoma is costly and provides limited clinical benefit in patients older than 75 years.