Using implementation science to decrease variation and high opioid administration in a surgical ICU

BACKGROUND

High doses and prolonged duration of opioids are associated with tolerance, dependence, and increased mortality. Unfortunately, despite recent efforts to curb outpatient opioid prescribing because of the ongoing epidemic, utilization remains high in the intensive care setting, with intubated patients commonly receiving infusions with a potency much higher than doses required to achieve pain control. We attempted to use implementation science techniques to monitor and reduce excessive opioid prescribing in ventilated patients in our Surgical ICU.

METHODS

We conducted a prospective study investigating opioid administration in a closed SICU at an academic medical center over 18 months. Commonly accepted conversions were used to aggregate daily patient opioid use. Patients with a history of chronic opioid use and those being treated with an ICP monitor/drain, neuromuscular blocker, or ECMO were excluded. If the patient spent a portion of a day on a ventilator, that day's total was included in the "vent group." MMEs per patient were collected for each patient and assigned to the on-call intensivist. Intensivists were blinded to the data for the first seven months. They were then provided with academic detailing followed by audit & feedback over the subsequent 11 months, demonstrating how opioid utilization during their time in the SICU compared to the unit average and a blinded list of the other attendings. Student's T-tests were performed to compare opioid utilization before and after initiation of academic detailing and audit & feedback.

RESULTS

Opioid utilization in patients on a ventilator decreased by 20.1% during the feedback period, including less variation among all intensivists and a 30.9% reduction by the highest prescribers.

CONCLUSION

Implementation science approaches can effectively reduce variation in opioid prescribing, especially for high outliers in a SICU. These interventions may reduce the risks associated with prolonged use of high-dose opioids.

LEVEL OF EVIDENCE

Prospective pre-post-intervention, Level II.

Racial and Ethnic Disparities in Operative Experience Among General Surgery Residents: A Multi-Institutional Study from the US ROPE Consortium

OBJECTIVE

To determine the relationship between race/ethnicity and case volume among graduating surgical residents.

BACKGROUND

Racial/ethnic minority individuals face barriers to entry and advancement in surgery; however, no large-scale investigations of the operative experience of racial/ethnic minority residents have been performed.

METHODS

A multi-institutional retrospective analysis of the Accreditation Council for Graduate Medical Education case logs of categorical general surgery residents at 20 programs in the US Resident OPerative Experience Consortium database was performed. All residents graduating between 2010 and 2020 were included. The total, surgeon chief, surgeon junior, and teaching assistant case volumes were compared between racial/ethnic groups.

RESULTS

The cohort included 1343 residents. There were 211 (15.7%) Asian, 65 (4.8%) Black, 73 (5.4%) Hispanic, 71 (5.3%) "Other" (Native American or Multiple Race), and 923 (68.7%) White residents. On adjusted analysis, Black residents performed 76 fewer total cases (95% CI, -109 to -43, P <0.001) and 69 fewer surgeon junior cases (-98 to -40, P <0.001) than White residents. Comparing adjusted total case volume by graduation year, both Black residents and White residents performed more cases over time; however, there was no difference in the rates of annual increase (10 versus 12 cases per year increase, respectively, P =0.769). Thus, differences in total case volume persisted over the study period.

CONCLUSIONS

In this multi-institutional study, Black residents graduated with lower case volume than non-minority residents throughout the previous decade. Reduced operative learning opportunities may negatively impact professional advancement. Systemic interventions are needed to promote equitable operative experience and positive culture change.

Disparities in the Operative Experience Between Female and Male General Surgery Residents: A Multi-institutional Study From the US ROPE Consortium

OBJECTIVE

To examine differences in resident operative experience between male and female general surgery residents.

BACKGROUND

Despite increasing female representation in surgery, sex and gender disparities in residency experience continue to exist. The operative volume of male and female general surgery residents has not been compared on a multi-institutional level.

METHODS

Demographic characteristics and case logs were obtained for categorical general surgery graduates between 2010 and 2020 from the US Resident OPerative Experience Consortium database. Univariable, multivariable, and linear regression analyses were performed to compare differences in operative experience between male and female residents.

RESULTS

There were 1343 graduates from 20 Accreditation Council for Graduate Medical Education-accredited programs, and 476 (35%) were females. There were no differences in age, race/ethnicity, or proportion pursuing fellowship between groups. Female graduates were less likely to be high-volume residents (27% vs 36%, P < 0.01). On univariable analysis, female graduates performed fewer total cases than male graduates (1140 vs 1177, P < 0.01), largely due to a diminished surgeon junior experience (829 vs 863, P < 0.01). On adjusted multivariable analysis, female sex was negatively associated with being a high-volume resident (OR = 0.74, 95% CI: 0.56 to 0.98, P = 0.03). Over the 11-year study period, the annual total number of cases increased significantly for both groups, but female graduates (+16 cases/year) outpaced male graduates (+13 cases/year, P = 0.02).

CONCLUSIONS

Female general surgery graduates performed significantly fewer cases than male graduates. Reassuringly, this gap in operative experience may be narrowing. Further interventions are warranted to promote equitable training opportunities that support and engage female residents.

A multi-institutional study from the US ROPE Consortium examining factors associated with directly entering practice upon residency graduation

BACKGROUND

There is concern regarding the competency of today's general surgery graduates as a large proportion defer independent practice in favor of additional fellowship training. Little is known about the graduates who directly enter general surgery practice and if their operative experiences during residency differ from graduates who pursue fellowship.

METHODS

Nineteen Accreditation Council for Graduate Medical Education-accredited general surgery programs from the US Resident OPerative Experience Consortium were included. Demographics, career choice, and case logs from graduates between 2010 to 2020 were analyzed.

RESULTS

There were 1,264 general surgery residents who graduated over the 11-year period. A total of 248 (19.6%) went directly into practice and 1,016 (80.4%) pursued fellowship. Graduates directly entering practice were more likely to be a high-volume resident (43.1% vs 30.5%, P < .01) and graduate from a high-volume program (49.2% vs 33.0%, P < .01). Direct-to-practice graduates performed 53 more cases compared with fellowship-bound graduates (1,203 vs 1,150, P < .01). On multivariable analysis, entering directly into practice was positively associated with total surgeon chief case volume (odds ratio = 1.47, 95% confidence interval 1.18-1.84, P < .01) and graduating from a US medical school (odds ratio = 2.54, 95% confidence interval 1.45-4.44, P < .01) while negatively associated with completing a dedicated research experience (odds ratio = 0.31, 95% confidence interval 0.22-0.45, P < .01).

CONCLUSION

This is the first multi-institutional study exploring resident operative experience and career choice. These data suggest residents who desire immediate practice can tailor their experience with less research time and increased operative volume. These data may be helpful for programs when designing their experience for residents with different career goals.

Integration of Web Analytics Into Graduate Medical Education: Usability Study

Background

Web analytics is the measurement, collection, analysis, and reporting of website and web application usage data. While common in the e-commerce arena, web analytics is underutilized in graduate medical education (GME).

Objective

The University of Arkansas for Medical Sciences Department of Surgery website was revamped with input from in-house surgeons in August 2017. This study investigated the use of web analytics to gauge the impact of our department’s website redesign project.

Methods

Google Analytics software was used to measure website performance before and after implementation of the new website. Eight-month matched periods were compared. Factors tracked included total users, new users, total sessions, sessions per user, pages per session, average session duration, total page views, and bounce rate (the percentage of visitors who visit a site and then leave [ie, bounce] without continuing to another page on the same site).

Results

Analysis using a nonpaired Student t test demonstrated a statistically significant increase for total page views (before vs after: 33,065 vs 81,852; P<.001) and decrease for bounce rate (before vs after: 50.70% vs 0.23%; P<.001). Total users, new users, total sessions, sessions per user, and pages per session showed improvement. The average session duration was unchanged. Subgroup analysis showed that after the main page, the next 3 most frequently visited pages were related to GME programs in our department.

Conclusions

Web analytics is a practical measure of a website’s efficacy. Our data suggest that a modern website significantly improves user engagement. An up-to-date website is essential for contemporary GME recruitment, will likely enhance engagement of residency applicants with GME programs, and warrants further investigation.

Characterization of Acidosis in Trauma Patient

Background

Recent data suggest that acidosis alone is not a good predictor of mortality in trauma patients. Little data are currently available regarding factors associated with survival in trauma patients presenting with acidosis.

Aims

The aims were to characterize the outcomes of trauma patients presenting with acidosis and to identify modifiable risk factors associated with mortality in these patients.

Settings and Design

This is a retrospective observational study of University of Arkansas for Medical Sciences (UAMS) trauma patients between November 23, 2013, and May 21, 2017.

Methods

Data were collected from the UAMS trauma registry. The primary outcome was hospital mortality. Analyses were performed using t-test and Pearson's Chi-squared test. Simple and multiple logistic regressions were performed to determine crude and adjusted odds ratios.

Results

There were 532 patients identified and 64.7% were acidotic (pH < 7.35) on presentation: 75.9% pH 7.2-7.35; 18.5% pH 7.0-7.2; and 5.6% pH ≤ 7.0. The total hospital mortality was 23.7%. Nonsurvivors were older and more acidotic, with a base deficit >-8, Glasgow Coma Scale (GCS) ≤ 8, systolic blood pressure ≤ 90, International Normalized Ratio (INR) >1.6, and Injury Severity Score (ISS) >15. Mortality was significantly higher with a pH ≤ 7.2 but mortality with a pH 7.2-7.35 was comparable to pH > 7.35. In the adjusted model, pH ≤ 7.0, pH 7.0-7.2, INR > 1.6, GCS ≤ 8, and ISS > 15 were associated with increased mortality. For patients with a pH ≤ 7.2, only INR was associated with increase in mortality.

Conclusions

A pH ≤ 7.2 is associated with increased mortality. For patients in this range, only the presence of coagulopathy is associated with increased mortality. A pH > 7.2 may be an appropriate treatment goal for acidosis. Further work is needed to identify and target potentially modifiable factors in patients with acidosis such as coagulopathy.

ROTEM as a Predictor of Mortality in Patients With Severe Trauma

BACKGROUND

Hemorrhage, especially when complicated by coagulopathy, is the most preventable cause of death in trauma patients. We hypothesized that assessing hemostatic function using rotational thromboelastometry (ROTEM) or conventional coagulation tests can predict the risk of mortality in patients with severe trauma indicated by an injury severity score greater than 15.

METHODS

We retrospectively reviewed trauma patients with an injury severity score >15 who were admitted to the emergency department between November 2015 and August 2017 in a single level I trauma center. Patients with available ROTEM and conventional coagulation data (partial thromboplastin time [PTT], prothrombin time [PT], and international normalized ratio) were included in the study cohort. Logistic regression was performed to assess the relationship between coagulation status and mortality.

RESULTS

The study cohort included 301 patients with an average age of 47 y, and 75% of the patients were males. Mortality was 23% (n = 68). Significant predictors of mortality included abnormal APTEM (thromboelastometry (TEM) assay in which fibrinolysis is inhibited by aprotinin (AP) in the reagent) parameters, specifically a low APTEM alpha angle, a high APTEM clot formation time, and a high APTEM clotting time. In addition, an abnormal international normalized ratio significantly predicted mortality, whereas abnormal PT and PTT did not.

CONCLUSIONS

A low APTEM alpha angle, an elevated APTEM clot formation time, and a high APTEM clotting time significantly predicted mortality, whereas abnormal PT and PTT did not appear to be associated with increased mortality in this patient population. Viscoelastic testing such as ROTEM appears to have indications in the management and stabilization of trauma patients.

Hemorrhage-Control Training in Medical Education

OBJECTIVES

To evaluate and analyze the efficacy of implementation of hemorrhage-control training into the formal medical school curriculum. We predict this training will increase the comfort and confidence levels of students with controlling major hemorrhage and they will find this a valuable skill set for medical and other healthcare professional students.

METHODS

After IRB and institutional approval was obtained, hemorrhage-control education was incorporated into the surgery clerkship curriculum for 96 third-year medical students at the University of Arkansas for Medical Sciences using the national Stop The Bleed program. Using a prospective study design, participants completed pre- and post-training surveys to gauge prior experiences and comfort levels with controlling hemorrhage and confidence levels with the techniques taught. Course participation was mandatory; survey completion was optional. The investigators were blinded as to the individual student's survey responses. A knowledge quiz was completed following the training.

RESULTS

Implementation of STB training resulted in a significant increase in comfort and confidence among students with all hemorrhage-control techniques. There was also a significant difference in students' perceptions of the importance of this training for physicians and other allied health professionals.

CONCLUSION

Hemorrhage-control training can be effectively incorporated into the formal medical school curriculum via a single 2-hour Stop The Bleed course, increasing students' comfort level and confidence with controlling major traumatic bleeding. Students value this training and feel it is a beneficial addition to their education. We believe this should be a standard part of undergraduate medical education.

Using Injury Severity Score and Abbreviated Injury Score to Determine Venous Thromboembolism Risk

Background

Venous thromboembolisms (VTEs) continue to be a leading cause of death among trauma patients. Predicting which patients will develop a VTE can be difficult. This study investigated whether the Injury Severity Score (ISS) could be used in conjunction with the Abbreviated Injury Score (AIS) to assess a trauma patient’s risk for subsequent VTE development.

Materials and Methods

Participants were found by querying a trauma center registry. There were 2,213 patients included for evaluation. The patients were categorized based on their ISS and the anatomical region with the greatest injury (determined by the AIS). Odds ratios for developing VTEs were calculated for each ISS category.

Results

The results showed that in most categories VTE risk increased as ISS increased. Patients with trauma to their head/neck, chest, or extremities with ISS values of 21 or greater were all at significantly increased risk for VTE development. Patients in these categories with an ISS less than 21 seemed to have little or only moderately increased odds of developing a VTE, although these values were not statistically significant. Patients with abdominal trauma were at increased risk even with ISS values of 11-21.

Conclusion

Trauma to the head/neck region, chest, and extremities (including pelvis) with ISS of 21 or higher had significantly increased odds of developing a VTE. Patients with abdominal trauma of any severity appeared to have increased odds of developing a VTE.

Right external iliac artery thrombus following the use of resuscitative endovascular balloon occlusion of the aorta for placenta accreta

A 33-year-old female, 32 weeks and 1 day gestation, with known placenta accreta who presented to the emergency department with 2 h of severe abdominal pain, nausea and vomiting. She became hypotensive and underwent emergency cesarean section. Emergency general surgery was consulted for placement of a resuscitative endovascular balloon for aortic occlusion (REBOA). After successful delivery, the balloon was inflated in zone 3 and systolic blood pressure rose from 70 to 170 mmHg. The patient underwent hysterectomy for ongoing hemorrhage. The patient was taken to the surgical intensive care unit. The patient was noted to have pulses following removal of the sheath. Arterial brachial indices and arterial duplex was performed 48 h after sheath removal. The patient was found to have complete occlusion of the right external iliac artery. Vascular surgery was consulted and cut-down performed with thrombus removal via fogarty catheter. The patient was discharged 2 days later without further complication.

Dilated cardiomyopathy secondary to acute pancreatitis caused by hypertriglyceridemia

A 30-year-old male presented to an outside facility with acute pancreatitis and triglycerides of 1594. He was transferred to our facility after becoming febrile, hypoxic and in acute renal failure with triglycerides of 4243. CT scan performed showed wall-off pancreatic necrosis. He underwent continuous renal replacement therapy and his acute renal failure resolved. He was treated with broad spectrum antibiotics and discharged. He developed a fever to 101 a week later and was found to have a large infected pancreatic pseudocyst. This was managed with an IR placed drain. This was continued for 6 weeks. He came to the emergency department several weeks later with shortness of breath and 3+ edema to bilateral lower extremities and lower abdomen. TTE performed showed an EF of 15%. He was diuresed 25 L during that stay. His heart failure was medically managed. We present this case of dilated cardiomyopathy secondary to acute pancreatitis.

Severe acute gallstone pancreatitis with diffuse hemorrhagic gastritis

A 67-year-old male presented with acute pancreatitis secondary to gallstones, also known as acute biliary pancreatitis, and subsequently developed gastric outlet obstruction and was transferred to our hospital. A gastro-jejunal feeding tube was placed and an open cholecystectomy was performed. The patient had a pancreatic drain placed for interval increase in pancreatic necrosis and then nearly exsanguinated from gastroduodenal artery pseudoaneurysm bleed. This was managed by coiling the gastroduodenal artery. The patient underwent a pancreatic necrosectomy with malencot drain placement and developed a post-operative upper gastrointestinal bleeding. An EGD showed diffuse gastritis, but no varices. And 18 days later the patient rebled, with the same diffuse gastritis. After further complications the patient elected to receive palliative care at a hospice facility. We are presenting this unusual case of diffuse, hemorrhagic gastritis after acute necrotizing pancreatitis.

Are Surgical Milestone Assessments Predictive of In-Training Examination Scores?

OBJECTIVES

With the recent utilization of Accreditation Council for Graduate Medical Education developmental milestones as part of resident evaluation, we sought to explore whether milestone-based ratings were associated with American Board of Surgery In-Training Examination (ABSITE) scores.

METHODS

Mid-year milestone ratings were obtained from the Accreditation Council for Graduate Medical Education Accreditation Database System for years 2014, 2015, and 2016 for all postgraduate years 1-5 general surgery residents in our program and paired with ABSITE scores (n = 69) from January of the following year. Linear regression was used to assess predictor importance of milestones on both ABSITE percentage correct scores and ABSITE percentile scores.

RESULTS

Minimal to small positive correlations were observed between milestones and ABSITE percentile scores (r = 0.09-0.25), while moderately large correlations were observed between milestones and percentage correct scores (r = 0.65-0.76). The Medical Knowledge 1 (MK1) milestone significantly predicted ABSITE percentage correct scores, and explained 60% of the variance (adjusted R² = 0.603). MK1 also significantly predicted ABSITE percentile scores, although weaker in magnitude, with MK1 explaining 20% of the variance (adjusted R² = 0.197). Postgraduate year level and other milestones were not influential predictors of ABSITE scores.

CONCLUSIONS

The mid-year MK1 milestone rating was predictive of ABSITE scores and may serve as a useful marker for Clinical Competency Committees to identify residents who could benefit from additional support to prepare for the ABSITE, although given the small exploratory nature of this study, additional research is still needed.

Relationships between study habits, burnout, and general surgery resident performance on the American Board of Surgery In-Training Examination

BACKGROUND

The American Board of Surgery In-Training Examination (ABSITE) is used by programs to evaluate the knowledge and readiness of trainees to sit for the general surgery qualifying examination. It is often used as a tool for resident promotion and may be used by fellowship programs to evaluate candidates. Burnout has been associated with job performance and satisfaction; however, its presence and effects on surgical trainees' performance are not well studied. We sought to understand factors including burnout and study habits that may contribute to performance on the ABSITE examination.

METHODS

Anonymous electronic surveys were distributed to all residents at 10 surgical residency programs (n = 326). Questions included demographics as well as study habits, career interests, residency characteristics, and burnout scores using the Oldenburg Burnout Inventory, which assesses burnout because of both exhaustion and disengagement. These surveys were then linked to the individual's 2016 ABSITE and United States Medical Licensing Examination (USMLE) step 1 and 2 scores provided by the programs to determine factors associated with successful ABSITE performance.

RESULTS

In total, 48% (n = 157) of the residents completed the survey. Of those completing the survey, 48 (31%) scored in the highest ABSITE quartile (≥75th percentile) and 109 (69%) scored less than the 75th percentile. In univariate analyses, those in the highest ABSITE quartile had significantly higher USMLE step 1 and step 2 scores (P < 0.001), significantly lower burnout scores (disengagement, P < 0.01; exhaustion, P < 0.04), and held opinions that the ABSITE was important for improving their surgical knowledge (P < 0.01). They also read more frequently to prepare for the ABSITE (P < 0.001), had more disciplined study habits (P < 0.001), were more likely to study at the hospital or other public settings (e.g., library, coffee shop compared with at home; P < 0.04), and used active rather than passive study strategies (P < 0.04). Gender, marital status, having children, and debt burden had no correlation with examination success. Backward stepwise multiple regression analysis identified the following independent predictors of ABSITE scores: study location (P < 0.0001), frequency of reading (P = 0.0001), Oldenburg Burnout Inventory exhaustion (P = 0.02), and USMLE step 1 and 2 scores (P = 0.007 and 0.0001, respectively).

CONCLUSIONS

Residents who perform higher on the ABSITE have a regular study schedule throughout the year, report less burnout because of exhaustion, study away from home, and have shown success in prior standardized tests. Further study is needed to determine the effects of burnout on clinical duties, career advancement, and satisfaction.