Evidence-based Surgical Competency Outcomes from the Clinical Readiness Program

Lateral Canthotomy/Cantholysis Performance Gap Analysis and Training Recommendations for Expeditionary Physicians

INTRODUCTION

Preservation of life, preservation of limb, and preservation of eyesight are the priorities for military medical personnel when attending to casualties. The incidences of eye injuries in modern warfare have increased significantly, despite personal eye equipment for service members. Serious eye injuries are often overlooked or discovered in a delayed fashion because they accompany other life- and limb-threatening injuries, which are assigned a higher priority. Prehospital military ocular trauma care is to shield the eye and evacuate the casualty to definitive ophthalmic care as soon as possible, with exceptions for treatment of ocular chemical injury and orbital compartment syndrome. Retrospective analysis of eye injuries in recent conflicts identified gaps in clinical capabilities with up to 96% of ocular injuries being suboptimally managed. Ocular compartment syndrome (OCS) is a complication associated with orbital hemorrhage, where significant morbidity occurs as a result of increasing intracompartment pressure. The ischemic tolerance of the retina and optic nerve is approximately 90 minutes, so OCS must be rapidly diagnosed and aggressively treated through lateral canthotomy/cantholysis (LC/C) to prevent permanent vision loss. LC/C procedures consist of using hemostats to crush the lateral canthal fold and cutting the lateral canthal tendon from the inferior crus to relieve increasing intracompartment pressure. The purpose of this study was to examine the baseline capabilities of military physicians and surgeons to accurately and independently perform the LC/C procedures and identify performance gaps that could be closed through focused professional development activities.

MATERIALS AND METHODS

This study received institutional review board approval at our institution. A total of 60 subjects voluntarily participated in the study from emergency medicine (15), general surgery (28), and ophthalmology (17). All procedural assessments were performed 1:1 by expert faculty ocular trauma specialists using a high-reliability eye trauma simulator (Sonalysts, Inc.). The competency standard was set at independent and accurate completion of all procedural components and all critical procedural components. Analyses were performed using descriptive statistics and analysis of variance to examine between-group differences (P < 0.05).

RESULTS

There was a significant difference between the total score performance and the critical score performance for the three groups (P < 0.001). Outcomes indicate a significant linear relationship between the expertise level of the clinical provider and the procedural performance of LC/C. Outcomes demonstrate the baseline surgical capabilities of the general surgeons transferred to LC/C performance; however, they were unfamiliar with the anatomy and the procedural techniques and requirements. The group of emergency medicine participants demonstrated performance gaps not only in the same areas as the general surgeons but also in their baseline surgical abilities. This suggests that different professional development activities are necessary for surgeons and physicians tasked with performing LC/V procedures.

CONCLUSIONS

We identified significant performance gaps among emergency medicine physicians, general surgeons, and ophthalmologists in their abilities to recognize and treat OCS through LC/C procedures. These sight-saving procedures are a critical competency for forward-situated clinicians in expeditionary contexts. We identified the need for targeted approaches to professional development for closing the performance gaps for both emergency medicine physicians and general surgeons.

Clinical Readiness: Can Providers Learn to Perform Lower Leg Fasciotomy Through a Tablet-based Augmented Reality Surgical Training Environment?

INTRODUCTION

The uses of on-demand, interactive tablet-based surgical training environments are of interest as potential resources for both the acquisition and maintenance of rarely performed, critical procedures for expeditionary surgical care. This study examined the effectiveness of a tablet-based augmented reality (AR) procedural training environment for lower leg fasciotomy with a cohort of novice surgical trainees in (1) procedural knowledge, (2) tablet-based procedural skills, (3) tablet-based procedural time, and (4) procedural performance on a cadaver. We hypothesized that engaging with the AR procedural training would increase procedural knowledge and tablet-based skills and procedural time. We hypothesized that the tablet-based AR training environment would be insufficient to acquire the ability to perform lower leg fasciotomy on a cadaver.

MATERIALS AND METHODS

This study was approved as exempt by the Institutional Review Board at USU. Surgical interns, sub-interns, and independent duty corpsman (n = 30) with no prior lower leg fasciotomy experience voluntarily participated. Tablet-based training activities included pre-training assessment, engagement with instruction, interactive procedural practice, and post-training assessment. Tablet-based knowledge assessment included 17 multiple choice questions covering concepts, reasoning, and judgment associated with the procedure. Tablet-based procedural completion and time were assessed within the training environment. Within 1 week of completing the tablet activities, participants were assessed by fellowship-trained trauma surgeons while performing cadaver-based lower leg fasciotomy. Statistical analysis included paired t-tests and effect size (Cohen's d). Statistical significance was set at P < .05.

RESULTS

Tablet-based AR procedural training significantly improved procedural knowledge (P < .001), tablet-based procedural skills (P < .001), and reduced tablet-based procedural time (P < .002). Effect sizes were very large for tablet-based procedural knowledge (d = 1.75) and skills (d = 3.2) and small (d = 0.42) for procedural time. There were no significant effects of procedural knowledge, tablet-based procedural skills, or time on cadaver-based performance. No participant was able to accurately and independently complete lower leg fasciotomy procedure on a cadaver.

CONCLUSIONS

Tablet-based AR procedural training improved procedural knowledge and tablet-based skills; however, those gains did not transfer to the ability to perform the procedure on a cadaver. The tablet's limited AR interface did not support the acquisition of requisite surgical technique, tissue handling, and decision-making in novice surgical trainees. Experienced surgeons may have different outcomes because their mature understanding of surgical constructs would allow extrapolation of abilities to other procedural contexts. Further investigation of the tablet-based training environments for surgical care is necessary before distributing such resources to support clinical readiness.

Acquisition and retention of military surgical competencies: a survey of surgeons' experiences in the UK Defence Medical Services

INTRODUCTION

The acquisition and retention of militarily relevant surgical knowledge and skills are vital to enable expert management of combat casualties on operations. Opportunities for skill sustainment have reduced due to the cessation of combat operations in Iraq and Afghanistan and lack of military-relevant trauma in UK civilian practice.

METHODS

A voluntary, anonymous online survey study was sent to all UK Defence Medical Services (DMS) surgical consultants and higher surgical trainees in Trauma and Orthopaedics, Plastic and Reconstructive, and General and Vascular surgical specialties (three largest surgical specialties in the DMS in terms of numbers). The online questionnaire tool included 20 questions using multiple choice and free text to assess respondents' subjective feelings of preparedness for deployment as surgeons for trauma patients.

RESULTS

There were 71 of 108 (66%) responses. Sixty-four (90%) respondents were regular armed forces, and 46 (65%) worked in a Major Trauma Centre (MTC). Thirty-three (47%) had never deployed on operations in a surgical role. Nineteen (27%) felt they had sufficient exposure to penetrating trauma. When asked 'How well do you feel your training and clinical practice prepares you for a surgical deployment?' on a scale of 1-10, trainees scored significantly lower than consultants (6 (IQR 4-7) vs 8 (IQR 7-9), respectively; p<0.001). There was no significant difference in scores between regular and reservists, or between those working at an MTC versus non-MTC. Respondents suggested high-volume trauma training and overseas trauma centre fellowships, simulation, cadaveric and live-tissue training would help their preparedness.

CONCLUSIONS

There was a feeling among a sample of UK DMS consultants and trainees that better preparedness is required for them to deploy confidently as a surgeon for combat casualties. The responses suggest that UK DMS surgical training requires urgent attention if current surgeons are to be ready for their role on deployed operations.

Developing the Ready Military Medical Force: military-specific training in Graduate Medical Education

Introduction

Graduate Medical Education plays a critical role in training the next generation of military physicians, ensuring they are ready to uphold the dual professional requirements inherent to being both a military officer and a military physician. This involves executing the operational duties as a commissioned leader while also providing exceptional medical care in austere environments and in harm's way. The purpose of this study is to review prior efforts at developing and implementing military unique curricula (MUC) in residency training programs.

Methods

We performed a literature search in PubMed (MEDLINE), Embase, Web of Science, and the Defense Technical Information Center through August 8, 2023, including terms "graduate medical education" and "military." We included articles if they specifically addressed military curricula in residency with terms including "residency and operational" or "readiness training", "military program", or "military curriculum".

Results

We identified 1455 articles based on title and abstract initially and fully reviewed 111. We determined that 64 articles met our inclusion criteria by describing the history or context of MUC, surveys supporting MUC, or military programs or curricula incorporated into residency training or military-specific residency programs.

Conclusion

We found that although there have been multiple attempts at establishing MUC across training programs, it is difficult to create a uniform curriculum that can be implemented to train residents to a single standard across services and specialties.

Quality of Integration of Air Force Trauma Surgeons Within the Center for Sustainment of Trauma and Readiness Skills, Cincinnati: A Pilot Study

INTRODUCTION

While previous studies have analyzed military surgeon experience within military-civilian partnerships (MCPs), there has never been an assessment of how well military providers are integrated within an MCP. The Center for Sustainment of Trauma and Readiness Skills, Cincinnati supports the Critical Care Air Transport Advanced Course and maintains the clinical skills of its staff by embedding them within the University of Cincinnati Medical Center. We hypothesized that military trauma surgeons are well integrated within University of Cincinnati Medical Center and that they are exposed to a similar range of complex surgical pathophysiology as their civilian partners.

MATERIALS AND METHODS

After Institutional Review Board approval, Current Procedural Terminology (CPT) codes were abstracted from billing data for trauma surgeons covering University of Cincinnati Hospitals in 2019. The number of trauma resuscitations and patient acuity metrics were abstracted from the Trauma Registry and surgeon Knowledge, Skills, and Abilities clinical activity (KSA-CA) scores were calculated using their CPT codes. Finally, surgeon case distributions were studied by sorting their CPT codes into 23 categories based on procedure type and anatomic location. Appropriate, chi-squared or Mann-Whitney U-tests were used to compare these metrics between the military and civilian surgeon groups and the metrics were normalized by the group's full-time equivalent (FTE) to adjust for varying weeks on service between groups.

RESULTS

Data were available for two active duty military and nine civilian staff. The FTEs were significantly lower in the military group: military 0.583-0.583 (median 0.583) vs. civilian 0.625-1.165 (median 1.0), P = 0.04. Per median FTE and surgeon number, both groups performed a similar number of trauma resuscitations (civilian 214 ± 54 vs. military 280 ± 13, P = 0.146) and KSA-CA points (civilian 55,629 ± 25,104 vs. military 36,286 ± 11,267; P = 0.582). Although the civilian surgeons had a higher proportion of hernia repairs (P < 0.001) and laparoscopic procedures (P = 0.006), the CPT code categories most relevant to combat surgery (those relating to solid organ, hollow viscus, cardiac, thoracic, abdominal, and tissue debridement procedures) were similar between the surgeon groups. Finally, patient acuity metrics were similar between groups.

CONCLUSION

This is the first assessment of U.S. Air Force trauma surgeon integration relative to their civilian partners within an MCP. Normalized by FTE, there was no difference between the two groups' trauma experience to include patient acuity metrics and KSA-CA scores. The proportion of CPT codes that was most relevant to expeditionary surgery was similar between the military and civilian partners, thus optimizing the surgical experience for the military trauma surgeons within University of Cincinnati Medical Center. The methods used within this pilot study can be generalized to any American College of Surgeons verified Trauma Center MCP, as standard databases were used.

Case Volume and Readiness to Deploy: Clinical Opportunities for Active-Duty Surgeons Outside of Military Hospitals

BACKGROUND

The Military Health System (MHS) uses a readiness program that identifies the knowledge, skills, and abilities (KSAs) necessary for surgeons to provide combat casualty care. Operative productivity is assigned an objective score based on case type and complexity and totaled to assess overall readiness. As of 2019, only 10.1% of surgeons met goal readiness threshold. At one tertiary military treatment facility (MTF), leadership has taken an aggressive approach toward increasing readiness by forming military training agreements (MTAs) and allowing Off Duty Employment (ODE). We sought to quantify the efficacy of this approach.

STUDY DESIGN

Operative logs from 2021 were obtained from surgeons assigned to the MTF. Operations were assigned CPT codes and processed through the KSA calculator (Deloitte; London, UK). Each surgeon was then surveyed to identify time away from clinical duties for deployment or military training.

RESULTS

Nine surgeons were present in 2021 and spent an average of 10.1 weeks (19.5%) abroad. Surgeons performed 2,348 operations (Average [Avg] 261 ± 95) including 1,575 (Avg 175; 67.1%) at the MTF, 606 (Avg 67.3; 25.8%) at MTAs, and 167 (Avg 18.6, 7.1%) during ODE. Adding MTA and ODE caseloads increased KSA scores by 56% (17,765 ± 7,889 vs 11,391 ± 8,355). Using the MHS threshold of 14,000, 3 of 9 (33.3%) surgeons met the readiness threshold from MTF productivity alone. Including all operations, 7 of 9 (77.8%) surgeons met threshold.

CONCLUSIONS

Increased use of MTAs and ODE significantly augments average caseloads. These operations provide considerable benefit and result in surgeon readiness far exceeding the MHS average. Military leadership can maximize the chances of meeting readiness goals by encouraging clinical opportunities outside the MTF.

Five Influential Factors for Clinical Team Performance in Urgent, Emergency Care Contexts

INTRODUCTION

In deployed contexts, military medical care is provided through the coordinated efforts of multiple interdisciplinary teams that work across and between a continuum of widely distributed role theaters. The forms these teams take, and functional demands, vary by roles of care, location, and mission requirements. Understanding the requirements for optimal performance of these teams to provide emergency, urgent, and trauma care for multiple patients simultaneously is critical. A team's collective ability to function is dependent on the clinical expertise (knowledge and skills), authority, experience, and affective management capabilities of the team members. Identifying the relative impacts of multiple performance factors on the accuracy of care provided by interdisciplinary clinical teams will inform targeted development requirements.

MATERIALS AND METHODS

A regression study design determined the extent to which factors known to influence team performance impacted the effectiveness of small, six to eight people, interdisciplinary teams tasked with concurrently caring for multiple patients with urgent, emergency care needs. Linear regression analysis was used to distinguish which of the 11 identified predictors individually and collectively contributed to the clinical accuracy of team performance in simulated emergency care contexts.

RESULTS

All data met the assumptions for regression analyses. Stepwise linear regression analysis of the 11 predictors on team performance yielded a model of five predictors accounting for 82.30% of the variance. The five predictors of team performance include (1) clinical skills, (2) team size, (3) authority profile, (4) clinical knowledge, and (5) familiarity with team members. The analysis of variance confirmed a significant linear relationship between team performance and the five predictors, F(5, 240) = 218.34, P < .001.

CONCLUSIONS

The outcomes of this study demonstrate that the collective knowledge, skills, and abilities within an urgent, emergency care team must be developed to the extent that each team member is able to competently perform their role functions and that smaller teams benefit by being composed of clinical authorities who are familiar with each other. Ideally, smaller, forward-deployed military teams will be an expert team of individual experts, with the collective expertise and abilities required for their patients. This expertise and familiarity are advantageous for collective consideration of significant clinical details, potential alternatives for treatment, decision-making, and effective implementation of clinical skills during patient care. Identifying the most influential team performance factors narrows the focus of team development strategies to precisely what is needed for a team to optimally perform.

A study of simulation training in laparoscopic bilioenteric anastomosis on a 3D-printed dry lab model

BACKGROUND

There are few studies on simulation training in laparoscopic bilioenteric anastomosis. There is also a lack of mature and reliable training models for bilioenteric anastomosis. In this study, we aimed to assess a feasible training model for bilioenteric anastomosis. Surgeons can improve their surgical ability by performing laparoscopic bilioenteric anastomosis on this model through repeated training.

METHOD

The original articles related to simulation training in surgical anastomosis were identified from January 2000 to November 2021 in the Clarivate Analytics Web of Science Core Collection database. We conducted a bibliometric analysis based on the country of these publications and the type of anastomosis. A 3D-printed bilioenteric anastomosis model was applied in this study. Baseline data of 15 surgeons (5 surgeons of Attendings, 5 surgeons of Fellows, and 5 surgeons of Residents) were collected. The bilioenteric anastomosis data, including the operation time and operation score, were recorded and analyzed. A study of the learning curve was also performed for further assessment.

RESULT

Surgeons at different levels of experience exhibited different levels of performance in conducting laparoscopic bilioenteric anastomosis on this model. Experienced surgeons completed their first training session in a shorter time and obtained a higher surgical score. In turn, repeated training significantly shortened the time of laparoscopic bilioenteric anastomosis for each trainer and improved the surgical score. Surgeons with different levels of experience needed different numbers of cases to reach the stable period of the learning curve. Experienced surgeons were able to reach a proficient level through fewer training cases.

CONCLUSION

A suitable biliary-enteric anastomosis model can help surgeons conduct simulation training and provide experience and skill accumulation for future real operations. Our training model performed well in this study and can effectively accomplish this goal.