Confidence and Competence in Volunteer Examiners of the American Board of Surgery

Simulation-Based Outreach Program Improves Rural Hospitals’ Team Confidence in Neonatal Resuscitation

Introduction: Neonatal resuscitation is a high acuity, low occurrence event (HALO), and in rural community hospitals, low birth rates prevent providers from regular opportunities to maintain essential resuscitation skills. Simulation is an effective training modality for medical education, although resources for simulation are often limited in rural hospitals. Our primary objective was to test the hypothesis that in situ neonatal resuscitation simulation training improves rural hospitals' delivery room team confidence in performing key Neonatal Resuscitation Program^® (NRP^®) skills. Our secondary objective was to compare confidence to performance as measured by adherence to NRP® guidelines.

Methods: We conducted a quasi-experimental pre-training survey and post-training survey of delivery room team confidence in NRP^® skills at five level one delivery hospitals before and after an in situ simulation training program. Participants included rural hospitals’ usual delivery room team members. Participants rated their confidence on a five-point Likert scale. Simulations were analyzed using an adapted version of a validated scoring tool for NRP^® adherence and presented as overall percentage scores.

Results: Our data demonstrate a significant improvement in self-assessed confidence levels pre- and post-simulation training in key areas of neonatal resuscitation. Participants reported higher confidence in airway management (4 vs. 3, p=0.003), emergency intravenous access (3 vs. 2, p=0.007), and the ability to manage a code in the delivery room (4 vs. 3, p=0.013) and the operating room (4 vs. 3, p=0.028). Improvements were also noted in their team member’s knowledge and skills to perform neonatal resuscitation. While improvements were appreciated in confidence, the performance of skills (NRP^® adherence scores) was often in the sub-optimal performance range.

Conclusions: An in situ-based neonatal resuscitation outreach simulation program improves self-confidence among rural delivery room teams. Additional research is needed to understand how to translate improved confidence into actual improved performance. 

Improved surgeon performance following cadaveric simulation of internal carotid artery injury during endoscopic endonasal surgery: training outcomes of a nationwide prospective educational intervention

OBJECTIVE

Internal carotid artery injury (ICAI) is a rare, life-threatening complication of endoscopic endonasal approaches that will be encountered by most skull base neurosurgeons and otolaryngologists. Rates of surgical proficiency for managing ICAI are not known, and the role of simulation to improve performance has not been studied on a nationwide scale.

METHODS

Attending and resident neurosurgery and otorhinolaryngology surgeons (n = 177) were recruited from multicenter regional and national training courses to assess training outcomes and validity at scale of a prospective educational intervention to improve surgeon technical skills using a previously validated, perfused human cadaveric simulator. Participants attempted an initial trial (T1) of simulated ICAI control using their preferred technique. An educational intervention including personalized instruction was performed. Participants attempted a second trial (T2). Task success (dichotomous), time to hemostasis (TTH), estimated blood loss (EBL), and surgeon heart rate were measured.

RESULTS

Participant rating scales confirmed that the simulation retained face and construct validity across eight instructional settings. Trial success (ICAI control) improved from 56% in T1 to 90% in T2 (p < 0.0001). EBL and TTH decreased by 37% and 38%, respectively (p < 0.0001). Postintervention resident surgeon performance (TTH, EBL, and success rate) was superior to preintervention attending surgeon performance. The most improved quartile of participants achieved 62% improvement in TTH and 73% improvement in EBL, with trial success improvement from 25.6% in T1 to 100% in T2 (p < 0.0001). Baseline surgeon confidence was uncorrelated with T1 success, while posttraining confidence correlated with T2 success. Tachycardia was measured in 57% of surgeon participants, but was attenuated during T2, consistent with development of resiliency.

CONCLUSIONS

Prior to training, many attending and most resident surgeons could not manage the rare, life-threatening intraoperative complication of ICAI. A simulated educational intervention significantly improved surgeon performance and remained valid when deployed at scale. Simulation also promoted the development of favorable cognitive skills (accurate perception of skill and resiliency). Rare, life-threatening intraoperative complications may be optimal targets for educational interventions using surgical simulation.