ACEP SimBox: A Pediatric Simulation-Based Training Innovation

Identified Needs in Pediatric Education for Emergency Medicine Physicians: A Qualitative Analysis

OBJECTIVES

General emergency medicine (EM) physicians provide most pediatric emergency care in the United States, yet EM physicians feel underprepared to manage pediatric emergencies. Pediatric emergency medicine (PEM) education during EM residency is variable, and learner preferences regarding educational experiences have not been widely explored through a qualitative lens. We aimed to better describe EM physicians' PEM educational needs and preferred teaching methods.

METHODS

In 2021, as part of a survey querying senior EM residents and recent graduates from 8 diverse EM programs regarding perceived preparedness for PEM emergencies, educational needs and content delivery methods were assessed using 2 free-text questions. Qualitative analysis included deidentification and iterative coding of the data with double coding of 100% of the comments. We performed conventional content analysis of responses to identify emerging themes.

RESULTS

The overall response rate for the survey was 53% (N = 129 out of 242 eligible participants) with 84 distinct free-text responses. Major themes included: 1) desire for education regarding neonates, infants, and critically ill children, especially airway management and 2) need for help translating lessons from PEM rotations to community EM practice. Respondents desired more autonomy during training. Their preferred PEM educational modality was simulation, and they appreciated online clinical pathways for just-in-time decision support.

CONCLUSIONS

This qualitative study of EM physicians proximal to training adds to a prior needs assessment by describing in detail desired pediatric content and preferred delivery. The findings can be used to better inform the development of PEM curricula for this group of EM physicians.

Dissemination, Utilization, and Satisfaction With Emergency Medicine Resident Simulation Curriculum for Pediatrics (EM ReSCu Peds) by North American Residency Programs

OBJECTIVES

Our research team's primary objective was to investigate how a custom standard simulation curriculum for teaching emergency medicine residents about pediatrics was being used by programs across North America. We also wanted to know if program directors were satisfied with the curriculum and whether they had challenges with implementing it. Our long-term goal is to promote the Emergency Medicine Resident Simulation Curriculum for Pediatrics for use by all programs in the United States.

METHODS

We distributed an electronic questionnaire to individuals who have downloaded the Emergency Medicine Resident Simulation Curriculum for Pediatrics in the form of an e-book from the Academic Life in Emergency Medicine Web site. The curriculum was marketed through national emergency medicine (EM) and pediatric emergency medicine (PEM) groups, PEM listserv, and through the International Network for Simulation-Based Pediatric Innovation, Research, and Education. We asked survey recipients how they used the curriculum, plans for future maintenance, satisfaction with curriculum use, and whether they had any challenges with implementation. Finally, we asked demographic questions.

RESULTS

Most survey respondents were EM or PEM health care physicians in the United States or Canada. Respondents' primary goal of using the curriculum was resident education. Through assessment with the Net Promoter Score, satisfaction with the curriculum was net positive with users largely scoring as curriculum promoters. We found COVID-19 and overall time limitations to be implementation barriers, whereas learner interest in topics was the largest cited facilitator. Most responders plan to continue to implement either selected cases or the entire curriculum in the future.

CONCLUSIONS

Of those who responded, our target audience of EM physicians used our curriculum the most. Further investigation on implementation needs, specifically for lower resource emergency programs, is needed.

Use of a SimBox, a Video-Augmented, Newborn Resuscitation Simulation for Prehospital Providers to Measure Clinical Performance and Educational Experience

OBJECTIVES

Few studies have described the current clinical practices, adherence to guidelines, and outcomes of newborn resuscitations attended by emergency medical services (EMS). SimBox, a novel, video-augmented simulation, was used to describe the adherence of prehospital providers to Neonatal Resuscitation Program guidelines, to measure satisfaction with the simulation intervention, and to describe the self-reported improvement in knowledge, skills, and attitudes after the simulation.

METHODS

A prospective observational cohort study of EMS providers was designed and conducted using SimBox, an open-access simulation platform, and facilitated by EMS educators. Clinical performance measures were collected using a five-item checklist. Simulation satisfaction measures were collected through net promoter scores. Learners' demographics, and self-reported knowledge, skills, and attitudes were measured using a retrospective survey of 25 questions.

RESULTS

In total, 33 facilitator and 55 learner surveys were collected across Connecticut, Colorado, and Alaska between July 2021 and September 2022. At least one deviation from clinical guidelines occurred in 22/30 (73.3%) of the sessions, with 10/30 (33.3%) teams inappropriately performing chest compressions, 5/31 (16.1%) teams not warming, drying, stimulating, and suctioning the newborn, and 7/31 (22.6%) teams not performing positive pressure ventilation correctly. Lastly, 10/30 (33.3%) teams administered an incorrect dose of dextrose-containing fluids. Very high levels of satisfaction were reported with net promoter scores of 97 and 82 out of 100 for the facilitator and learner surveys, respectively. Finally, all 55/55 (100%) of the learners strongly or somewhat agreed that the simulation improved their knowledge, teamwork, communication, and psychomotor skills.

CONCLUSIONS

In this cohort of prehospital providers, clinical management decisions during a newborn resuscitation simulation often deviated from the gold-standard, newborn resuscitation guidelines. Free, online, open-access simulation resources like SimBox can be used to identify and measure practice deviations from standardized resuscitation protocols in the prehospital setting.

Health Care Simulation in Person and at a Distance: A Systematic Review

ABSTRACT

Distance simulation is a method of health care training in which the learners and facilitators are in different physical locations. Although methods of distance simulation have existed in health care for decades, this approach to education became much more prevalent during the COVID-19 pandemic. This systematic review studies a subset of distance simulation that includes combined in-person and distance simulation elements, identified here as "mixed- distance simulation." A review of the distance simulation literature identified 10,929 articles. Screened by inclusion and exclusion criteria, 34 articles were ultimately included in this review. The findings of this review present positive and negative aspects of mixed-distance simulation formats, a description of the most frequent configurations related to delivery, terminology challenges, as well as future directions including the need for faculty development, methodological rigor, and reporting details.

Blueprint for community emergency department pediatric simulation

Background

Gaps in quality of pediatric emergency care have been noted in community emergency departments (CEDs), where >85% of children receive care. In situ simulation provides opportunities for hands-on experiences and can help close these gaps. We aimed to develop, implement, and evaluate an innovative, replicable, and scalable pediatric in situ simulation-based CED curriculum, under the leadership of a local colleague, through collaborative approach with a regional academic medical center (AMC).

Methods

Kern's model was used as follows: problem identification and general needs assessment-pediatric readiness assessment and discussions with CED physician and nursing leadership; targeted needs assessment-review of recent pediatric transfer cases; goals and objectives-enhance pediatric knowledge and skills of interprofessional teams and detect latent safety threats; educational strategies-codeveloped by CED and AMC, included prelearning using podcasts and videos, simulation and facilitated debriefing, resource sharing after simulations; implementation-3-h simulation sessions facilitated in person by the CED team and remotely by AMC (leadership required participation and paid staff); and evaluation and feedback-retrospective pre-post survey, Simulation Effectiveness Tool-Modified (SET-M), Net Promoter Score (NPS), and review/feedback meetings.

Results

Based on needs assessment, the selected cases included newborn resuscitation, seizure, asthma, and tetrahydrocannabinol ingestion causing altered mental sensorium in a child. Twenty-four 3-h simulation sessions were conducted over 1 year. A total of 168 participants completed the sessions, while 75 participants (54.7% nurses, 22.7% physicians, and others) completed feedback surveys. Seventy-six percent of participants reported completing presimulation education material. Participants reported improved skills at appropriately evaluating a critically ill newborn and critically ill infant/toddler and improved teamwork during the care of a pediatric patient. The majority agreed that simulation was effective in teaching pediatric resuscitation. The NPS was 84% (excellent).

Conclusions

A locally facilitated CED in situ simulation curriculum was successfully developed and implemented under local leadership, with remote collaboration by AMC. The curriculum was well received and effective.

Implementation of a pediatric in situ, train-the-trainer simulation program in general emergency departments

Background

Most children receive emergency care in general emergency departments (EDs). Pediatric resuscitations require specific equipment and weight-based dosing that may be less familiar to general ED healthcare professionals. In situ simulation (ISS) improves teamwork and problem solving, and it may identify latent safety threats. This innovative program brought academic faculty to participating hospitals and taught simulation principles in a small-group environment. This format removed many of the barriers to implementing simulations for general EDs and was intended to teach principles for utilizing simulation to meet unique departmental needs.

Methods

Using the Consolidated Framework for Implementation Research (CFIR) framework, ED teams at eight hospitals participated in a train-the-trainer program from 2016 to 2020 intended to help them implement their own ISSs. Training covered benefits of ISS, use of simulation for identifying latent safety threats, debriefing principles, and potential safety risks of ISS. Faculty also provided on-site mentoring during the implementation phase. We identified factors and barriers that contributed to the successful adoption of an ISS program.

Results

Most hospitals continued their ISS program after the study ended. Several themes emerged as pearls and pitfalls to implementing a train-the-trainer program. Successful teams had strong nursing and physician leadership participation, and team members had positive working relationships with early positive feedback which encouraged future ISS implementation. Barriers to simulation included high staff turnover of nurses and physicians as well as social distancing protocols related to infection control.

Conclusions

Academic EDs can partner with general EDs to implement a train-the-trainer simulation program. We describe facilitators and barriers to implementing a train-the-trainer ISS program in general EDs to improve emergency care for high-risk, low-frequency events.

The feasibility of a pediatric distance learning curriculum for emergency department nurses during the COVID-19 pandemic: An Improving Pediatric Acute Care Through Simulation (ImPACTS) collaboration

Introduction

To develop and evaluate the feasibility and effectiveness of a longitudinal pediatric distance learning curriculum for general emergency nurses, facilitated by nurse educators, with central support through the Improving Acute Care Through Simulation collaborative.

Methods

Kern’s 6-step curriculum development framework was used with pediatric status epilepticus aimed at maintaining physical distancing, resulting in a 12-week curriculum bookended by 1-hour telesimulations, with weekly 30-minute online asynchronous distance learning. Recruited nurse educators recruited a minimum of 2 local nurses. Nurse educators facilitated the intervention, completed implementation surveys, and engaged with other educators with the Improving Pediatric Acute Care through Simulation project coordinator. Feasibility data included nurse educator project engagement and curriculum engagement by nurses with each activity. Efficacy data were collected through satisfaction surveys, pre-post knowledge surveys, and pre-post telesimulation performance checklists.

Results

Thirteen of 17 pediatric nurse educators recruited staff to complete both telesimulations, and 38 of 110 enrolled nurses completed pre-post knowledge surveys. Knowledge scores improved from a median of 70 of 100 (interquartile range: 66-78) to 88 (interquartile range: 79-94) (P = .018), and telesimulation performance improved from a median of 60 of 100 (interquartile range: 45-60) to 100 (interquartile range: 85-100) (P = .016). Feedback included a shortened intervention and including physician participants.

Discussion

A longitudinal pediatric distance learning curriculum for emergency nurses collaboratively developed and implemented by nurse educators and Improving Pediatric Acute Care through Simulation was feasible for nurse educators to implement, led to modest engagement in all activities by nurses, and resulted in improvement in nurses’ knowledge and skills. Future directions include shortening intervention time and broadening interprofessional scope.

Low-Cost "Telesimulation" Training Improves Real Patient Pediatric Shock Outcomes in India

INTRODUCTION

Pediatric shock, especially septic shock, is a significant healthcare burden in low-income countries. Early recognition and management of shock in children improves patient outcome. Simulation-based education (SBE) for shock recognition and prompt management prepares interdisciplinary pediatric emergency teams in crisis management. COVID-19 pandemic restrictions on in-person simulation led us to the development of telesimulation for shock. We hypothesized that telesimulation training would improve pediatric shock recognition, process of care, and patient outcomes in both simulated and real patient settings.

MATERIALS AND METHODS

We conducted a prospective quasi-experimental interrupted time series cohort study over 9 months. We conducted 40 telesimulation sessions for 76 participants in teams of 3 or 4, utilizing the video telecommunication platform (Zoom©). Trained observers recorded time-critical interventions on real patients for the pediatric emergency teams composed of residents, fellows, and nurses. Data were collected on 332 pediatric patients in shock (72% of whom were in septic shock) before, during, and after the intervention. The data included the first hour time-critical intervention checklist, patient hemodynamic status at the end of the first hour, time for the resolution of shock, and team leadership skills in the emergency room.

RESULTS

There was a significant improvement in the percent completion of tasks by the pediatric emergency team in simulated scenarios (69% in scenario 1 vs. 93% in scenario 2; p < 0.001). In real patients, completion of tasks as per time-critical steps reached 100% during and after intervention compared to the pre-intervention phase (87.5%), p < 0.05. There was a significant improvement in the first hour hemodynamic parameters of shock patients: pre (71%), during (79%), and post (87%) intervention (p < 0.007 pre vs. post). Shock reversal time reduced from 24 h pre-intervention to 6 h intervention and to 4.5 h post intervention (p < 0.002). There was also a significant improvement in leadership performance assessed by modified Concise Assessment of Leader Management (CALM) instrument during the simulated (p < 0.001) and real patient care in post intervention (p < 0.05).

CONCLUSION

Telesimulation training is feasible and improved the process of care, time-critical interventions, leadership in both simulated and real patients and resolution of shock in real patients. To the best of our knowledge, this is one of the first studies where telesimulation has shown improvement in real patient outcomes.