Developing the Virtual Resus Room: Fidelity, Usability, Acceptability, and Applicability of a Virtual Simulation for Teaching and Learning

Virtual Obstetric Emergency Simulations: Enhancing Knowledge, Skills, and Confidence of Emergency Medicine and Obstetric Professionals

Between 2008 and 2016, 23% of pregnancy-related deaths in Ohio occurred in an emergency department (ED) or outpatient setting. Prior research showed that 98% of Ohio's delivery hospitals conduct obstetric (OB) emergency simulations, whereas only 30% include ED staff. The goal of the grant was to increase the knowledge, skill, and self-efficacy of emergency medicine (EM) professionals in managing OB emergencies. In addition to EM professionals, there was high interest by obstetrics and gynecology (OB/GYN) and other professionals in the course. Therefore, the goal of the project was to increase these elements for all professionals including EM and non-EM professionals in managing OB emergencies.Twelve virtual training courses using simulated patient encounters and video-based skills training were conducted across Ohio on the management of OB emergencies. Scenarios focused on common causes of pregnancy-related death using data from the Ohio Pregnancy-Associated Mortality Review Committee. Pre- and posttests assessed training effectiveness.Between August 1, 2020, and June 30, 2023, 258 learners completed the course. Most were female (76.76%), White (90.61%), and under 45 years old (69.40%). Most (66.49%) were from EM, followed by OB/GYN (18.09%), and other specialties (15.43%) including family medicine and pediatric EM. Most worked in hospital settings (89.19%). Learners reported a median 10.00 (interquartile range [IQR]: 15.00) years in clinical practice. Overall, mean knowledge scores increased by 0.81 (95% confidence interval [CI]: 0.62, 1.01), after the course (p < 0.001). Mean knowledge scores increased by 0.90 (95% CI: 0.64, 1.16; p < 0.001), 0.67 (95% CI: 0.24, 1.09; p = 0.003), and 0.60 (95% CI: 0.16, 1.04; p = 0.01) for those from EM, OB/GYN, and other specialties, respectively. Median scores for reported self-efficacy increased by 24.00 (IQR: 22.33) and self-reported skills increased by 30.42 (IQR: 22.83) points (p < 0.001).Virtual simulations can be effective in improving EM, OB, and other professionals' knowledge, self-efficacy, and self-reported skills in managing OB emergencies. · Obstetric knowledge and skills can be taught effectively in a virtual environment.. · Educational interventions can use pregnancy-associated mortality data to target local patterns.. · Simulation can teach management of high-acuity, low-frequency obstetric emergencies to learners..

Design and evaluation of a problem-based learning VR module for apparel fit correction training

The increased adoption of three-dimensional (3D) digital prototyping software programs makes it necessary to train novice designers to use these programs efficiently. However, existing studies spanning from engineering to design education indicate that students feel incompetent in understanding 3D digital prototypes and navigating the software, so there is a need to find effective training methods. In the current study, training modules were developed to teach participants fit correction skills through an iterative problem-based learning (PBL) approach. A review of the literature was performed to develop the fit correction tasks and guide the module development process. Expert feedback was used to fine-tune the tasks and module interface. The current study explored the effects of PBL-based virtual reality (VR) training on learning how to correct two-dimensional (2D) apparel patterns to improve consequent 3D garment fit. Results indicated that the training module significantly improved spatial visualization and fit correction skills. Participants with higher apparel spatial visualization skills saw a higher improvement in fit correction skills because of the training. At lower spatial visualization skill levels, women saw a higher increase in apparel spatial visualization skills after the training than men but the difference between the learning outcomes across genders reduced when participants had higher spatial skills before training. These findings were supported by the results of qualitative data obtained through interviews. The participants found the PBL approach, immediate feedback, and aid in visualization through garment simulations beneficial for understanding the concepts. At the same time, they indicated that the training module could be used as a supplement to the traditional classroom but cannot replace the physical garment fitting practice. The findings of the study verified that PBL using virtual garment simulations can have a positive impact on learning outcomes and help identify the stage of education at which learners can be exposed to PBL.

A Comparison of Telesimulation Using the Virtual Resus Room and In Situ Simulation in Pediatric Emergency Medicine

OBJECTIVES

During the COVID-19 pandemic, there was a marked shift toward telesimulation in medical education. Limited studies exist comparing the effectiveness of online and offline simulation education. The goals of this study are to evaluate active learners' perceived effectiveness of telesimulation versus in situ simulation and to identify potential shortcomings of existing online teaching platforms.

METHODS

Through participant evaluations after a simulation, we compared telesimulation using the Virtual Resus Room (VRR) to in situ simulation in the domains of (1) self-efficacy, (2) fidelity, (3) educational value, and (4) teaching quality. Study subjects included medical and pharmacy residents and medical students completing their pediatric emergency medicine rotation at two children's hospitals as well as nurses, nurse practitioners, and physician assistants who were recently hired and orienting to their new roles in the emergency department. Learners used a modified Michigan Standard Simulation Experience Scale to evaluate either a telesimulation or in situ simulation case. Survey responses were compared using Wilcoxon rank sum tests with Bonferroni correction for multiple comparisons.

RESULTS

In overall assessment, in situ simulation was rated higher than telesimulation. There were significant differences noted related to perceived realism, utility in training device-related skills, and utility in training team-building skills. All P values were less than 0.0036. There were no significant differences between simulation types in perception of physical examination fidelity, instructor adequacy, or self-efficacy.

CONCLUSIONS

Telesimulation using the VRR is comparable to in situ simulation in learners' perception of improvement in self-efficacy and of teaching quality for pediatric emergency medicine topics. However, participants felt less able to practice tactile and communication skills virtually. Further innovation is needed to improve learners' experience with fidelity and educational value.

Exploring cultural sensitivity during distance simulations in pediatric emergency medicine

Background

Cultural sensitivity (CS) training is vital to pediatric emergency medicine (PEM) curricula. This study aimed to explore CS in Yale PEM fellows and emergency medicine (EM) residents at Indus Hospital and Health Network (IHHN) in Pakistan through distance simulation activities.

Methods

This mixed-methods analysis of an educational intervention was conducted at Yale University in collaboration with IHHN. We approached seven U.S. PEM fellows and 22 Pakistani EM residents. We performed a baseline CS assessment using the Clinical Cultural Competency Questionnaire (CCCQ). Afterward, the U.S. PEM fellows facilitated the Pakistani EM residents through six distance simulation sessions. Qualitative data were collected through online focus groups. The CCCQ was analyzed using descriptive statistics, and content analysis was used to analyze the data from the focus groups.

Results

Seven U.S. PEM fellows and 18 of 22 Pakistani EM residents responded to the CCCQ at the beginning of the module. The mean (±SD) CCCQ domain scores for the U.S. PEM fellows versus the Pakistani EM residents were 2.56 (±0.37) versus 2.87 (±0.72) for knowledge, 3.02 (±0.41) versus 3.33 (±0.71) for skill, 2.86 (±0.32) versus 3.17 (±0.73) for encounter/situation, and 3.80 (±0.30) versus 3.47 (±0.47) for attitude (each out of 5 points). Our qualitative data analysis showed that intercultural interactions were valuable. There is a common language of medicine among the U.S. PEM fellows and Pakistani EM residents. The data also highlighted a power distance between the facilitators and learners, as the United States was seen as the standard of "how to practice PEM." The challenges identified were time differences, cultural practices such as prayer times, the internet, and technology. The use of local language during debriefing was perceived to enhance engagement.

Conclusion

The distance simulation involving U.S. PEM fellows and Pakistani EM residents was an effective approach in assessing various aspects of intercultural education, such as language barriers, technical challenges, and religious considerations.

Telesimulation for neonatal resuscitation training

Telesimulation uses telecommunication and simulation to educate and assess remote learners, obviating the need for instructors or learners to travel off site. Telesimulation increases access to and convenience of simulation-based education for sites that do not have formal simulation centers, including rural/remote areas. Telesimulation is feasible, improves knowledge and skills, and is favorably received by learners and instructors. In general, telesimulation has been shown to be effective for neonatal resuscitation training, even in low- and middle-income countries. Post telesimulation debriefing, termed teledebriefing, requires many of the skills of in-person debriefing, and teledebriefing can optimize learning by exposing learners to content experts in geographically distant sites or from specialties not available locally. When implementing telesimulation for neonatal resuscitation training, key considerations include program design, telecommunication platform, pre-telesimulation preparation, and teledebriefing. Additional research is needed to identify whether lessons learned during telesimulation translate to clinical practice and impact patient outcomes.

Implementation of a North American pediatric emergency medicine simulation curriculum using the virtual resuscitation room

Background

Simulation provides consistent opportunities for residents to practice high-stakes, low-frequency events such as pediatric resuscitations. To increase standardization across North American residency programs, the Emergency Medicine Resident Simulation Curriculum for Pediatrics (EM ReSCu Peds) was developed. However, access to high-quality simulation/pediatric expertise is not uniform. As the concurrent COVID-19 pandemic necessitated new virtual simulation methods, we adapted the Virtual Resus Room (VRR) to teach EM ReSCu Peds. VRR is an award-winning, low-resource, open-access distance telesimulation platform we hypothesize will be effective and scalable for teaching this curriculum.

Methods

EM residents completed six VRR EM ReSCu Peds simulation cases and received immediate facilitator-led teledebriefing. Learners completed retrospective pre-post surveys after each case. Learners and facilitators completed end-of-day surveys. Primary outcomes were learning effectiveness measured by a composite of the Simulation Effectiveness in Teaching Modified (SET-M) tool and self-reported changes in learner comfort with case objectives. Secondary outcome was VRR scalability to teach EM ReSCu Peds using a composite outcome of net promoter scores (NPS), resource utilization, open-text feedback, and technical issues.

Results

Learners reported significantly increased comfort with 95% (54/57) of EM ReSCu Peds-defined case objectives (91% cognitive, 9% psychomotor), with moderate (Cohen's d 0.71, 95% CI 0.67-0.76) overall effect size. SET-M responses indicated simulation effectiveness, particularly with debriefing. Ninety EM residents from three North American residency programs were taught by 59 pediatric faculty from six programs over 4 days-more than possible if simulations were conducted in person. Learners (39) and faculty (68) NPS were above software industry benchmarks (13). Minor, quickly resolved, technical issues were reported by 18% and 29% of learners and facilitators, respectively.

Conclusions

Learners and facilitators report that the VRR is an effective and scalable platform to teach EM ReSCu Peds. This low-cost, accessible distance simulation intervention could increase equitable, global access to high-quality pediatric emergency education.

Building a theoretical model for virtual interprofessional education

BACKGROUND

Virtual interprofessional education (IPE) has emerged as a promising alternative to traditional in-person IPE. However, theoretical frameworks to support virtual interprofessional learning are not well established. Two theoretical frameworks emerged as relevant to virtual IPE: (1) the Canadian Interprofessional Health Collaborative (CIHC) interprofessional learning framework and (2) Dornan's Experience-Based Learning Model (ExBL) of workplace learning. In this study, we sought to explore virtual IPE using both frameworks to develop new theoretical understandings and identify assumptions, gaps and barriers.

METHODS

This was a qualitative study. Semi-structured interviews were conducted with medical and nursing student participants (n = 14) and facilitators (n = 3) from virtual IPE workshops. Transcripts were analysed using directed content analysis methodology, informed by the CIHC and ExBL frameworks. Themes were explored using mind-mapping transitional coding. Data collection and analysis were continued iteratively until themes with adequate conceptual depth, relevance and plausibility were identified.

RESULTS

Three themes were identified: (1) a shift in the balance of personal and professional, (2) blunted sociologic fidelity and (3) uncertainty and threats to interpersonal connections. Professional distinctions and hierarchies are blurred virtually. This contributed to an increased sense of psychological safety among most learners and lowered the threshold for participation. Separation from workplace sociologic complexity facilitated communication and role clarification objectives. However, loss of immersion may limit deeper engagement. Interprofessional objectives that rely on deeper sociological fidelity, such as conflict resolution, may be threatened. Informal interactions between learners are hindered, which may threaten organic development of interprofessional relationships.

CONCLUSIONS

Role clarification and communication objectives are preserved in virtual IPE. Educators should pay close attention to psychological safety and sociologic fidelity-both to leverage advantages and guard against threats to connection and transferability. Virtual IPE may be well suited as a primer to in-person activities or as scaffolding towards interprofessional workplace practice.

At the limits of digital education. The importance of practical education for clinical competencies learning in the field of emergency medicine: A controlled non-randomized interventional study

Introduction

A high-quality education of future physicians is essential. Modern approaches interlock the acquisition of theoretical knowledge and practical skills in a spiral curriculum, leading to a mutual learning benefit for knowledge and application. This model was challenged by the elimination of hands-on trainings during the pandemic, which were often replaced by purely digital teaching models. Given the holistic nature of the spiral curriculum, we assumed that a purely digital model would have an impact on knowledge acquisition due to missing hands-on learning opportunities. The aim of the study was to investigate, using an emergency seminar as an example, whether purely digital training leads to a difference in theoretical knowledge compared to the traditional model.

Materials and methods

Study design: We used a two-groups design comparing a sample of medical students taught in 2020 with a purely digital teaching format (DF; n = 152) with a historical control group taught with a traditional format (TF; n = 1060). Subject of investigation was a seminar on emergency medicine, taking place in the 4th year. Outcome parameters: The primary outcome parameter was the students' acquired knowledge, measured by the score achieved in the final exams. Students' evaluation of the seminar was used as a secondary outcome parameter.

Results

Students in the DF group scored significantly lower than students in the TF group in the final exams. Students in the DF group rated the course significantly worse than students in the TF group.

Discussion

The study results illustrate that purely digital education leads to inferior knowledge acquisition compared to the traditional spiral curriculum. A possible explanation may lie in a deeper processing of the information (e.g., understanding the information by experience and analysis) and accordingly a better memory recall. Moreover, the students' critical appraisal of the DF may have had an unfavorable effect on learning performance. Moderating factors may be lower learning motivation or the “zoom fatigue” effect.

Conclusion

These study results clearly illustrate the importance of hands-on teaching for knowledge acquisition. The interlocking of theoretical knowledge and practical skills, as ensured by the spiral curriculum, is essential.

Virtual Simulation in Undergraduate Medical Education: A Scoping Review of Recent Practice

Virtual simulation (VS) as an emerging interactive pedagogical strategy has been paid more and more attentions in the undergraduate medical education. Because of the fast development of modern computer simulation technologies, more and more advanced and emerging VS-based instructional practices are constantly increasing to promote medical education in diverse forms. In order to describe an overview of the current trends in VS-based medical teaching and learning, this scoping review presented a worldwide analysis of 92 recently published articles of VS in the undergraduate medical teaching and learning. The results indicated that 98% of included articles were from Europe, North America, and Asia, suggesting a possible inequity in digital medical education. Half (52%) studies reported the immersive virtual reality (VR) application. Evidence for educational effectiveness of VS in medical students' knowledge or skills was sufficient as per Kirkpatrick's model of outcome evaluation. Recently, VS has been widely integrated in surgical procedural training, emergency and pediatric emergency medicine training, teaching of basic medical sciences, medical radiation and imaging, puncture or catheterization training, interprofessional medical education, and other case-based learning experiences. Some challenges, such as accessibility of VS instructional resources, lack of infrastructure, "decoupling" users from reality, as well as how to increase students' motivation and engagement, should be addressed.