A practical guide to virtual debriefings: communities of inquiry perspective

Engagement in Distance Healthcare Simulation Debriefing: A Concept Development and Framework

SUMMARY STATEMENT

Understanding distance health care simulation debriefing is crucial in light of the increased use of and emerging technology in remote education for reasons of accessibility, global collaboration, and continuous professional development. This article is a confluence of a number of previously published studies designed to serve as a foundation to develop the concept of "engagement in health care distance simulation debriefing" using the Schwartz-Barcott & Kim hybrid mixed methods model. The model uses 3 phases: theoretical (a realist systematic review of the literature), fieldwork (3 exploratory studies and 2 pilot experimental studies), and analytical (analysis of the theoretical and fieldwork findings through expert discussion). This study defines the concept of "engagement in health care simulation distance debriefing" through exploration of its uses and analysis in literature, interviews, and expert review. The hybrid approach to the analysis provided rigor to generate a new, reflective conceptual model. This conceptual model defines the complexity in engagement during distance debriefing and helps shape the development of simulationists and debriefers, leading to more effective distance simulations and debriefings.

A Staged Defragmented Simultaneous Debriefing Model As Integrated Micro-debriefing Components Inside Online Simulation for Competencies Formation

Background Currently, there are no separate debriefing models for online simulation training, and existing models simply imitate the traditional models used in on-site simulation training (the physical presence of individuals, such as students or trainees, in a simulation center). This involves hands-on, in-person training within a simulated environment to enhance practical skills and knowledge in a controlled setting. This scenario does not fully meet the requirements and capabilities of distance learning. Objective To develop a staged defragmented debriefing model as integrated micro-debriefing components inside an online simulation to support the development of clinical decision-making and competencies formation within medical education and offer recommendations to support the use of this debriefing model as a teaching strategy. Methods This descriptive study was conducted from August 2020 to September 2023. To build a staged defragmented debriefing model as integrated micro-debriefing components inside an online simulation for competencies formation the traditional debriefing model's components for on-site simulation training, simulation type, and structure, modern concepts of e-learning, and classification of the seriousness of medication errors were used. The main focus of this study was on providing a detailed account of the debriefing components for online simulation training, features, and implementation of this new teaching model. A total of 38 participants, healthcare professionals, were recruited for this study. The participants were randomly assigned to two groups: one experiencing the staged defragmented debriefing model (n = 20) and the other control group, which received traditional debriefing following simulation training (n = 18). Results The results allowed us to successfully develop a staged defragmented debriefing model inside the simulation that integrates micro-debriefing components located at different points of the simulation scenarios. This teaching approach was successfully implemented in online clinical case scenarios in the "ClinCaseQuest" Simulation Training Platform for continuous medical education. Additionally, an internal validation experiment comparing the effectiveness of the staged defragmented debriefing model with the traditional debriefing method demonstrated superior learning outcomes and participant satisfaction in the staged debriefing group. Conclusions The staged defragmented debriefing model, when integrated into online simulations, represents a promising strategy for advancing clinical decision-making skills and competencies formation in medical education. Implementation of this debriefing model as a teaching strategy holds promise for enhancing learning outcomes in medical education settings. Further research, validation, and implementation are recommended to maximize the model's potential impact on medical education and training.

Feasibility and Impact of an Online Simulation Focusing on Nursing Communication About Sexual Health in Gynecologic Oncology

Nurses' communication regarding the sexual health of women with gynecologic cancer is suboptimal and may be attributed to their lack of sexual health training and knowledge. Our study aims to document the learning experience, impacts, and feasibility of an online educational intervention activity between oncology nurses and a simulated participant on communication with patients regarding oncological sexual health. Using a qualitative approach, we conducted a feasibility study, which included 11 oncology nurses, and performed semi-structured individual interviews after our simulation exercise. We then conducted an iterative thematic data analysis. The participating nurses found the learning experience positive and satisfactory, despite issues with discussions between learners via Zoom™. Study nurse participants reported positive outcomes in knowledge, beliefs, attitudes, communication skills, and nursing practices. Finally, the educational intervention was found to be feasible. The online educational intervention involving a simulated participant appears to be a satisfactory, feasible, and promising module to improve communication regarding the sexual health of gynecologic cancer patients among oncology nurses. However, further studies are needed to verify this type of intervention's effectiveness and optimize oncology nurses' continuing education in sexual health.

Understanding the Effects of Health Care Distance Simulation: A Systematic Review

ABSTRACT

The use of distance simulation has rapidly expanded in recent years with the physical distance requirements of the COVID-19 pandemic. With this development, there has been a concurrent increase in research activities and publications on distance simulation. The authors conducted a systematic review of the peer-reviewed distance health care simulation literature. Data extraction and a risk-of-bias assessment were performed on selected articles. Review of the databases and gray literature reference lists identified 10,588 titles for review. Of those, 570 full-text articles were assessed, with 54 articles included in the final analysis. Most of these were published during the COVID-19 pandemic (2020-2022). None of the included studies examined an outcome higher than a Kirkpatrick level of 2. Most studies only examined low-level outcomes such as satisfaction with the simulation session. There was, however, a distinction in studies that were conducted in a learning environment where all participants were in different locations ("distance only") as compared with where some of the participants shared the same location ("mixed distance"). This review exclusively considered studies that focused solely on distance. More comparative studies exploring higher level outcomes are required to move the field forward.

Distance simulation in the health professions: a scoping review

BACKGROUND

Distance simulation is defined as simulation experiences in which participants and/or facilitators are separated from each other by geographic distance and/or time. The use of distance simulation as an education technique expanded rapidly with the recent COVID-19 pandemic, with a concomitant increase in scholarly work.

METHODS

A scoping review was performed to review and characterize the distance simulation literature. With the assistance of an informationist, the literature was systematically searched. Each abstract was reviewed by two researchers and disagreements were addressed by consensus. Risk of bias of the included studies was evaluated using the Risk of Bias 2 (RoB 2) and Risk of Bias in Non-randomized Studies of Interventions (ROBINS-I) tools.

RESULTS

Six thousand nine hundred sixty-nine abstracts were screened, ultimately leading to 124 papers in the final dataset for extraction. A variety of simulation modalities, contexts, and distance simulation technologies were identified, with activities covering a range of content areas. Only 72 papers presented outcomes and sufficient detail to be analyzed for risk of bias. Most studies had moderate to high risk of bias, most commonly related to confounding factors, intervention classification, or measurement of outcomes.

CONCLUSIONS

Most of the papers reviewed during the more than 20-year time period captured in this study presented early work or low-level outcomes. More standardization around reporting is needed to facilitate a clear and shared understanding of future distance simulation research. As the broader simulation community gains more experience with distance simulation, more studies are needed to inform when and how it should be used.

Telesimulation for neonatal resuscitation training

Telesimulation uses telecommunication and simulation to educate and assess remote learners, obviating the need for instructors or learners to travel off site. Telesimulation increases access to and convenience of simulation-based education for sites that do not have formal simulation centers, including rural/remote areas. Telesimulation is feasible, improves knowledge and skills, and is favorably received by learners and instructors. In general, telesimulation has been shown to be effective for neonatal resuscitation training, even in low- and middle-income countries. Post telesimulation debriefing, termed teledebriefing, requires many of the skills of in-person debriefing, and teledebriefing can optimize learning by exposing learners to content experts in geographically distant sites or from specialties not available locally. When implementing telesimulation for neonatal resuscitation training, key considerations include program design, telecommunication platform, pre-telesimulation preparation, and teledebriefing. Additional research is needed to identify whether lessons learned during telesimulation translate to clinical practice and impact patient outcomes.

Videos of simulated after action reviews: a training resource to support social and inclusive learning from patient safety events

Innovation in the education and training of healthcare staff is required to support complementary approaches to learning from patient safety and everyday events in healthcare. Debriefing is a commonly used learning tool in healthcare education but not in clinical practice. Little is known about how to implement debriefing as an approach to safety learning across a health system. After action review (AAR) is a debriefing approach designed to help groups come to a shared mental model about what happened, why it happened and to identify learning and improvement. This paper describes a digital-based implementation strategy adapted to the Irish healthcare system to promote AAR uptake. The digital strategy aims to assist implementation of national level incident management policies and was collaboratively developed by the RCSI University of Medicine and Health Sciences and the National Quality and Patient Safety Directorate of the Health Service Executive. During the COVID-19 pandemic, a well-established in-person AAR training programme was disrupted and this led to the development of a series of open access videos on AAR facilitation skills (which accompany the online version of this paper). These provide: (1) an introduction to the AAR facilitation process; (2) a simulation of a facilitated formal AAR; (3) techniques for handling challenging situations that may arise in an AAR and a (4) reflection on the benefits of the AAR process. These have the potential to be used widely to support learning from patient safety and everyday events including excellent care.

Recommendations of the Netzwerk Kindersimulation for the Implementation of Simulation-Based Pediatric Team Trainings: A Delphi Process

BACKGROUND

Serious or life-threatening pediatric emergencies are rare. Patient outcomes largely depend on excellent teamwork and require regular simulation-based team training. Recommendations for pediatric simulation-based education are scarce. We aimed to develop evidence-based guidelines to inform simulation educators and healthcare stakeholders.

METHODS

A modified three-round Delphi technique was used. The first guideline draft was formed through expert discussion and based on consensus (n = 10 Netzwerk Kindersimulation panelists). Delphi round 1 consisted of an individual and team revision of this version by the expert panelists. Delphi round 2 comprised an in-depth review by 12 external international expert reviewers and revision by the expert panel. Delphi round 3 involved a revisit of the guidelines by the external experts. Consensus was reached after three rounds.

RESULTS

The final 23-page document was translated into English and adopted as international guidelines by the Swiss Society of Pediatrics (SGP/SSP), the German Society for Neonatology and Pediatric Intensive Care (GNPI), and the Austrian Society of Pediatrics.

CONCLUSIONS

Our work constitutes comprehensive up-to-date guidelines for simulation-based team trainings and debriefings. High-quality simulation training provides standardized learning conditions for trainees. These guidelines will have a sustainable impact on standardized high-quality simulation-based education.

Implementation of a North American pediatric emergency medicine simulation curriculum using the virtual resuscitation room

Background

Simulation provides consistent opportunities for residents to practice high-stakes, low-frequency events such as pediatric resuscitations. To increase standardization across North American residency programs, the Emergency Medicine Resident Simulation Curriculum for Pediatrics (EM ReSCu Peds) was developed. However, access to high-quality simulation/pediatric expertise is not uniform. As the concurrent COVID-19 pandemic necessitated new virtual simulation methods, we adapted the Virtual Resus Room (VRR) to teach EM ReSCu Peds. VRR is an award-winning, low-resource, open-access distance telesimulation platform we hypothesize will be effective and scalable for teaching this curriculum.

Methods

EM residents completed six VRR EM ReSCu Peds simulation cases and received immediate facilitator-led teledebriefing. Learners completed retrospective pre-post surveys after each case. Learners and facilitators completed end-of-day surveys. Primary outcomes were learning effectiveness measured by a composite of the Simulation Effectiveness in Teaching Modified (SET-M) tool and self-reported changes in learner comfort with case objectives. Secondary outcome was VRR scalability to teach EM ReSCu Peds using a composite outcome of net promoter scores (NPS), resource utilization, open-text feedback, and technical issues.

Results

Learners reported significantly increased comfort with 95% (54/57) of EM ReSCu Peds-defined case objectives (91% cognitive, 9% psychomotor), with moderate (Cohen's d 0.71, 95% CI 0.67-0.76) overall effect size. SET-M responses indicated simulation effectiveness, particularly with debriefing. Ninety EM residents from three North American residency programs were taught by 59 pediatric faculty from six programs over 4 days-more than possible if simulations were conducted in person. Learners (39) and faculty (68) NPS were above software industry benchmarks (13). Minor, quickly resolved, technical issues were reported by 18% and 29% of learners and facilitators, respectively.

Conclusions

Learners and facilitators report that the VRR is an effective and scalable platform to teach EM ReSCu Peds. This low-cost, accessible distance simulation intervention could increase equitable, global access to high-quality pediatric emergency education.

Factors of Engagement in Synchronous Online Learning Conversations and Distance Debriefing: A Realist Synthesis Review

SUMMARY STATEMENT

The COVID-19 pandemic propelled remote simulation and online distance debriefings. Like in-person debriefings, faculty seek to facilitate effective reflective discourse. The online learning environment, however, presents challenges to learner engagement that differ considerably from in-person debriefing, yet little research exists in this area. In an effort to identify factors that influence debriefing engagement in the online environment, we conceptualized distance debriefings as complex social interactions and performed a realist review of the literature for evidence in the fields of online learning, healthcare simulation, instructional design, and other teaching and learning fields to see whether we might discern factors that influence engagement in online learning conversations that might inform online distance debriefing best practices. Eighteen articles were found through our search of 5 online databases (MEDLINE, CINAHL, ERIC, Google Scholar). We conducted iterative purposeful searching and continued to do so throughout the review to try to identify any additional studies that would contribute to our understanding. A thematic analysis of the findings of our included articles revealed indicators categorized using the community of inquiry framework, enabling us to understand and explain them in the context of online learning and propose their application to distance debriefing engagement. We also propose a new dimension to the framework: internal and external factors of engagement. Our findings demonstrate that online learning can positively influence engagement of learners if essential factors are implemented. These factors may inform recommendations for best practices toward learner engagement during healthcare simulation distance debriefing.

Setting an Agenda: Results of a Consensus Process on Research Directions in Distance Simulation

BACKGROUND

The COVID-19 pandemic forced rapid implementation and refinement of distance simulation methodologies in which participants and/or facilitators are not physically colocated. A review of the distance simulation literature showed that heterogeneity in many areas (including nomenclature, methodology, and outcomes) limited the ability to identify best practice. In April 2020, the Healthcare Distance Simulation Collaboration was formed with the goal of addressing these issues. The aim of this study was to identify future research priorities in the field of distance simulation using data derived from this summit.

METHODS

This study analyzed textual data gathered during the consensus process conducted at the inaugural Healthcare Distance Simulation Summit to explore participant perceptions of the most pressing research questions regarding distance simulation. Participants discussed education and patient safety standards, simulation facilitators and barriers, and research priorities. Data were qualitatively analyzed using an explicitly constructivist thematic analysis approach, resulting in the creation of a theoretical framework.

RESULTS

Our sample included 302 participants who represented 29 countries. We identified 42 codes clustered within 4 themes concerning key areas in which further research into distance simulation is needed: (1) safety and acceptability, (2) educational/foundational considerations, (3) impact, and (4) areas of ongoing exploration. Within each theme, pertinent research questions were identified and categorized.

CONCLUSIONS

Distance simulation presents several challenges and opportunities. Research around best practices, including educational foundation and psychological safety, are especially important as is the need to determine outcomes and long-term effects of this emerging field.

Helping healthcare teams to debrief effectively: associations of debriefers' actions and participants' reflections during team debriefings

BACKGROUND

Debriefings help teams learn quickly and treat patients safely. However, many clinicians and educators report to struggle with leading debriefings. Little empirical knowledge on optimal debriefing processes is available. The aim of the study was to evaluate the potential of specific types of debriefer communication to trigger participants' reflection in debriefings.

METHODS

In this prospective observational, microanalytic interaction analysis study, we observed clinicians while they participated in healthcare team debriefings following three high-risk anaesthetic scenarios during simulation-based team training. Using the video-recorded debriefings and INTERACT coding software, we applied timed, event-based coding with DE-CODE, a coding scheme for assessing debriefing interactions. We used lag sequential analysis to explore the relationship between what debriefers and participants said. We hypothesised that combining advocacy (ie, stating an observation followed by an opinion) with an open-ended question would be associated with participants' verbalisation of a mental model as a particular form of reflection.

RESULTS

The 50 debriefings with overall 114 participants had a mean duration of 49.35 min (SD=8.89 min) and included 18 486 behavioural transitions. We detected significant behavioural linkages from debriefers' observation to debriefers' opinion (z=9.85, p<0.001), from opinion to debriefers' open-ended question (z=9.52, p<0.001) and from open-ended question to participants' mental model (z=7.41, p<0.001), supporting our hypothesis. Furthermore, participants shared mental models after debriefers paraphrased their statements and asked specific questions but not after debriefers appreciated their actions without asking any follow-up questions. Participants also triggered reflection among themselves, particularly by sharing personal anecdotes.

CONCLUSION

When debriefers pair their observations and opinions with open-ended questions, paraphrase participants' statements and ask specific questions, they help participants reflect during debriefings.

Exploring Medical Students' Learning Around Uncertainty Management Using a Digital Educational Escape Room: A Design-based Research Approach

Introduction

Medical professionals meet many transitions during their careers, and must learn to adjust rapidly to unfamiliar workplaces and teams. This study investigated the use of a digital educational escape room (DEER) in facilitating medical students' learning around managing uncertainty in transitioning from classroom to clinical placement.

Methods

We used design-based research to explore the design, build, and test of a DEER, as well as gain insight into how these novel learning environments work, using Community of Inquiry (CoI) as a guiding conceptual framework. This study represented a mixed methods pilot test of a prototype DEER. Twenty-two medical students agreed to participate, and data were collected through qualitative (i.e., focus groups, game-play observations) and quantitative (i.e., questionnaires) methods.

Results

Eighty-two per cent of participants agreed or strongly agreed that the DEER supported their learning around uncertainty. Participants offered diverse examples of how the game had facilitated new insights on, and approaches to, uncertainty. With respect to the learning environment, multiple indicators and examples of the three domains of CoI - cognitive, teaching and social presence - were observed.

Discussion

Our findings suggested that DEERs offer a valuable online learning environment for students to engage with complex and emotion-provoking challenges, such as those experienced at transitions. The study also suggested that CoI can be applied to the design, implementation, and evaluation of DEER learning environments, and we have proposed a set of design principles that may offer guidance here.

Who Can Debriefing Assessment for Simulation in Healthcare? Different Perspectives on Teledebriefing Assessments

INTRODUCTION

Virtual debriefing is a cardinal element to achieve the effectiveness of telesimulation. There are different instruments to assess face-to-face debriefing to determine the degree of effectiveness of debriefing; Debriefing Assessment for Simulation in Healthcare (DASH) instrument is one of them. This study aims to describe and compare the evaluation of raters, instructors, and students during a virtual debriefing using the DASH.

METHODS

A cross-sectional study was performed evaluating the virtual debriefing of 30 instructors after a heart failure telesimulation scenario. The evaluation was conducted by 30 instructors, 338 undergraduate students in the seventh semester, and 7 simulation raters. The 3 versions of the DASH instrument in Spanish were applied, respectively.

RESULTS

Two comparisons were made, student versus instructor and rater versus instructor. Cronbach α was 0.97 for each version. The averages of the results on the DASH instrument were: 6.61 (3.34-7.0), 5.95 (4.65-7.0), and 4.84 (2.68-6.02) for student, rater, and instructor versions, respectively. The size effect between student and debriefer perspectives was 0.42. In contrast, the size effect between instructor and rater was 0.72. All differences were significant.

CONCLUSIONS

There are different rates between the persons who use the DASH. In this study, from the perspective of the instructor and rater, the difference was 1 point with a wide range, in contrast with the difference between instructor and student, which is relatively minor. It is necessary to consider the perspectives of experts in the subject to achieve a virtual debriefing of high quality and improve a debriefing by using the DASH.

Virtual Healthcare Simulation: Implementation, Distractions, and Preferences

INTRODUCTION

Social distancing guidelines related to COVID-19 resulted in many simulation centers temporarily closing or adopting virtual simulation-based education (SBE). This mixed methods study aimed to evaluate our center's readiness to implement virtual SBE, the preferred method of delivery (virtual vs. nonvirtual), and any reported distractions.

METHODS

Educators and simulation operations specialists (SOSs) used by our simulation center completed a survey focused on our center's implementation readiness for virtual SBE at 3 time points over a 3-week period. Three virtual simulation-based styles were developed: observer, vignette, and hybrid. All styles combined the use of Zoom and LearningSpace. Upon the completion of each session, learners, facilitators, and SOSs completed a survey focused on the preferred method of simulation delivery (virtual vs. nonvirtual) as well as any reported distractions during sessions.

RESULTS

While some important lessons were learned, simulation team survey scores suggested an overall agreement in the center's preparedness during the 3-week implementation period. Most learners, facilitators, and SOSs preferred a nonvirtual delivery due to the "hands-on" component. Learners participating in the vignette style, however, significantly preferred virtual SBE due to "learning environment comfort" such as reduced anxiety, "better discussion," and "convenience." Reported distractions focused on "challenges with technology," "interruptions at home," "program logistics," and the "remote atmosphere."

CONCLUSIONS

Most learners, facilitators, and SOSs preferred nonvirtual SBE; however, virtual SBE may prove beneficial for learners participating in the vignette style or particularly those experiencing anxiety. Future distractions may be mitigated for the simulation team and learners with proper preparedness.

Engaging perioperative students in online learning: Human factors

The aim of this article is to reflect on how a specific approach to teaching and learning - role-play and in particular the 'radio play' format - can overcome some of the alienation and barriers to student engagement that the necessity for online teaching can engender. The example used is a post-registration module in perioperative nursing delivered in a London University. Authors reflect on experiences of developing and implementing an activity designed to increase student engagement in an online session focussing on human factors in the perioperative setting. The aim of the session was to highlight the factors that potentially lead to clinical error in a way that engaged students and enabled them to relate learning to their own experiences. The challenge was how best to do this in an online setting. This article describes the use of an approach devised by AdvanceHE. Two student participants contribute their reflections to this article and focus on the extent to which the session facilitated a new understanding of the impact of human factors in a perioperative setting. These reflections suggest that the approach to the teaching employed was useful to participants and that it has promise as an online approach. The authors recommend evaluation of this approach.

Community of Inquiry framework to evaluate an online obstetric and neonatal emergency simulation workshop for health professional students in India

BACKGROUND

We transitioned our obstetric neonatal emergency simulation (ONE-Sim) workshops to an online format during the COVID-19 pandemic. In this study, we evaluated key learning acquired by undergraduate medical and nursing students attending the online ONE-Sim workshops from a low- and middle-income country (LMIC).

METHODS

Student perception of online workshops was collected using electronic questionnaires. Data was analysed using thematic analysis by employing the Community of Inquiry (CoI) framework.

RESULTS

One hundred sixty medical and nursing students who attended the online ONE-Sim workshops completed the questionnaires. There was evidence in the data to support all three aspects of the CoI framework-social, cognitive and teacher presence.

CONCLUSIONS

The use of the CoI framework helped to describe key learning from online interprofessional simulation workshops conducted for a LMIC.

Psychological safety of remotely facilitated simulation compared with in-person-facilitated simulation: an <i>in situ</i> experimental controlled trial

The COVID-19 pandemic motivated simulation educators to attempt various forms of distance simulation in order to maintain physical distancing and to rapidly deliver training and ensure systems preparedness. However, the perceived psychological safety in distance simulation remains largely unknown. A psychologically unsafe environment can negatively impact team dynamics and learning outcomes; therefore, it merits careful consideration with the adoption of any new learning modality.

Between October 2020 and April 2021, 11 rural and remote hospitals in Alberta, Canada, were enrolled by convenience sampling in in-person-facilitated simulation (IPFS) (n = 82 participants) or remotely facilitated simulation (RFS) (n = 66 participants). Each interprofessional team was invited to attend two COVID-19-protected intubation simulation sessions. An

There was no statistically significant difference between RFS and IPFS total scores on the

Psychological safety can be established and maintained with RFS. Furthermore, in this study, RFS was shown to be comparable to IPFS in improving psychological safety among rural and remote interdisciplinary teams, providing simulation educators another modality for reaching any site or team.

A practical guide for translating in-person simulation curriculum to telesimulation

This article provides a road map, along with recommendations, for the adoption and implementation of telesimulation at a large scale. We provide tools for translating an in-presence simulation curriculum into a telesimulation curriculum using a combination off-the-shelf telecommunication platform. We also describe the roles and tasks that emerged within the simulation team when planning and delivering a telesimulation curriculum.

The community of inquiry framework for virtual team-to-team debriefings during interprofessional trauma simulations

Purpose

Psychological safety is key to effective debriefing and learning. The COVID-19 pandemic necessitated rapid adaption of simulation events to virtual/hybrid platforms. We sought to determine the effect of utilizing the Community of Inquiry framework (CoI) for debriefing virtually connecting interprofessional learner teams on the psychological safety experienced during trauma simulations.

Methods

General surgery (GSR), emergency medicine (EMR) residents, trauma nurses/nurse practitioners and medical students participated in multiple simulation events designed to improve teamwork and leadership skills. Pre-course materials were provided before the event for learners to prepare. Briefings delineating expectations emphasized importance of and strategies employed to achieve psychological safety. Four unique clinical scenarios were run for each simulation event, with a debrief after each scenario. Virtual team-to-team debriefings were structured using the Community of Inquiry (CoI) conceptual framework. All learners completed pre-/post-assessments utilizing Inter-professional Collaborative Competencies Attainment Survey (ICCAS).

Results

Twenty-five learners participated (13 GSR, 5 EMR, 3 medical students, 2 trauma APRNs and 2 trauma RNs). Learner assessment found 88% (22) "agreed"/"strongly agreed" that virtual team-to-team debriefing had social, cognitive and educator presence per the CoI domains. However, one GSR and two nurse learners "strongly disagreed" with these statements. Most learners felt the debriefing was effective and safe. All participants "strongly agreed"/"agreed" the simulation achieved ICCAS competencies.

Conclusions

Debriefings utilizing a virtual platform are challenging with multiple barriers to ensuring psychological safety and efficacy. By structuring debriefings using the CoI framework we demonstrate they can be effective for most learners. However, educators should recognize the implications of social identity theory, particularly the effects of hierarchy, on comfort level of learners. Developing strategies to optimize virtual simulation learning environments is essential as this valuable pedagogy persists during and beyond the COVID-19 pandemic.

Immediate faculty feedback using debriefing timing data and conversational diagrams

BACKGROUND

Debriefing is an essential skill for simulation educators and feedback for debriefers is recognised as important in progression to mastery. Existing assessment tools, such as the Debriefing Assessment for Simulation in Healthcare (DASH), may assist in rating performance but their utility is limited by subjectivity and complexity. Use of quantitative data measurements for feedback has been shown to improve performance of clinicians but has not been studied as a focus for debriefer feedback.

METHODS

A multi-centre sample of interdisciplinary debriefings was observed. Total debriefing time, length of individual contributions and demographics were recorded. DASH scores from simulation participants, debriefers and supervising faculty were collected after each event. Conversational diagrams were drawn in real-time by supervising faculty using an approach described by Dieckmann. For each debriefing, the data points listed above were compiled on a single page and then used as a focus for feedback to the debriefer.

RESULTS

Twelve debriefings were included (µ = 6.5 simulation participants per event). Debriefers receiving feedback from supervising faculty were physicians or nurses with a range of experience (n = 7). In 9/12 cases the ratio of debriefer to simulation participant contribution length was ≧ 1:1. The diagrams for these debriefings typically resembled a fan-shape. Debriefings (n = 3) with a ratio < 1:1 received higher DASH ratings compared with the ≧ 1:1 group (p = 0.038). These debriefings generated star-shaped diagrams. Debriefer self-rated DASH scores (µ = 5.08/7.0) were lower than simulation participant scores (µ = 6.50/7.0). The differences reached statistical significance for all 6 DASH elements. Debriefers evaluated the 'usefulness' of feedback and rated it 'highly' (µ= 4.6/5).

CONCLUSION

Basic quantitative data measures collected during debriefings may represent a useful focus for immediate debriefer feedback in a healthcare simulation setting.

Virtual conference design: features and obstacles

The Covid-19 pandemic has forced a change in the way people work, and the location that they work from. The impact has caused significant disruption to education, the work environment and how social interactions take place. Online user habits have also changed due to lockdown restrictions and virtual conferencing software has become a vital cog in team communication. In result, a spate in software solutions have emerged in order to support the challenges of remote learning and working. The conferencing software landscape is now a core communication solution for company-wide interaction, team discussions, screen sharing and face-to-face contact. Yet the number of existing platforms is diverse. In this article, a systematic literature review investigation on virtual conferencing is presented. As output from the analysis, 67 key features and 74 obstacles users experience when interacting with virtual conferencing technologies are identified from 60 related open-source journal articles from 5 digital library repositories.

SimUniversity at a distance: a descriptive account of a team-based remote simulation competition for health professions students

Background

SimUniversity competition is an innovative Society in Europe for Simulation Applied to Medicine (SESAM) initiative which has existed since 2014, with the aim of creating opportunities for undergraduate healthcare students to take part in a formative educational experience on an international platform. The main educational focus is on promoting non-technical skills such as leadership, situation awareness, decision making, communication, and assertiveness, but also clinical reasoning within a team. In preparation for the 2021 virtual conference, the team designed a new methodology to meet the same mission, and yet be offered remotely.

Main text

In this article, we describe the way in which we transformed the SimUniversity competition activity from face to face to a remote simulation. We relied on Zoom as the main communication technology to enable the distance component and followed the key elements of pre-briefing, simulation, and debriefing with the students being onsite together in one location and the faculty and simulator technologists in distant locations. Thirty-eight medical and nursing students formed 8 teams from 7 different countries. Two participating teams were based in Germany and one in Italy, Belgium, the Netherlands, Romania, Portugal, and Syria. Each team consisted of between 4 and 5 members and was self-selected to consist of either medical students alone or medical and nursing students together. The SimUniversity faculty team was composed of 5 physician educators, one nurse educator, one paramedic simulation technologist, and one industry simulation technologist. The faculty members facilitated each simulation synchronously in Zoom, while being based in different geographical locations within Europe (Germany, Switzerland, and the Netherlands) and the Middle East (Qatar and Lebanon).

Conclusion

We conclude that assuming there is access to adequate internet connectivity and minimal technical setup, conducting a remote simulation with virtual debriefing is achievable in supporting team-based learning, particularly when learners and/or faculty members are in distant locations. While the authors do not recommend this method to be superior to a face-to-face experience, we propose this model to be an alternative method to consider when educators are faced with imposed restrictions such as what we faced during the COVID-19 pandemic. We discuss lessons learned and highlight other potential benefits that this method may provide, to consider even when the restrictions are lifted.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41077-021-00199-5.

Low-Cost "Telesimulation" Training Improves Real Patient Pediatric Shock Outcomes in India

INTRODUCTION

Pediatric shock, especially septic shock, is a significant healthcare burden in low-income countries. Early recognition and management of shock in children improves patient outcome. Simulation-based education (SBE) for shock recognition and prompt management prepares interdisciplinary pediatric emergency teams in crisis management. COVID-19 pandemic restrictions on in-person simulation led us to the development of telesimulation for shock. We hypothesized that telesimulation training would improve pediatric shock recognition, process of care, and patient outcomes in both simulated and real patient settings.

MATERIALS AND METHODS

We conducted a prospective quasi-experimental interrupted time series cohort study over 9 months. We conducted 40 telesimulation sessions for 76 participants in teams of 3 or 4, utilizing the video telecommunication platform (Zoom©). Trained observers recorded time-critical interventions on real patients for the pediatric emergency teams composed of residents, fellows, and nurses. Data were collected on 332 pediatric patients in shock (72% of whom were in septic shock) before, during, and after the intervention. The data included the first hour time-critical intervention checklist, patient hemodynamic status at the end of the first hour, time for the resolution of shock, and team leadership skills in the emergency room.

RESULTS

There was a significant improvement in the percent completion of tasks by the pediatric emergency team in simulated scenarios (69% in scenario 1 vs. 93% in scenario 2; p < 0.001). In real patients, completion of tasks as per time-critical steps reached 100% during and after intervention compared to the pre-intervention phase (87.5%), p < 0.05. There was a significant improvement in the first hour hemodynamic parameters of shock patients: pre (71%), during (79%), and post (87%) intervention (p < 0.007 pre vs. post). Shock reversal time reduced from 24 h pre-intervention to 6 h intervention and to 4.5 h post intervention (p < 0.002). There was also a significant improvement in leadership performance assessed by modified Concise Assessment of Leader Management (CALM) instrument during the simulated (p < 0.001) and real patient care in post intervention (p < 0.05).

CONCLUSION

Telesimulation training is feasible and improved the process of care, time-critical interventions, leadership in both simulated and real patients and resolution of shock in real patients. To the best of our knowledge, this is one of the first studies where telesimulation has shown improvement in real patient outcomes.

109 Perceptions of Virtual Simulations by Inter-Professional Simulation Facilitators

The COVID-19 pandemic has necessitated pedagogical change with many events virtual or hybrid in nature. Simulation events are particularly affected due to their hands-on quality. In addition, requirement for virtual facilitators may be increased compared with in-person counterparts. Virtual simulation education must be as high quality as in-person efforts and facilitator training is key. Some principles of virtual facilitation differ from in-person, for example, in relation to debriefing

The aim of the study was to deliver virtual facilitator education addressing the format, objectives, expectations and strategies for virtual IP simulations.

The traditional in-person Facilitator Training and Inter-professional Education (IPE) Event Training Design course our university-affiliated program delivers was adapted based on a local needs assessment to the virtual Facilitating Virtual Simulations Crash Course. This was delivered as required as small-group Zoom-based teaching, outlining educational theory, practice and principles of virtual simulation facilitation.

Sixteen virtual inter-professional simulations have been delivered for students in 19 professions within our Office of IPE since September 2020 with 33 inter-professional facilitators from 4 institutions. To determine the efficacy of our novel virtual facilitation, training facilitators were surveyed. The majority had facilitated one to five simulations (in-person 58%, virtual 70%). In addition to the Office of IPE training, 30% of facilitators had received external education on in-person simulation facilitation compared with 6% for virtual facilitation. The majority of facilitators strongly agreed/agreed that they were as effective a facilitator in virtual simulations (80%), as confident facilitating virtually (70%), as psychologically safe in virtual debriefings (75%), and that virtual simulations will continue in their practice after the pandemic (100%). Most (95%) facilitators strongly agreed/agreed that students were as engaged with virtual simulations as with in-person and 80% felt virtual simulations were a good learning experience for students. The majority (88%) of facilitators strongly agreed/agreed that the virtual crash course provided the knowledge and practice to help them effectively facilitate virtually, and 75% strongly agreed/agreed that the crash course made them appreciate and foster IP relationships in their daily work. These results are comparable to evaluation of in-person training delivered before the pandemic.

Virtual simulation events require specific facilitation strategies, and virtual education is useful to improve the knowledge and confidence of facilitators. Facilitators value the virtual simulation experience for themselves and their students, and they believe that this will be an important pedagogy post-pandemic.

53 Remote and Back Again: An Educator’s Tale of Simulation

Between November 2020 and May 2021, 61 simulation sessions were run either face-to-face or remotely for foundation-level doctors and pre-registration pharmacists. A total of 346 participants attended. Thirty-three sessions were face-to-face (185 participants) and 28 were remotely via Microsoft Teams (161 participants). The content was the same for both modalities.

The aim of the study was to discern whether there was a difference in learning points and confidence scores between face-to-face and remote participants.

Participants were asked to rate their confidence (see Table 1) before and after the course. They were asked to provide their main learning points and what they gained from the course. Confidence scores were compared and assessed for change. Responses were compared between face-to-face and remote.

Confidence score change on Likert scale 1–5.

All participants reported increased confidence. Table 1 shows that the changes were comparable, with the changes in the remote participants all being marginally higher than in face-to-face. The distribution of learning points for remote and face-to-face participants was identical. For both modalities, the top two points were communication and escalation. The dominant theme in remote was escalation and communication in face-to-face. Remote participants were positive about the course, in their free-text responses, ‘most innovative use of technology I have seen during COVID’ and ‘My hands are sweating, I can’t believe how real that felt’ a common theme in the comments was that they would rather do the course face-to-face.

While not preferred, remote simulation appears to deliver equivalent learning and is a suitable alternative when face-to-face is impossible. The main difference seen was in communication skills, which is concurrent with Cheng et al.

Comparison of In-Person and Telesimulation for Critical Care Training during the COVID-19 Pandemic

Background

The coronavirus disease (COVID-19) pandemic has disrupted medical education for trainees of all levels. Although telesimulation was initially used to train in resource-limited environments, it may be a reasonable alternative for replicating authentic patient experiences for medical students during the COVID-19 pandemic. It is unclear whether a more passive approach through telesimulation training is as effective as traditional in-person simulation training.

Objective

Our aim was to evaluate the effectiveness of in-person versus remote simulation training on learners’ comfort with managing critical care scenarios.

Methods

This was a prospective observational cohort study assessing the impact of an in-person versus remote simulation course on volunteer fourth-year medical students from February to April 2021 at the University of California San Diego School of Medicine. Precourse and postcourse surveys were performed anonymously using an online secure resource.

Results

In the in-person learners, there was statistically significant improvement in learner comfort across all technical, behavioral, and cognitive domains. In remote learners, there was a trend toward improvement in self-reported comfort across technical and cognitive domains in the telesimulation course. However, the only statistically significant improvement in postcourse surveys of telesimulation learners, compared with baseline, was in running codes. Regardless of the training modality, the students had a positive experience with the critical care simulation course, ranking it, on average, 9.6 out of 10 (9.9 in in-person simulation vs. 9.3 in telesimulation; P = 0.06).

Conclusion

We demonstrated that implementation of a telesimulation-based simulation course focusing on critical care cases is feasible and well received by trainees. Although a telesimulation-based simulation course may not be as effective for remote learners as active in-person participants, our study provided evidence that there was still a trend toward improving provider readiness across technical and cognitive domains when approaching critical care cases.

Perspectives of engagement in distance debriefings

Background

The COVID-19 pandemic propelled remote simulation and online distance debriefings. Like in-person debriefings, educators seek to facilitate reflective learning conversations, yet, in the online setting, educators face challenges to learner engagement that differ considerably from in-person debriefing.

Methods

We performed a thematic analysis of fourteen semi-structured interviews conducted with fourteen participants who had experience with virtual debriefing as an educator or as a learner. We explored the experiences and perceptions of both educators and learners to provide a more in-depth understanding of the factors that influence engagement in online distance debriefing.

Results

Our study identified the challenges online distance debriefing poses for educators and learners. We found ten themes that support the Community of Inquiry (CoI) theoretical framework and provided additional considerations related to internal and external factors of engagement, including the influence of the simulation, false engagement, and self-presence.

Conclusions

We believe these findings can inform the design and facilitation of online debriefings to help provide educators with guidance and innovative solutions to best engage their learners in the challenging online environment.

Clinical debriefing during the COVID-19 pandemic: hurdles and opportunities for healthcare teams

The COVID-19 pandemic and the subsequent pressures on healthcare staff and resources have exacerbated the need for clinical teams to reflect and learn from workplace experiences. Surges in critically ill patients, the impact of the disease on the workforce and long term adjustments in work and life have upturned our normality. Whilst this situation has generated a new 'connectedness' within healthcare workers, it also continues to test our resilience.An international multi-professional collaboration has guided the identification of ongoing difficulties to effective communication and debriefing, as well as emerging opportunities to promote a culture of dialogue. This article outlines pandemic related barriers and new possibilities categorising them according to task management, teamwork, situational awareness and decision making. It describes their direct and indirect impact on clinical debriefing and signposts towards solutions to overcome challenges and, building on new bridges, advance team conversations that allow us to learn, improve and support each other.This pandemic has brought clinical professionals together; nevertheless, it is essential to invest in further developing and supporting cohesive teams. Debriefing enables healthcare teams and educators to mitigate stress, build resilience and promote a culture of continuous learning and patient care improvement.

The impact of the COVID-19 pandemic on family medicine residency training

BACKGROUND

Family physicians have played a unique clinical role during the COVID-19 pandemic. We hypothesized that the pandemic would be associated with significant deleterious effects on clinical activity, educational training, personal safety and well-being.

OBJECTIVE

We conducted a national survey to obtain preliminary data that would assist in future targeted data collection and subsequent evaluation of the impact of the pandemic on family medicine residents and teaching faculty.

METHODS

An anonymous online survey of residents and faculty was distributed via the Association of Family Medicine Residency Directors list serve between 5/21/2020 and 6/18/2020. Survey questions focused on clinical and educational activities, safety and well-being.

RESULTS

One hundred and fifty-three residents and 151 teaching faculty participated in the survey. Decreased clinical activity was noted by 81.5% of residents and 80.9% of faculty and the majority began conducting telehealth visits (97.9% of residents, 91.0% of faculty). Distance learning platforms were used by all residents (100%) and 39.6% noted an overall positive impact on their education. Higher levels of burnout did not significantly correlate with reassignment of clinical duties (residents P = 0.164; faculty P = 0.064). Residents who showed significantly higher burnout scores (P = 0.035) and a decline in levels of well-being (P = 0.031) were more likely to participate in institutional well-being support activities.

CONCLUSIONS

Our preliminary data indicate that family medicine residents and teaching faculty were profoundly affected by the COVID-19 pandemic. Future studies can be directed by current findings with focus on mitigation factors in addressing globally disruptive events such as COVID-19.

VIRTUAL SIMULATION FOR LAST-YEAR NURSING GRADUATE STUDENTS IN TIMES OF COVID-19: A QUASI-EXPERIMENTAL STUDY

Background

The COVID-19 pandemic has made it necessary to adapt university health-education. Virtual simulation has been proposed to be a suitable tool.

Methods

A quasi-experimental study was conducted on nursing students in the final year. The virtual simulation platform vSim® was used. Improvements in knowledge, skills during simulation, satisfaction and selfconfidence obtained through the training provided were analyzed, as well as satisfaction with the platform.

Results

Prepost training knowledge improved. Skill acquisition improved between the first and last attempts in all cases. The levels of selfconfidence and satisfaction with the training and the platform used were high.

Conclusions

The vSim® was a useful solution during the pandemic. Knowledge improved and high selfconfidence was obtained.

How to Use TeleSimBox "Off the Shelf" to Connect Remote Content Experts With In-Person Simulation Participants

In this technical report, we describe how to use TeleSimBox to run a remotely facilitated simulation to connect the facilitator with learners at a distant site. This method was developed to comply with safety measures imposed during the coronavirus disease-19 (COVID-19) pandemic to reduce the risk of viral exposure and transmission. Here, we present one example where a telesimulation naïve facilitator was trained as an in-person facilitator to enable the in-situ medical student and resident learners to participate in a pediatric emergency simulation exercise remotely guided by an off-site content expert. The case of neonatal shock was run five times during a half-day emergency department (ED) educational program with one to four participants per session. 14/15 (93%) participants completed evaluations and felt that the simulation met the case learning objectives and that connecting with the remote facilitator was useful for their learning. Feedback from the one newly trained in-person facilitator was that the tool was easy to learn how to use quickly, and the process of connecting with a remote expert was worthwhile for learners. To grab this web-based toolkit off the proverbial shelf and successfully run a telesimulation session from start to finish took approximately one hour; 20 minutes were spent in preparation the day prior and 40 minutes to set up and run the simulations the day of. We believe that this is a low-cost, efficient, and perceived to be an effective method to connect remotely located content experts and learners to engage in a simulation-based education activity when access to in-person resources and personnel is limited.

TeleSimBox: A perceived effective alternative for experiential learning for medical student education with social distancing requirements

INTRODUCTION

During the COVID-19 pandemic the Association of American Medical Colleges recommended that medical students not be involved with in-person patient care or teaching, necessitating alternative learning opportunities. Subsequently we developed the telesimulation education platform: TeleSimBox. We hypothesized that this remote simulation platform would be feasible and acceptable for faculty use and a perceived effective method for medical student education.

METHODS

Twenty-one telesimulations were conducted with students and educators at four U.S. medical schools. Sessions were run by cofacilitator dyads with four to 10 clerkship-level students per session. Facilitators were provided training materials. User-perceived effectiveness and acceptability were evaluated via descriptive analysis of survey responses to the Modified Simulation Effectiveness Tool (SET-M), Net Promoter Score (NPS), and Likert-scale questions.

RESULTS

Approximately one-quarter of students and all facilitators completed surveys. Users perceived that the sessions were effective in teaching medical knowledge and teamwork, though less effective for family communication and skills. Users perceived that the telesimulations were comparable to other distance learning and to in-person simulation. The tool was overall positively promoted.

CONCLUSION

Users overall positively scored our medical student telesimulation tool on the SET-M objectives and promoted the experience to colleagues on the NPS. The next steps are to further optimize the tool.

"A debriefer must be neutral" and other debriefing myths: a systemic inquiry-based qualitative study of taken-for-granted beliefs about clinical post-event debriefing

BACKGROUND

The goal of this study was to identify taken-for-granted beliefs and assumptions about use, costs, and facilitation of post-event debriefing. These myths prevent the ubiquitous uptake of post-event debriefing in clinical units, and therefore the identification of process, teamwork, and latent safety threats that lead to medical error. By naming these false barriers and assumptions, the authors believe that clinical event debriefing can be implemented more broadly.

METHODS

We interviewed an international sample of 37 clinicians, educators, scholars, researchers, and healthcare administrators from hospitals, universities, and healthcare organizations in Western Europe and the USA, who had a broad range of debriefing experience. We adopted a systemic-constructivist approach that aimed at exploring in-depth assumptions about debriefing beyond obvious constraints such as time and logistics and focused on interpersonal relationships within organizations. Using circular questions, we intended to uncover new and tacit knowledge about barriers and facilitators of regular clinical debriefings. All interviews were transcribed and analyzed following a comprehensive process of inductive open coding.

RESULTS

In total, 1508.62 min of interviews (25 h, 9 min, and 2 s) were analyzed, and 1591 answers were categorized. Many implicit debriefing theories reflected current scientific evidence, particularly with respect to debriefing value and topics, the complexity and difficulty of facilitation, the importance of structuring the debriefing and engaging in reflective practice to advance debriefing skills. We also identified four debriefing myths which may prevent post-event debriefing from being implemented in clinical units.

CONCLUSION

The debriefing myths include (1) debriefing only when disaster strikes, (2) debriefing is a luxury, (3) senior clinicians should determine debriefing content, and (4) debriefers must be neutral and nonjudgmental. These myths offer valuable insights into why current debriefing practices are ad hoc and not embedded into daily unit practices. They may help ignite a renewed momentum into the implementation of post-event debriefing in clinical settings.

Translational simulation: from description to action

This article describes an operational framework for implementing translational simulation in everyday practice. The framework, based on an input-process-output model, is developed from a critical review of the existing translational simulation literature and the collective experience of the authors' affiliated translational simulation services. The article describes how translational simulation may be used to explore work environments and/or people in them, improve quality through targeted interventions focused on clinical performance/patient outcomes, and be used to design and test planned infrastructure or interventions. Representative case vignettes are used to show how the framework can be applied to real world healthcare problems, including clinical space testing, process development, and culture. Finally, future directions for translational simulation are discussed. As such, the article provides a road map for practitioners who seek to address health service outcomes using translational simulation.

[Debriefing in pediatric emergency care]

Kommunikationsfehler und systembedingte Probleme wirken sich negativ auf Teamarbeit und gemeinsame Entscheidungsfindung aus und können den Patienten Schaden zufügen. Regelmäßige Nachbesprechungen nach kritischen Ereignissen wiederum wirken sich positiv auf die Teamzusammenarbeit und das Patientenoutcome in der Kindernotfallversorgung aus. Das gemeinsame Reflektieren fördert das Lernen, hilft den Teams, sich zu verbessern, und verhindert, dass sich Fehler in Zukunft wiederholen. Dennoch werden Debriefings im präklinischen und klinischen Alltag noch immer qualitativ unzureichend durchgeführt. Gründe dafür sind mangelnde Zeit, Fehlen von erfahrenen Debriefern und fehlende Unterstützung durch Verantwortungsträger. Debriefings können je nach Bedarf zu verschiedenen Zeitpunkten mit unterschiedlicher Dauer stattfinden. Nachbesprechungen können auch rein virtuell oder als sogenannte Hybridveranstaltung durchgeführt werden. Nachbesprechungen sollten sich auf gemeinsames Lernen und das Erarbeiten zukunftsorientierter Verbesserungen konzentrieren. Nicht nur lebensbedrohliche Ereignisse können Nachbesprechungen auslösen, sondern auch potenziell kritische Situationen, wie routinemäßige Intubationen. Debriefing-Skripte fördern eine Strukturierung und ermöglichen selbst unerfahrenen Moderatoren, alle Aspekte zu bearbeiten. Neben der Diskussion schwieriger Abläufe sollten unbedingt positive Leistungen besprochen werden, um diese zu verstärken und das Lernen am Erfolg zu ermöglichen. Dabei sollten die Beweggründe eines Verhaltens erfragt und nicht nur die nach außen sichtbaren Leistungen bewertet werden. Diese Strategie fördert bedarfsgerechtes Lernen und konzentriert sich auf Lösungen. Hilfreich sind dabei spezielle Fragetechniken, echtes Interesse und eine positive Sicherheitskultur.