Examining pediatric resuscitation education using simulation and scripted debriefing: a multicenter randomized trial

The effect of scripted debriefing in resuscitation training: A scoping review

Objectives

To evaluate the effectiveness of scripted debriefing relative to no use of script during debriefing in resuscitation training.

Methods

This scoping review was undertaken as part of the continuous evidence evaluation process of the International Liaison Committee on Resuscitation (ILCOR) and based on the Preferred Reporting Items for Systematic review and Meta-Analysis (PRISMA) extension for scoping review. MEDLINE, EMBASE, and SCOPUS were searched from inception to January 2024. We included all published studies comparing scripted debriefing vs non-scripted debriefing evaluating patient outcomes, behaviour change of learners, learning outcomes for learners and cognitive load and teaching quality for instructors.

Results

Our initial literature search identified 1238 citations. After removing 552 duplicates, reviewing the titles and abstracts of the remaining 686 articles yielded 11 for full-text review. Of these, six articles were selected for inclusion in the final analysis. The six studies described debriefing scripts varying in content, framework, scripted language and the integration of objective data. Scripted debriefing improved CPR performance, team leadership skills and knowledge acquisition, but showed no difference in teamwork performance compared to non-scripted debriefing. Scripted debriefing also improved debriefing quality and decreased cognitive load of the instructor during resuscitation training.

Conclusion

The use of a debriefing script during resuscitation education can improve CPR performance, team leader performance, knowledge acquisition and reduce the debriefer's cognitive load. Future research should explore how debriefing scripts can be designed to optimize learning outcomes.

A Comparison of 2 Debriefing Rubrics to Assess Facilitator Adherence to the PEARLS Debriefing Framework

INTRODUCTION

Many educators have adopted the Promoting Excellence and Reflective Learning in Simulation (PEARLS) model to guide debriefing sessions in simulation-based learning. The PEARLS Debriefing Checklist (PDC), a 28-item instrument, and the PEARLS Debriefing Adherence Rubric (PDAR), a 13-item instrument, assess facilitator adherence to the model. The aims of this study were to collect evidence of concurrent validity and to evaluate their unique strengths.

METHODS

A review of 130 video recorded debriefings from a synchronous high-fidelity mannequin simulation event involving third-year medical students was undertaken. Each debriefing was scored utilizing both instruments. Internal consistency was determined by calculating a Cronbach's α. A Pearson correlation was used to evaluate concurrent validity. Discrimination indices were also calculated.

RESULTS

Cronbach's α values were 0.515 and 0.714 for the PDAR and PDC, respectively, with ≥0.70 to ≤0.90 considered to be an acceptable range. The Pearson correlation coefficient for the total sum of the scores of both instruments was 0.648, with a values between ±0.60 and ±0.80 considered strong correlations. All items on the PDAR had positive discrimination indices; 3 items on the PDC had indices ≤0, with values between -0.2 and 0.2 considered unsatisfactory. Four items on both instruments had indices >0.4, indicating only fair discrimination between high and low performers.

CONCLUSIONS

Both instruments exhibit unique strengths and limitations. The PDC demonstrated greater internal consistency, likely secondary to having more items, with the tradeoff of redundant items and laborious implementation. Both had concurrent validity in nearly all subdomains. The PDAR had proportionally more items with high discrimination and no items with indices ≤0. A revised instrument incorporating PDC items with high reliability and validity and removing those identified as redundant or poor discriminators, the PDAR 2, is proposed.

Breaking Bad News in Breast Imaging: Keys to Success

The radiologist's ability to effectively communicate with patients is crucial in breast imaging. Having to tell a patient that she or he requires a biopsy procedure or has a new diagnosis of breast cancer is both a challenging task and a daily reality for many practicing breast radiologists. Despite this, communication in breast imaging is often not formally taught in most training programs, leading many breast radiologists to obtain their skills through on-the-job experience. We discuss the importance of effective communication with patients and a breast imaging-specific method for delivering bad news, adapted from approaches used in medical oncology. A conversation "script" or guide is provided along with the rationale for how to best handle these difficult conversations. Lastly, we review how to teach effective communication to those in training using our breast imaging fellowship program and recent survey results as an example.

Effects of Simulation Fidelity on Health Care Providers on Team Training-A Systematic Review

ABSTRACT

This systematic review, following PRISMA standards, aimed to assess the effectiveness of higher versus lower fidelity simulation on health care providers engaged in team training. A comprehensive search from January 1, 2011 to January 24, 2023 identified 1390 studies of which 14 randomized (n = 1530) and 5 case controlled (n = 257) studies met the inclusion criteria. The certainty of evidence was very low due to a high risk of bias and inconsistency. Heterogeneity prevented any metaanalysis. Limited evidence showed benefit for confidence, technical skills, and nontechnical skills. No significant difference was found in knowledge outcomes and teamwork abilities between lower and higher fidelity simulation. Participants reported higher satisfaction but also higher stress with higher fidelity materials. Both higher and lower fidelity simulation can be beneficial for team training, with higher fidelity simulation preferred by participants if resources allow. Standardizing definitions and outcomes, as well as conducting robust cost-comparative analyses, are important for future research.

Society for Simulation in Healthcare Guidelines for Simulation Training

BACKGROUND

Simulation has become a staple in the training of healthcare professionals with accumulating evidence on its effectiveness. However, guidelines for optimal methods of simulation training do not currently exist.

METHODS

Systematic reviews of the literature on 16 identified key questions were conducted and expert panel consensus recommendations determined using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) methodology.

OBJECTIVE

These evidence-based guidelines from the Society for Simulation in Healthcare intend to support healthcare professionals in decisions on the most effective methods for simulation training in healthcare.

RESULTS

Twenty recommendations on 16 questions were determined using GRADE. Four expert recommendations were also provided.

CONCLUSIONS

The first evidence-based guidelines for simulation training are provided to guide instructors and learners on the most effective use of simulation in healthcare.

Efficacy of high-fidelity simulation in advanced life support training: a systematic review and meta-analysis of randomized controlled trials

BACKGROUND

Simulation is an increasingly used novel method for the education of medical professionals. This study aimed to systematically review the efficacy of high-fidelity (HF) simulation compared with low-fidelity (LF) simulation or no simulation in advanced life support (ALS) training.

METHODS

A comprehensive search of the PubMed, Chinese Biomedicine Database, Embase, CENTRAL, ISI, and China Knowledge Resource Integrated Database was performed to identify randomized controlled trials (RCTs) that evaluated the use of HF simulation in ALS training. Quality assessment was based on the Cochrane Handbook for Systematic Reviews of Interventions version 5.0.1. The primary outcome was the improvement of knowledge and skill performance. The secondary outcomes included the participants' confidence and satisfaction at the course conclusion, skill performance at one year, skill performance in actual resuscitation, and patient outcomes. Data were synthesized using the RevMan 5.4 software.

RESULTS

Altogether, 25 RCTs with a total of 1,987 trainees were included in the meta-analysis. In the intervention group, 998 participants used HF manikins, whereas 989 participants received LF simulation-based or traditional training (classical training without simulation). Pooled data from the RCTs demonstrated a benefit in improvement of knowledge [standardized mean difference (SMD) = 0.38; 95% confidence interval (CI): 0.18-0.59, P = 0.0003, I2 = 70%] and skill performance (SMD = 0.63; 95% CI: 0.21-1.04, P = 0.003, I2 = 92%) for HF simulation when compared with LF simulation and traditional training. The subgroup analysis revealed a greater benefit in knowledge with HF simulation compared with traditional training at the course conclusion (SMD = 0.51; 95% CI: 0.20-0.83, P = 0.003, I2 = 61%). Studies measuring knowledge at three months, skill performance at one year, teamwork behaviors, participants' satisfaction and confidence demonstrated no significant benefit for HF simulation.

CONCLUSIONS

Learners using HF simulation more significantly benefited from the ALS training in terms of knowledge and skill performance at the course conclusion. However, further research is necessary to enhance long-term retention of knowledge and skill in actual resuscitation and patient's outcomes.

Successful implementation of a rater training program for medical students to evaluate simulated pediatric emergencies

Introduction

Simulation-based training is increasingly used in pediatrics to teach technical skills, teamwork, and team communication, and to improve potential deficiencies in pediatric emergency care. Team performance must be observed, analyzed, and evaluated by trained raters. The structured training of medical students for the assessment of simulated pediatric emergencies has not yet been investigated.

Methods

We developed a rater training program for medical students to assess guideline adherence, teamwork, and team communication in simulated pediatric emergencies. Interrater reliability was measured at each training stage using Kendall tau coefficients.

Results

In 10 out of 15 pairs of raters interrater reliability was moderate to high (tau>0.4), whereas it was low in the remaining 5 pairs of raters.

Discussion

The interrater reliability showed good agreement between medical students and expert raters at the end of the rater training program. Medical students can be successfully involved in the assessment of guideline adherence as well as teamwork and team communication in simulated pediatric emergencies.

Who is the real team leader? Comparing leadership performance of the team leader and CPR Coach during simulated cardiac arrest

Purpose

To describe the leadership performance of team leaders and CPR Coaches, and to determine if there is a correlation between leadership scores and CPR performance during management of simulated pediatric cardiac arrest events.

Methods

This is a secondary analysis of data from a prior randomized controlled trial. We observed the performance of both team leaders and CPR coaches during the management of an 18-minute simulated cardiac arrest scenario which was run for 20 resuscitation teams comprised of CPR-certified professionals from four pediatric tertiary care centers. CPR Coaches were responsible for providing real-time verbal feedback of CPR performance to compressors. Two raters were trained to use the Behavioral Assessment Tool (BAT) to assess leadership performance of the team leader and CPR Coach. BAT scores of team leaders and CPR coaches were compared and linked with objective CPR performance.

Results

There was no significant difference between the BAT scores of team leaders and CPR coaches (median score 27/40 vs 28.8/40, p = 0.16). Higher BAT scores of team leaders were significantly associated with higher percentage of excellent CPR (r = 0.52, p = 0.02), while higher BAT scores of CPR coaches were significantly associated with higher chest compression fraction (r = 0.48, p = 0.03).

Conclusions

Both team leaders and CPR coaches have similarly high leadership performance during the management of simulated cardiac arrest. Leadership behaviors were associated with quality of CPR performance.Clinical Trial Registration: Registration ID: NCT02539238; https://www.clinicaltrials.gov.

Data-informed debriefing for cardiopulmonary arrest: A randomized controlled trial

Aim

To determine if data-informed debriefing, compared to a traditional debriefing, improves the process of care provided by healthcare teams during a simulated pediatric cardiac arrest.

Methods

We conducted a prospective, randomized trial. Participants were randomized to a traditional debriefing or a data-informed debriefing supported by a debriefing tool. Participant teams managed a 10-minute cardiac arrest simulation case, followed by a debriefing (i.e. traditional or data-informed), and then a second cardiac arrest case. The primary outcome was the percentage of overall excellent CPR. The secondary outcomes were compliance with AHA guidelines for depth and rate, chest compression (CC) fraction, peri-shock pause duration, and time to critical interventions.

Results

A total of 21 teams (84 participants) were enrolled, with data from 20 teams (80 participants) analyzed. The data-informed debriefing group was significantly better in percentage of overall excellent CPR (control vs intervention: 53.8% vs 78.7%; MD 24.9%, 95%CI: 5.4 to 44.4%, p = 0.02), guideline-compliant depth (control vs. intervention: 60.4% vs 85.8%, MD 25.4%, 95%CI: 5.5 to 45.3%, p = 0.02), CC fraction (control vs intervention: 88.6% vs 92.6, MD 4.0%, 95%CI: 0.5 to 7.4%, p = 0.03), and peri-shock pause duration (control vs intervention: 5.8 s vs 3.7 s, MD -2.1 s, 95%CI: -3.5 to -0.8 s, p = 0.004) compared to the control group. There was no significant difference in time to critical interventions between groups.

Conclusion

When compared with traditional debriefing, data-informed debriefing improves CPR quality and reduces pauses in CPR during simulated cardiac arrest, with no improvement in time to critical interventions.

Have you ACED it? How to successfully implement performance-oriented, Acute Critical Event Debriefing

Acute Critical Event Debriefing (ACED) after cardiopulmonary arrests should be the standard of care. However, little literature exists on how to implement performance-focused ACED in healthcare. Based on a series of successful ACED implementations in a variety of our settings, we describe key learnings and propose best practices to aid clinicians and organizations in establishing a successful ACED program. Within this practical guide, we also present a novel, standardized debriefing tool (Hotwash) that has been adapted for a variety of clinical settings.

Data-driven resuscitation training using pose estimation

BACKGROUND

Cardiopulmonary resuscitation (CPR) training improves CPR skills while heavily relying on feedback. The quality of feedback can vary between experts, indicating a need for data-driven feedback to support experts. The goal of this study was to investigate pose estimation, a motion detection technology, to assess individual and team CPR quality with the arm angle and chest-to-chest distance metrics.

METHODS

After mandatory basic life support training, 91 healthcare providers performed a simulated CPR scenario in teams. Their behaviour was simultaneously rated based on pose estimation and by experts. It was assessed if the arm was straight at the elbow, by calculating the mean arm angle, and how close the distance between the team members was during chest compressions, by calculating the chest-to-chest distance. Both pose estimation metrics were compared with the expert ratings.

RESULTS

The data-driven and expert-based ratings for the arm angle differed by 77.3%, and based on pose estimation, 13.2% of participants kept the arm straight. The chest-to-chest distance ratings by expert and by pose estimation differed by 20.7% and based on pose estimation 63.2% of participants were closer than 1 m to the team member performing compressions.

CONCLUSIONS

Pose estimation-based metrics assessed learners' arm angles in more detail and their chest-to-chest distance comparably to expert ratings. Pose estimation metrics can complement educators with additional objective detail and allow them to focus on other aspects of the simulated CPR training, increasing the training's success and the participants' CPR quality.

TRIAL REGISTRATION

Not applicable.

2022 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations: Summary From the Basic Life Support; Advanced Life Support; Pediatric Life Support; Neonatal Life Support; Education, Implementation, and Teams; and First Aid Task Forces

This is the sixth annual summary of the International Liaison Committee on Resuscitation International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations. This summary addresses the most recently published resuscitation evidence reviewed by International Liaison Committee on Resuscitation Task Force science experts. Topics covered by systematic reviews include cardiopulmonary resuscitation during transport; approach to resuscitation after drowning; passive ventilation; minimizing pauses during cardiopulmonary resuscitation; temperature management after cardiac arrest; use of diagnostic point-of-care ultrasound during cardiac arrest; use of vasopressin and corticosteroids during cardiac arrest; coronary angiography after cardiac arrest; public-access defibrillation devices for children; pediatric early warning systems; maintaining normal temperature immediately after birth; suctioning of amniotic fluid at birth; tactile stimulation for resuscitation immediately after birth; use of continuous positive airway pressure for respiratory distress at term birth; respiratory and heart rate monitoring in the delivery room; supraglottic airway use in neonates; prearrest prediction of in-hospital cardiac arrest mortality; basic life support training for likely rescuers of high-risk populations; effect of resuscitation team training; blended learning for life support training; training and recertification for resuscitation instructors; and recovery position for maintenance of breathing and prevention of cardiac arrest. Members from 6 task forces have assessed, discussed, and debated the quality of the evidence using Grading of Recommendations Assessment, Development, and Evaluation criteria and generated consensus treatment recommendations. Insights into the deliberations of the task forces are provided in the Justification and Evidence-to-Decision Framework Highlights sections, and priority knowledge gaps for future research are listed.

Students and simulation facilitators' experiences and perceptions of a distraction and interruption simulation: a mixed-methods study

BACKGROUND

While distractions and interruptions are leading causes of errors during medication preparation, most nursing students are not taught how to manage distractions in a highly-interruptive environment. To help prepare nursing students to manage distractions and interruptions in clinical practice, we developed, implemented, and evaluated a medication preparation distraction and interruption simulation.

OBJECTIVES

To explore student and simulation facilitators experiences and perceptions of a distraction and interruption simulation.

DESIGN

A sequential explanatory mixed-methods design was adopted including surveys, interviews, and focus groups.

SETTING

A mid-sized research intensive western Canadian university.

PARTICIPANTS

A total of 112 third year nursing students who engaged in the distraction and interruption simulation, and five simulation facilitators who facilitated the distraction and interruption simulation, participated in this study.

METHODS

Students were invited to complete a cross sectional survey following the distraction and interruption simulation and were then invited to participate in focus groups. Simulation facilitators were invited to participate in one-on-one interviews following facilitating the distraction and interruption simulation. All data were collected between June and December 2020.

RESULTS

Data from surveys, interviews, and focus groups were delineated into 4 themes related to the phases of the simulation. The prebriefing provided an overview of the simulation and helped create psychological safety that was imperative for learning about potential medication errors when being distracted and interrupted. The simulation scenario had a high degree of fidelity and helped students implement strategies to manage distractions and interruptions. The structured debrief provided an opportunity for meaningful reflection. The impact of the simulation was apparent as students articulated the balance between speed versus safety and new strategies developed to manage distractions and interruptions in clinical practice.

CONCLUSION

This study supports the use of simulation to develop key skills for managing distractions and interruptions during medication preparation in clinical practice.

Patient-facing communication for cytopathologists: A framework for disclosing diagnostic error

Medical errors are a major source of harm to patients. Regulatory bodies mandate and patient safety experts advocate the disclosure of medical errors to patients to promote transparency and to create accountability for improving health care processes. Although pathologists regularly report errors-either to pathology or clinical colleagues or via internal safety reporting systems-few pathologists directly disclose those errors to patients. Yet many pathologists are interested in participating in the direct disclosure of medical errors to patients and may even be mandated to do so. When surveyed on why they do not directly disclose errors to patients, pathologists commonly cite a lack of confidence and a lack of training. Another barrier cited is the lack of a preexisting relationship between the pathologist and the patient. With respect to this last barrier, cytopathologists have a distinct advantage over surgical or clinical pathologists, as many cytopathologists regularly interact with and develop a rapport with patients when they are performing fine-needle aspiration (FNA) procedures. To improve the safety culture in pathology, direct error disclosure practices must be developed, supported, and strengthened. It is critical for cytopathologists to be comfortable with disclosing errors to patients. Being comfortable with disclosing an error, however, requires training, practice, and advance reflection. Using a practical, case-based format centered around FNA examples, this article addresses how to disclose a medical error to a patient. It provides a framework, heuristic principles, and structured conversation systems and talking points to guide the inexperienced pathologist to find his or her voice in a challenging disclosure conversation.

2022 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations: Summary From the Basic Life Support; Advanced Life Support; Pediatric Life Support; Neonatal Life Support; Education, Implementation, and Teams; and First Aid Task Forces

This is the sixth annual summary of the International Liaison Committee on Resuscitation International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations. This summary addresses the most recently published resuscitation evidence reviewed by International Liaison Committee on Resuscitation Task Force science experts. Topics covered by systematic reviews include cardiopulmonary resuscitation during transport; approach to resuscitation after drowning; passive ventilation; minimizing pauses during cardiopulmonary resuscitation; temperature management after cardiac arrest; use of diagnostic point-of-care ultrasound during cardiac arrest; use of vasopressin and corticosteroids during cardiac arrest; coronary angiography after cardiac arrest; public-access defibrillation devices for children; pediatric early warning systems; maintaining normal temperature immediately after birth; suctioning of amniotic fluid at birth; tactile stimulation for resuscitation immediately after birth; use of continuous positive airway pressure for respiratory distress at term birth; respiratory and heart rate monitoring in the delivery room; supraglottic airway use in neonates; prearrest prediction of in-hospital cardiac arrest mortality; basic life support training for likely rescuers of high-risk populations; effect of resuscitation team training; blended learning for life support training; training and recertification for resuscitation instructors; and recovery position for maintenance of breathing and prevention of cardiac arrest. Members from 6 task forces have assessed, discussed, and debated the quality of the evidence using Grading of Recommendations Assessment, Development, and Evaluation criteria and generated consensus treatment recommendations. Insights into the deliberations of the task forces are provided in the Justification and Evidence-to-Decision Framework Highlights sections, and priority knowledge gaps for future research are listed.

Impact of the PEARLS Healthcare Debriefing cognitive aid on facilitator cognitive load, workload, and debriefing quality: a pilot study

BACKGROUND

The Promoting Excellence and Reflective Learning in Simulation (PEARLS) Healthcare Debriefing Tool is a cognitive aid designed to deploy debriefing in a structured way. The tool has the potential to increase the facilitator's ability to acquire debriefing skills, by breaking down the complexity of debriefing and thereby improving the quality of a novice facilitator's debrief. In this pilot study, we aimed to evaluate the impact of the tool on facilitators' cognitive load, workload, and debriefing quality.

METHODS

Fourteen fellows from the New York City Health + Hospitals Simulation Fellowship, novice to the PEARLS Healthcare Debriefing Tool, were randomized to two groups of 7. The intervention group was equipped with the cognitive aid while the control group did not use the tool. Both groups had undergone an 8-h debriefing course. The two groups performed debriefings of 3 videoed simulated events and rated the cognitive load and workload of their experience using the Paas-Merriënboer scale and the raw National Aeronautics and Space Administration task load index (NASA-TLX), respectively. The debriefing performances were then rated using the Debriefing Assessment for Simulation in Healthcare (DASH) for debriefing quality. Measures of cognitive load were measured as Paas-Merriënboer scale and compared using Wilcoxon rank-sum tests. Measures of workload and debriefing quality were analyzed using mixed-effect linear regression models.

RESULTS

Those who used the tool had significantly lower median scores in cognitive load in 2 out of the 3 debriefings (median score with tool vs no tool: scenario A 6 vs 6, p=0.1331; scenario B: 5 vs 6, p=0.043; and scenario C: 5 vs 7, p=0.031). No difference was detected in the tool effectiveness in decreasing composite score of workload demands (mean difference in average NASA-TLX -4.5, 95%CI -16.5 to 7.0, p=0.456) or improving composite scores of debriefing qualities (mean difference in DASH 2.4, 95%CI -3.4 to 8.1, p=0.436).

CONCLUSIONS

The PEARLS Healthcare Debriefing Tool may serve as an educational adjunct for debriefing skill acquisition. The use of a debriefing cognitive aid may decrease the cognitive load of debriefing but did not suggest an impact on the workload or quality of debriefing in novice debriefers. Further research is recommended to study the efficacy of the cognitive aid beyond this pilot; however, the design of this research may serve as a model for future exploration of the quality of debriefing.

2022 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations: Summary From the Basic Life Support; Advanced Life Support; Pediatric Life Support; Neonatal Life Support; Education, Implementation, and Teams; and First Aid Task Forces

This is the sixth annual summary of the International Liaison Committee on Resuscitation International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations. This summary addresses the most recently published resuscitation evidence reviewed by International Liaison Committee on Resuscitation Task Force science experts. Topics covered by systematic reviews include cardiopulmonary resuscitation during transport; approach to resuscitation after drowning; passive ventilation; minimising pauses during cardiopulmonary resuscitation; temperature management after cardiac arrest; use of diagnostic point-of-care ultrasound during cardiac arrest; use of vasopressin and corticosteroids during cardiac arrest; coronary angiography after cardiac arrest; public-access defibrillation devices for children; pediatric early warning systems; maintaining normal temperature immediately after birth; suctioning of amniotic fluid at birth; tactile stimulation for resuscitation immediately after birth; use of continuous positive airway pressure for respiratory distress at term birth; respiratory and heart rate monitoring in the delivery room; supraglottic airway use in neonates; prearrest prediction of in-hospital cardiac arrest mortality; basic life support training for likely rescuers of high-risk populations; effect of resuscitation team training; blended learning for life support training; training and recertification for resuscitation instructors; and recovery position for maintenance of breathing and prevention of cardiac arrest. Members from 6 task forces have assessed, discussed, and debated the quality of the evidence using Grading of Recommendations Assessment, Development, and Evaluation criteria and generated consensus treatment recommendations. Insights into the deliberations of the task forces are provided in the Justification and Evidence-to-Decision Framework Highlights sections, and priority knowledge gaps for future research are listed.

PRE-scripted debriefing for Paediatric simulation Associated with Resuscitation EDucation (PREPARED): A multicentre, cluster randomised controlled trial

Aim

Scripted debriefing tools may improve the performance of novices debriefing in resuscitation courses, but this has not previously been measured. The aim of this study was to determine the impact of a script on the quality of debriefs in a statewide paediatric resuscitation course.

Methods

This cluster-randomised controlled trial compared scripted debriefing (intervention) versus non-scripted debriefing (control) for participants in a paediatric resuscitation course. The trial was conducted across participating sites in Queensland, Australia, from November 2017 to February 2020. Debriefing quality was measured using the Observational Structured Assessment of Debriefing (OSAD) tool. The OSAD tool rates 8 domains that comprise the elements of an ideal debrief. OSAD scores between scripted and non-scripted groups were compared, overall and after stratification by debriefer experience and site size.

Results

Seventy debriefings occurred across 19 sites (intervention, n = 34, control n = 36). There was a statistically significant increase in total OSAD scores in the scripted group, compared to non-scripted (mean difference (MD) = 3.5, 95% confidence interval (CI) 0.7–6.2, p = 0.01). The categories of ‘reflection’ and ‘analysis’ had the greatest difference in OSAD scores in the scripted group (MD = 0.8, 95%CI 0.2–1.3, p = 0.005; MD = 0.6, 95%CI 0.2–1.0, p = 0.007). After stratification, overall OSAD scores improved for novices (MD = 4.1, 95%CI 0.5–7.7, p = 0.03) and large centres (MD = 5.2, 95%CI 1.1–9.2, p = 0.01).

Conclusion

Providing debriefing scripts to faculty facilitating simulated paediatric resuscitation scenarios improved the quality of debriefing, especially for novices and those at large sites. The development and provision of debriefing scripts for large-scale paediatric resuscitation courses should be considered.

Debriefing strategies for interprofessional simulation-a qualitative study

Background

Interprofessional education is becoming more common worldwide. Simulation is one format in which this can effectively take place. The debriefing after the simulation is a critical part of the simulation process as it allows reflection and discussion of concepts that arose during the simulation. Debriefing has been noted to be challenging in the literature. Debriefing after interprofessional simulation (IPS) is likely to have even more challenges, many related to the different backgrounds (profession, specialty) of the learners. This study was designed to investigate: ‘How do differing learner professions impact on delivery of post simulation debriefing after team based interprofessional simulation—what are the challenges and what strategies can be used to overcome them?’

Methods

An initial review of the literature was used to identify current understanding and potential themes requiring further exploration. Using the results from the literature as a starting point for topics and questions to be asked, semi-structured interviews were planned, with those who are experienced in debriefing after IPS. The interviews were transcribed then analysed using a framework analysis.

Results

The literature search resulted in twenty relevant papers. Four dimensions were drawn out from these papers that were directly related to debriefing after IPS: ‘the debriefer’, ‘method of debriefing’, ‘the learner’ and ‘psychological safety’. Sixteen interviews occurred between June and August 2020. Ten themes were extracted from the analysis of the transcripts of these interviews: number and specialty of debriefers, credibility, assumptions/preconceptions, nurses vs doctors, method of debriefing, the learner, hierarchy, safe learning environment, inclusion of all learners, and number of debriefers. These themes were fitted in the four dimensions identified in the literature search, and discussed as so.

Conclusion

Several challenges and strategies were identified during this study. ‘It depends’ was a common answer received in the interviews suggesting that there is very little advice that can be given that applies to every situation. The main recommendation from this study is the support for an interprofessional group of debriefers in IPS although this does introduce its own challenges. Further research is suggested around the hierarchy found in IPS debriefing and how this translates to and from clinical practice.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41077-022-00214-3.

Faculty Development Approaches for Life Support Courses: A Scoping Review

The aim of this scoping review initiated by the Education, Implementation and Teams Task Force of the International Liaison Committee on Resuscitation was to identify faculty development approaches to improve instructional competence in accredited life support courses. We searched PubMed, Ovid Embase, Cumulative Index to Nursing and Allied Health Literature, and the Cochrane Central Register of Controlled Trials to identify studies published from January 1, 1966 to December 31, 2021 on approaches to improve faculty development for life support courses. Data on participant characteristics, interventions, design, and outcomes of included studies were extracted. Of the initially identified 10 310 studies, we included 20 studies (5 conference abstracts, 1 short communication, 14 full-length articles). Among them, 12 studies aimed to improve instructors/candidates' teaching ability in basic life support courses. A wide variety of interventions were identified. The interventions were categorized into 4 themes: instructor qualification/training (n=9), assessment tools (n=3), teaching skills enhancement (n=3), and additional courses for instructors (n=5). Most studies showed that these interventions improved specific teaching ability or confidence of the instructors and learning outcomes in different kinds of life support courses. However, no studies addressed clinical outcomes of patients. In conclusion, the faculty development approaches for instructors are generally associated with improved learning outcomes for participants, and also improved teaching ability and self-confidence of the instructors. It is encouraged that local organizations implement faculty development programs for their teaching staff of their accredited resuscitation courses. Further studies should explore the best ways to strengthen and maintain instructor competency, and define the cost-effectiveness of various different faculty development strategies.

Rapid Cycle Deliberate Practice Improves Retention of Pediatric Resuscitation Skills Compared With Postsimulation Debriefing

INTRODUCTION

Rapid cycle deliberate practice (RCDP) for teaching team-based resuscitation is associated with similar improvements in immediate performance as compared with postsimulation debriefing (PSD). Limited studies compare skill retention between these 2 modalities. Our objective was to compare retention of team leader performance in residents trained with RCDP versus PSD.

METHODS

This was a cluster-randomized trial comparing RCDP and PSD from January 2018 to April 2019. Pediatric and emergency medicine residents participated in simulation-based pediatric resuscitation education, and teams were randomized to undergo either RCDP or PSD. Each participant's team leader performance was assessed 1 to 12 months after training via a simulated cardiac arrest. The primary outcome was time to defibrillation. Secondary outcomes included overall team leader performance and time to chest compressions.

RESULTS

Thirty-two residents (90.6% pediatrics, 9.4% emergency medicine) met inclusion criteria (16 RCDP, 16 PSD). Of the 32 residents, 40% returned in 1 to 3 months, 25% 3 to 6 months, 16% 6 to 9 months, and 19% 10 to 12 months. Participants in RCDP had more than 5 times the odds of achieving defibrillation versus those in the PSD group (odds ratio = 5.57, 95% confidence interval = 1.13-27.52, P = 0.04). The RCDP group had a higher mean Resident Team Leader Evaluation score (0.54 ± 0.19) than the PSD group (0.34 ± 0.16, P < 0.001).

CONCLUSIONS

This study shows significant differences in subsequent performance in the team leader trained with RCDP and suggests that RCDP may improve retention of pediatric resuscitation skills compared with PSD. Future studies should focus on best applications for RCDP with attention to knowledge and skill decay.

Debriefing for Simulation-Based Medical Education: A Survey From the International Network of Simulation-Based Pediatric Innovation, Research and Education

CONTEXT

Current debriefing approaches and faculty development strategies for simulation educators differ around the world. We aim to describe the status of current debriefing practice and faculty development for simulation educators in this study.

METHODS

We distributed a paper-based survey during 2 international conferences to obtain data from active International Network for Simulation-based Pediatric Innovation, Research and Education members. The survey was tested to ensure content validity and consisted of the following 3 constructs: demographic characteristics, current debriefing practice, and issues related to faculty development.

RESULTS

One hundred nine of 114 participants (96%) completed the survey. Debriefing practice differs in terms of timing, duration, framework, and conversational framework. Most debriefings were less than 30 minutes (93/109, 85%), with many educators not using objective data during debriefing (47/109, 43%). Three- or 4-phase debriefing frameworks were used most commonly (66/109, 61%). Most participants have access to some faculty development opportunities (99/109, 91%). Barriers to faculty development are related to time and resource constraints (eg, freeing up facilitator's time: 75/109, 69%, competing priorities 64/109, 59%). Most participants indicated that their needs for debriefing to improve learning outcomes were met (95/109, 87%). The desired content for future faculty development opportunities varies between educators with different levels of expertise.

CONCLUSIONS

Approaches to debriefing among members of an international pediatric simulation network vary considerably. Although faculty development opportunities were available to most participants, future simulation programs should work on addressing barriers and optimizing faculty development plans to meet the needs of their educators.

Enablers of the successful implementation of simulation exercises: a qualitative study among nurse teachers in undergraduate nursing education

BACKGROUND

Simulation exercises are increasingly being used as a teaching method in the field of undergraduate nursing education. Thus, the present study sought to identify, describe and discuss enablers of the successful implementation of simulation exercises in undergraduate nursing education.

METHODS

This study had a qualitative descriptive design and involved individual interviews conducted between November and December 2018 with six nurse teachers from three different university campuses in Norway. The transcribed interviews were analysed by means of a qualitative thematic analysis.

RESULTS

The majority of the interviewees wanted to offer more simulation exercises as part of their respective undergraduate nursing education programmes. Moreover, creating a safe environment, facilitating student-centred learning and promoting reflection were all identified by the interviewees as enablers of the successful implementation of simulation exercises.

CONCLUSIONS

The findings of this study indicate that nurse teachers consider simulation to be a valuable teaching method for improving students' learning outcomes. In addition, the findings could guide the future implementation of simulation exercises in undergraduate nursing education.

TRIAL REGISTRATION

ClinicalTrials.gov ID: NCT04063319 . Protocol ID: 52110 Nursing Students' Recognition of and Response to Deteriorating Patients.

Communication as a High-Stakes Clinical Skill: "Just-in-Time" Simulation and Vicarious Observational Learning to Promote Patient- and Family-Centered Care and to Improve Trainee Skill

Patient-provider communication is a hallmark of high-quality care and patient safety; however, the pace and increasingly complex challenges that face overextended teams strain even the most dedicated clinicians. The COVID-19 pandemic has further disrupted communication between clinicians and their patients and families. The dependence on phone communication and the physical barriers of protective gear limit nonverbal communication and diminish clinicians' ability to recognize and respond to emotion. Developing new approaches to teach communication skills to trainees who are often responsible for communicating with patients and their families is challenging, especially during a pandemic or other crisis. "Just-in-time" simulation-simulation-based training immediately before an intervention-provides the scaffolding and support trainees need for conducting difficult conversations, and it enhances patients' and families' experiences. Using a realistic scenario, the author illustrates key steps for effectively using just-in-time simulation-based communication training: assessing the learner's understanding of the situation; determining what aspects of the encounter may prove most challenging; providing a script as a cognitive aid; refreshing or teaching a specific skill; preparing learners emotionally through reflection and mental rehearsal; coaching on the approach, pace, and tone for a delivery that conveys empathy and meaning; and providing specific, honest, and curious feedback to close a performance gap. Additionally, the author acknowledges that clinical conditions sometimes require learning by observing rather than doing and has thus provided guidance for making the most of vicarious observational learning: identify potential challenges in the encounter and explicitly connect them to trainee learning goals, explain why a more advanced member of the team is conducting the conversation, ask the trainee to observe and prepare feedback, choose the location carefully, identify everyone's role at the beginning of the conversation, debrief, share reactions, and thank the trainee for their feedback and observations.

Qualities of Effective Vital Anaesthesia Simulation Training Facilitators Delivering Simulation-Based Education in Resource-Limited Settings

BACKGROUND

Lack of access to safe and affordable anesthesia and surgical care is a major contributor to avoidable death and disability across the globe. Effective education initiatives are a viable mechanism to address critical skill and process gaps in perioperative teams. Vital Anaesthesia Simulation Training (VAST) aims to overcome barriers limiting widespread application of simulation-based education (SBE) in resource-limited environments, providing immersive, low-cost, multidisciplinary SBE and simulation facilitator training. There is a dearth of knowledge regarding the factors supporting effective simulation facilitation in resource-limited environments. Frameworks evaluating simulation facilitation in high-income countries (HICs) are unlikely to fully assess the range of skills required by simulation facilitators working in resource-limited environments. This study explores the qualities of effective VAST facilitators; knowledge gained will inform the design of a framework for assessing simulation facilitators working in resource-limited contexts and promote more effective simulation faculty development.

METHODS

This qualitative study used in-depth interviews to explore VAST facilitators' perspectives on attributes and practices of effective simulation in resource-limited settings. Twenty VAST facilitators were purposively sampled and consented to be interviewed. They represented 6 low- and middle-income countries (LMICs) and 3 HICs. Interviews were conducted using a semistructured interview guide. Data analysis involved open coding to inductively identify themes using labels taken from the words of study participants and those from the relevant literature.

RESULTS

Emergent themes centered on 4 categories: Persona, Principles, Performance and Progression. Effective VAST facilitators embody a set of traits, style, and personal attributes (Persona) and adhere to certain Principles to optimize the simulation environment, maximize learning, and enable effective VAST Course delivery. Performance describes specific practices that well-trained facilitators demonstrate while delivering VAST courses. Finally, to advance toward competency, facilitators must seek opportunities for skill Progression.Interwoven across categories was the finding that effective VAST facilitators must be cognizant of how context, culture, and language may impact delivery of SBE. The complexity of VAST Course delivery requires that facilitators have a sensitive approach and be flexible, adaptable, and open-minded. To progress toward competency, facilitators must be open to self-reflection, be mentored, and have opportunities for practice.

CONCLUSIONS

The results from this study will help to develop a simulation facilitator evaluation tool that incorporates cultural sensitivity, flexibility, and a participant-focused educational model, with broad relevance across varied resource-limited environments.

Development, Validation, and Implementation of a Guideline to Improve Clinical Event Debriefing at a Level-I Adult and Level-II Pediatric Trauma Center

OBJECTIVE

Clinical event debriefing is recommended by the American Heart Association and the European Resuscitation Council, because debriefings improve team performance. The purpose here was to develop and validate tools needed to overcome barriers to debriefing in the emergency department.

METHOD

This quality improvement project was conducted in 4 phases. Phase 1: Current evidence related to debriefing in the emergency department was reviewed and synthesized to inform an iterative process for drafting the debriefing guideline and instrument for documentation. Phase 2: Content Validity Index of the tools was evaluated by obtaining ratings of items' clarity and relevance from 5 national experts in 2 rounds of review. On the basis of experts' feedback, tools were revised, and a Facilitators' Guide was created. Phase 3: The validated debriefing tools were implemented. Phase 4: Debriefing facilitators completed a survey about their experience with using the new tools.

RESULTS

The Content Validity Index of 71 debriefing tool items (guideline, instrument, Facilitators' Guide) was 0.93 and 0.96 for clarity and relevance, respectively. Of the 32 debriefings conducted during the first 8 weeks of implementation, 53% described patient safety concerns, and 97% described recommendations to improve performance. Most (94%) facilitators agreed that the guideline clarified debriefing requirements.

CONCLUSION

The use of debriefing tools validated by computation of the Content Validity Index led to the identification of safety threats and recommendations to improve care processes. These tools can be used in ED settings to promote team learning and aid in identifying and resolving safety concerns.

Effects of using a cognitive aid on content and feasibility of debriefings of simulated emergencies

Background: Adverse events in patient care are often caused by failures in teamwork. Simulation training and its debriefing can contribute to improving teamwork and thus patient care. When conducting debriefings, there are several design factors that can potentially influence learning outcomes. This study examines the use of a cognitive aid to help structure the content of debriefings and compares it with debriefings that are merely roughly structured. In addition, the feasibility of the debriefing, the satisfaction of the participants and their teamwork during the training are investigated. Methods: In a simulated night shift, seven teams of four to five medical students (n=32) took part in six cases that simulated common situations in an emergency medicine environment and received a debriefing on their teamwork after each case, either in the intervention condition with the help of the TeamTAG tool - a cognitive aid focusing on selected teamwork principles from Crisis Resource Management (CRM) - or in the control condition without it. The facilitators noted the topics of the debriefings and rated their experience of conducting them; the participants indicated their satisfaction with the debriefings, as well as their assessment of the importance of CRM principles. In addition, the quality of teamwork was assessed using the Team Emergency Assessment Measure (TEAM). Results: The analysis showed no difference in the number of teamwork principles discussed between the control and intervention conditions, but topics were repeated more frequently in the control group. The TeamTAG guideline was focused on and implemented by the tutors, who discussed the CRM principles included in the TeamTAG more consistently than in the control condition. The tutors in both conditions were satisfied with the implementation, and the use of TeamTAG facilitated time management. There were no differences in participants' satisfaction, their assessment of the importance of the teamwork principles, or the quality of teamwork between conditions. Conclusion: The use of a cognitive aid can help to direct the focus on certain topics or learning objectives and facilitate time management through pre-structuring; however, a difference in learning outcomes (in terms of the quality of teamwork) could not be identified. Besides the influence of a certain structure or script, a strong influence from the individual guiding the debriefing is likely.

Student Performance During a Simulated Patient Encounter Has No Impact on Debriefer Adherence to PEARLS Debriefing Model

PURPOSE

Debriefing is necessary for effective simulation education. The PEARLS (Promoting Excellence and Reflective Learning in Simulations) is a scripted debriefing model that incorporates debriefing best practices. It was hypothesized that student simulation performance might impact facilitator adherence to the PEARLS debriefing model. There are no published findings on the effect of student performance on debriefer behavior.

METHODS

Third-year medical students participated in a video-recorded, formative simulation to treat a high-fidelity mannequin for an asthma exacerbation. A faculty debriefer trained in the PEARLS model evaluated student performance with a standardized rubric and conducted a recorded debriefing. Debriefing recordings were analyzed for debriefer adherence to the PEARLS model. Debriefers were assigned a debriefing score (DS) from 0 to 13; 13 was perfect adherence to the model. Definitive intervention (DI) for asthma exacerbation was defined as bronchodilator therapy. Critical actions were as follows: a focused history, heart/lung exam, giving oxygen, and giving a bronchodilator.

RESULTS

Mean DS for the debriefers of students who provided DI was 8.57; 9.14 for those students who did not (P = 0.25). Mean DS for debriefers of students who completed all critical actions was 8.68; 8.52 for those students who did not (P = 0.62). Analysis of elapsed time to DI showed no relationship between the time DI was provided and DS.

CONCLUSIONS

Student performance had no impact on debriefer performance, suggesting the PEARLS model is an effective aid for debriefers, regardless of learner performance. These findings suggest student performance may not bias facilitators' ability to conduct quality debriefings.

Exploration of simulation-based medical education for undergraduate students

Over the past decades, extensive studies have underscored the growing importance of simulation-based medical education (SBME) for medical students. However, the underlying influence of SBME on undergraduate students is yet to be investigated. This work is a single-center cohort study involving 1178 undergraduate students who were divided into a control group and an SBME group. All participants gave their written informed consent. We compared the theoretical and practical achievements of these 2 groups and distributed a feedback questionnaire. Results show that SBME significantly improves the practical or theoretical achievements of students (P < .001). The humanistic care (improvement rate: 69.2%) and doctor-patient communication (improvement rate: 56.3%) performances of these studies were vastly improved. The students in the SBME group tend to allocate more time to communicating with others. SBME is an effective teaching method that can improve the reflective capacity and communication skills of undergraduate medical students, thereby resulting in their relatively improved performance.

Development of a Novel and Scalable Simulation-Based Teamwork Training Model Using Within-Group Debriefing of Observed Video Simulation

THE CHALLENGE

Effective teamwork and communication skills are essential for safe and reliable health care. These skills require training and practice. Experiential learning is optimal for training adults, and the industry has recognized simulation training as an exemplar of this approach. Yet despite decades of investment, this training is inaccessible and underutilized for most of the more than 12 million health care professionals in the United States.

DESIGNING A SOLUTION

This report describes the design process of an adapted simulation training created to overcome the key barriers to scaling simulation-based teamwork training: access to technology, time away from clinical work, and availability of trained simulation educators. The prototype training is designed for delivery in one-hour segments and relies on observation of video simulation scenarios and within-group debriefing, which are promising variations on traditional simulation training. To our knowledge, these two simulation approaches have not been previously combined. The resulting prototype minimizes the need for an on-site trained simulation educator. This report details the development of a training model, its subsequent modification based on pilot testing, and the evaluation of the resulting redesigned prototype.

PRELIMINARY EVALUATION

Participant evaluations of the redesigned prototype were highly positive, with 92% reporting that they would like to participate in additional, similar training sessions. Positive results were also found in assessment of feasibility, acceptability, psychological safety, and behavioral intention (reported intention to alter behavior).

Objective Structured Assessment of Debriefing (OSAD) in simulation-based medical education: Translation and validation of the German version

Debriefing is essential for effective learning during simulation-based medical education. To assess the quality of debriefings, reliable and validated tools are necessary. One widely used validated tool is the Objective Structured Assessment of Debriefing (OSAD), which was originally developed in English. The aim of this study was to translate the OSAD into German, and to evaluate the reliability and validity of this German version (G-OSAD) according the 'Standards of Educational and Psychological Measurement'. In Phase 1, the validity evidence based on content was established by a multistage cross-cultural adaptation translation of the original English OSAD. Additionally, we collected expert input on the adequacy of the content of the G-OSAD to measure debriefing quality. In Phase 2, three trained raters assessed 57 video recorded debriefings to gather validity evidence based on internal structure. Interrater reliability, test-retest reliability, internal consistency, and composite reliability were examined. Finally, we assessed the internal structure by applying confirmatory factorial analysis. The expert input supported the adequacy of the content of the G-OSAD to measure debriefing quality. Interrater reliability (intraclass correlation coefficient) was excellent for the average ratings (three raters: ICC = 0.848; two raters: ICC = 0.790), and good for the single rater (ICC = 0.650). Test-retest reliability was excellent (ICC = 0.976), internal consistency was acceptable (Cronbach's α = 0.865), and composite reliability was excellent (ω = 0.93). Factor analyses supported the unidimensionality of the G-OSAD, which indicates that these G-OSAD ratings measure debriefing quality as intended. The G-OSAD shows good psychometric qualities to assess debriefing quality, which are comparable to the original OSAD. Thus, this G-OSAD is a tool that has the potential to optimise the quality of debriefings in German-speaking countries.

Post-crisis debriefing: A tool for improving quality in the medical emergency team system

OBJECTIVES

To examine clinicians' perception of quality of technical and non-technical response to emergencies and application of post crisis debriefing.

DESIGN

Descriptive, anonymous, self-reporting survey on the needs and perception of a post-crisis debriefing implementation.

SETTING

Multi-specialist medical institute in Italy focused on solid organ transplantation and organ failure support.

MAIN OUTCOMES

Perception of application of guidelines and evaluation of debriefing implementation during in-hospital emergencies.

RESULTS

Response rate to the survey was 25% (148 health care workers). Of all respondents, 86% were employed >10 years, 75% were involved in ≤5 emergencies over the previous year. Resuscitation guidelines were considered fully applied by 55%; 64% of respondents considered the teaching programme as sufficient. Of all participants, 97% were aware of the importance of teamwork dynamics, 79% were aware of the importance of the personal performance, and 52% considered emergencies as valid opportunities for professional growth. Leadership was considered important by 45% of respondents; debriefing implemented by 41%, and considered a potentially useful tool by 85%.

CONCLUSION

Post-crisis debriefing is a way to diffuse self-reflective and life-long learning culture; it is perceived as a powerful tool for improving quality of the rapid response system by the vast majority of those surveyed.

Baseline well-being, perceptions of critical incidents, and openness to debriefing in community hospital emergency department clinical staff before COVID-19, a cross-sectional study

BACKGROUND

Emergency department personnel routinely bear witness to traumatic experiences and critical incidents that can affect their own well-being. Peer support through debriefing has demonstrated positive impacts on clinicians' well-being following critical incidents. This study explored community hospital emergency department staff's perceptions of critical incidents, assessed openness to debriefing and measured baseline well-being. Our analysis provides a baseline of provider well-being immediately prior to the local onset of COVID-19. The potential need for additional resources to support frontline providers during the pandemic can be evaluated.

METHOD

We conducted a cross-sectional study for 4-weeks prior to the first COVID-19 case in Connecticut using a survey offered to an interprofessional group of emergency department clinical staff. The main outcome measures were the Hospital Anxiety and Depression Scale (HADS) and the Professional Quality of Life (ProQOL) scale. Pearson's chi-square test was used to identify significant differences in perceptions of critical incidents and debriefings between professional categories. One-way ANOVA and Tukey's test were used to analyze significant differences in well-being between professional categories.

RESULTS

Thirty-nine clinical personnel from St. Vincent's Emergency Department responded to the survey. Events frequently selected as critical incidents were caring for critically ill children (89.7%), mass casualty events (84.6%), and death of a patient (69.2%). Critical incidents were commonly reported (81.6%) as occurring once per week. Additionally, 76.2% of participants reported wanting to discuss a critical incident with their team. Across all respondents, 45.7% scored borderline or abnormal for anxiety, 55.9% scored moderate for burnout, and 55.8% scored moderate to high for secondary traumatic stress.

CONCLUSIONS

At baseline, providers reported caring for critically ill children, mass casualty events, and death of a patient as critical incidents, which typically occurred once per week. Death of a patient occurs at increased frequency during the protracted mass casualty experience of COVID-19 and threatens provider well-being. Receptiveness to post-event debriefing is high but the method is still underutilized. With nearly half of staff scoring borderline or abnormal for anxiety, burnout, and secondary traumatic stress at baseline, peer support measures should be implemented to protect frontline providers' well-being during and after the pandemic.

Alternatives to High-Fidelity Simulation

Simulation-based education improves health care professionals' performance in managing critical events. Limitations to widespread uptake of high-fidelity simulation include barriers related to training, technology, and time. Alternatives to high-fidelity simulation that overcome these barriers include in situ simulation, classroom-based simulation, telesimulation, observed simulation, screen-based simulation, and game-based simulation. Some settings have limited access to onsite expert facilitation to design, implement, and guide participants through simulation-based education. Alternatives to onsite expert debriefing in these settings include teledebriefing, scripted debriefing, and within-group debriefing. A combination of these alternatives promotes successful implementation and maintenance of simulation-based education for managing critical health care events.

Sim for Life: Foundations-A Simulation Educator Training Course to Improve Debriefing Quality in a Low Resource Setting: A Pilot Study

INTRODUCTION

Despite the importance of debriefing, little is known about the effectiveness of training programs designed to teach debriefing skills. In this study, we evaluated the effectiveness of a faculty development program for new simulation educators at Mbarara University of Science and Technology in Uganda, Africa.

METHODS

Healthcare professionals were recruited to attend a 2-day simulation educator faculty development course (Sim for Life: Foundations), covering principles of scenario design, scenario execution, prebriefing, and debriefing. Debriefing strategies were contextualized to local culture and focused on debriefing structure, conversational strategies, and learner centeredness. A debriefing worksheet was used to support debriefing practice. Trained simulation educators taught simulation sessions for 12 months. Debriefings were videotaped before and after initial training and before and after 1-day refresher training at 12 months. The quality of debriefing was measured at each time point using the Objective Structured Assessment of Debriefing (OSAD) tool by trained, calibrated, and blinded raters.

RESULTS

A total of 13 participants were recruited to the study. The mean (95% confidence interval) OSAD scores pretraining, posttraining, and at 12 months before and after refresher were 18.2 (14.3-22.1), 26.7 (22.8-30.6), 25.5 (21.2-29.9), and 27.0 (22.4-31.6), respectively. There was a significant improvement from pretraining to posttraining (P < 0.001), with no significant decay from posttraining to 12 months (P = 0.54). There was no significant difference in OSAD scores pre- versus post-refresher training at 12 months (P = 0.49).

CONCLUSIONS

The Sim for Life Foundations program significantly improves debriefing skills with retention of debriefing skills at 12 months.

Educational impact of a pilot paediatric simulation-based training course in Botswana

Background

As emergency medical services (EMS) systems develop globally in resource-limited settings, equipping providers with paediatric training is essential. Low-fidelity simulation-based training is an effective modality for training healthcare workers, though limited data exist on the impact of such training programmes. The objective of this study was to evaluate the paediatric portion of a simulation-based curriculum for prehospital providers in Botswana.

Methods

This was a prospective cohort study of EMS providers from more populated regions of Botswana, who attended a 2-day training that included didactic lectures, hands-on skills stations and low-fidelity simulation training. We collected data on participant self-efficacy with paediatric knowledge and skills and performance on both written and simulation-based tests. Self-efficacy and test data were analysed, and qualitative course feedback was summarised.

Results

Thirty-one EMS providers participated in the training. Median self-efficacy levels increased for 13/15 (87%) variables queried. The most notable improvements were observed in airway management, newborn resuscitation and weight estimation. Mean written test scores increased by 10.6%, while mean simulation test scores increased by 21.5% (p<0.0001). One hundred per cent of the participants rated the course as extremely useful or very useful.

Discussion/Conclusion

We have demonstrated that a low-fidelity simulation-based training course based on a rigorous needs assessment may enhance short-term paediatric knowledge and skills for providers in a developing EMS system in a limited-resource setting. Future studies should focus on studying larger groups of learners in similar settings, especially with respect to the impact of educational programmes like these on real-world patient outcomes.

Applications of Postresuscitation Debriefing Frameworks in Emergency Settings: A Systematic Review

OBJECTIVES

Postresuscitation debriefing (PRD) is a valuable educational tool in emergency medicine. It is recommended by international resuscitation guidelines, has been shown to improve both patient outcomes and resuscitation team performance, and is frequently requested by medical learners. However, there is limited research comparing standardized debriefing frameworks. Not only does this hinder the ability of interested emergency departments (EDs) to adopt PRD, but it limits the quality of future debriefing research. We sought to identify and compare existing PRD frameworks to inform the implementation of effective PRD in emergency medicine.

METHODS

We conducted a systematic review following PRISMA standards to identify debriefing frameworks used in the ED and other acute care settings for further analysis. Identified frameworks were analyzed and compared based on a method previously described in the literature.

RESULTS

Our search identified six frameworks, which ranged from simple tools for immediate feedback to complex, hospital-wide systems engineering-based approaches to quality improvement. Key findings were the importance of ensuring debriefing facilitators are properly selected and trained and of tailoring framework design to specific organizational targets. However, there is limited validation data for these frameworks, and more study is needed to identify and validate true best practices in PRD.

CONCLUSIONS

All six identified frameworks seem to be effective methods of debriefing. Given the breadth in debriefing methods and goals identified, this suggests that there may not be a one-size-fits-all approach to PRD and that organizations should instead identify their own unique needs and barriers and adopt the debriefing framework that best addresses those needs. Other findings were the importance of well-trained debriefing facilitators and the use of clear roles in organizing debriefings. Further research is needed to assess the effectiveness of postresuscitation frameworks with regard to both team performance and patient outcomes.

Understanding Debriefing: A Qualitative Study of Event Reconstruction at an Academic Medical Center

PURPOSE

This qualitative study sought to characterize the role of debriefing after real critical events among anesthesia residents at the Hospital of the University of Pennsylvania.

METHOD

From October 2016 to June 2017 and February to April 2018, the authors conducted 25 semistructured interviews with 24 anesthesia residents after they were involved in 25 unique critical events. Interviews focused on the experience of the event and the interactions that occurred thereafter. A codebook was generated through annotation, then used by 3 researchers in an iterative process to code interview transcripts. An explanatory model was developed using an abductive approach.

RESULTS

In the aftermath of events, residents underwent a multistage process by which the nature of critical events and the role of residents in them were continuously reconstructed. Debriefing-if it occurred-was 1 stage in this process, which also included stages of internal dialogue, event documentation, and lessons learned. Negotiated in each stage were residents' culpability, reputation, and the appropriateness of their affective response to events.

CONCLUSIONS

Debriefing is one of several stages of interaction that occur after a critical event; all stages play a role in shaping how the event is interpreted and remembered. Because of its dynamic role in constituting the nature of events and residents' role in them, debriefing can be a high-stakes interaction for residents, which can contribute to their reluctance to engage in it. The function and quality of debriefing can be assessed in more insightful fashion by understanding its relation to the other stages of event reconstruction.

'Take 10 to talk about it': Use of a scripted, post-event debriefing tool in a neonatal intensive care unit

AIM

This study assessed the impact of a scripted, post-event debriefing tool in identifying logistical, procedural, personnel and performance obstacles and successes in a clinical setting. It was predicted that the debriefing tool would highlight the importance of routine debriefing following challenging clinical events.

METHODS

The study was conducted in a 22-bed neonatal intensive care unit at a tertiary hospital and involved all staff members in the perinatal service. The debriefing tool, a two-page form providing a structured, scripted approach, was used at the earliest opportunity after acute clinical deteriorations, emergency caesarean sections and any other critical events as decided by the neonatal team. Sessions were facilitated by either a nursing or medical member of the neonatal team. Following a 2-month trial, impact was measured via the comparison of before and after survey questions as well as review of a database of issues raised, subsequent actions and outcomes.

RESULTS

Significant, positive changes were observed for survey questions specific to the frequency of debriefing, team communication, provision of learning opportunities and identification of logistical, equipment and procedural issues. In addition, the database highlighted the significant positive impact in day-to-day practice as a result of changes initiated by the debriefing tool. All participants requested the unit to continue using the tool.

CONCLUSION

Scripted, post-event debriefing is achievable and valuable in the clinical setting. It encourages a supportive workplace culture and empowers team members to initiate practical change in their organisations.

Development of an in situ simulation-based continuing professional development curriculum in pediatric emergency medicine

BACKGROUND

Continuing professional development (CPD) activities delivered by simulation to independently practicing physicians are becoming increasingly popular. At present, the educational potential of such simulations is limited by the inability to create effective curricula for the CPD audience. In contrast to medical trainees, CPD activities lack pre-defined learning expectations and, instead, emphasize self-directed learning, which may not encompass true learning needs. We hypothesize that we could generate an interprofessional CPD simulation curriculum for practicing pediatric emergency medicine (PEM) physicians in a single-center tertiary care hospital using a deliberative approach combined with Kern's six-step method of curriculum development.

METHODS

From a comprehensive core list of 94 possible PEM clinical presentations and procedures, we generated an 18-scenario CPD simulation curriculum. We conducted a comprehensive perceived and unperceived needs assessment on topics to include, incorporating opinions of faculty PEM physicians, hospital leadership, interprofessional colleagues, and expert opinion on patient benefit, simulation feasibility, and value of simulating the case for learning. To systematically rank items while balancing the needs of all stakeholders, we used a prioritization matrix to generate objective "priority scores." These scores were used by CPD planners to deliberately determine the simulation curriculum contents.

RESULTS

We describe a novel three-step CPD simulation curriculum design method involving (1) systematic and deliberate needs assessment, (2) systematic prioritization, and (3) curriculum synthesis. Of practicing PEM physicians, 17/20 responded to the perceived learning needs survey, while 6/6 leaders responded to the unperceived needs assessment. These ranked data were input to a five-variable prioritization matrix generating priority scores. Based on local needs, the highest 18 scoring clinical presentations and procedures were selected for final inclusion in a PEM CPD simulation curriculum. An interim survey of PEM physician (21/24 respondents) opinions was collected, with 90% finding educational value with the curriculum. The curriculum includes items not identified by self-directed learning that PEM physicians thought should be included.

CONCLUSIONS

We highlight a novel methodology for PEM physicians that can be adapted by other specialities when designing their own CPD simulation curriculum. This methodology objectively considers and prioritizes the needs of practicing physicians and stakeholders involved in CPD.

Clinical event debriefing: a review of approaches and objectives

PURPOSE OF REVIEW

This review explores four different approaches and clarifies objectives for debriefing after a clinical event in the emergency department. Psychological debriefing aims to prevent or reduce symptoms of traumatic stress and normalize recovery. Psychological first aid helps team members provide each other with pragmatic social support. Debriefing for simulation-based education promotes learning by team members. Quality improvement approaches and after action reviews focus on systems improvement.

RECENT FINDINGS

Qualitative studies have begun to explore interactions between clinical staff after a significant clinical event. Clearer descriptions and measurements of quality improvements and the effect of clinical event debriefing on patient outcomes are appearing. An increasing number of studies describe melded, scripted approaches to the hot debrief.

SUMMARY

Clinical staff have consistently indicated they value debriefing after a significant clinical event. Differing objectives from different approaches have translated into a wide variety of methods and a lack of clarity about relevant outcomes to measure. Recent descriptions of scripted approaches may clarify these objectives and pave the way for measuring relevant outcomes that demonstrate the effectiveness of and find the place for debriefing in the emergency department.

An Evaluation of a New Debriefing Framework: REFLECT

BACKGROUND

Postresuscitation debriefing (PRD) is recommended by the American Heart Association guidelines but is infrequently performed. Prior studies have identified barriers for pediatric emergency medicine (PEM) fellows including lack of a standardized curriculum.

OBJECTIVE

Our objective was to create and assess the feasibility of a time-limited, structured PRD framework entitled REFLECT: Review the event, Encourage team participation, Focused feedback, Listen to each other, Emphasize key points, Communicate clearly, and Transform the future.

METHODS

Each PEM fellow (n = 9) at a single center was a team leader of a pre-intervention and post-intervention videotaped, simulated resuscitation followed by a facilitated team PRD. Our intervention was a 2-hour interactive, educational workshop on debriefing and the use of the REFLECT debriefing aid. Videos of the pre-intervention and post-intervention debriefings were blindly analyzed by video reviewers to assess for the presence of debriefing characteristics contained in the REFLECT debriefing aid. PEM fellow and team member assessments of the debriefings were completed after each pre-intervention and post-intervention simulation, and written evaluations by PEM fellows and team members were analyzed.

RESULTS

All 9 PEM fellows completed the study. There was an improvement in the pre-intervention and post-intervention assessment of the REFLECT debriefing characteristics as determined by fellow perception (63% to 83%, P < 0.01) and team member perception (63% to 82%, P < 0.001). All debriefings lasted less than 5 minutes. There was no statistical difference between pre-intervention and post-intervention debriefing time (P = 1.00).

CONCLUSIONS

REFLECT is a feasible debriefing aid designed to incorporate evidence-based characteristics into a PRD.

Simulation-Based Event Analysis Improves Error Discovery and Generates Improved Strategies for Error Prevention

INTRODUCTION

An adverse event (AE) is a negative consequence of health care that results in unintended injury or illness. The study investigates whether simulation-based event analysis is different from traditional event analysis in uncovering root causes and generating recommendations when analyzing AEs in hospitalized children.

METHODS

Two simulation scenarios were created based on real-life AEs identified through the hospital's Safety Reporting System. Scenario A involved an error of commission (inpatient drug error) and scenario B involved detecting an error that already occurred (drug infusion error). Each scenario was repeated 5 times with different, voluntary clinicians. Content analysis, using deductive and inductive approaches to coding, was used to analyze debriefing data. Causes and recommendations were compiled and compared with the traditional event analysis.

RESULTS

Errors were reproduced in 60% (3/5) of scenario A. In scenario B, participants identified the error in 100% (5/5) of simulations (average time to error detection = 15 minutes). Debriefings identified reasons for errors including product labeling, memory aid interpretation, and lack of standard work for patient handover. To prevent error, participants suggested improved drug labeling, specialized drug kits, alert signs, and handoff checklists. Compared with traditional event analysis, simulation-based event analysis revealed unique causes for error and new recommendations.

CONCLUSIONS

Using simulation to analyze AEs increased unique error discovery and generated new recommendations. This method is different from traditional event analysis because of the immediate clinician debriefings in the clinical environment. Hospitals should consider simulation-based event analysis as an important addition to the traditional process.