Structuring feedback and debriefing to achieve mastery learning goals

The expository phase of debriefing in clinical simulation: a qualitative study

BACKGROUND

Clinical simulation fosters reflective, experiential learning in a safe environment, allowing participants to learn from mistakes without patient risk. Debriefing, essential for reflection, is typically facilitator driven. The MAES© methodology (Self-Learning Methodology in Simulated Environments) shifts the focus to students, guiding them through six sequential phases: group identity creation, topic selection, objective setting, competency establishment, scenario design, simulation, and debriefing. MAES© introduces an expository phase in debriefing, where students present theoretical and practical content. The facilitator assumes a significant, yet secondary role, fostering increased student-led learning opportunities and, at times, enabling even trained real patients to co-facilitate the debriefing.

OBJECTIVE

To explore participants' experiences and perceptions regarding the expository phase of debriefing within the MAES© methodology framework, with specific focus on the student-led debriefing component.

METHOD

A descriptive qualitative inductive approach with thematic content analysis was used. Open-ended questionnaires from 151 undergraduate final year and post-graduate nursing students, captured their experiences with the MAES© expository phase. Open-ended questionnaires allow participants to freely and anonymously express their perspectives and experiences. Responses were transcribed, independently coded, and analyzed using MaxQDA® v18. Data were coded and analyzed based on absolute and relative frequencies of emerging categories. The study adhered to the SRQR (Standards for Reporting Qualitative Research) guidelines.

RESULTS

The analysis revealed several key themes in student evaluations. Satisfaction with the methodology emerged strongly, with over one-third of participants expressing no desired changes. The reflective nature of the approach was prominently valued, along with its effectiveness for concept clarification and fostering collaborative learning. Participants particularly noted developmental outcomes in communication competencies and technical skills, while appreciating the motivational learning environment and evidence-based focus. The suggested improvements focused on three main aspects: increased session dynamism, a greater use of visual and interactive elements, and reduced dependence on slide-based presentations.

CONCLUSION

The study highlights the value of the expository phase in the MAES© methodology, emphasizing its effectiveness in clarifying concepts, fostering collaboration, and developing technical and communication skills. It also promotes student autonomy through active engagement. However, participants suggested improvements, such as greater dynamism, personalization, and varied presentation methods using videos, skill stations or patient's-oriented debriefing. Overall, the expository phase proves to be a valuable pedagogical tool with potential for broader application in simulation-based learning and other debriefing models.

CLINICAL TRIAL NUMBER

Not applicable.

Exploring the role of self-led debriefings within simulation-based education: time to challenge the status quo?

BACKGROUND

The notion that debriefing quality is highly reliant on the skills and expertise of the facilitator is being increasingly challenged. There is therefore emerging interest in self-led debriefings (SLDs), whereby following a simulated learning event, individuals or groups of learners conduct a debriefing amongst themselves, without the immediate presence of a trained facilitator. The interest in this approach to debriefing is multifactorial but is, in part, driven by a desire to reduce costs associated with resource-intensive faculty presence. The debate regarding the role of SLDs in simulation-based education (SBE) therefore has important implications for the simulation community.

MAIN BODY

We comprehensively explore the role of SLDs by contextualising their application across the spectrum of SBE, both in terms of contrasting simulation factors, namely (i) simulation modality, (ii) debriefing forum, and (iii) debriefing adjuncts, as well as different learner characteristics, namely (i) learners' previous simulation experience, (ii) learner numbers, and (iii) learners' professional and cultural backgrounds. These factors inherently shape the conduct and format of SLDs, and thus impact their effectiveness in influencing learning. We have synthesised and critically analysed the available literature to illuminate this discussion.

CONCLUSIONS

The current evidence suggests that SLDs can, in the right circumstances, form part of an effective debriefing strategy and support learners to reach appropriate levels of critical self-reflection and learning. Careful consideration and due diligence must go into the design and implementation of SLDs to augment the advantages of this debriefing format, such as enhancing flexibility and learner autonomy, whilst mitigating potential risks, such as reinforcing errors and biases or causing psychological harm. In situations where resources for facilitator-led debriefings (FLDs) are limited, simulation educators should recognise SLDs as a potential avenue to explore in their local contexts. By leveraging the strengths of both formats, balancing learner autonomy and expert guidance, a combined SLD and FLD approach may yet prove to be the optimal debriefing strategy to maximise learning. Whilst more research is needed to deepen our understanding of the nuances of SLDs to assess their true applicability across the spectrum of SBE, the time may now have arrived to consider challenging the status quo.

Simulation-Based Mastery Learning Curriculum Development Workbook

SUMMARY STATEMENT

This Workbook and its Action Plans and Notes aim to equip health professions educators with the information and guidance needed to develop and implement a simulation-based mastery learning curriculum. The Workbook begins with an introductory statement about mastery learning curriculum developers and teachers and also about expected behavior of learners in a mastery context. The Workbook continues with 10 connected sections on simulation-based mastery learning curriculum development: (1) problem identification and needs assessment, (2) targeted needs assessment, (3) goals and objectives, (4) education strategies, (5) learner assessment goals and tools, (6) standard setting, (7) curriculum implementation, (8) feedback and debriefing, (9) unexpected collateral effects, and (10) program evaluation. These sections are modeled after the Thomas and Kern (Curriculum Development for Medical Education: A Six-Step Approach. 4th ed. Baltimore: Johns Hopkins University Press; 2022) steps for curriculum development and add several steps needed to incorporate simulation-based mastery learning goals. Curriculum development is an iterative process and each decision impacts preceding and subsequent steps. In addition, steps often change and evolve as a curriculum is developed and revised. Users are encouraged to record and refine their curriculum development plans as they move, back-and-forth, through the Workbook and Action Plans and Notes. References are provided throughout the document to amplify the text and provide detailed examples of the curriculum development steps and procedures. The intended outcome is a simulation-based mastery learning curriculum plan that can be implemented and used to educate learners to a very high standard of achievement.

Turning nursing students' mistakes into resources for learning in simulation-based training: facilitators' assumptions about providing feedback in debriefing

BACKGROUND

The aim of this study was to investigate how facilitators approach and use nursing students' mistakes in simulation-based training as learning resources in the simulation debriefing phase. Facilitators are responsible for raising students' awareness of their performances during the debriefing and facilitating reflections on their performances, including satisfactory behaviours and performance gaps. Research on facilitators' work during debriefing has highlighted various challenges, such as providing a safe and constructive climate among novice students while simultaneously teaching them the correct procedures, methods, and knowledge of caring practices to become professional nurses. There is a lack of research on how facilitators approach, handle, and use students' mistakes as a learning resource. Thus, this study investigated facilitators' assumptions about providing feedback to nursing students when they made mistakes during simulation-based training METHOD: Individual semi-structured interviews were conducted with nine experienced facilitators from three universities in Norway. Data were analyzed following the principles of thematic analysis (TA).

RESULTS

Facilitators made varying assumptions about the simulations and debriefings as learning processes. These differences were evident in their accounts of how feedback was provided to students when they made mistakes during the simulation-based training.

CONCLUSION

Facilitators' statements about their practices reflect assumptions about how they make simulation activities a resource for meaningful learning, including how to use students' mistakes as learning opportunities during debriefing discussions. Consequently, these assumptions regarding learning provide valuable insights into the ambiguous and complex praxis of using simulation-based training as a professional educational tool.

Health simulation through the lens of self-determination theory - opportunities and pathways for discovery

Health simulation is broadly viewed as an appealing, impactful, and innovative enhancement for the education and assessment of health professions students and practitioners. We have seen exponential and global growth in programmes implementing simulation techniques and technologies. Alongside this enthusiasm and growth, the theoretical underpinnings that might guide the efficacy of the field have not always been considered. Many of the principles that guide simulation design, development and practice have been intuited through practical trial and error. In considering how to retrofit theory to practice, we have at our disposal existing theories that may assist with building our practice, expertise, identity as a community of practice, authority and legitimacy as a field. Self-determination theory (SDT) is an established and evolving theory that examines the quality of motivation and human behaviours. It has been applied to a variety of contexts and provides evidence that may support and enhance the practice of health simulation. In this paper, SDT is outlined, and avenues for examining the fit of theory to practice are suggested. Promising links exist between SDT and health simulation. Opportunities and new pathways of discovery await.

The State of Mastery Learning in Pediatric Graduate Medical Education: A Scoping Review

Objective

The aim of this study was to characterize the state of mastery learning interventions, identify gaps in current approaches, and highlight opportunities to improve the rigor of ML in pediatric graduate medical education (GME) training programs.

Methods

In October 2022, we searched Ovid, PubMed, Scopus, and ERIC. Two reviewers independently screened 165 citations and reviewed the full manuscripts of 20 studies. We developed a modified data abstraction tool based on the Recommendations for Reporting Mastery Education Research in Medicine (ReMERM) guidelines and extracted variables related to mastery learning curricular implementation and design and learner assessment.

Results

Eleven studies of ML approaches within pediatric GME were included in the full review, with over half published after 2020. ML interventions were used to teach both simple and complex tasks, often in heterogeneous learner groups. While deliberate practice and feedback were consistently reported features of ML in pediatrics, opportunities for improvement include clearly defining mastery, conducting learning over multiple sessions, presenting sufficient validity evidence for assessment tools, adhering to rigorous standard setting processes, and reporting psychometric data appropriate for ML.

Conclusion

In pediatric GME, ML approaches are in their infancy. By addressing common shortcomings in the existing literature, future efforts can improve the rigor of ML in pediatric training programs and its impact on learners and patients.

A Modern Diagnostic Procedure-The Introduction of Point-of-Care Ultrasound in Romanian Emergency Physicians' Daily Routine

BACKGROUND

Emergency medicine in Romania has developed fast since inception. The need for faster diagnostic capabilities due to the high workload pre- and in-hospital made point-of-care ultrasound (POCUS) a logical next step. The advantages of POCUS are well known, but implementation presents challenges. Our goal was to study how a straightforward method of implementation would work locally.

METHODS

Two prospective observational studies were conducted at 6 months (prehospital) and 4 months (in-hospital). The protocol used was extended focused assessment sonography in trauma (eFAST), and the shock index (SI) was used to stratify patients. Voluntary sampling was conducted by emergency physicians. The primary outcomes were patient numbers, type of case use, results, and accuracy.

RESULTS

The prehospital study registered 34 patients: 41% traumas, 35% cardiac arrest, 18% shock, and 6% acute respiratory distress. The in-hospital study patients were 78: 36% traumas, 6% cardiac arrests, 41% shock, and 17% acute respiratory distress. A total of 88.5% of the cases were confirmed with definitive imagistic findings.

CONCLUSION

The studies mark an increase in POCUS usage and use in complicated cases. Providing supervision and feedback into clinical practice resulted in a further increase in POCUS usage, the second study having an 88.5% accuracy when compared to the final diagnostic proving the increased efficiency of a longitudinal training approach.

Simulation Use in Respiratory Therapy Programs in Saudi Arabia: Results of a National Survey

Background

The use of simulation-based methods for teaching and learning in the education of health professions is increasing, but its prevalence in Saudi Arabia among respiratory therapy programs has yet to be investigated. The purpose of this study is to identify the use of simulation-based learning (SBL) in respiratory therapy programs in Saudi Arabia.

Methods

A cross-sectional study was performed by sending Google forms survey via Email to directors of respiratory therapy programs in Saudi Arabia (N=16) to evaluate how each one used simulations as an educational tool.

Results

The survey was returned with a total response of 12 out of all 16 program that were initially contacted (75% response rate). Among the respondents, approximately 75% of the programs are using SBL, while high-fidelity simulation is used by all programs. The present data show that 67% of the respiratory therapy programs has a space for simulation within the department, while 33% utilizes institutional simulation centers. For short simulation scenarios, debriefing is not conducted in 67% of the programs. There is acceptance by program directors that simulation hours should be counted towards clinical hours. About 67% of respondent programs have mandatory simulation learning activities, and 100% agree that simulations should be used more. However, lack of training and shortage of staff are among barriers to increase the use of SBL.

Conclusion

SBL is commonly used and relatively varied among respiratory therapy programs. However, it requires some improvements in several aspects, including the use of debriefing and increasing the number of properly trained staff.

A comparison of rapid cycle deliberate practice and traditional reflective debriefing on interprofessional team performance

BACKGROUND

In simulation-based education, debriefing is necessary to promote knowledge acquisition and skill application. Rapid Cycle Deliberate Practice (RCDP) and Traditional Reflective Debriefing (TRD) are based in learning theories of deliberate practice and reflective learning, respectively. In this study, we compared the effectiveness of TRD versus RCDP on acquisition of conceptual knowledge and teamwork skills among interdisciplinary learners in the pediatric emergency department.

METHODS

One hundred sixty-four learners including emergency department attending physicians, fellows, nurses, medical technicians, paramedics, and respiratory therapists, participated in 28 in-situ simulation workshops over 2 months. Groups were quasi-randomized to receive RCDP or TRD debriefing. Learners completed a multiple-choice test to assess teamwork knowledge. The TEAM Assessment Tool assessed team performance before and after debriefing. Primary outcomes were teamwork knowledge and team performance.

RESULTS

Average pre-intervention baseline knowledge assessment scores were high in both groups (TRD mean 90.5 (SD 12.7), RCDP mean 88.7 (SD 15.5). Post-test scores showed small improvements in both groups (TRD mean 93.2 (SD 12.2), RCDP mean 89.9 (SD 13.8), as indicated by effect sizes (ES = 0.21 and 0.09, for TRD and RCDP, respectively). Assessment of team performance demonstrated a significant improvement in mean scores from pre-assessment to post-assessment for all TEAM Assessment skills in both TRD and RCDP arms, based on p-values (all p < 0.01) and effect sizes (all ES > 0.8). While pre-post improvements in TEAM scores were generally higher in the RCDP group based on effect sizes, analysis did not indicate either debriefing approach as meaningfully improved over the other.

CONCLUSIONS

Our study did not demonstrate that either TRD versus RCDP was meaningfully better in teamwork knowledge acquisition or improving skill application and performance. As such, we propose Reflective Deliberate Practice as a framework for future study to allow learners to reflect on learning and practice in action.

Debriefing Methods for Simulation in Healthcare: A Systematic Review

ABSTRACT

Debriefing is a critical component in most simulation experiences. With the growing number of debriefing concepts, approaches, and tools, we need to understand how to debrief most effectively because there is little empiric evidence to guide us in their use. This systematic review explores the current literature on debriefing in healthcare simulation education to understand the evidence behind practice and clarify gaps in the literature. The PICO question for this review was defined as "In healthcare providers [P], does the use of one debriefing or feedback intervention [I], compared to a different debriefing or feedback intervention [C], improve educational and clinical outcomes [O] in simulation-based education?" We included 70 studies in our final review and found that our current debriefing strategies, frameworks, and techniques are not based on robust empirical evidence. Based on this, we highlight future research needs.

Nontechnical Skills for Intraoperative Team Members

Nontechnical skills, defined as the set of cognitive and social skills used by individuals and teams to reduce error and improve performance in complex systems, have become increasingly recognized as a key contributor to patient safety. Efforts to characterize, quantify, and teach nontechnical skills in the context of perioperative care continue to evolve. This review article summarizes the essential behaviors for safety, described in taxonomies for nontechnical skills assessments developed for intraoperative clinical team members (eg, surgeons, anesthesiologists, scrub practitioners, perfusionists). Furthermore, the authors describe emerging methods to advance understanding of the impact of nontechnical skills on perioperative outcomes.

How theories of complexity and resilience affect interprofessional simulation-based education: a qualitative analysis of facilitators' perspectives

BACKGROUND

Quality of care and patient safety rely on the ability of interprofessional teams to collaborate effectively. This can be trained through interprofessional simulation-based education (IPSE). Patient safety also relies on the ability to adapt to the complexity of such situations, an ability termed resilience. Since these needs are not explicitly addressed in IPSE, the aim of this study was to explore how central concepts from complexity-theory and resilience affect IPSE, from facilitators' perspective, when applied in debriefings.

METHODS

A set of central concepts in complexity-theory and resilience were introduced to facilitators on an IPSE course for nursing and medical students. In five iterations of focus groups interviews the facilitators discussed their application of these concepts by reviewing video recordings of their own debriefings. Video recordings of the interviews were subjected to coding and thematic analysis.

RESULTS

Three themes were identified. The first, Concepts of complexity and resilience are relevant for IPSE, points to the applicability of these concepts and to the fact that students often need to deviate from prescribed guidelines/algorithms in order to solve cases. The second theme, Exploring complexity, shows how uncertainty could be used as a cue to explore complexity. Further, that individual performance needs to account for the context of actions and how this may lead to certain outcomes. Moreover, it was suggested that several ways to approach a challenge can contribute to important insight in the conditions for teamwork. The third theme, Unpacking how solutions are achieved, turns to needs for handling the aforementioned complexity. It illustrates the importance of addressing self-criticism by highlighting how students were often able to overcome challenges and find solutions. Finally, this theme highlights how pre-defined guidelines and algorithms still work as important resources to help students in transforming perceived messiness into clarity.

CONCLUSIONS

This study suggests that IPSE provides the possibility to explore complexity and highlight resilience so that such capability can be trained and improved. Further studies are needed to develop more concrete ways of using IPSE to account for complexity and developing resilience capacity and to evaluate to what extent IPSE can provide such an effect.

Fostering Adaptive Expertise Through Simulation

Technology-enhanced simulation has been used to tackle myriad challenges within health professions education. Recently, work has typically adopted a mastery learning orientation that emphasizes trainees' sequential mastery of increasingly complex material. Doing so has privileged a focus on performance and task completion, as captured by trainees' observable behaviors and actions. Designing simulation in these ways has provided important advances to education, clinical care, and patient safety, yet also placed constraints around how simulation-based activities were enacted and learning outcomes were measured. In tracing the contemporary manifestations of simulation in health professions education, this article highlights several unintended consequences of this performance orientation and draws from principles of adaptive expertise to suggest new directions. Instructional approaches grounded in adaptive expertise in other contexts suggest that uncertainty, struggle, invention, and even failure help learners to develop deeper conceptual understanding and learn innovative approaches to novel problems. Adaptive expertise provides a new lens for simulation designers to think intentionally around how idiosyncrasy, individuality, and inventiveness could be enacted as central design principles, providing learners with opportunities to practice and receive feedback around the kinds of complex problems they are likely to encounter in practice. Fostering the growth of adaptive expertise through simulation will require a fundamental reimagining of the design of simulation scenarios, embracing the power of uncertainty and ill-defined problem spaces, and focusing on the structure and pedagogical stance of debriefing. Such an approach may reveal untapped potential within health care simulation.

The integrative feedback tool: assessing a novel feedback tool among emergency medicine residents

OBJECTIVE

Feedback is critical to the growth of learners. However, feedback quality can be variable in practice. Most feedback tools are generic, with few targeting emergency medicine. We created a feedback tool designed for emergency medicine residents, and this study aimed to evaluate the effectiveness of this tool.

METHODS

This was a single-center, prospective cohort study comparing feedback quality before and after introducing a novel feedback tool. Residents and faculty completed a survey after each shift assessing feedback quality, feedback time, and the number of feedback episodes. Feedback quality was assessed using a composite score from seven questions, which were each scored 1 to 5 points (minimum total score, 7 points; maximum, 35 points). Preintervention and postintervention data were analyzed using a mixed-effects model that took into account the correlation of random effects between study participants.

RESULTS

Residents completed 182 surveys and faculty members completed 158 surveys. The use of the tool was associated with improved consistency in the summative score of effective feedback attributes as assessed by residents (P=0.040) but not by faculty (P=0.259). However, most of the individual scores for attributes of good feedback did not reach statistical significance. With the tool, residents perceived that faculty spent more time providing feedback (P=0.040) and that the delivery of feedback was more ongoing throughout the shift (P=0.020). Faculty felt that the tool allowed for more ongoing feedback (P=0.002), with no perceived increase in the time spent delivering feedback (P=0.833).

CONCLUSION

The use of a dedicated tool may help educators provide more meaningful and frequent feedback without impacting the perceived required time needed to provide feedback.

Are we talking about practice? A randomized study comparing simulation-based deliberate practice and mastery learning to self-guided practice

OBJECTIVES

Simulation-based technical skills training is now ubiquitous in medicine, particularly for high acuity, low occurrence (HALO) procedures. Mastery learning and deliberate practice (ML + DP) are potentially valuable educational methods, however, they are resource intensive. We sought to compare the effect of deliberate practice and mastery learning versus self-guided practice on skill performance of the rare, life-saving procedure, a bougie-assisted cricothyroidotomy (BAC).

METHODS

We conducted a multi-center, randomized study at five North American emergency medicine (EM) residency programs. We randomly assigned 176 EM residents to either the ML + DP or self-guided practice groups. Three blinded airway experts independently evaluated BAC skill performance by video review before (pre-test), after (post-test) and 6-12 months (retention) after the training session. The primary outcome was post-test skill performance using a global rating score (GRS). Secondary outcomes included performance time and skill performance at the retention test.

RESULTS

Immediately following training, GRS scores were significantly higher as mean performance improved from pre-test, (22, 95% CI = 21-23) to post-test (27, 95% CI = 26-28), (p < 0.001) for all participants. However, there was no difference between the groups on GRS scores (p = 0.2) at the post-test or at the retention test (p = 0.2). At the retention test, participants in the ML + DP group had faster performance times (66 s, 95% CI = 57-74) compared to the self-guided group (77 s, 95% CI = 67-86), (p < 0.01).

CONCLUSIONS

There was no significant difference in skill performance between groups. Residents who received deliberate practice and mastery learning demonstrated an improvement in skill performance time.

Effect of rapid cycle deliberate practice in peripheral intravenous catheters insertion training: A simulation experimental study

AIM

to compare the effect of rapid cycle deliberate practice simulation training with skill-training simulation on peripheral intravenous catheter insertion for Licensed Practical Nurses.

BACKGROUND

The use of peripheral intravenous catheters is associated with high rates of complications, although it is widely used in clinical practice. Training strategies to ensure good performance can minimize the risks inherent to this procedure.

DESIGN

A randomized simulation experimental pre-post interventional study.

METHODS

Sixty participants were allocated to intervention (n = 30) or control (n = 30) groups. Participants allocated to the intervention group were trained through the Rapid cycle deliberate practice simulation strategy, while participants in the control group were trained through the skill-training simulation strategy. A pre-test was applied before any intervention and a post-test after intervention. The primary outcome was the performance in the peripheral intravenous catheter insertion skill. The comparison of correct performance in the tests was analyzed intergroup and intragroup. The effect size of the interventions was also analyzed. The t-Student and Mann-Whitney tests compared the difference between the groups. The training effect was calculated by Cohen's dm and Glass's Δ measures.

RESULTS

Performance between the pre-post-test increased from 59.4% to 96% (p < 0.001) in the intervention group and from 57.8% to 93.5% in the control group (p < 0001). There was no statistical difference between the groups after intervention (p = 0225). Cohen's dm measurement was 2.95 and 3.59 in the control and intervention groups, respectively.

CONCLUSIONS

The rapid cycle deliberate practice simulation strategy resulted in Licensed Practical Nurses' performance improvements in peripheral intravenous catheter insertion, evidenced by the increase of correct performance actions in the post-test compared to the pre-test. However, with no statistical difference compared to the skill-training simulation strategy.

Emergency Point-of-Care Ultrasound Stewardship - A Joint Position Paper by EuSEM and EFSUMB and Endorsed by IFEM and WFUMB

Emergency Medicine Point-of-Care Ultrasound (EMPoCUS) is a convincing concept. It has spread rapidly because of its intuitive, simple applicability and low equipment costs. The speed of its emerging growth frequently outpaces the development of quality assurance and education. Indeed, education standards vary worldwide, and in some cases seem to neglect the principles of modern competence-based education. Additional challenges are encountered such as remote or low resource medical practice. Here, EMPoCUS might be the only ad-hoc imaging modality available. Once mastery of EMPoCUS is achieved, emergency physicians should be able to independently and efficiently care for their patients using a variety of PoCUS skills. However, most curricula only define these tasks as non-binding and in general terms or use outdated measures, such as length of training and self-reporting of achieved examinations with variable oversight, or administrative measures to create educational milestones. This threatens to take quality assurance down the wrong path. It created a scenario in which concrete EMPoCUS skill outcome measures that would realistically reflect the training objectives and simultaneously would be easily observable and verifiable are lacking. In view of the dangers of poorly controlled EMPoCUS dissemination and the current lack of European guidelines, we would like to set central standards for European EMPoCUS stewardship based on a critical review of the current situation. This position paper, which was jointly developed by EuSEM and EFSUMB and endorsed by IFEM and WFUMB, is also intended to accompany the EFSUMB/EuSEM guidelines on PoCUS currently being prepared for publication.

Necessity of Pretests in Central Venous Catheter Insertion Simulation-Based Mastery Learning: A Randomized Controlled Trial

PURPOSE

Simulation-based mastery learning (SBML) is a rigorous form of competency-based learning. Components of SBML include a pretest, deliberate practice, and a posttest; all learners must meet or exceed a minimum passing standard (MPS) on the posttest before completing training. The authors aimed to explore whether a modified SBML curriculum (without a pretest assessment) was as effective as the standard SBML curriculum (with a pretest assessment).

METHOD

The authors performed a randomized controlled trial of internal medicine residents who participated in an internal jugular central venous catheter insertion SBML curriculum at a tertiary care academic medical center in Chicago, Illinois, from December 2018 through December 2021. Residents were randomly assigned to complete the usual SBML intervention (pretest group) or to complete a modified SBML intervention without a pretest (no pretest group). The authors compared initial posttest performance and training time between groups.

RESULTS

Eighty-nine of 120 eligible residents (74.1%) completed the study: 43 in the pretest group and 46 in the no pretest group. Median (IQR) initial posttest scores were not statistically different between the pretest group (96.6 [93.1-100]) and the no pretest group (96.6 [92.4-100]). However, all 43 residents (100%) in the pretest group reached the MPS at the initial posttest compared with 41 of the 46 (89%) in the no pretest group ( P = .06). Residents in the pretest group required 16.5 hours more faculty and learning time than the no pretest group.

CONCLUSIONS

More residents who completed a pretest reached the MPS at initial posttest. However, incorporating a pretest during the internal jugular central venous catheter SBML curriculum required substantially more learner and faculty time without clear performance benefits.

Coaching the coach: A randomized controlled study of a novel curriculum for procedural coaching during intubation

Background

Videolaryngoscopy allows real-time procedural coaching during intubation. This study sought to develop and assess an online curriculum to train pediatric emergency medicine attending physicians to deliver procedural coaching during intubation.

Methods

Curriculum development consisted of semistructured interviews with 12 pediatric emergency medicine attendings with varying levels of airway expertise analyzed using a constructivist grounded theory approach. Following development, the curriculum was implemented and assessed through a multicenter randomized controlled trial enrolling participants in one of three cohorts: the coaching module, unnarrated video recordings of intubations, and a module on ventilator management. Participants completed identical pre and post assessments asking them to select the correct coaching feedback and provided reactions for qualitative thematic analysis.

Results

Content from interviews was synthesized into a video-enhanced 15-min online coaching module illustrating proper technique for intubation and strategies for procedural coaching. Eighty-seven of 104 randomized physicians enrolled in the curriculum; 83 completed the pre and post assessments (80%). The total percentage correct did not differ between pre and post assessments for any cohort. Participants receiving the coaching module demonstrated improved performance on patient preparation, made more suggestions for improvement, and experienced a greater increase in confidence in procedural coaching. Qualitative analysis identified multiple benefits of the module, revealed that exposure to video recordings without narration is insufficient, and identified feedback on suggestions for improvement as an opportunity for deliberate practice.

Conclusions

This study leveraged clinical and educational digital technology to develop a curriculum dedicated to the content expertise and coaching skills needed to provide feedback during intubations performed with videolaryngoscopy. This brief curriculum changed behavior in simulated coaching scenarios but would benefit from additional support for deliberate practice.

An integrated pre-clerkship curriculum to build cognitive medical schema: It's not just about the content

Both physiology and pathophysiology are essential disciplines in health professional education however, clinicians do not use this knowledge in isolation. Instead, physicians use inter-disciplinary concepts embedded within integrated cognitive schema (illness scripts) established through experience/knowledge that manifest as expert-level thinking. Our goal was to develop a pre-clerkship curriculum devoid of disciplinary boundaries (akin to the physician's illness script) and enhance learners' clerkship and early clinical performance. As well as developing curricular content, the model considered non-content design elements such as learner characteristics and values, faculty and resources and the impact of curricular and pedagogical changes. The goals of the trans-disciplinary integration were to develop deep learning behaviors through, 1) developing of integrated, cognitive schema to support the transition to expert-level thinking, 2) authentic, contextualization to promote knowledge transfer to the clinical realm 3) allowing autonomous, independent learning, and 4) harnessing the benefits of social learning. The final curricular model was a case-based approach with independent learning of basic concepts, differential diagnosis and illness scripting writing, and concept mapping. Small-group classroom sessions were team-taught with basic scientists and physicians facilitating learners' self-reflection and development of clinical reasoning. Specifications grading was used to assess the products (written illness scripts and concept maps) as well as process (group dynamics) while allowing a greater degree of learner autonomy. Although the model we adopted could be transferred to other program settings, we suggest it is critical to consider both content and non-content elements that are specific to the environment and learner.

Simulation Based Mastery Learning of Transesophageal Echocardiography

Transesophageal echocardiography (TEE) education is part of pediatric cardiology fellow training. Simulation-based mastery learning (SBML) is an efficient and valuable education experience. The aim of this project was to equip trainees with the basic knowledge and skill required to perform a pediatric TEE. The secondary aim was to assess the utility of using SBML for pediatric TEE training. The target group is trainees from pediatric cardiology and cardiac anesthesia who participated in a TEE bootcamp. A baseline knowledge pretest was obtained. The knowledge session consisted of preparation via reading material, viewing recorded lectures and completing an iterative multiple-choice examination, which was repeated until a minimum passing score of 90% was achieved. The skills session involved a review of TEE probe manipulation and image acquisition, followed by rapid cycle deliberate practice using simulation to acquire TEE skills at 3 levels, advancing in complexity from level 1 to level 3. Eight individuals (7 pediatric cardiology fellows at varying training levels and one anesthesia attending) participated in the TEE bootcamp. All reached a minimum knowledge post test score of at least 90% before the skills session. All subjects reached mastery in TEE probe manipulation. All reached mastery in image acquisition for the skill level that they attempted (level 1-8/8, level 2-8/8, level 3-4/4, with 4 participants not attempting level 3). A TEE bootcamp using SBML is a powerful medical education strategy. SBML is a rigorous approach that can be used to achieve high and uniform TEE learning outcomes among trainees of different training levels and backgrounds.

Simulation-based Mastery Learning Improves Emergency Medicine Residents' Ability to Perform Temporary Transvenous Cardiac Pacing

INTRODUCTION

Temporary transvenous cardiac pacing (TVP) is a critical intervention that emergency physicians perform infrequently in clinical practice. Prior simulation studies revealed that emergency medicine (EM) residents and board-certified emergency physicians perform TVP poorly during checklist-based assessments. Our objective in this report was to describe the design and implementation of a simulation-based mastery learning (SBML) curriculum and evaluate its impact on EM residents' ability to perform TVP.

METHODS

An expert panel of emergency physicians and cardiologists set a minimum passing standard (MPS) for a previously developed 30-item TVP checklist using the Mastery Angoff approach. Emergency medicine residents were assessed using this checklist and a high-fidelity TVP task trainer. Residents who did not meet the MPS during baseline testing viewed a procedure video and completed a 30-minute individual deliberate practice session before retesting. Residents who did not meet the MPS during initial post-testing completed additional deliberate practice and assessment until meeting or exceeding the MPS.

RESULTS

The expert panel set an MPS of correctly performing 28 (93.3%) checklist items. Fifty-seven EM residents participated. Mean checklist scores improved from 13.4 (95% CI 11.8-15.0) during baseline testing to 27.5 (95% CI 26.9-28.1) during initial post-testing (P < 0.01). No residents met the MPS at baseline testing. The 21 (36.8%) residents who did not meet the MPS during initial post-testing all met or exceeded the MPS after completing one additional 30-minute deliberate practice session.

CONCLUSION

Emergency medicine residents demonstrated significantly improved TVP performance with reduced variability in checklist scores after completing a simulation-based mastery learning curriculum.

Emotional Activation in Simulation: Measuring the Influence of Participant Roles and Scenario Design

INTRODUCTION

The degree of emotional activation required for optimal learning in either hands-on or observer roles is unclear, as is the level of stress that impedes learning. Measuring emotional activation is time-consuming, and many scales measure threat or anxiety without considering pleasurable activation. This study examined emotional activation in the observer and hands-on roles in 2 different scenario designs.

METHODS

This study was a 2-cohort, parallel study of graduate nurses and doctors completing 2 different courses in managing the deteriorating patient. We examined emotional activation by role across 2 scenario designs. We measured emotional activation on 3 anchored measures scales: the State Trait Anxiety Inventory, Cognitive Appraisal Index, and the Affect Grid with data analysis using analysis of variance and repeated measures.

RESULTS

Hands-on learners experienced higher anxiety, threat, and arousal levels and less pleasure than observers in both scenario designs. There were no differences in pre-emotional and postemotional activation in immersive scenarios for either role and increased arousal and decreased threat and anxiety in the hands-on role in the pause-and-discuss scenario design.

CONCLUSIONS

Hands-on learners were more emotionally activated than observers in both scenario designs. There was significant perceived anxiety, threat, and pleasurable arousal in both roles and both scenario designs. Pause-and-discuss scenarios demonstrated similar levels of activation as the immersive scenario design. The Affect Grid provided a quick subjective view of arousal and pleasure in simulation participants, potentially providing educators with an indication of whether emotional activation is positive (excitement) or negative (stressful) and may be helpful in educational planning and future research.

Teaching, coaching, or debriefing With Good Judgment: a roadmap for implementing "With Good Judgment" across the SimZones

Simulation-based learning occurs in multiple contexts, and one teaching style cannot adequately cover the needs at each learning level. For example, reflective debriefing, often used following a complex simulation case, is not what is needed when learning new skills. When to use which facilitation style is a question that educators often overlook or struggle to determine. SimZones is a framework used to clarify the multiple contexts in simulation. This framework, combined with elements of Debriefing With Good Judgment, can help educators match the appropriate facilitation style with learner needs and learning context. We have distilled the core elements of the "with good judgment" approach to debriefing and applied them to the SimZones framework to guide educators with (1) what type of learning can be expected with each learning context, (2) what behaviors and activities can be expected of the learners in each learning context, (3) what instructional strategies are most effectively used at each stage, and (4) what are the implications for the teacher-learner relationship.

Cardiopulmonary Resuscitation Training for Healthcare Professionals: A Scoping Review

SUMMARY STATEMENT

The optimal strategy for training cardiopulmonary resuscitation (CPR) for healthcare professionals remains to be determined. This scoping review aimed to describe the emerging evidence for CPR training for healthcare professionals.We screened 7605 abstracts and included 110 studies in this scoping review on CPR training for healthcare professionals. We assessed the included articles for evidence for the following topics: training duration, retraining intervals, e-learning, virtual reality/augmented reality/gamified learning, instructor-learner ratio, equipment and manikins, other aspects of contextual learning content, feedback devices, and feedback/debriefing. We found emerging evidence supporting the use of low-dose, high-frequency training with e-learning to achieve knowledge, feedback devices to perform high-quality chest compressions, and in situ team simulations with debriefings to improve the performance of provider teams.

Simulation-based procedure training (SBPT) in rarely performed procedures: a blueprint for theory-informed design considerations

Simulation-based procedure training is now integrated within health professions education with literature demonstrating increased performance and translational patient-level outcomes. The focus of published work has been centered around description of such procedural training and the creation of realistic part-task models. There has been little attention with regards to design consideration, specifically around how simulation and educational theory should directly inform programme creation. Using a case-based approach in cardiology as an example, we present a blueprint for theory-informed simulation-based procedure training linking learning needs analysis and defining suitable objectives to matched fidelity. We press the importance of understanding how to implement and utilise task competence benchmarking in practice, and the role of feedback and debriefing in cycles of repeated practice. We conclude with evaluation and argue why this should be considered part of the initial design process rather than an after-thought following education delivery.

Effective competency-based medical education requires learning environments that promote a mastery goal orientation: A narrative review

PURPOSE

Competency-based medical education (CBME) emphasizes the need for learners to be central to their own learning and to take an active role in learning. This approach has a dual aim: to encourage learners to actively engage in their own learning, and to push learners to develop learning strategies that will prepare them for lifelong learning. This review paper proposes a theoretical bridge between CBME and lifelong learning and puts forth the argument that in order for CBME programs to produce the physicians truly needed in our society now and in the future, learning environments must be intentionally designed to foster mastery goal orientations and to support the development of adaptive self-regulated learning skills and behaviours.

MATERIALS AND METHODS

This narrative literature review incorporated results of searches conducted by a subject librarian in PsycInfo and MedLine. Articles were also identified through reference lists of identified papers to capture older key citations. Analysis of the literature used a constructivist epistemological approach to develop an integrative description of the interaction of achievement goal orientation, self-regulated learning, learning environment, and lifelong learning.

RESULTS

Findings from achievement goal theory research support the assumption that adoption of a mastery goal orientation facilitates the use of adaptive learning behaviours, such as those described in self-regulated learning theory. Adaptive self-regulated learning strategies, in turn, facilitate effective lifelong learning. The authors offer evidence for how learning environments influence goal orientations and self-regulated learning, and propose that CBME programs intentionally plan for such learning environments. Finally, the authors offer specific suggestions and examples for how learning environments can be designed or adjusted to support adoption of a mastery goal orientation and use of self-regulated learning behaviours and strategies to help support development of adaptive lifelong learners.

Understanding Learners' Metacognition of Online Teacher Feedback Amid COVID-19: A Case Study in a University Livestream Instruction Context

While research on metacognition in second language (L2) learning has burgeoned in the past two decades, its relation to actual teaching behaviors, such as teacher feedback, remains to be fully described and explained in L2 classroom, especially in livestream English teaching settings. To fill this gap, this case study examined how learners utilize and regulate metacognition of online teacher feedback during COVID-19 in a Chinese inner land university. Data were gathered through semi-structured interviews. With qualitative and interpretive analysis, it is revealed that leaners positively receive online teacher feedback for its detrimentalness together with a growth mindset and high levels of resilience, but, on the whole, there is a metacognitive deficit: they misinterpret self-consciousness about online feedback which is underpinned by a conception of tasks that characterizes online L2 learning. This research expands our understanding of L2 learning processes pertaining to awareness and management of teacher feedback receiving and may also shed light on solutions to empower livestream teaching by building external scaffolding devices to compensate weaknesses of online L2 education during the pandemic and beyond.

Cross-cultural validation and psychometric testing of the Debriefing Experience Scale (DES): a cross-sectional study

BACKGROUND

The Debriefing Experience Scale (DES) is a tool that is used to explore nursing students' subjective experiences during a debriefing and to help determine best debriefing practices. A Chinese version of the scale has not been found; its development can enhance learning in simulation activites in Chinese healthcare education programs.

METHODS

A simplified Chinese version of the DES was developed and tested using 34 Chinese undergraduate (second year) nursing students. They participated in six simulation scenarios and debriefings. Eight experts were consulted to determine the content validity of the scale. Critical ratio method, Cronbach's alpha, intraclass correlation coefficient, correlation coefficient and factor analysis were used in testing the psychometric properties of the scale.

RESULTS

Analysis of 200 scales showed that the simplified Chinese version of the DES had good potential in discriminatiing Chinese nursing students' experiences of debriefing.

CONCLUSIONS

The simplified Chinese DES was effective in evaluating the experience of debriefing. A larger sample size and multicenter research is needed to confirm these findings.

[Best practice-example of a paramedic competence system in the context of user and patient safety: the Reutlinger Weg]

The discussion about the competencies and responsibilities of paramedics has been going on for decades and is the subject of controversial legal debates and currently the focus of political attention due to the heterogeneous country-specific design. However, there are only a few published examples of a so-called competency system for the safe and effective use of prehospital emergency medicine interventions. The practical experience of a competence system is presented. Adequate education and training are crucial for development of competence. A physician-supported quality assurance system creates the opportunity to confirm the competencies of paramedics within the framework of competence checks, monitor the system by means of indicators, and detect weak points at an early stage. Safety culture must be exemplified. Standard operating procedures (SOPs) are the guideline for implementation. In a competence system, certified paramedics can be granted authorization and thus contribute to rapid and efficient patient care, while keeping emergency physicians available for indications requiring their competencies.

How to train thoracic anesthesia for residents and consultants?

PURPOSE OF REVIEW

The training of anesthesiologists in thoracic surgery is a significant challenge. International professional societies usually provide only a case number-based or time-based training concept. There are only a few concepts of simulation trainings in thoracic anesthesia and interprofessional debriefings on a daily basis are rarely applied. In this review, we will show how professional curricula should aim for competence rather than number of cases and why simulation-based training and debriefing should be implemented.

RECENT FINDINGS

Recent curricula recommend so-called entrustable professional activities (EPAs)as a way out of the dilemma between the number of cases vs. competence. With these EPAs, competence can be mapped and prerequisites defined.Training concepts from simulation in healthcare have so far not explicitly reached anesthesia for thoracic surgery. In addition to mere technical training, combined technical-behavioral training forms have proven to be an effective training targeting the entire team in the context of the actual working environment in the operating theatre.

SUMMARY

Interdisciplinary and interprofessional learning can take place in simulation trainings and on a daily basis through postevent debriefings. When these debriefings are conducted in a structured way, an improvement in the performance of the entire team can be the result. The basis for these debriefings - as well as for other training approaches - is psychological safety, which should be established and maintained together with all professions involved.

An Investigation on the Perceptions of Practicing Interdisciplinary Health Professionals on Rapid Cycle Deliberate Practice Simulation

INTRODUCTION

Rapid cycle deliberate practice (RCDP) is a relatively new method for delivering simulation for a structured algorithm-based clinical content. We sought to understand how a group of practicing emergency medicine healthcare professionals would perceive RCDP as a learning method.

METHODS

This was a qualitative study of participants' reactions to RCDP simulation during an orientation process to a new freestanding emergency department using grounded theory. Focus groups were held after simulation sessions to investigate the participants reactions to RCDP as well as the experience of multiple professions participating. Two investigators independently coded the focus group transcripts to detect themes and developed a list of codes, which were then confirmed by consensus. Data were organized into themes with contributing codes.

RESULTS

Thirty-one individuals participated in the focus groups including physicians, nurse practitioners, nurses, respiratory therapists, and patient care technicians. Four themes were detected: the procedural components of RCDP, the behavioral response to RCDP, learning through RCDP, and RCDP as interprofessional experience. The participants view of emotions and interruptions and pauses had discrepant interpretation.

CONCLUSIONS

Participants received RCDP simulation positively. Initial negative reactions to the interruptions and pauses of RCDP dissipated as the simulation progressed. Ultimately, learners agreed that RCDP was extremely effective as compared with traditional simulation for medical resuscitation training because of the authenticity of the multidisciplinary aspect. This suggests that RCDP may be an effective tool for continuing education of practicing healthcare professionals.

Effect of Artificial Intelligence Tutoring vs Expert Instruction on Learning Simulated Surgical Skills Among Medical Students: A Randomized Clinical Trial

IMPORTANCE

To better understand the emerging role of artificial intelligence (AI) in surgical training, efficacy of AI tutoring systems, such as the Virtual Operative Assistant (VOA), must be tested and compared with conventional approaches.

OBJECTIVE

To determine how VOA and remote expert instruction compare in learners' skill acquisition, affective, and cognitive outcomes during surgical simulation training.

DESIGN, SETTING, AND PARTICIPANTS

This instructor-blinded randomized clinical trial included medical students (undergraduate years 0-2) from 4 institutions in Canada during a single simulation training at McGill Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal, Canada. Cross-sectional data were collected from January to April 2021. Analysis was conducted based on intention-to-treat. Data were analyzed from April to June 2021.

INTERVENTIONS

The interventions included 5 feedback sessions, 5 minutes each, during a single 75-minute training, including 5 practice sessions followed by 1 realistic virtual reality brain tumor resection. The 3 intervention arms included 2 treatment groups, AI audiovisual metric-based feedback (VOA group) and synchronous verbal scripted debriefing and instruction from a remote expert (instructor group), and a control group that received no feedback.

MAIN OUTCOMES AND MEASURES

The coprimary outcomes were change in procedural performance, quantified as Expertise Score by a validated assessment algorithm (Intelligent Continuous Expertise Monitoring System [ICEMS]; range, -1.00 to 1.00) for each practice resection, and learning and retention, measured from performance in realistic resections by ICEMS and blinded Objective Structured Assessment of Technical Skills (OSATS; range 1-7). Secondary outcomes included strength of emotions before, during, and after the intervention and cognitive load after intervention, measured in self-reports.

RESULTS

A total of 70 medical students (41 [59%] women and 29 [41%] men; mean [SD] age, 21.8 [2.3] years) from 4 institutions were randomized, including 23 students in the VOA group, 24 students in the instructor group, and 23 students in the control group. All participants were included in the final analysis. ICEMS assessed 350 practice resections, and ICEMS and OSATS evaluated 70 realistic resections. VOA significantly improved practice Expertise Scores by 0.66 (95% CI, 0.55 to 0.77) points compared with the instructor group and by 0.65 (95% CI, 0.54 to 0.77) points compared with the control group (P < .001). Realistic Expertise Scores were significantly higher for the VOA group compared with instructor (mean difference, 0.53 [95% CI, 0.40 to 0.67] points; P < .001) and control (mean difference. 0.49 [95% CI, 0.34 to 0.61] points; P < .001) groups. Mean global OSATS ratings were not statistically significant among the VOA (4.63 [95% CI, 4.06 to 5.20] points), instructor (4.40 [95% CI, 3.88-4.91] points), and control (3.86 [95% CI, 3.44 to 4.27] points) groups. However, on the OSATS subscores, VOA significantly enhanced the mean OSATS overall subscore compared with the control group (mean difference, 1.04 [95% CI, 0.13 to 1.96] points; P = .02), whereas expert instruction significantly improved OSATS subscores for instrument handling vs control (mean difference, 1.18 [95% CI, 0.22 to 2.14]; P = .01). No significant differences in cognitive load, positive activating, and negative emotions were found.

CONCLUSIONS AND RELEVANCE

In this randomized clinical trial, VOA feedback demonstrated superior performance outcome and skill transfer, with equivalent OSATS ratings and cognitive and emotional responses compared with remote expert instruction, indicating advantages for its use in simulation training.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT04700384.

Simulation and Active Learning Decreases Training Time of an Emergency Triage Assessment and Treatment Course in Pilot Study in Malawi: Implications for Increasing Efficiency and Workforce Capacity in Low-Resource Settings

OBJECTIVES

The aim of the Emergency Triage Assessment and Treatment (ETAT) plus trauma course is to improve the quality of care provided to infants and children younger than 5 years. The curriculum was revised and shortened from 5 to 2.5 days by enhancing simulation and active learning opportunities. The aim of this study was to examine the feasibility and value of the new short-form ETAT course by assessing postcourse knowledge and satisfaction.

METHODS

We delivered the short-form ETAT course to a group of interdisciplinary health workers in Malawi. Precourse and postcourse knowledge was assessed using a standardized 20 questions short answer test used previously in the 5-day courses. A 13-statement survey with 2 open-ended questions was used to examine participant satisfaction.

RESULTS

Participants' postcourse knowledge improved significantly (P < 0.001) after the shorter ETAT course. Participants reported high levels of satisfaction with the short-form ETAT.

CONCLUSIONS

Simulation and other active learning strategies reduced training time by 50% in the short-form ETAT course. Participants with and without previous ETAT training improved their knowledge after participating in the short-form ETAT course. Reduced training time is beneficial in settings already burdened by scarce human resources, may facilitate better access to in-service training, and build capacity while conserving resources in low-resource settings.

Examining the Role of Structured Debriefing in Simulator-Based Clinical Skills Training for Namibian Veterinary Students: A Pilot Study

Post-event debriefing has been described as an effective tool in improving learning achievements in simulator-based teaching. This article examines the effect of structured post-event debriefing sessions in simulator-based veterinary clinical skills training. Nineteen Namibian veterinary students took part in instructor-led practice, self-directed practice with structured post-event debriefing and self-directed practice without debriefing (control) at three different learning stations in a veterinary clinical skills laboratory. Students evaluated their practice experience using Likert-type scales, and learning achievements were assessed using an objective structured clinical examination (OSCE). The results show that the choice of practice model had no significant effect on learning achievements overall. However, at individual learning stations, different practice models showed significant differences regarding effect on learning achievements. Students generally preferred practice sessions with some form of instructor involvement but the importance of instructor guidance was rated differently at each individual learning station.

Best Practices and Theoretical Foundations for Simulation Instruction Using Rapid-Cycle Deliberate Practice

STATEMENT

Rapid-cycle deliberate practice (RCDP) is a learner-centered simulation instructional strategy that identifies performance gaps and targets feedback to improve individual or team deficiencies. Learners have multiple opportunities to practice observational, deductive, decision-making, psychomotor, and crisis resource management skills. As its implementation grows, simulationists need to have a shared mental model of RCDP to build high-quality RCDP-based initiatives. To compare and make general inferences from RCDP data, each training needs to follow a similar structure. This article seeks to describe the fundamentals of RCDP, including essential components and potential variants. We also summarize the current published evidence regarding RCDP's effectiveness. This article serves to create a shared understanding of RCDP, provide clear definitions and classifications for RCDP research, and provide options for future RCDP investigation.

Recommendations and Guidelines for the Use of Simulation to Address Structural Racism and Implicit Bias

SUMMARY STATEMENT

Simulation-based education is a particularly germane strategy for addressing the difficult topic of racism and implicit bias due to its immersive nature and the paradigm of structured debriefing. Researchers have proposed actionable frameworks for implicit bias education, particularly outlining the need to shift from recognition to transformation, with the goal of changing discriminatory behaviors and policies. As simulation educators tasked with training health care professionals, we have an opportunity to meet this need for transformation. Simulation can shift behaviors, but missteps in design and implementation when used to address implicit bias can also lead to negative outcomes. The focus of this article is to provide recommendations to consider when designing simulation-based education to specifically address racism and implicit bias.

Qualities of Effective Vital Anaesthesia Simulation Training Facilitators Delivering Simulation-Based Education in Resource-Limited Settings

BACKGROUND

Lack of access to safe and affordable anesthesia and surgical care is a major contributor to avoidable death and disability across the globe. Effective education initiatives are a viable mechanism to address critical skill and process gaps in perioperative teams. Vital Anaesthesia Simulation Training (VAST) aims to overcome barriers limiting widespread application of simulation-based education (SBE) in resource-limited environments, providing immersive, low-cost, multidisciplinary SBE and simulation facilitator training. There is a dearth of knowledge regarding the factors supporting effective simulation facilitation in resource-limited environments. Frameworks evaluating simulation facilitation in high-income countries (HICs) are unlikely to fully assess the range of skills required by simulation facilitators working in resource-limited environments. This study explores the qualities of effective VAST facilitators; knowledge gained will inform the design of a framework for assessing simulation facilitators working in resource-limited contexts and promote more effective simulation faculty development.

METHODS

This qualitative study used in-depth interviews to explore VAST facilitators' perspectives on attributes and practices of effective simulation in resource-limited settings. Twenty VAST facilitators were purposively sampled and consented to be interviewed. They represented 6 low- and middle-income countries (LMICs) and 3 HICs. Interviews were conducted using a semistructured interview guide. Data analysis involved open coding to inductively identify themes using labels taken from the words of study participants and those from the relevant literature.

RESULTS

Emergent themes centered on 4 categories: Persona, Principles, Performance and Progression. Effective VAST facilitators embody a set of traits, style, and personal attributes (Persona) and adhere to certain Principles to optimize the simulation environment, maximize learning, and enable effective VAST Course delivery. Performance describes specific practices that well-trained facilitators demonstrate while delivering VAST courses. Finally, to advance toward competency, facilitators must seek opportunities for skill Progression.Interwoven across categories was the finding that effective VAST facilitators must be cognizant of how context, culture, and language may impact delivery of SBE. The complexity of VAST Course delivery requires that facilitators have a sensitive approach and be flexible, adaptable, and open-minded. To progress toward competency, facilitators must be open to self-reflection, be mentored, and have opportunities for practice.

CONCLUSIONS

The results from this study will help to develop a simulation facilitator evaluation tool that incorporates cultural sensitivity, flexibility, and a participant-focused educational model, with broad relevance across varied resource-limited environments.

Incorporating Rapid Cycle Deliberate Practice Cardiac Arrest Simulation Program Into Nursing Staff Continuing Professional Development

BACKGROUND

The Rapid Cycle Deliberate Practice (RCDP) is an innovative team-based simulation method that has been shown to be effective particularly in cardiac arrest education. Via a partnership between an educational institution and a hospital, the RCDP cardiac arrest simulation program was developed to improve nurses' cardiac arrest response preparation.

METHOD

A pre- and posttest educational intervention study design was used. Participants included staff nurses (n = 89) who underwent a 2-hour RCDP simulation. The adapted version of the Simulation Effectiveness Tool-Modified and a five-question pre- and posttest knowledge survey were used to assess the effectiveness of the intervention.

RESULTS

The simulation program increased participants' knowledge of cardiac arrest response (p < .05) and improved their confidence in communication (p = .036) and assessment skills (p = .029).

CONCLUSION

The RCDP cardiac arrest simulation is an effective strategy for increasing nurses' confidence and knowledge in cardiopulmonary resuscitation delivery. [J Contin Educ Nurs. 2021;52(6):274-279.].

Student Performance During a Simulated Patient Encounter Has No Impact on Debriefer Adherence to PEARLS Debriefing Model

PURPOSE

Debriefing is necessary for effective simulation education. The PEARLS (Promoting Excellence and Reflective Learning in Simulations) is a scripted debriefing model that incorporates debriefing best practices. It was hypothesized that student simulation performance might impact facilitator adherence to the PEARLS debriefing model. There are no published findings on the effect of student performance on debriefer behavior.

METHODS

Third-year medical students participated in a video-recorded, formative simulation to treat a high-fidelity mannequin for an asthma exacerbation. A faculty debriefer trained in the PEARLS model evaluated student performance with a standardized rubric and conducted a recorded debriefing. Debriefing recordings were analyzed for debriefer adherence to the PEARLS model. Debriefers were assigned a debriefing score (DS) from 0 to 13; 13 was perfect adherence to the model. Definitive intervention (DI) for asthma exacerbation was defined as bronchodilator therapy. Critical actions were as follows: a focused history, heart/lung exam, giving oxygen, and giving a bronchodilator.

RESULTS

Mean DS for the debriefers of students who provided DI was 8.57; 9.14 for those students who did not (P = 0.25). Mean DS for debriefers of students who completed all critical actions was 8.68; 8.52 for those students who did not (P = 0.62). Analysis of elapsed time to DI showed no relationship between the time DI was provided and DS.

CONCLUSIONS

Student performance had no impact on debriefer performance, suggesting the PEARLS model is an effective aid for debriefers, regardless of learner performance. These findings suggest student performance may not bias facilitators' ability to conduct quality debriefings.

A Microdebriefing Crisis Resource Management Program for Simulated Pediatric Resuscitation in a Community Hospital: A Feasibility Study

INTRODUCTION

Crisis Resource Management (CRM) is a team training tool used in healthcare to enhance team performance and improve patient safety. Our program intends to determine the feasibility of high-fidelity simulation for teaching CRM to an interprofessional team in a community hospital and whether a microdebriefing intervention can improve performance during simulated pediatric resuscitation.

METHODS

We conducted a single-center prospective interventional study with 24 teams drawn from 4 departments. The program was divided into an initial assessment simulation case (pre), a 40-minute microdebriefing intervention, and a final assessment simulation case (post). Post and pre results were analyzed for each team using t tests and Wilcoxon signed-rank tests. Primary outcome measures included (a) completion of program, (b) percent enrollment, (c) participant reaction, and (d) support of continued programs on completion. Secondary outcomes included (a) change in teamwork performance, measured by the Clinical Teamwork Scale; (b) change in time to initiation of chest compressions and defibrillation; and (c) pediatric advanced life support adherence, measured by the Clinical Performance Tool.

RESULTS

We successfully completed a large-scale training program with high enrollment. Twenty-four teams with 162 participants improved in Clinical Teamwork Scale scores (42.8%-57.5%, P < 0.001), Clinical Performance Tool scores (61.7%-72.1%, P < 0.001), and time to cardiopulmonary resuscitation initiation (70.6-34.3 seconds, P < 0.001).

CONCLUSIONS

Our center ran a well-attended, well-received interprofessional program in a community hospital site demonstrating that teaching CRM skills can improve simulated team performance in a diverse experienced cohort.

"A debriefer must be neutral" and other debriefing myths: a systemic inquiry-based qualitative study of taken-for-granted beliefs about clinical post-event debriefing

BACKGROUND

The goal of this study was to identify taken-for-granted beliefs and assumptions about use, costs, and facilitation of post-event debriefing. These myths prevent the ubiquitous uptake of post-event debriefing in clinical units, and therefore the identification of process, teamwork, and latent safety threats that lead to medical error. By naming these false barriers and assumptions, the authors believe that clinical event debriefing can be implemented more broadly.

METHODS

We interviewed an international sample of 37 clinicians, educators, scholars, researchers, and healthcare administrators from hospitals, universities, and healthcare organizations in Western Europe and the USA, who had a broad range of debriefing experience. We adopted a systemic-constructivist approach that aimed at exploring in-depth assumptions about debriefing beyond obvious constraints such as time and logistics and focused on interpersonal relationships within organizations. Using circular questions, we intended to uncover new and tacit knowledge about barriers and facilitators of regular clinical debriefings. All interviews were transcribed and analyzed following a comprehensive process of inductive open coding.

RESULTS

In total, 1508.62 min of interviews (25 h, 9 min, and 2 s) were analyzed, and 1591 answers were categorized. Many implicit debriefing theories reflected current scientific evidence, particularly with respect to debriefing value and topics, the complexity and difficulty of facilitation, the importance of structuring the debriefing and engaging in reflective practice to advance debriefing skills. We also identified four debriefing myths which may prevent post-event debriefing from being implemented in clinical units.

CONCLUSION

The debriefing myths include (1) debriefing only when disaster strikes, (2) debriefing is a luxury, (3) senior clinicians should determine debriefing content, and (4) debriefers must be neutral and nonjudgmental. These myths offer valuable insights into why current debriefing practices are ad hoc and not embedded into daily unit practices. They may help ignite a renewed momentum into the implementation of post-event debriefing in clinical settings.

Development of a Novel and Scalable Simulation-Based Teamwork Training Model Using Within-Group Debriefing of Observed Video Simulation

THE CHALLENGE

Effective teamwork and communication skills are essential for safe and reliable health care. These skills require training and practice. Experiential learning is optimal for training adults, and the industry has recognized simulation training as an exemplar of this approach. Yet despite decades of investment, this training is inaccessible and underutilized for most of the more than 12 million health care professionals in the United States.

DESIGNING A SOLUTION

This report describes the design process of an adapted simulation training created to overcome the key barriers to scaling simulation-based teamwork training: access to technology, time away from clinical work, and availability of trained simulation educators. The prototype training is designed for delivery in one-hour segments and relies on observation of video simulation scenarios and within-group debriefing, which are promising variations on traditional simulation training. To our knowledge, these two simulation approaches have not been previously combined. The resulting prototype minimizes the need for an on-site trained simulation educator. This report details the development of a training model, its subsequent modification based on pilot testing, and the evaluation of the resulting redesigned prototype.

PRELIMINARY EVALUATION

Participant evaluations of the redesigned prototype were highly positive, with 92% reporting that they would like to participate in additional, similar training sessions. Positive results were also found in assessment of feasibility, acceptability, psychological safety, and behavioral intention (reported intention to alter behavior).

Reflection-in-action during high-fidelity simulation: A concept analysis

OBJECTIVES

Our primary aim was to complete an in-depth analysis of the concept of "reflection-in-action" during high-fidelity simulation. We sought to identify what is currently known about the topic and establish a strong foundation for theory development regarding cultivating reflection-in-action during high-fidelity simulation.

DESIGN

Walker and Avant's (2011) systematic approach to concept analysis was used as a framework to develop a comprehensive understanding of reflection-in-action during high-fidelity simulation.

DATA SOURCES

We conducted a review of literature on reflection-in-action (with open date parameters) in PubMed, Eric, PsychInfo, ABI/Business Premium Collection, and the Cumulative Index of Nursing and Allied Health Literature (CINAHL) electronic data bases using key terms "reflection-in-action" AND "simulation". In addition, we hand-searched reference lists from key articles in the journals Simulation in Healthcare, Simulation and Gaming, and Advances in Simulation.

RESULTS

Our search resulted in 22 articles, from 1998 to 2019, that met the inclusion criteria. Four defining attributes of the concept were identified: (1) reflection-in-action must occur during high-fidelity simulation and cannot be captured within post-simulation debriefing; (2) a critical learning juncture must occur and be identified by the learners; (3) a pause in student action must occur during the high-fidelity simulation; and (4) knowledge sharing must occur through out-loud discussion. Antecedents, consequences, and empirical referents of reflection-in-action were also identified.

CONCLUSIONS

The insights from this review may enhance the ability of nursing educators to effectively support reflection-in-action within high-fidelity simulation nursing education. This concept analysis also establishes a foundation for reflection-in-action strategy development, as well as suggestions for future research in high-fidelity simulation nursing education.

Rapid Cycle Deliberate Practice to Facilitate "Nano" In Situ Simulation: An Interprofessional Approach to Just-in-Time Training

BACKGROUND

Simulation is increasingly used to identify latent threats to patient safety, such as delays in recognition and management of time-sensitive conditions. The Rapid Cycle Deliberate Practice teaching method may facilitate "nano" (brief) in situ simulation training in a critical care setting to improve multidisciplinary team performance of time-sensitive clinical tasks.

OBJECTIVE

To determine whether nano-in situ simulation training with Rapid Cycle Deliberate Practice can improve pediatric intensive care unit team proficiency in identifying and managing postoperative shock in a pediatric cardiac patient.

METHODS

A quality improvement educational project was conducted involving nano-in situ simulation sessions in a combined pediatric and pediatric cardiac intensive care unit. The Rapid Cycle Deliberate Practice method was used with an expert-driven checklist for 30-minute simulation scenarios.

RESULTS

A total of 23 critical care providers participated. The proportion of time-sensitive tasks completed within 5 minutes increased significantly from before to after training (52% [13 of 25] vs 100% [25 of 25]; P ≤ .001). Using a 5-point Likert scale, with higher scores indicating higher levels, the participants reported high degrees of performance confidence (mean, 4.42; SD, 0.20) and satisfaction with the simulation experience (mean, 4.96; SD, 0.12).

CONCLUSION

The Rapid Cycle Deliberate Practice method was used to facilitate nano-in situ simulation training and identify areas requiring additional education to improve patient safety. In situ simulation can educate providers in a cost-effective and timely manner.

Simulation in Undergraduate Education

Simulation is an integral component of undergraduate nursing education because it allows for a safe, timely, and prescriptive approach to meet learning objectives at the levels of individual simulations, courses, and academic programs. This review of the literature provides an overview of steps taken to move simulation forward in undergraduate nursing education, and it highlights educational theories, research, best practices, and policy statements underpinning modern nursing simulation. This chapter outlines simulation and curriculum integration approaches and provides examples of participant, course, and program outcomes.