Fostering Adaptive Expertise Through Simulation

Living Matter(s) for Learning: An International, Multi-Sited Ethnography Exploring How Surgeons' Learning Is Mediated Through the Use of Live Animal Simulation

Introduction

Surgical simulation training substituting a live animal for a human patient is a continuing practice. Despite clear ethical controversy, many perceive this type of simulation to be 'high fidelity' and therefore valuable. This study employs a sociomaterial perspective to explore how use of a live animal mediates learning activity and behaviour during a trauma surgical simulation course.

Methods

This international, focused ethnography generated data through observation of surgical simulation courses in six different countries. A narrative analysis was conducted using instrument-mediated learning theory as a lens for interpretation.

Results

The key finding is the dual and fluid existence of a live animal as an instrument for learning, variably perceived as a simulator tool for training and as a patient that must be saved. When framed as a tool, surgical knowledge and skills are practiced with learning acquired via epistemic and pragmatic mediation. Performing a thoracotomy denotes a critical moment; procedural unfamiliarity, evident haemorrhage and inherent risk of a deadly outcome contribute to uncertainty and clinical complexity. Learners are hence more likely to frame the animal as a patient. This experience has psychological fidelity, feeling more authentic as actions have consequences. Risk of failure to sustain the life of the animal mediates reflexive learning, teaching the learners about themselves and their abilities.

Conclusion

Live animal simulation training mediates surgical learning differently, dependent on whether the animal is framed as an instrument or as a patient. The animal's ability to bleed and exsanguinate to death creates risk and uncertainty as learners perform complex skills under pressure of significant consequence. Authenticity could be amplified if the animal is framed as a patient throughout the simulated learning event.

Validity Evidence for Using Virtual, Interactive Patient Encounters to Teach and Assess Clinical Reasoning for First-Year Medical Students

PURPOSE

Despite universal agreement on the importance of clinical reasoning skills, inadequate curricular attention to these skills remains a problem. To facilitate integration of clinical reasoning instruction and assessment into the preclerkship phase, the authors created a clinical reasoning curriculum using technology-enhanced patient simulations.

METHOD

In 2023, first-year medical students at Duke University School of Medicine were enrolled in a biomedical science course using diagnostic reasoning sessions and 16 virtual, interactive patient (VIP) encounters to teach and assess clinical reasoning. The encounters were enhanced with interactive pop-in windows that assessed multiple clinical reasoning domains. Student responses were independently evaluated by faculty. Cumulative VIP clinical reasoning composite (CRC) scores were calculated, and growth mixture modeling was used to define students by growth trajectory. Clinical reasoning was assessed in a summative objective structured clinical examination (OSCE).

RESULTS

Of the 118 students who participated in the curriculum, 1 was excluded from analysis for inadequate participation in the VIP encounters, leaving 117 students. The aggregate VIP encounter response rate was 95% (1,783 of 1,872 assessments completed). Clinical reasoning was assessed through cumulative performance across multiple domains. The mean (SD) scores were 58 (13) for information gathering, 46 (13) for illness script identification, 64 (14) for hypothesis generation, 59 (12) for differential diagnosis, and 77 (21) for management and plan. To identify latent classes of growth in cumulative VIP-CRC scores, growth mixture modeling was performed for 1-, 2-, and 3-class models. The 2-class model showed the best fit due to having the lowest bayesian information criterion (11,765.17) and Akaike information criteria (11,737.55).

CONCLUSIONS

Integrated clinical reasoning instruction and deliberate, formative practice through authentic simulations were effective at teaching and assessing clinical reasoning in the preclerkship phase. VIP and OSCE can be used to identify students at risk of low performance in the clerkship year.

Simulation-Based Mastery Learning Curriculum Development Workbook

SUMMARY STATEMENT

This Workbook and its Action Plans and Notes aim to equip health professions educators with the information and guidance needed to develop and implement a simulation-based mastery learning curriculum. The Workbook begins with an introductory statement about mastery learning curriculum developers and teachers and also about expected behavior of learners in a mastery context. The Workbook continues with 10 connected sections on simulation-based mastery learning curriculum development: (1) problem identification and needs assessment, (2) targeted needs assessment, (3) goals and objectives, (4) education strategies, (5) learner assessment goals and tools, (6) standard setting, (7) curriculum implementation, (8) feedback and debriefing, (9) unexpected collateral effects, and (10) program evaluation. These sections are modeled after the Thomas and Kern (Curriculum Development for Medical Education: A Six-Step Approach. 4th ed. Baltimore: Johns Hopkins University Press; 2022) steps for curriculum development and add several steps needed to incorporate simulation-based mastery learning goals. Curriculum development is an iterative process and each decision impacts preceding and subsequent steps. In addition, steps often change and evolve as a curriculum is developed and revised. Users are encouraged to record and refine their curriculum development plans as they move, back-and-forth, through the Workbook and Action Plans and Notes. References are provided throughout the document to amplify the text and provide detailed examples of the curriculum development steps and procedures. The intended outcome is a simulation-based mastery learning curriculum plan that can be implemented and used to educate learners to a very high standard of achievement.

Ready, or not? A qualitative study of emergency medicine senior residents' perspectives on preparing for practice

Objectives

The transition from residency to unsupervised practice challenges doctors to adapt to new environments and responsibilities. Past work has focused on how physicians acclimate to their new roles, raising questions about how residents might think proactively about transitions while still in training. This study explores senior emergency medicine (EM) residents' perspectives on preparedness for unsupervised practice and how they draw from training experiences to assess their evolving sense of preparedness.

Methods

The authors used a constructivist grounded theory approach, inviting all fourth-year EM residents from two residency programs to participate in semistructured interviews. Participants were asked to reflect on their preparedness for entering unsupervised practice and to imagine scenarios for which they felt unprepared. Two authors coded line by line using constant comparison, organizing data into codes and categories. The research team met to discuss relationships between codes, developing themes to theorize about the phenomenon of interest.

Results

Sixteen residents were interviewed. The authors identified two overarching categories of themes. First, participants described individualized conceptualizations of preparedness, constructed from past workplace experiences and those they anticipated they would have in unsupervised practice. These conceptualizations emphasized drawing confidence from experience and developing adaptability to manage the uncertainties of medical practice. The second overarching category involved participants' efforts to gauge their own preparedness. To do so, they used interactions with others to assess their readiness to manage specific problems and made holistic appraisals across multiple experiences to assess their overall preparedness for unsupervised practice.

Conclusions

Trainees draw from past experiences to forecast their abilities to manage the inevitable uncertainties of unsupervised practice. These conceptualizations of preparedness reflect a capability approach to training, with informed confidence and dynamic self-appraisal. These findings suggest potential learning goals of senior trainees and considerations for medical educators to consider when fostering trainees' capabilities for unsupervised practice.

Exploring the Meta-debrief: Developing a Toolbox for Debriefing the Debrief

SUMMARY STATEMENT

Otherwise known as debriefing the debrief, meta-debriefing describes the practice of debriefing simulation facilitators after they have facilitated, or observed, a debriefing. It is a vital component of enhancing debriefing skills, irrespective of where debriefers may be in terms of their professional development journey from novice to expert. We present the following 4 fundamental pillars, which underpin the creation of an impactful meta-debriefing strategy: theoretically driven, psychologically safe, context dependent, and formative in function. Furthermore, we describe various strategies that, underpinned by these 4 key pillars, contribute to a toolbox of techniques that enable meta-debriefers to develop proficiency and flexibility in their practice. We have synthesized and critically reviewed the current evidence base, derived mostly from the debriefing literature, and highlighted gaps to address in meta-debriefing contexts. We hope this article stimulates discussion among simulation practitioners, progresses the science and art of meta-debriefing, and prompts further research so that meta-debriefing can become an integral evidence-based component of our faculty development processes.

Adapting Novel Augmented Reality Devices for Patient Simulations in Medical Education

Extended reality (XR) simulations are becoming increasingly common in educational settings, particularly in medical education. Advancing XR devices to enhance these simulations is a booming field of research. This study seeks to understand the value of a novel, non-wearable mixed reality (MR) display during interactions with a simulated holographic patient, specifically in taking a medical history. Twenty-one first-year medical students at the University of North Carolina at Chapel Hill participated in the virtual patient (VP) simulations. On a five-point Likert scale, students overwhelmingly agreed with the statement that the simulations helped ensure they were progressing along learning objectives related to taking a patient history. However, they found that, at present, the simulations can only partially correct mistakes or provide clear feedback. This finding demonstrates that the novel hardware solution can help students engage in the activity, but the underlying software may need adjustment to attain sufficient pedagogical validity.

Social and Cognitive Skills (SCOPE)-a generic model for multi-professional work and education in healthcare

In this article, we present a generic model for social and cognitive skills that can be used in work and (simulation-based) education in healthcare. We combined existing non-technical skills tools into a tool that we call SCOPE. SCOPE is a model that comprises the three social categories of "teamwork", "leading", and "task management" as well as the two cognitive categories of "situation awareness" and "decision making". Each category comprises between three and six elements. We formulated guiding questions for each category in an attempt to emphasize its core meaning. We developed a dynamic graphical representation of the categories that emphasize the constant changes in the relative importance of the categories over the course of a clinical or educational situation. Anecdotal evidence supports the value of the model for aligning language around social and cognitive skills across specialties and professions.

The MIDAS touch: Frameworks for procedural model innovation and validation

Background

Simulation-based procedural practice is crucial to emergency medicine skills training and maintenance. However, many commercial procedural models are either nonexistent or lacking in key elements. Simulationists often create their own novel models with minimal framework for designing, building, and validation. We propose two interlinked frameworks with the goal to systematically build and validate models for the desired educational outcomes.

Methods

Simulation Academy Research Committee and members with novel model development expertise assembled as the MIDAS (Model Innovation, Development and Assessment for Simulation) working group. This working group focused on improving novel model creation and validation beginning with a preconference workshop at 2023 Society for Academic Emergency Medicine Annual Meeting. The MIDAS group sought to (1) assess the current state of novel model validation and (2) develop frameworks for the broader simulation community to create, improve, and validate procedural models.

Findings

Workshop participants completed 17 surveys for a response rate of 100%. Many simulationists have created models but few have validated them. The most common barriers to validation were lack of standardized guidelines and familiarity with the validation process.We have combined principles from education and engineering fields into two interlinked frameworks. The first is centered on steps involved with model creation and refinement. The second is a framework for novel model validation processes.

Implications

These frameworks emphasize development of models through a deliberate, form-follows-function methodology, aimed at ensuring training quality through novel models. Following a blueprint of how to create, test, and improve models can save innovators time and energy, which in turn can yield greater and more plentiful innovation at lower time and financial cost. This guideline allows for more standardized approaches to model creation, thus improving future scholarship on novel models.

Feel for the game: Simulation as transformative practices

'@runedalljensen demonstrates how the conventional division of technical and non‐technical skills frequently observed in simulation‐based health professsional education may be arbitrary and distracting.

How do residents respond to uncertainty with peers and supervisors in multidisciplinary teams? Insights from simulations with epistemic fidelity

BACKGROUND

Residents struggle to express clinical uncertainty, often exhibiting negative cognitive, behavioral, and emotional responses to uncertainty when engaging with patients or supervisors. However, the Integrative Model of Uncertainty Tolerance posits that individuals may have positive or negative responses to perceived uncertainty. Situational characteristics, such as interactions with other health professionals, can impact whether the response is positive or negative. The team context in which residents interact with resident peers and supervisors could represent varying situational characteristics that enable a spectrum of responses to uncertainty. Understanding the situational characteristics of multidisciplinary teams that allow residents to display positive responses to perceived uncertainty could inform strategies to foster positive responses to uncertainty in other contexts. We explored resident responses to perceived uncertainty in a simulated multidisciplinary team context.

METHODS

A simulation-primed qualitative inquiry approach was used. Fourteen residents from Cardiology and Obstetrics and Gynecology participated in simulation scenarios involving pregnant patients with heart disease. We incorporated epistemic fidelity through the deliberate inclusion of ambiguity and complexity to prompt uncertainty. Audio recordings of debriefing sessions were analyzed using directed content analysis.

RESULTS

Residents recognized that uncertainty is unavoidable, and positive responses to uncertainty are crucial to team dynamics and patient safety. While residents had positive responses to expressing uncertainty to peers, they had predominantly negative responses to expressing uncertainty to supervisors. Predominant negative response to supervisors related to judgement from supervisors, and impacts on perceived trustworthiness or independence. Although residents recognized expressing uncertainty to a supervisor could identify opportunities for learning and resolve their uncertainty, the negative responses overshadowed the positive responses. Residents highly valued instances in which supervisors were forthcoming about their own uncertainty.

CONCLUSIONS

Through participation in simulations with epistemic fidelity, residents reflected on how they perceive and respond to uncertainty in multidisciplinary teams. Our findings emphasize the role of situational characteristics, particularly peers and supervisors, in moderating responses to perceived uncertainty. The productive discussions around responses to uncertainty in debriefing sessions suggest further studies of multidisciplinary simulations could enhance our understanding of how uncertainty is expressed, and potentially be used as an instructional intervention to promote positive responses to uncertainty.

Powerful medical education improves health care quality and return on investment

INTRODUCTION

Powerful medical education (PME) involves the use of new technologies informed by the science of expertise that are embedded in laboratories and organizations that value evidence-based education and support innovation. This contrasts with traditional medical education that relies on a dated apprenticeship model that yields uneven results. PME involves an amalgam of features, conditions and assumptions, and contextual variables that comprise an approach to developing clinical competence grounded in education impact metrics including efficiency and cost-effectiveness.

METHODS

This article is a narrative review based on SANRA criteria and informed by realist review principles. The review addresses the PME model with an emphasis on mastery learning and deliberate practice principles drawn from the new science of expertise. Pub Med, Scopus, and Web of Science search terms include medical education, the science of expertise, mastery learning, translational outcomes, cost effectiveness, and return on investment. Literature coverage is comprehensive with selective citations.

RESULTS

PME is described as an integrated set of twelve features embedded in a group of seven conditions and assumptions and four context variables. PME is illustrated via case examples that demonstrate improved ventilator patient management learning outcomes compared to traditional clinical education and mastery learning of breaking bad news communication skills. Evidence also shows that PME of physicians and other health care providers can have translational, downstream effects on patient care practices, patient outcomes, and return on investment. Several translational health care quality improvements that derive from PME include reduced infections; better communication among physicians, patients, and families; exceptional birth outcomes; more effective patient education; and return on investment.

CONCLUSIONS

The article concludes with challenges to hospitals, health systems, and medical education organizations that are responsible for producing physicians who are expected to deliver safe, effective, and cost-conscious health care.

Design of a Workshop for Focused Transesophageal Echocardiography During Noncardiac Surgery in Nurse Anesthesia Education

OBJECTIVE

The use of transesophageal echocardiography (TEE) by certified registered nurse anesthetists (CRNAs) during noncardiac surgery is relatively uncommon despite its unique potential to diagnose causes of hemodynamic instability. To address this problem, educational endeavors designed to provide practical TEE skills to CRNAs are needed. The aim of the current study was to evaluate the feasibility, acceptability, efficacy, and utility of a 2-day focused TEE workshop in nurse anesthesia education that employed a protocol involving a limited number of views and used goal-directed, qualitative assessments of critical physiologic parameters.

METHODS

This was a prospective, observational study involving 14 second-year nurse anesthesia students. The cohort was evaluated following completion of this workshop by simulator-based testing involving hypothetical clinical scenarios, and this test data was analyzed according to the percent successful acquisition and interpretation of TEE views to determine immediate objective teaching efficacy. The acceptability, perceived efficacy, and perceived utility of the workshop were assessed by online survey, and survey responses were qualitative and quantitative in nature.

RESULTS

Participants acquired appropriate TEE views associated with clinical scenarios 99% of the time and correctly interpreted the pathology in those views 93% of the time. Participants uniformly perceived significant educational value in this workshop and intend to incorporate TEE in their future clinical practice.

CONCLUSIONS

A 2-day workshop to teach focused TEE to nurse anesthesia trainees directed by a streamlined protocol is feasible, acceptable, and perceived as useful by participants, and provides practical experience and entry-level competency in this point-of-care ultrasound modality.

Development of an instrument for medical students' self-assessment of facets of competence for patient-centred care

OBJECTIVE

To develop a facets of competence self-assessment instrument (FOCSI) with operationalised items for ten competence facets required for patient-centred care at the beginning of residency.

METHODS

We conducted focus groups and cognitive interviews with final-year medical students to develop items that match students' clinical experience. We tested 50 items in two samples and analysed model fit and internal consistency of all possible combinations to identify the optimal ten-item-solution. Item analysis was performed as well as correlation with six personality traits.

RESULTS

An optimal ten-item solution for the self-assessment instrument emerged for sample 1 (n = 101, 27.2 ± 3.5 years, 75.2 % female). We validated the model fit with sample 2 (n = 135, 27.7 ± 3.9 years, 66.7 % female): χ2(35) = 49.3, p = .055, CFI = .94, RMSEA = .055, SRMR = .058, Cronbach's alpha = .78. The personality factors 'Conscientiousness' and 'Extraversion' correlate positively with most FOCSI items.

CONCLUSION

The operationalised FOCSI items support undergraduate medical students close to graduation in realistic self-assessment of facets of competences for patient-centred care in their transition to residency.

PRACTICE IMPLICATIONS

Realistic self-assessment of facets of competence will provide medical students with the opportunity to monitor their competence development as part of self-directed learning for gaining adaptive expertise in professional, patient-centred care.