Cognitive Load Theory for the Design of Medical Simulations

The effect of interprofessional game-based learning on perceived cognitive load and self-efficacy in interprofessional communication and collaboration in patient safety incidents

BACKGROUND

This study aims to investigate the effect of the interprofessional game-based learning method on students' perceived cognitive load and self-efficacy in interprofessional communication and collaboration during patient safety incidents, in comparison to traditional instructional methods.

METHODS

The quasi-experimental study was conducted in 2023-2024. The educational objective was to improve the interprofessional collaboration of the students in patient safety incidents. Students in operating room nursing and anesthesia nursing (n = 60) participated in this study. Interprofessional game-based learning and traditional methods were used in the intervention group and the control group, respectively. Participants completed two questionnaires about cognitive load and self-efficacy two months after intervention. The data were analyzed using descriptive tests (mean, standard deviation, and percentage) and analytical tests (including ANCOVA and Student T-test).

RESULTS

The IP-GBL intervention significantly improved students' self-efficacy in the intervention group compared to the control group (F = 26.51, df = 1.57, p-value = 0.0001, Partial Eta Squared = 0.31). The IP-GBL method enhanced GCL and eliminated ECL and ICL compared to the traditional method. (p = 0.0001).

CONCLUSION

The IP-GBL enhanced germane cognitive load and decreased the intrinsic and extrinsic cognitive load, which facilitated students' learning. Patient safety training using interprofessional game-based learning has a favorable educational effect on students' self-efficacy. The findings indicated that the students' self-efficacy in interprofessional collaboration and communication regarding patient safety incidents in the surgical department significantly improved. Therefore, the interprofessional game-based learning method in formal and informal education of patient safety that requires collaboration between different professions is recommended.

Does management reasoning display context specificity? An exploration of sleep loss and other distracting situational (contextual) factors in clinical reasoning

OBJECTIVES

Context specificity occurs when a health professional sees two patients with identical signs and symptoms yet arrives at two different diagnoses due to other existing factors. For example, one patient speaks English as a first language, while the other patient has limited English proficiency. It is not known if context specificity extends beyond diagnosis and also affects management reasoning. Our study explored whether reduced sleep and other distracting contextual factors (e.g., limited English proficiency) lead to context specificity, resulting in suboptimal management reasoning.

METHODS

Seventeen medical residents participated in a two-month study (consisting of one outpatient and one inpatient rotation), in which their sleep was tracked. After each rotation, participants watched two clinical encounter videos-one with and one without distracting contextual factors-and completed think-aloud interviews for each video discussing their management plans. Interviews were transcribed and assessed for management reasoning themes.

RESULTS

Residents (n=17) on outpatient rotations received more sleep than those on inpatient rotations (450.5 min ± 7.13 vs. 425.6 min ± 10.78, p=0.023). Five management reasoning themes were identified: organized knowledge, disorganized knowledge, uncertainty, addressing non-pharmacologic interventions, and addressing patient needs and concerns. There was essentially no difference in the prevalence of utterances of organized knowledge themes between residents with more or less sleep (25 vs. 27 times, p=0.78) or those exposed to contextual factors vs. not exposed (24 vs. 28 times, p=0.58). However, disorganized knowledge themes were observed significantly more frequently in participants exposed to contextual factors (33 vs. 18 times, p=0.036).

CONCLUSIONS

Residents slept more during outpatient rotations. While sleep alone was not associated with the prevalence of management reasoning themes, residents exposed to videos with distracting contextual factors displayed significantly more instances of disorganized knowledge, supporting the phenomenon of context specificity in management reasoning.

Effectiveness of a new basic course incorporating medical trainer simulator for HEMS education in Japan: a pre-post intervention study

BACKGROUND

Japan's HEMS (Helicopter Emergency Medical Services) has recently shifted from quantitative expansion to qualitative improvement, highlighting the need for standardizing training and enhancing safety. This study aimed to evaluate a newly developed basic training course that integrates a Medical Trainer (MeTra) simulator, addressing the need for standardized education and improved safety in HEMS operations.

METHODS

In total, 208 HEMS professionals (83 doctors, 49 nurses, and 76 operational staff) participated in the revamped course, which combines e-learning, practical discussions, and MeTra simulation. Self-reported questionnaires assessing non-technical (4 items) and technical skills (6 items) using a 5-point Likert scale were administered pre- and post-course. Wilcoxon signed-rank tests evaluated changes in perceived competence. We also measured the MeTra simulator's fidelity and overall course satisfaction.

RESULTS

All non-technical and technical skills items improved significantly (p < 0.05), with notable gains in patient management during aircraft malfunction (average increase of 1.49 points) and fire extinguisher use (average increase of 1.11 points). Participants rated the MeTra simulator highly, especially for its enclosed environment, with 91% rating it four or higher, and for its communication system fidelity, with 96% rating it four or higher. Overall course satisfaction was high, with 96% rating it four or higher. Nonetheless, in line with Cook's caution on Kirkpatrick Level 2 data, these findings primarily reflect participants' perceptions rather than objective performance, and no control group was included.

CONCLUSIONS

The new basic course incorporating the MeTra simulator may enhance self-reported competencies for diverse HEMS professionals. This standardized education program marks a significant step towards aligning Japan's HEMS training with international standards.

Insights from 40 years of educational research: honoring Jeroen van Merriënboer

Simulation-based education in healthcare has advanced significantly, yet a persistent gap remains between educational science and healthcare simulation research. The late Jeroen van Merriënboer's extensive work in educational science provides valuable guidance for bridging this gap. Four key insights from his research can serve as a strong theoretical bedrock for educators and researchers aiming to design more effective and cohesive simulation-based learning experiences: (1) integrating learning in both simulated and real environments to improve transfer, (2) offering targeted learner support that evolves with expertise, (3) embracing the complexity of educational practice and avoiding one-size-fits-all solutions, and (4) embedding domain-general skills within specific disciplines. Championing these insights may catalyze more theory-informed practice and research in healthcare simulation. Nevertheless, applying these principles in practice remains a challenge, highlighting the need for further research into the "how"-specifically how to interconnect learning environments, adapt instruction to diverse needs, integrate theory with practice, and combine the teaching of domain-general and domain-specific skills.

Effectiveness of simulation fidelity levels on theoretical-practical knowledge and gains in drug administration to critically ill patients: A randomized clinical trial

OBJECTIVE

To compare the effectiveness of high- and low-fidelity simulation, combined with theoretical foundations, in acquiring theoretical and practical knowledge, as well as in self-perceived gains from simulation.

BACKGROUND

The administration of medication to critically ill patients is a complex and high-risk process that requires specialized knowledge and vigilance to prevent medication errors. In response, educational interventions have been widely implemented to enhance patient safety, with simulation-based education emerging as a key strategy.

DESIGN

Randomized clinical trial, based on the CONSORT guidelines for simulation studies.

METHODS

Sixty nursing students were randomly assigned to either the experimental group (high-fidelity simulation) or the control group (low-fidelity simulation). Both groups received theoretical instruction, followed by simulation exercises. The study assessed theoretical knowledge, perceived gains from the simulation, practical performance and the evaluation of the simulation design.

RESULTS

The study found significant improvements in theoretical knowledge and perceived gains in both groups, with the experimental group showing more substantial progress. Interestingly, practical performance was higher in the low-fidelity group. No significant differences were observed in the evaluation of the simulation design between the two groups.

CONCLUSION

Both high- and low-fidelity simulations are effective in nursing education, though their impacts vary. High-fidelity simulations are more effective for enhancing theoretical understanding, while low-fidelity simulations tend to improve immediate practical skills.

Experienced cognitive load in the emergency department. A prospective study

BACKGROUND AND IMPORTANCE

The emergency department (ED) is a hectic place, where many critically ill patients are treated. For residents working in the ED, this environment may be demanding.

OBJECTIVES

The aim of this study was to investigate the [1] cognitive load experienced by residents working in the ED, and [2] differences in cognitive load during the day.

METHODS

In this multicentre, prospective study in three EDs in the Netherlands, the experienced cognitive load was graded by residents on three scales, agreed upon during Delphi meetings: the complexity (low-high: 1-3), mental effort (low-high: 1-9) and comfortability scale (low-high: 0-100%). We applied the scores per decision, 1-hour and 2-hour intervals, patient and shift.

MAIN RESULTS

We observed 14 residents and analysed 74 1-hour and 45 2-hour intervals, 79 patients, 24 shifts and 592 separate decisions. The experienced cognitive load per decision was low. In contrast, the cognitive load was higher per 2-hour interval (mental effort: median 4.0 (IQR 4.0) and comfortability 80% (IQR 20)) and per shift (mental effort: median 5.5 (IQR 4.0) and comfortability 80% (IQR 20). Complexity was low for all measurements. Mental effort rose from 17h onwards higher values, whereas a decrease in comfortability was seen from 21h onwards.

CONCLUSION

From 17h onwards, residents working in the ED experienced rather high mental effort and reported feeling not optimally comfortable when making decisions. The mental effort was highest between 21-23h. This was found when cognitive load was measured per 2-hour interval and per shift, but not per decision. This study may provide an insights to optimise cognitive load by reorganisation of the ED.

An interprofessional training program for intrahospital transport of critically ill patients: model build-up and assessment

Intrahospital transport of critically ill patients for diagnostic or therapeutic procedures can be compromised by patient instability, equipment problems or inexperienced teamworking. This quasi-experimental study aimed to assess the effectiveness of an in-situ interprofessional simulation-based training (IIST) model for junior member transport teams. Newly registered postgraduate physicians, nurses and respiratory therapists underwent the IIST. The technical skills (TS) of each participant and non-technical skills (NTS) of each interprofessional team were assessed using well-validated checklists. Thirty-six participants enrolled and were randomly assigned to six experimental and six control teams. Most participants achieved a significantly higher level of both TS and NTS. Both the control and experimental teams overvalued their NTS in the pretest, while the posttest self-assessment scores among the experimental groups more closely matched the expert assessments. Despite challenges in scheduling and the setting, the IIST was successfully conducted in a crowded hospital, which enabled trainees to optimize their learning in a real-life environment. In conclusion, the IIST model can facilitate the development of both TS and NTS for transport team members. Transport teams made up of newly registered staff from different disciplines may lack insight into their NTS in critical patient transfer management, but simulation training may cause improvements.

The mental workload of ICU nurses performing human-machine tasks and associated factors: A cross-sectional questionnaire survey

AIMS

To assess the level of mental workload (MWL) of intensive care unit (ICU) nurses in performing different human-machine tasks and examine the predictors of the MWL.

DESIGN

A cross-sectional questionnaire study.

METHODS

Between January and February 2021, data were collected from ICU nurses (n = 427) at nine tertiary hospitals selected from five (east, west, south, north, central) regions in China through an electronic questionnaire, including sociodemographic questions, the National Aeronautics and Space Administration Task Load Index, General Self-Efficacy Scale, Difficulty-assessing Index System of Nursing Operation Technique, and System Usability Scale. Descriptive statistics, t-tests, one-way ANOVA and multiple linear regression models were used.

RESULTS

ICU nurses experienced a medium level of MWL (score 52.04 on a scale of 0-100) while performing human-machine tasks. ICU nurses' MWL was notably higher in conducting first aid and life support tasks (using defibrillators or ventilators). Predictors of MWL were task difficulty, system usability, professional title, age, self-efficacy, ICU category, and willingness to study emerging technology actively. Task difficulty and system usability were the strongest predictors of nearly all typical tasks.

CONCLUSION

ICU nurses experience a medium MWL while performing human-machine tasks, but higher mental, temporal, and effort are perceived compared to physical demands. The MWL varied significantly across different human-machine tasks, among which are significantly higher: first aid and life support and information-based human-machine tasks. Task difficulty and system availability are decisive predictors of MWL.

IMPACT

This is the first study to investigate the level of MWL of ICU nurses performing different representative human-machine tasks and to explore its predictors, which provides a reference for future research. These findings suggest that healthcare organizations should pay attention to the MWL of ICU nurses and develop customized management strategies based on task characteristics to maintain a moderate level of MWL, thus enabling ICU nurses to perform human-machine tasks better.

PATIENT OR PUBLIC CONTRIBUTION

No patient or public contribution.

PEARLS debriefing for social justice and equity: integrating health advocacy in simulation-based education

Addressing health inequities in health professions education is essential for preparing healthcare workers to meet the demands of diverse communities. While simulation has become a widely recognized and effective method for providing safe and authentic clinical learning experiences, there has been limited attention towards the power of simulation in preparing health practitioners to work with groups who experience health disparities due to systems of inequality. Balancing technical proficiency with educational approaches that foster critical reflection and inform action oriented towards social accountability is essential. Transformational learning promotes the development of critical consciousness through critical reflection. Debriefing plays a crucial role in fostering learning in this direction by providing a structured opportunity to critically reflect on taken for granted assumptions, examine power and privilege embedded within systems and structures, and empower learners to take action toward changing those conditions. Building on the Promoting Excellence and Reflective Learning in Simulation (PEARLS) Healthcare Debriefing Tool, we propose a PEARLS Debriefing for Social Justice and Equity (DSJE) Tool that specifically directs attention to systems of inequality that contribute to health disparities for vulnerable groups across a range of simulation scenarios. This approach has two aims: (a) to transform debriefings into a critically reflective space by engaging learners in dialogue about social and structural determinants of health that may create or perpetuate inequities and (b) to foster critical reflection on what actions can be taken to improve the health and well-being of identified at risk and vulnerable groups. From this perspective, we can use the adapted PEARLS Tool to incorporate conversations about systems of inequality, equity, diversity, and inclusion (EDI) into our existing educational practices, and make concentrated efforts towards community-driven and socially conscious simulation-based education (SBE).

A novel blended and interprofessional approach to pediatric emergency training: self-assessment, perception, and perceived long-term effects

BACKGROUND

We developed a blended training program at a tertiary pediatric center based on hospital-specific emergency guidelines, profession-specific Virtual Patients (VPs), and interprofessional team training. Using this novel approach, we addressed differing educational needs of medical and nursing staff and intrinsic cognitive overload among participants, aiming for harmonization of in-house emergency proceedings.

METHODS

Self-assessments of pediatric emergency knowledge and skills were conducted before (T1) and after (T2) preparation using VPs, as well as after the team training day (T3). At T3, participants completed questionnaires on the training approach, its components, and learning impact. Ten months after the training, a follow-up survey (T4) queried perceived benefits within and beyond emergency situations.

RESULTS

A total of 56 medical staff and 56 nursing staff members participated in the pilot phase. Of these, N = 55 (98%) and N = 48 (85%), respectively, returned self-assessments; questionnaires were completed by N = 55 (98%) and N = 51 (91%), respectively. In both groups, 57 participants (50.9%) completed the follow-up survey. After team training (T3), both groups had statistically significant increased knowledge and skill scores compared with those at T1. Regarding the blended approach and its components, medical and nursing staff alike rated the entire course and its guidelines, the preparatory VPs, and the team training very highly. Participants felt being better prepared for pediatric emergencies. Perceived strengths of the training approach were in the triangulation of teaching methods and its interprofessionalism. More training scenarios were requested, as well as recurrent training. In the follow-up, participants reported improved confidence and calmness, as well as improved communication and collaboration when involved in an emergency. Beyond emergencies, benefits were reported in daily routines.

CONCLUSIONS

Our blended approach was perceived as being effective in improving preparedness among medical and nursing house staff. This approach permits customization of content and deliberate practice to improve pediatric critical care.

Comparison of virtual and in-person simulations for sepsis and trauma resuscitation training in Singapore: a randomized controlled trial

PURPOSE

This study aimed to compare cognitive, non-cognitive, and overall learning outcomes for sepsis and trauma resuscitation skills in novices with virtual patient simulation (VPS) versus in-person simulation (IPS).

METHODS

A randomized controlled trial was conducted on junior doctors in 1 emergency department from January to December 2022, comparing 70 minutes of VPS (n=19) versus IPS (n=21) in sepsis and trauma resuscitation. Using the nominal group technique, we created skills assessment checklists and determined Bloom’s taxonomy domains for each checklist item. Two blinded raters observed participants leading 1 sepsis and 1 trauma resuscitation simulation. Satisfaction was measured using the Student Satisfaction with Learning Scale (SSLS). The SSLS and checklist scores were analyzed using the Wilcoxon rank sum test and 2-tailed t-test respectively.

RESULTS

For sepsis, there was no significant difference between VPS and IPS in overall scores (2.0; 95% confidence interval [CI], -1.4 to 5.4; Cohen’s d=0.38), as well as in items that were cognitive (1.1; 95% CI, -1.5 to 3.7) and not only cognitive (0.9; 95% CI, -0.4 to 2.2). Likewise, for trauma, there was no significant difference in overall scores (-0.9; 95% CI, -4.1 to 2.3; Cohen’s d=0.19), as well as in items that were cognitive (-0.3; 95% CI, -2.8 to 2.1) and not only cognitive (-0.6; 95% CI, -2.4 to 1.3). The median SSLS scores were lower with VPS than with IPS (-3.0; 95% CI, -1.0 to -5.0).

CONCLUSION

For novices, there were no major differences in overall and non-cognitive learning outcomes for sepsis and trauma resuscitation between VPS and IPS. Learners were more satisfied with IPS than with VPS (clinicaltrials.gov identifier: NCT05201950).

Avatar-based versus conventional patient monitoring with distant vision: a computer-based simulation study

Patient monitoring in the perioperative setting can be challenging, especially when monitoring multiple patients simultaneously or managing dynamic situations that require movement around the operating room. We aimed to evaluate whether avatar-based patient monitoring, which presents vital signs in the form of changing colors, shapes and motion, improves remote vital sign recognition compared to conventional monitoring. We conducted a prospective, single-center, computer-based simulation study to evaluate how anesthesia providers recognize vital signs when using the Philips Visual Patient Avatar at different viewing distances (8 and 16 m) compared to conventional monitoring. The primary outcome was the total number of correctly identified vital signs which were compared for the two distances and the two devices using mixed Poisson regression. We analyzed data from 28 anesthesia providers who participated in 112 simulations. The correct recognition rate using the Visual Patient Avatar compared to conventional monitoring at 8 m was increased by 74% (rate ratio 1.74, 95% CI, 1.42 to 2.14, p < 0.001) and by 51% at 16-meter viewing distance (rate ratio 1.51, 95% CI, 1.23 to 1.87, p < 0.001). We observed scenario-specific superior performance for six vital signs at 8 m. The results provide empirical evidence that avatar-based monitoring can significantly improve the perception of vital signs when using distant vision.

Augmented Reality in Ward Round-Based Simulation: Exploring Student Experiences and Impact on Confidence

INTRODUCTION

 Doctors in training make substantial contributions to ward rounds. Despite this, formal education in this area is lacking, leading to diminished confidence and competence among undergraduate students and trainees. Ward round-based simulation (WRBS) has shown promise in improving clinical and decision-making skills. This quasi-experimental mixed-methods study aims to explore student experiences of augmented reality (AR) in simulated medical ward rounds. Specifically, it seeks to compare AR to existing traditional simulation modalities (TSM), manikin, and actor, to evaluate its viability as an alternative and to explore the impact of a mixed-modality simulated ward round on student confidence levels in performing ward round tasks.

MATERIALS AND METHODS

Fourteen participants engaged in a simulated ward round involving three cases: an actor as a patient, a manikin, and an AR case. Guided by pre- and post-simulation questionnaires, confidence levels around WRBS were explored using Wilcoxon's signed-rank test. Additionally, thematic analysis of semi-structured focus groups explored the use of AR in simulation compared to TSM.

RESULTS

Significant improvements in confidence shown through the pre- and post-simulation questionnaires (p < 0.019) were found using Wilcoxon's signed-rank test across all 11 questions, with effect sizes (r) ranging from 0.65 to 0.9. The highest effect size observed (r = 0.9) asked about the change in confidence when starting or stopping medications during a ward round (p = 0.002). Qualitative analysis of focus group discussions identified key themes such as the visual accuracy of AR, the need for interactivity, and the cognitive load of mixed-method simulations.

CONCLUSION

The findings suggest that AR can significantly enhance medical training by providing realistic and immersive learning experiences, although further refinements are necessary to improve interactivity and reduce cognitive demands. This study highlights the potential for integrating innovative technologies to better prepare students for clinical practise and provides further insight into the practicalities of using AR in medical education.

Veterinary High-Stakes Immersive Simulation Training With Repeat Practice Following Structured Debriefing Improves Students' Ability to Cope With High-Pressure Situations

INTRODUCTION

Immersive simulation is used increasingly in medical education, and there is increasing awareness of the impact of simulation scenarios on emotional state and cognitive load and how these impact learning. 1 There is growing awareness of the requirement to equip veterinarians with skills for managing high-pressure environments and provide training on human factors.

METHODS

Veterinary students participated in a high-fidelity immersive simulation of a road traffic collision involving multiple casualties. The students took part in the same simulation twice, the second time after a debrief. Each participant's emotional state and cognitive load were assessed after participating in each simulation. Each participant was asked to score the effect of pressure on their performance.

RESULTS

One hundred twenty-five students participated and demonstrated a higher cognitive load with more positive emotional states during the second scenario after the completion of a structured debrief and discussion focusing on pressure relief techniques (cognitive load - ¯ μ Scenario run 1 = 4.44 ± 1.85 [SD], ¯ μ Scenario2 = 5.69 ± 1.74 [SD]). Most (63%) participants described being in a low-performance state of frazzle during the first scenario compared with most (61%) who described being in a high-performance state of flow during the second.

CONCLUSION

Immersive simulation scenarios, with structured debriefing, may allow the measurement of emotional state and cognitive load in participants. Furthermore, this study suggests that curriculum training in human factors and pressure relief techniques, coupled with immersive simulation and debrief, may improve future performance in high-stakes and high-pressure scenarios.

Twelve tips for orienting preclinical healthcare students to simulation education

Simulation-based education (SBE) is common in healthcare education and is increasingly being incorporated in preclinical curriculum. Preclinical students typically have had little exposure to the clinical setting (i.e. hospital patient rooms, equipment) and often feel uncomfortable when first placed in the simulated clinical environment. Prebriefing, a standard of best practice in simulation, prepares learners for simulation exercises. To successfully integrate SBE in preclinical education, we recommend expanding the prebriefing to include: multiple activities that orient learners to the learning space and the structure of a simulation activity, the goals of simulation as a learning process, faculty modeling of a simulated patient encounter, and expected learner outcomes. This approach increases student familiarity with the simulation learning environment and performance expectations, which can reduce cognitive load and improve learning outcomes. We describe 12 tips for increasing the scope of the prebriefing to promote effective learner participation and development during preclinical SBE.

How to deliver effective paediatric simulation based education

Simulation based education (SBE) is an educational tool increasingly used in the approach to the initial and ongoing education of healthcare professionals. Like all education tools, SBE needs to be used appropriately to achieve the desired outcomes. Using Cognitive Load Theory (CLT) in the instructional design of simulations is essential to maximise participant learning by reducing extraneous load and optimising intrinsic load. Educators can modify task fidelity, task complexity and instructional support to optimise learning. Specific methodologies can be used in program design such as rapid cycle deliberate practice, round the table teaching, low dose high frequency and flipped classroom. Fidelity and authenticity are important factors to consider when choosing design elements to ensure learner engagement, but not to overwhelm cognitive load. An integral part of SBE is the feedback or debriefing component. Several evidence-based methodologies can be employed to facilitate post simulation learning, including Debriefing with Good Judgement and PEARLS. Educators also need to consider faculty education and development, such as the discovery, growth and maturity model.

The role of implementing instructional design principles on learner experience with training in current good manufacturing practices (cGMP)

INTRODUCTION

The objective of the study was to assess if improvement of the learner experience could be achieved through the use of instructional design strategies in current Good Manufacturing Practices (cGMP) training. This is a novel application in a topic that is known to be boring but is critical to ensuring patient safety.

METHODS

An experimental randomized controlled repeated measures cross-over design was utilized in a sample of pharmacy students to determine the effect of an intervention training strategy (which utilized a mix of strategies including weeding, signaling, use of multimedia, and optimized space and type) on the learner experience (Evaluation, Overall Satisfaction, Perceived Knowledge, and Future Recommendation) compared with a control.

RESULTS

The sample of 52 pharmacy students that participated evaluated the intervention training strategy with higher scores than the control, with better overall satisfaction, perceived knowledge, and future recommendation scores than the control training strategy. Thus, an apparent effect which resulted from the use of instructional design strategies was seen for all learner experience variables (p < .01).

CONCLUSION

Improvement in the learner experience can be achieved by using instructional design strategies in cGMP training. This indicates that similar results could be obtained in other topics where such techniques have not yet been applied.

The use of cognitive load theory to assist in the teaching of electrocardiogram interpretation within paramedical science education

BACKGROUND

Paramedics are expected to record electrocardiograms (ECGs) as part of their clinical assessment; however, it is an extremely difficult skill to learn and understand as it has a high intrinsic cognitive load which can also be challenging to teach effectively.

AIMS

This article will explore the use of cognitive load theory to assist in the teaching of ECG interpretation within the context of paramedical education.

DESCRIPTION

Cognitive load theory can be useful to aid teaching within complex medical and health science domains including clinical skills teaching.

CONCLUSIONS

The application of cognitive load theory to the teaching of ECG interpretation can be useful as it allows for the development of understanding, building schemata linking information currently being learned to knowledge already gained within the long-term memory, which can maximise germane load by the appropriate selection of intrinsic load, minimising extraneous load therefore not overloading the working memory.

Cognitive load theory in workplace-based learning from the viewpoint of nursing students: application of a path analysis

PURPOSE

The present study aimed to test the relationship between the components of the Cognitive Load Theory (CLT) including memory, intrinsic and extraneous cognitive load in workplace-based learning in a clinical setting, and decision-making skills of nursing students.

METHODS

This study was conducted at Shahid Sadoughi University of Medical Sciences in 2021-2023. The participants were 151 nursing students who studied their apprenticeship courses in the teaching hospitals. The three basic components of the cognitive load model, including working memory, cognitive load, and decision-making as the outcome of learning, were investigated in this study. Wechsler's computerized working memory test was used to evaluate working memory. Cognitive Load Inventory for Handoffs including nine questions in three categories of intrinsic cognitive load, extraneous cognitive load, and germane cognitive load was used. The clinical decision-making skills of the participants were evaluated using a 24-question inventory by Lowry et al. based on a 5-point scale. The path analysis of AMOS 22 software was used to examine the relationships between components and test the model.

FINDINGS

In this study, the goodness of fit of the model based on the cognitive load theory was reported (GIF = 0.99, CFI = 0.99, RMSEA = 0.03). The results of regression analysis showed that the scores of decision-making skills in nursing students were significantly related to extraneous cognitive load scores (p-value = 0.0001). Intrinsic cognitive load was significantly different from the point of view of nursing students in different academic years (p = 0.0001).

CONCLUSION

The present results showed that the CLT in workplace-based learning has a goodness of fit with the components of memory, intrinsic cognitive load, extraneous cognitive load, and clinical decision-making skill as the key learning outcomes in nursing education. The results showed that the relationship between nursing students' decision-making skills and extraneous cognitive load is stronger than its relationship with intrinsic cognitive load and memory Workplace-based learning programs in nursing that aim to improve students' decision-making skills are suggested to manage extraneous cognitive load by incorporating cognitive load principles into the instructional design of clinical education.

High-consequence infectious diseases: the conception and development of a multi-disciplinary, interprofessional simulation training programme

BACKGROUND

High-consequence infectious diseases (HCIDs) represent a group of acute infectious diseases with the potential to impact healthcare systems and public health profoundly. Effective management requires a system-based strategy focused on early detection, initiation of infection prevention and control measures, and appropriate use of personal protective equipment (PPE). Inadequate training in the safe use of HCID PPE, and lack of familiarity with key processes such as HCID waste and spills management, exacerbates the risk posed to healthcare workers (HCWs). Enhanced training opportunities are required to ensure that staff are equipped with the necessary knowledge and capabilities to protect themselves from pathogen exposure and infection.

AIM

To create a bespoke interprofessional HCID simulation training programme.

METHODS

A detailed learning needs analysis was undertaken, which identified multiple areas amenable to educational intervention. A full-day HCID simulation programme was developed, providing HCWs the opportunity to practice and gain proficiency in various domains.

FINDINGS

Six interprofessional participants took part in the HCID simulation programme pilot. All six (100%) participants felt that the stated learning objectives had been achieved, and five and one participants found the programme to be extremely useful (83%) or very useful (17%), respectively. Following refinement based on pilot feedback, a further six courses have been run for 38 participants, of whom 97% found the programme to be extremely useful or very useful.

CONCLUSION

The development of a training intervention in the low-frequency, high-risk field of HCIDs had a positive impact. Given the disproportionate impact on HCWs at times of HCID outbreaks, more investment is needed to keep the workforce upskilled.

Applying simulation learning theory to identify instructional strategies for Generation Z emergency medicine residency education

Introduction

Generation Z learners are entering emergency medicine (EM) residency training, bringing unique learning preferences that influence their engagement with residency education. To optimally teach and motivate this incoming generation of learners, EM educators must understand and adapt to the changing instructional landscape.

Methodology

The Simulation Leaders Advancing the Next Generation in Emergency Medicine (SLANG-EM) Workgroup was created to identify effective educational strategies for Generation Z learners entering EM. Members were faculty in the Society for Academic Emergency Medicine (SAEM) Simulation Academy, well versed in learning theory supporting simulation-based education (SBE) and actively involved in EM residency education.

Unique treatment/analysis

Through primary and secondary literature searches, the SLANG-EM Workgroup identified four distinctive learning preferences of Generation Z learners: (1) individualized and self-paced learning, (2) engaging and visual learning environments, (3) immediate and actionable feedback, and (4) combined personal and academic support. Workgroup members evaluated these learning preferences using a novel conceptual framework informed by the theoretical principles underpinning SBE, recommending instructional strategies for Generation Z EM residency learners across multiple educational environments.

Implications for educators

Instructional strategies were described for the didactic, simulation, and clinical learning environments. In the didactic environment, identified instructional strategies included meaningful asynchronous education, interactive small-group learning, and improved multimedia design. In the simulation environment, educational innovations particularly suitable for Generation Z learners included learner-centered debriefing, rapid-cycle deliberate practice, and virtual simulation. In the clinical environment, described instructional strategies involved setting learner-centered goals and delivering facilitative feedback in the context of an educational alliance. Overall, these instructional strategies were clustered around themes of student-centered education and the educator as facilitator, which align well with Generation Z learning preferences. These findings were synthesized and presented as an advanced workshop, "Delivering Effective Education to the Next Generation," at the 2023 SAEM Annual Meeting.

The Acquisition of Static and Dynamic Intervention Skills by Graduate Speech-Language Pathology Students

PURPOSE

Speech-language pathology programs use simulated learning experiences (SLEs) to teach graduate student clinicians about fidelity to therapeutic interventions, including static skills (clinical actions that are delivered in a prespecified way regardless of the client's behavior) and dynamic skills (contingent responses formulated in response to a client's behavior). The purpose of this study was to explore student learning of static and dynamic skills throughout SLEs and live clinical practice.

METHOD

Thirty-three speech-language pathology graduate students participated in this study. Students were first trained to deliver an intervention before having their treatment fidelity measured at three time points: an initial SLE, actual clinical practice, and a final SLE. Treatment fidelity was first summarized using an overall accuracy score and then separated by static and dynamic skills. We hypothesized that (a) overall accuracy would increase from the initial simulation to treatment but remain steady from treatment to the final simulation and that (b) students would acquire dynamic skills more slowly than static skills.

RESULTS

In line with our hypotheses, students' overall accuracy improved over time. Although accuracy for static skills was mostly established after the first simulation, dynamic skills remained less accurate, with a slower acquisition timeline.

CONCLUSIONS

These results demonstrate that SLEs are efficacious in teaching students the clinical skills needed for actual clinical practice. Furthermore, we show that dynamic skills are more difficult for students to learn and implement than static skills, which suggests the need for greater attention to dynamic skill acquisition during clinical education.

A Realistic, Low-Cost Simulated Automated Chest Compression Device

Audience

This simulated automated chest compression device was designed for use in simulation cardiac arrest cases involving emergency medicine residents, but it would be applicable to other learners such as nurses, pharmacists, and medical students.

Background

Automated chest compression devices (ACCD) are commonly utilized in cardiac arrest in the emergency department and by emergency medical services (EMS) as patients arrive in the ED.1 Prolonged simulated cardiac arrest can be challenging to maintain proper chest compression depth and technique.2 Resident learning may be enhanced during cardiac arrest in the simulation environment by implementing the use of a simulated ACCD.

Educational Objectives

By the end of this educational session using a resuscitation trainer or high-fidelity manikin, learners should be able to:Recognize appropriate application of simulated ACCD to an ongoing resuscitation caseDemonstrate proper positioning of simulated ACCD in manikin modelIntegrate simulated ACCD to provide compressions appropriately throughout cardiac arrest scenario.

Educational Methods

We developed a cost-effective simulated ACCD for use in resuscitation simulation cases. An initial pilot session identified components of fidelity that were used to model the simulated ACCD after those utilized in clinical situations. Three simulated devices were created and then tested for efficacy during high-fidelity simulation with 25 emergency medicine residents.

Research Methods

Visual analog scales were used to explore how the simulated ACCD affected perceived realism and stress level during the cardiac arrest simulation. Qualitative data were collected through open-ended learner feedback comments. The institutional review board at our institution reviewed this project and determined that it was exempt.

Results

With inclusion of the simulated ACCD device, learners rated the simulation "more realistic" with an average rating of 74/100 and "less stressful" with an average rating of 69/100 on the visual analog scales. Learner comments noted that the use of the ACCD in simulation resulted in better resource availability and accurate environmental noise.

Discussion

The simulated ACCD presented here was found to be effective, realistic, and practical for use by learners in a resuscitation curriculum. Our results suggest that implementating a cost-effective simulated ACCD ($98 for supplies) in high-fidelity simulation cardiac arrest cases enhances the perceived realism of the environment and offers physician learners a low-stress opportunity to practice the clinical application of ACCD in cardiac arrest resuscitation. Additionally, the use of the simulated ACCD, specifically in a prolonged resuscitation, eliminated the need for physically demanding manual chest compressions. Anecdotally, in simulated environments we have observed poor-quality manual chest compressions due to an understanding that the manikin is "not real," leading to decreased psychological fidelity from the shared acceptance of the poor-quality compressions. Thus, the presence of a simulated clinical device providing chest compressions could have increased the feel of realism through improved psychological fidelity. Additionally, we note that the physical and psychological fidelity of this simulated device was sufficient for physicians to perceive clinical implementation, but may be suboptimal for assistive staff, who are focused on the specific functionality and may benefit from training on the physical device in clinical use. Finally, our simulated ACCD resembles the clinical device our department uses; we advise modifications as appropriate to allow a simulated ACCD created for other learners to also resemble their clinically used ACCD.

Topics

Automated chest compression device, ACLS, improvised equipment, high fidelity simulation.

Qualitative Exploration of Anesthesia Providers' Perceptions Regarding Philips Visual Patient Avatar in Clinical Practice

The Philips Visual Patient Avatar, a user-centered visualization technology, offers an alternative approach to patient monitoring. Computer-based simulation studies indicate that it increases diagnostic accuracy and confidence, while reducing perceived workload. About three months after the technology's integration into clinical practice, we conducted an assessment among anesthesia providers to determine their views on its strengths, limitations, and overall perceptions. This single-center qualitative study at the University Hospital of Zurich examined anesthesia providers' perceptions of the Philips Visual Patient Avatar after its implementation. The study included an online survey to identify medical personnel's opinions on the technology's strengths and areas for improvement, which were analyzed using thematic analysis. A total of 63 of the 377 invited anesthesia providers (16.7%) responded to the survey. Overall, 163 comments were collected. The most prevalent positive themes were good presentation of specific parameters (16/163; 9.8%) and quick overview/rapid identification of problems (15/163; 9.2%). The most common perceived area for improvement was the ability to adjust the visualization thresholds of Visual Patient Avatar, which represent the physiological upper and lower vital-sign limits (33/163; 20.3%). The study showed that users consider Philips Visual Patient Avatar a valuable asset in anesthesia, allowing for easier identification of underlying problems. However, the study also revealed a user desire for the ability to freely adjust the thresholds of the Visual Patient Avatar by the handling caregivers, which were fixed to the departmental standard during the study.

Evaluating an obstetrics and gynecology teaching program for medical students incorporating simulation-based education underpinned by cognitive load theory

Although there have been previous publications on curriculum innovations in teaching O&G to medical students, especially utilizing simulation-based education, there have been none, as far as we know, incorporating and evaluating the outcomes using cognitive load theory. The aim of this article was to describe the introduction, implementation, and evaluation of an innovative teaching program in O&G, incorporating simulation-based education, underpinned by cognitive load theory. Cognitive load is defined as the amount of information a working memory can hold at any one time and incorporates three types of cognitive load-intrinsic, extraneous, and germane. To optimize learning, educators are encouraged to manage intrinsic cognitive load, minimize extraneous cognitive load, and promote germane cognitive load. In these sessions, students were encouraged to prepare in advance of each session with recommended reading materials; to limit intrinsic cognitive load and promote germane cognitive load, faculty were advised ahead of each session to manage intrinsic cognitive load, an open-book MCQ practice session aimed to reduce anxiety, promote psychological safety, and minimize extraneous cognitive load. For the simulation sessions, the faculty initially demonstrated the role-play situation or clinical skill first, to manage intrinsic cognitive load and reduce extraneous cognitive load. The results of the evaluation showed that the students perceived that they invested relatively low mental effort in understanding the topics, theories, concepts, and definitions discussed during the sessions. There was a low extraneous cognitive load. Measures of germane cognitive load or self-perceived learning were high. The primary message is that we believe this teaching program is a model that other medical schools globally might want to consider adopting, to evaluate and justify innovations in the teaching of O&G to medical students. The secondary message is that evaluation of innovations to teaching and facilitation of learning using cognitive load theory is one way to contribute to the high-quality training of competent future healthcare workers required to provide the highest standard of care to women who are crucial to the overall health and wellbeing of a nation.

Dyadic practice for the acquisition of laparoscopic skills (DALS)-A randomized controlled trial

BACKGROUND

Laparoscopic simulation is integral to surgical education but requires significant resources. We aimed to compare the effectiveness of dyadic practice (DP), involving two individuals working together, to individual practice (IP) for novices acquiring laparoscopic skills and assess their learning experience.

METHODS

We conducted a Randomized Controlled Trial comparing DP and IP for novice medical students who completed a laparoscopic simulation workshop. Participants were assessed individually pre-course (test 1), post-course (test 2), and 8-week retention (test 3) using a validated quantitative method. A post-course questionnaire and interview, analyzed with thematic analysis, assessed the learning experience.

RESULTS

In total, 31 DP and 35 IP participants completed the study. There was no difference in mean scores between DP and IP groups in all three tests: test 1 (p = 0.55), test 2 (p = 0.26), test 3 (p = 0.35). In trend analysis, the DP group improved post-course (test 1 vs. 2: p = 0.02) and maintained this level at the retention test (2 vs. 3: p = 0.80, 1 vs. 3: p = 0.02). Whilst the IP group also improved post-course (test 1 vs. 2: p < 0.001), this improvement was not retained (2 vs. 3: p = 0.003, 1 vs. 3: p = 0.32). Thematic analysis revealed that DP participants valued peer support, peer feedback and observation time, but also acknowledged the limitations of reduced practical time and issues with teamwork.

CONCLUSION

DP is non-inferior to IP for novices learning laparoscopic skills, is well received and may lead to superior long-term skill retention.

Novice learners' perspectives on obstetric airway crisis decision-making training using virtual reality simulation

BACKGROUND

Current training on managing an obstetric difficult airway crisis is likely inadequate, as real-life opportunities to practice are rare. Frequent simulation training sessions could be helpful but are resource intensive. Virtual reality (VR) simulation training may be a potential tool to complement existing simulation curricula.

METHODS

In this pilot qualitative study, a VR simulation scenario of an obstetric airway crisis was designed to test the decision-making of novice learners rotating through obstetric anesthesia training. Individual interviews were conducted pre-VR to assess learning needs and post-VR to assess perspectives on utilizing the VR teaching tool. The interviews were transcribed and thematically analyzed.

RESULTS

Twenty-one residents were recruited and participated in the study. Analysis of pre-VR interviews identified three major themes, including gaps in the current curriculum, lack of confidence in managing obstetric difficult airway crises, and recognition that simulation is resource intensive. Post-VR interview themes revealed that VR could be helpful in learning decision-making under stress. Suggested improvements included better video and audio quality, and adding haptic feedback and potential multiplayer features in the future.

CONCLUSION

We identified the advantages of VR simulation and its potential as an intervention to address gaps in our curriculum. Areas of improvement were identified for more effective future implementation.

Relationship Between Cognitive Load Theory, Intrinsic Motivation and Emotions in Healthcare Professions Education: A Perspective on the Missing Link

Cognitive Load Theory (CLT) is one of the key cognitive theories that have been used to assess learners' information and working memory load. CLT has been applied to Simulation Based Education (SBE) and optimizing instructional design. However, a challenge that occurs is that these high-fidelity simulations and mannequins of critically ill patients can elicit negative emotions in learners which can unfavorably impact the learning process. There is also a potential for cognitive overload if the simulation is more authentic and requires more dynamic interactions and lead to high levels of anxiety due to a novel learning environment, which can also have detrimental effects on learning process. Hence, it is critical for health professional educators (HPE) to know how to minimize cognitive load to improve learning as a professional in a workplace setting. The literature on the role of emotions, intrinsic motivation, cognitive load is scarce in HPE literature. Specifically when not being studied together at once since they move dynamically together and affect the learning for the learner. Therefore, the purpose of this perspective paper is to cover the gap in the literature and propose a framework and recommendation for future HPE research.

The impact of brief mindfulness meditation on anxiety, cognitive load, and teamwork in emergency simulation training: A randomized controlled trial

BACKGROUND

Emergency simulation training may impose a heavy psychological burden on health professions students (HPS), evoking anxiety, and overwhelming their cognitive load. Mindfulness may have a positive impact on HPS' anxiety, cognitive load, and teamwork during simulation training. The effects of integration of a brief pre-briefing mindfulness meditation (MM) practice into emergency simulation training, on anxiety, cognitive load, and teamwork remain understudied.

METHODS

From November 2021 to June 2022, 70 undergraduate HPS participated in this pilot randomized controlled study. Participants were randomly assigned to the experimental group (EG, n = 24) that completed a brief in-person mindfulness meditation training program (MMTP) (2 h/week during 4 weeks) or a control group (CG, n = 46). Each group was comprised of teams (2 medical students and 1-2 nursing students). Measures of anxiety, mindfulness, cognitive load, and teamwork were collected at 4-time points: baseline, after the completion of the brief MMTP (for the EG only), at the first simulation assessment within one month later, and the second (6-month follow-up) simulation assessment. Student's t and Wilcoxon Mann-Whiney tests were used to compare the groups' measures and changes over time. A one-way repeated measures ANOVA was conducted to assess anxiety and mindfulness scores' changes over time among EG participants.

RESULTS

52 participants completed all time-point assessments. EG participants recorded better state-anxiety, cognitive load, and teamwork scores than the CG participants in both simulation assessments. However, no statistically significant differences were recorded between the EG and the CG in trait-anxiety and mindfulness at the 6-month follow-up assessment.

CONCLUSION

Brief pre-briefing MM practice mitigates HPS' state-anxiety, and promotes cognitive load, and teamwork during emergency simulation training. Simulation instructors should consider MM practice in the emergency healthcare simulation instructional design.

Hazard Assessment and Remediation Tool for Simulation-Based Healthcare Facility Design Testing

OBJECTIVES

To develop an objective, structured observational tool to enable identification and measurement of hazards in the built environment when applied to audiovisual recordings of simulations by trained raters.

BACKGROUND

Simulation-based facility design testing is increasingly used to optimize safety of healthcare environments, often relying on participant debriefing or direct observation by human factors experts.

METHODS

Hazard categories were defined through participant debriefing and detailed review of pediatric intensive care unit in situ simulation videos. Categories were refined and operational definitions developed through iterative coding and review. Hazard detection was optimized through the use of structured coding protocols and optimized camera angles.

RESULTS

Six hazard categories were defined: (1) slip/trip/fall/injury risk, impaired access to (2) patient or (3) equipment, (4) obstructed path, (5) poor visibility, and (6) infection risk. Analysis of paired and individual coding demonstrated strong overall reliability (0.89 and 0.85, Gwet's AC1). Reliability coefficients for each hazard category were >0.8 for all except obstructed path (0.76) for paired raters. Among individual raters, reliability coefficients were >0.8, except for slip/trip/fall/injury risk (0.68) and impaired access to equipment (0.77).

CONCLUSIONS

Hazard Assessment and Remediation Tool (HART) provides a framework to identify and quantify hazards in the built environment. The tool is highly reliable when applied to direct video review of simulations by either paired raters or trained single clinical raters. Subsequent work will (1) assess the tool's ability to discriminate between rooms with different physical attributes, (2) develop strategies to apply HART to improve facility design, and (3) assess transferability to non-ICU acute care environments.

'Gear up and get ready': Collaborative curriculum for radiographers supporting percutaneous nephrolithotomy in the operating theatre

INTRODUCTION

Newly qualified radiographers often find working in the operating theatre (OT) challenging and intimidating. These perceptions, which inhibit confidence, may hinder their effectiveness in interprofessional teamwork, which may in turn adversely affect patient outcomes. A collaborative education programme was designed, building upon the foundations of competency-based education (CBE) and simulation-based mastery learning (SBML) to examine its potential in mitigating these perceptions. The objective of this research was to assess participants' experience and level of competency after attending the curated collaborative educational programme.

METHODS

The programme was developed based on the Analysis, Design, Development, Implementation, and Evaluation (ADDIE) model and comprises two teaching and learning phases: educational session and simulation. A collaborative approach was undertaken to develop an assessment checklist for the interprofessional simulation. Requirements for the simulation, such as scenario design, information and storyboard, task trainer, logistics, and learners' briefing, debrief, and feedback, were identified and assembled. The radiographers' performance was recorded using a practical skills assessment checklist and a theory assessment.

RESULTS

Twelve radiographers participated and showed improvement in their self-rating of learning objectives before and after the programme. The median (interquartile range) score achieved in the theory assessment, out of a possible of 11, was 9.00 (7.75-9.50). The median (interquartile range) score achieved in the simulation component, out of a possible of 16, was 15.00 (14.00-15.00). There was statistically significant difference in self-perceived performance in all learning objective domains.

CONCLUSION

The findings from the programme were promising. The use of simulation and an assessment checklist proved to be useful learning tools in preparing newly qualified radiographers for work in the OT.

IMPLICATIONS FOR PRACTICE

Assessment checklists are valuable tools that should be considered to facilitate teaching and learning. The use of interprofessional simulation activities can support radiographers in developing knowledge, professional skills, and clinical competency. It should be conducted in a timely manner to facilitate the introduction to role understanding and effective communication.

Evaluation of tracheostomy suctioning procedure among nursing and respiratory therapy students: wearable manikin vs. standard manikin

Introduction

This study aims to evaluate cognitive load (CL), emotional levels (EL), and stress levels (SL) of students when using a wearable manikin vs. a standard manikin for tracheostomy suctioning (TS).

Methods

This study was approved by the Institutional Review Board. Subjects were recruited by email. Subjects completed a baseline demographics questionnaire, then they were randomized into two groups: wearable manikin group (WMG) or standard manikin group (SMG). For the WMG, an actor simulated a patient by wearing the device. In phase I, both groups were educated on how to perform TS by video and offered hands-on practice. Then I put through a tracheostomy suctioning clinical simulation and completed a post sim-survey. In phase II, the same survey was repeated after encountering a real patient as part of their clinical rotation.

Results

A total of 30 subjects with a mean age 26.0 ± 5.5 years participated. 20 (66.7%) were respiratory care students and 10 (33.3%) were nursing students. In the WMG, the median stress level dropped significantly post phase II compared to post phase I [2(1,4) vs.3(1,5), p = 0.04]. There were no significant changes in median CL, confidence, and satisfaction levels between post phase II and post phase I (p > 0.05). In the SMG, the satisfaction level increased significantly post phase II compared to post phase I [5(4,5) vs.4(2,5), p = 0.004], but there were no significant changes in CL, SL, and confidence levels between post phase I and phase II. There was no significant difference in mean EL scores over time and these changes did not differ by group. Subjects in the WMG showed a higher mean competency score than those in the SMG (85.5 ± 13.6 vs. 78.5 ± 20.8, p = 0.14, Cohen's d = 0.4), yet not significant.

Conclusion

Our results showed that the WMG is beneficial in helping bridge the gap of learning TS from the sim setting to the real-world clinical setting. More studies with higher sample size and use of other CL scales that assesses the different types of CL are needed to validate our findings.

Twelve tips for the pre-brief to promote psychological safety in simulation-based education

It is recognised that simulation-based education can be stressful, and this can impact negatively on learning. A fundamental aspect of facilitating simulation is creating a safe educational environment. Edmondson's seminal work on creating psychological safety among interpersonal teams has been embraced by the healthcare simulation community. Psychological safety is an underpinning philosophy for creating simulation experiences in which learners can develop within a stimulating and challenging yet supportive social atmosphere. Through careful design and thoughtful delivery, the introductory phase of simulation, the pre-briefing, can effectively prepare learners for simulation, reduce learner anxiety, and promote psychological safety, to enhance learning experiences. These twelve tips provide guidance for conducting a pre-brief and promoting a psychologically safe environment for simulation-based education.

Are evaluations in simulated medical encounters reliable among rater types? A comparison between standardized patient and outside observer ratings of OSCEs

Objective

By analyzing Objective Structured Clinical Examination (OSCE) evaluations of first-year interns' communication with standardized patients (SP), our study aimed to examine the differences between ratings of SPs and a set of outside observers with training in healthcare communication.

Methods

Immediately following completion of OSCEs, SPs evaluated interns' communication skills using 30 items. Later, two observers independently coded video recordings using the same items. We conducted two-tailed t-tests to examine differences between SP and observers' ratings.

Results

Rater scores differed significantly on 21 items (p < .05), with 20 of the 21 differences due to higher SP in-person evaluation scores. Items most divergent between SPs and observers included items related to empathic communication and nonverbal communication.

Conclusion

Differences between SP and observer ratings should be further investigated to determine if additional rater training is needed or if a revised evaluation measure is needed. Educators may benefit from adjusting evaluation criteria to decrease the number of items raters must complete and may do so by encompassing more global questions regarding various criteria. Furthermore, evaluation measures may be strengthened by undergoing reliability and validity testing.

Innovation

This study highlights the strengths and limitations to rater types (observers or SPs), as well as evaluation methods (recorded or in-person).

Use of real-time immersive digital training and educational technologies to improve patient safety during the processing of reusable medical devices: Quo Vadis?

Hospital acquired infections stemming from contaminated reusable medical devices are of increasing concern. This issue is exaggerated with the introduction of complex medical devices like endoscopes and robotic instrumentation. Although medical device manufacturers validate their cleaning instructions for use, evidence in the literature demonstrates that effective device processing is not being performed consistently within sterile processing departments in clinical settings. The result is increased risks to patient safety. As a solution to this problem, focused one-on-one training increases compliance to the medical device manufacturer's processing instruction. However, often this is not a practical solution for the volume of healthcare staff responsible for device processing activities. This constitutes the first paper to address the blended use of educational and digital technologies to address these challenges and as a result inform safety and sustainability for the medical device sector. Cognitive learning theory is an evidence-based framework for learning. It supports the use of immersive educational experiences using emerging extended reality technologies (e.g., virtual or augmented reality) to increase learning comprehension. The delivery of educational content via these technologies provides an innovative option for repeatable leaning and training outcomes. The motivation is to decrease patient risk of contaminated reusable medical devices. The proposed approach while primary motivated by safety can also enhance sustainability and efficiency enabled by artificial intelligence and robotic instrumentation.

Cognitive load theory in action: e-learning modules improve performance in simulation-based education. A pilot study

PURPOSE

Learners participating in simulation-based education may experience cognitive overload with potential detrimental effects to learning and performance. Multiple strategies have been proposed to mitigate this detrimental response. However, these strategies have not fully considered the potential benefits of using online platforms, such as accessibility, cost-effectiveness, efficiency, and scalability. Addressing this gap in the literature, preparatory online modules were developed by applying concepts from cognitive load theory and simulation-based education. This study assessed whether using preparatory online modules to deliver weekly pre-briefing content could impact cognitive load and performance. The participants were first-year postgraduate medical trainees participating in a simulation-based resuscitation curriculum.

METHODS

Fifty-three trainees were allocated to receive preparatory online modules (online modules group, n = 27) or not (control group, n = 26) during the course component of a simulation-based resuscitation curriculum. Then, these trainees participated in a simulation-based objective structured clinical examination (OSCE). Sources of cognitive load (intrinsic, extraneous, and germane) were measured using a modified cognitive load questionnaire. Performance was assessed using the Ottawa Surgical Competency Operating Room Evaluation. Data were analyzed with descriptive statistics, and principal component analysis.

RESULTS

During the course component, the online modules group was found to have higher intrinsic and germane cognitive load, and lower extraneous cognitive load compared to the control group. During the OSCE, the online modules group scored significantly higher in performance scores (p = 0.0077, d = 0.39, 95% confidence interval = 0.10;0.68) compared to the control group. Principal component analysis supported the results obtained with the modified cognitive load questionnaire.

CONCLUSION

Trainees using preparatory online modules during the course component of a simulation-based resuscitation curriculum experienced cognitive load changes consistent with cognitive optimization. This may have contributed to their superior performance in the subsequent OSCE. Future research should explore the long-term impacts of online preparatory training and consider potential barriers to implementation in diverse healthcare environments.

Using pointing gestures to convey tactical information: investigating the roles of expertise and complexity

Coach's speech and pointing gestures are closely related. However, the question of whether the coach's pointing gestures influence the learning of complex game systems is still unclear. The present study examined the moderating roles of content complexity and expertise level on recall performance, visual attention, and mental effort through the coach's pointing gestures. One hundred and ninety-two novice and expert basketball players were randomly assigned to one of the four experimental conditions (simple content + no-gesture, simple content + with-gesture, more complex content + no-gesture, or more complex content + with-gesture). The results showed that regardless of the complexity of the content, novices showed significantly better recall performance, better visual search on the static diagrams and lower mental effort in the with-gesture condition than in the no-gesture condition. However, the results showed that experts benefited equally from both conditions (with-gesture and no-gestures) when the content was simple, whereas they benefited more from the condition with-gesture when the content was more complex. The findings and their implications for the design of learning materials are discussed in terms of cognitive load theory.

Simulation-Based Training in Emergency Obstetric Care in Sub-Saharan and Central Africa: A Scoping Review

Background

Every day approximately 810 women die from complications related to pregnancy and childbirth worldwide. Around two thirds of these deaths happen in sub-Saharan Africa. One of the strategies to decrease these numbers is improving the quality of care by emergency obstetric simulation-based training. The effectiveness of such training programs depends on the program's instructional design.

Objective

This review gives an overview of studies about emergency obstetric simulation-based training and examines the applied instructional design of the training programs in sub-Saharan and Central Africa.

Methods

We searched Medline, Embase and Cochrane Library from inception to May 2021. Peer-reviewed articles on emergency obstetric, postgraduate, simulation-based training in sub-Saharan and Central Africa were included. Outcome measures were categorized based on Kirkpatrick's levels of training evaluation. The instructional design was evaluated by using the ID-SIM questionnaire.

Findings

In total, 47 studies met the inclusion criteria. Evaluation on Kirkpatrick level 1 showed positive reactions in 18 studies. Challenges and recommendations were considered. Results on knowledge, skills, and predictors for these results (Kirkpatrick level 2) were described in 29 studies. Retention as well as decay of knowledge and skills over time were presented. Results at Kirkpatrick level 3 were measured in 12 studies of which seven studies demonstrated improvements of skills on-the-job. Improvements of maternal and neonatal outcomes were described in fifteen studies and three studies reported on cost-estimations for training rollout (Kirkpatrick level 4). Instructional design items were heterogeneously applied and described.

Conclusions

Results of 47 studies indicate evidence that simulation-based training in sub-Saharan and Central Africa can have a positive impact across all four levels of Kirkpatrick's training evaluation model. However, results were not consistent across all studies and the effects vary over time. A detailed description of instructional design features in future publications on simulation-based training will contribute to a deeper understanding of the underlying mechanisms that determine why certain training programs are more effective in improving maternal and neonatal healthcare outcomes than other.

Developing a virtual reality (VR) application for practicing the ABCDE approach for systematic clinical observation

BACKGROUND

The Airways, Breathing, Circulation, Disability, Exposure (ABCDE) approach is an international approach for systematic clinical observation. It is an essential clinical skill for medical and healthcare professionals and should be practiced repeatedly. One way to do so is by using virtual reality (VR). The aim was therefore to develop a VR application to be used by inexperienced health students and professionals for self-instructed practice of systematic clinical observation using the ABCDE approach.

METHODS

An iterative human-centred approach done in three overlapping phases; deciding on the ABCDE approach, specifying the requirements, and developing the application.

RESULTS

A total of 138 persons were involved. Eight clinical observations were included in the ABCDE approach. The requirements included making it possible for inexperienced users to do self-instructed practice, a high level of immersion, and a sense of presence including mirroring the physical activities needed to do the ABCDE approach, allowing for both single and multiplayer, and automatic feedback with encouragement to repeat the training. In addition to many refinements, the testing led to the development of some new solutions. Prominent among them was to get players to understand how to use the VR hand controllers and start to interact with the VR environment and more instructions like showing videos on how to do observations. The solutions in the developed version were categorised into 15 core features like onboarding, instructions, quiz, and feedback.

CONCLUSION

A virtual reality application for self-instructed practice of systematic clinical observation using the ABCDE approach can be developed with sufficient testing by inexperienced health students and professionals.

Neural basis underlying the sense of coherence in medical professionals revealed by the fractional amplitude of low-frequency fluctuations

Although mitigating burnout has long been a pressing issue in healthcare, recent global disasters, including the COVID-19 pandemic and wars, have exacerbated this problem. Medical professionals are frequently exposed to diverse job-induced distress; furthermore, the importance of people's sense of coherence (SOC) over work has been addressed to better deal with burnout. However, the neural mechanisms underlying SOC in medical professionals are not sufficiently investigated. In this study, the intrinsic fractional amplitude of low-frequency fluctuations (fALFF) were measured as an indicator of regional brain spontaneous activity using resting-state functional magnetic resonance imaging in registered nurses. The associations between participants' SOC levels and the fALFF values within brain regions were subsequently explored. The SOC scale scores were positively correlated with fALFF values in the right superior frontal gyrus (SFG) and the left inferior parietal lobule. Furthermore, the SOC levels of the participants mediated the link between their fALFF values in the right SFG and the depersonalization dimension of burnout. The results deepened the understanding of the counter role of SOC on burnout in medical professionals and may provide practical insights for developing efficient interventions.

Human-centered visualization technologies for patient monitoring are the future: a narrative review

Medical technology innovation has improved patient monitoring in perioperative and intensive care medicine and continuous improvement in the technology is now a central focus in this field. Because data density increases with the number of parameters captured by patient-monitoring devices, its interpretation has become more challenging. Therefore, it is necessary to support clinicians in managing information overload while improving their awareness and understanding about the patient's health status. Patient monitoring has almost exclusively operated on the single-sensor-single-indicator principle-a technology-centered way of presenting data in which specific parameters are measured and displayed individually as separate numbers and waves. An alternative is user-centered medical visualization technology, which integrates multiple pieces of information (e.g., vital signs), derived from multiple sensors into a single indicator-an avatar-based visualization-that is a meaningful representation of the real-world situation. Data are presented as changing shapes, colors, and animation frequencies, which can be perceived, integrated, and interpreted much more efficiently than other formats (e.g., numbers). The beneficial effects of these technologies have been confirmed in computer-based simulation studies; visualization technologies improved clinicians' situation awareness by helping them effectively perceive and verbalize the underlying medical issue, while improving diagnostic confidence and reducing workload. This review presents an overview of the scientific results and the evidence for the validity of these technologies.

Cognitive Load Assessment Scales in Simulation: Validity Evidence for a Novel Measure of Cognitive Load Types

INTRODUCTION

Cognitive load (CL) theory provides a framework to inform simulation instructional design. Reliable measures of CL types (intrinsic [IL], extraneous [EL], and germane load [GL]) in simulation are lacking. We developed the novel Cognitive Load Assessment Scales in Simulation (CLAS-Sim) and report validity evidence using Kane's framework.

METHODS

This quasi-experimental study tested the effect of a segmented/pause-and-debrief or standard/end-of-case-debrief intervention on pediatric residents' performance and self-rated CL in 2 complex- and simple-case simulations. After each simulation, participants completed 22 items measuring CL types. Three validity inferences were examined: scoring (instrument development and principal component analysis); generalization (internal consistency reliability of CL-component items across cases); and extrapolation [CLAS-Sim correlations with the single-item Paas scale, which measures overall CL; differences in primary task performance (high vs low); and discriminant validity of IL under different instructional-design conditions].

RESULTS

Seventy-four residents completed both simulations and postcase CLAS-Sim measures. The principal component analysis yielded 3 components: 4-item IL, 4-item EL, and 3-item GL scales (Cronbach's α, 0.68-0.77). The Paas scores correlated with CLAS-Sim IL and total CL scores in both cases ( rs range, 0.39-0.70; P ≤ 0.001). High complex-case performers reported lower IL and total CL (analyses of variance, each P < 0.001). In multivariate analyses of variance, CLAS-Sim IL, GL, and total CL varied across both cases by arm (each P ≤ 0.018); the segmented-debrief arm reported lower IL than the standard-debrief arm in both cases (each P ≤ 0.01).

CONCLUSIONS

The CLAS-Sim demonstrates preliminary validity evidence for distinguishing 3 CL types but requires further study to evaluate the impact of simulation-design elements on CL and learning.

Taking the Pulse of the Current State of Simulation

Simulation in health-care professions has grown in the last few decades. We provide an overview of the history of simulation in other fields, the trajectory of simulation in health professions education, and research in medical education, including the learning theories and tools to assess and evaluate simulation programs. We also propose future directions for simulation and research in health professions education.

The simulation design in health and nursing: A scoping review

AIMS

The aims of this study were to map the components of the simulation design in health and nursing and to propose a classification based on their definitions to support the planning of simulation-based experiences.

DESIGN

Scoping review.

METHOD

Searches were performed in the databases LILACS, Embase, MEDLINE/PubMed, SCOPUS, Web of Science, Google Scholar and ProQuest Thesis and Dissertation were performed, without time limitation, to identify studies about simulation design.

RESULTS

This study mapped 19 components of the simulation design found in 26 studies included, which can contribute to the development of simulation-based experiences, classified into structural, methodological and theoretical-pedagogical components. The simulation design can be described according to its fundamental components: structural-define the basic formulation of a simulation in terms of infrastructure and conceptual framework; methodological-define the participants, roles and the instruction format; and theoretical-pedagogical-define the educational references used to support the simulation strategy.

Cognitive Load Management: An Invaluable Tool for Safe and Effective Surgical Training

This article highlights the importance of considering Cognitive Load (CL) and Cognitive Load Theory (CLT) during surgical training, focusing on the acquisition of intra-operative skills. It describes the basis of CLT with the overarching aim of describing CLT-based techniques to enhance current training strategies and surgical performance, many of which are instinctively already employed in surgical practice. Currently, methods of feedback and assessment are imperfect - typically subjective, unsystematic, opportunistic, or retrospective, and at risk of human bias. Surgical Sabermetrics, the advanced analytics of surgical and audio-visual data, aims to enhance this feedback by providing objective, real-time, digital-based feedback. This article introduces the benefit of real-time measurement of CL to enhance feedback and its applications to surgical performance that follow the ethos of Surgical Sabermetrics.¹ The 2022 theme for ICOSET was "Making it Better." Cognitive Load and Surgical Sabermetrics principles provide tools to make Surgical training better, with the goal of higher quality care for patients.

The influence of the simulation environment on teamwork and cognitive load in novice trauma professionals at the emergency department: Piloting a randomized controlled trial

INTRODUCTION

This pilot study aimed to test the feasibility of conducting a randomized controlled trial to examine how simulation environments (in situ versus laboratory) influence teamwork skills development and cognitive load among novice healthcare trauma professionals in the emergency department.

METHOD

Twenty-four novice trauma professionals (nurses, medical residents, respiratory therapists) were assigned to in situ or laboratory simulations. They participated in two 15-minute simulations separated by a 45-minute debriefing on teamwork. After each simulation, they completed validated teamwork and cognitive load questionnaires. All simulations were video recorded to assess teamwork performance by trained external observers. Feasibility measures (e.g., recruitment rate, randomization procedure and intervention implementation) were recorded. Mixed ANOVAs were used to calculate effect sizes.

RESULTS

Regarding feasibility, several difficulties were encountered, such as a low recruitment rate and the inability to perform randomization. Outcome results suggest that the simulation environment does not affect novice trauma professionals' teamwork performance and cognitive load (small effect sizes), but a large effect size was observed for perceived learning.

CONCLUSION

This study highlights several barriers to conducting a randomized study in the context of interprofessional simulation-based education in the emergency department. Suggestions are made to guide future research in the field.

Critical design choices in healthcare simulation education: a 4C/ID perspective on design that leads to transfer

BACKGROUND

Healthcare simulation education often aims to promote transfer of learning: the application of knowledge, skills, and attitudes acquired during simulations to new situations in the workplace. Although achieving transfer is challenging, existing theories and models can provide guidance.

RECOMMENDATIONS

This paper provides five general recommendations to design simulations that foster transfer: (1) emphasize whole-task practice, (2) consider a cognitive task analysis, (3) embed simulations within more comprehensive programs, (4) strategically combine and align simulation formats, and (5) optimize cognitive load. We illustrate the application of these five recommendations with a blueprint for an educational program focusing on simulation activities.

CONCLUSIONS

More evidence-informed approaches to healthcare simulation might require a paradigm shift. We must accept that a limited number of simulations is not enough to develop complex skills. It requires comprehensive programs that combine simulation sessions with workplace learning.

A Conceptual Framework for Instructional Design of a High Acuity and Low Occurrence Event - Simulation Based Education Training of Residents, Medical Students, and Nurses in Anaphylaxis Utilizing Curated Educational Theories

The broad goal of this educational curriculum is utilization and optimization of Simulation-Based Education (SBE) in the training of residents, medical students, and nursing staff involved in the rapid and timely recognition of Anaphylaxis and its optimized treatment. A critical gap in Anaphylaxis Diagnosis, Management, and Treatment (ADAM) has been well established across medical disciplines. It is imperative to include all members of the healthcare team, as nurses and pharmacists play key roles in anaphylaxis recognition and care. Nurses and pharmacists are proficiently trained in the initial assessment of acute patient complaints, status, and in proper dosing/administration considerations. Anaphylaxis is a High Acuity and Low Occurrence (HALO) event. Delayed recognition and administration of epinephrine-autoinjector (EAI) is a patient safety concern. Suboptimal technique and expertise in this regard is common. Literature abounds with reports of physician trainee doubts and uncertainties in the recognition and optimized management of Anaphylaxis. Importantly, Anaphylaxis is frequently misdiagnosed in hospital emergency departments. SBE methodologies are ideal for instructing HALO experiences. The framework of the "Zone of Simulation Matrix" supports the utilization of a simulation experience in this instance. Learning will be effective, enhanced, and made durable by embedding numerous specifically curated educational theories. Given the paucity in training of residents and nursing staff in Anaphylaxis, such instruction is imperative. Of note, a special emphasis in this curricular framework is the debriefing experience. Considerations will be given to the psychological safety of the trainees and the importance of the heterogeneity of prior experiences. Precise diagnosis minimizes mortality. In the hospital setting, nurses are the first responders to critical HALO events, and there is a lack of awareness of ADAM by nursing students.

Using Task-Evoked Pupillary Response to Predict Clinical Performance during a Simulation Training

Training in healthcare skills can be affected by trainees' workload when completing a task. Due to cognitive processing demands being negatively correlated to clinical performance, assessing mental workload through objective measures is crucial. This study aimed to investigate task-evoked changes in pupil size as reliable markers of mental workload and clinical performance. A sample of 49 nursing students participated in a cardiac arrest simulation-based practice. Measurements of cognitive demands (NASA-Task Load Index), physiological parameters (blood pressure, oxygen saturation, and heart rate), and pupil responses (minimum, maximum, and difference diameters) throughout revealed statistically significant differences according to performance scores. The analysis of a multiple regression model produced a statistically significant pattern between pupil diameter differences and heart rate, systolic blood pressure, workload, and performance (R² = 0.280; F (6, 41) = 2.660; p < 0.028; d = 2.042). Findings suggest that pupil variations are promising markers to complement physiological metrics for predicting mental workload and clinical performance in medical practice.

Evaluating the integration of body donor imaging into anatomical dissection using augmented reality

Augmented reality (AR) has recently been utilized as an integrative teaching tool in medical curricula given its ability to view virtual objects while interacting with the physical environment. The evidence for AR in medical training, however, is limited. For this reason, the purpose of this mixed method study was to evaluate the implementation of overlaying donor-specific diagnostic imaging (DSDI) onto corresponding body donors in a fourth-year, dissection-based, medical elective course entitled anatomy for surgeons (AFS). Students registered in AFS course were separated into groups, receiving either DSDI displayed on Microsoft HoloLens AR head-mounted display (n = 12) or DSDI displayed on iPad (n = 15). To test for the change in spatial ability, students completed an anatomical mental rotation test (AMRT) prior to and following the AFS course. Students also participated in a focus group discussion and completed a survey at the end of AFS, analyzed through thematic triangulation and an unpaired, Mann Whitney U test respectively, both addressing dissection experience, DSDI relevancy to dissection, and use of AR in anatomical education. Although statistically significant differences were not found when comparing student group AMRT scores, survey and discussion data suggest that the HoloLens had improved the students' understanding of, and their spatial orientation of, anatomical relationships. Trunk dissection quality grades were significantly higher with students using the HoloLens. Although students mentioned difficulties with HoloLens software, with faculty assistance, training, and enhanced software development, there is potential for this AR tool to contribute to improved dissection quality and an immersive learning experience.