From Theory to Practice: The Application of Cognitive Load Theory to the Practice of Medicine

The Application of Cognitive Load Theory to the Design of Health and Behavior Change Programs: Principles and Recommendations

Health and behavior change programs play a crucial role in improving health behaviors at individual and family levels. However, these programs face challenges with engagement and retention and typically show modest efficacy. Cognitive load theory is an established and highly used educational theory that proposes individuals have a finite capacity to process new information ("working memory"). Learning, engagement, and performance are negatively impacted when working memory is exceeded. Cognitive load theory is grounded in an understanding of human cognition and conceptualizes different types of cognitive loads imposed on individuals by a learning experience. Cognitive load theory aims to guide the design of learning experiences, considering how the human mind works, leading to more meaningful and effective learning. Cognitive load theory is increasingly applied to domains outside the classroom, such as designing patient and clinical education. Applying cognitive load theory to the design of health programs, their materials, and interfaces can provide insights. By considering the cognitive demands placed on individuals when interacting with health programs, design can be optimized to reduce cognitive load and better facilitate learning and behavior adoption. This may enhance engagement, retention, and effectiveness of programs. Cognitive load theory may be particularly valuable for individuals with diminished working memory due to high levels of mental load and stress. Design principles are presented to consolidate knowledge from cognitive load theory and existing approaches to guide researchers, policymakers, and health programmers. Further research and interdisciplinary collaboration are needed to realize the potential of cognitive load theory in health.

Toward better prevention of physician burnout: insights from individual participant data using the MD-specific Occupational Stressor Index and organizational interventions

Background

Physician burnout has become a public-health crisis. The need is dire for robust organizational solutions, focusing on reduction of specific stressors. The physician-specific Occupational Stressor Index (OSI) based on cognitive ergonomics can help. Individual-participant data (IPD) from different studies addressing physician burnout are lacking.

Aims

To perform IPD analysis regarding job stressors and their relation to physician burnout and to utilize the IPD results to inform a systematic review of the stressors that show an association with physician burnout, focusing on intervention studies.

Methods

PRISMA guidelines are followed for the IPD analysis and systematic review of intervention studies on the implicated stressors, taking the COVID-19 pandemic into consideration. The IPD analysis is performed on studies using the physician-specific OSI vis-à-vis burnout assessed by the Copenhagen Burnout Inventory (CBI). Odds ratios (OR) ± 95% confidence-intervals (CI) are reported, adjusting for age, gender and caring for patients with suspected COVID-19 infection.

Results

Three studies fulfilled the inclusion criteria, providing complete IPD data for 95 physicians. Thirty-two (33.7%) physicians had total OSI scores >88, for which intervention is urgently needed. Unit-change in the total stressor burden assessed via OSI yielded OR = 1.11 (95%CI: 1.03-1.18) (p = 0.003) for personal burnout, OR = 1.17 (95%CI: 1.08-1.26) (p = 0.0001) for work-related burnout and OR = 1.07 (95%CI: 1.01-1.15) (p = 0.03) for patient-related burnout. Caring for patients with suspected COVID-19 infection showed significant multivariable results (p = 0.04) only for personal burnout. Twenty distinct work stressors revealed multivariable associations with CBI. Systematic examination via PUBMED, CINAHL and OVID Medline yielded 33 publications mitigating those stressors among physicians. Adequate staffing was pivotal. Clerical staff off-loaded administrative burden. Information-technology staff helped diminish interruptions, enhancing workflow. Cross-coverage reduced time constraints, ensured separate periods for non-clinical tasks, and ≥1 work-free day/week. Several interventions impacted physician burnout, as did recognition of physicians' efforts/achievements. Other OSI-identified stressors were insufficiently examined in intervention studies: e.g. vacation; appropriately-timed, cross-covered restbreaks; and counter-measures for emotionally-disturbing aspects of MD's work, particularly during the pandemic.

Conclusions

Further participatory-action research is needed in well-controlled intervention trials to alleviate physician burnout.

A randomized controlled trial on evaluating clinician-supervised generative AI for decision support

BACKGROUND

The integration of generative artificial intelligence (AI) as clinical decision support systems (CDSS) into telemedicine presents a significant opportunity to enhance clinical outcomes, yet its application remains underexplored.

OBJECTIVE

This study investigates the efficacy of one of the most common generative AI tools, ChatGPT, for providing clinical guidance during cardiac arrest scenarios.

METHODS

We examined the performance, cognitive load, and trust associated with traditional methods (paper guide), autonomous ChatGPT, and clinician-supervised ChatGPT, where a clinician supervised the AI recommendations. Fifty-four subjects without medical backgrounds participated in randomized controlled trials, each assigned to one of three intervention groups: paper guide, ChatGPT, or supervised ChatGPT. Participants completed a standardized CPR scenario using an Augmented Reality (AR) headset, and performance, physiological, and self-reported metrics were recorded.

MAIN FINDINGS

Results indicate that the Supervised-ChatGPT group showed significantly higher decision accuracy compared to the paper guide and ChatGPT groups, although the scenario completion time was longer. Physiological data showed a reduced LF/HF ratio in the Supervised-ChatGPT group, suggesting potentially lower cognitive load. Trust in AI was also highest in the supervised condition. In one instance, ChatGPT suggested a risky option, highlighting the need for clinician supervision.

CONCLUSION

Our findings highlight the potential of supervised generative AI to enhance decision-making accuracy and user trust in emergency healthcare settings, despite trade-offs with response time. The study underscores the importance of clinician oversight and the need for further refinement of AI systems to improve safety. Future research should explore strategies to optimize AI supervision and assess the implementation of these systems in real-world clinical settings.

Diagnostic reasoning and cognitive error in emergency medicine: Implications for teaching and learning

BACKGROUND

Accurate diagnosis in emergency medicine (EM) is high stakes and challenging. Research into physicians' clinical reasoning has been ongoing since the late 1970s. The dual-process theory has established itself as a valid model, including in EM. It is based on the distinction between two information-processing systems. System 1 rapidly generates one or more diagnostic hypotheses almost instantaneously, driven by experiential knowledge, while System 2 proceeds more slowly and analytically, applying formal rules to arrive at a final diagnosis.

METHODS

We reviewed the literature on dual-process theory in the fields of cognitive science, medical education and emergency medicine.

RESULTS AND CONCLUSION

The literature reflects two prominent interpretations regarding the relationship between the fast and slow phases and these interpretations carry very different implications for the training of clinical learners. One interpretation, prominent in the EM community, presents it as a "check-and-balance" framework in which most diagnostic error is caused by cognitive biases originating within System 1. As a result, EM residents are frequently advised to deploy analytical (System 2) strategies to correct such biases. However, such teaching approaches are not supported by research into the nature of diagnostic reasoning. An alternative interpretation assumes a harmonious relationship between Systems 1 and 2 in which both fast and slow processes are driven by underlying knowledge that conditions performance and the occurrence of errors. Educational strategies corresponding to this alternative have not been explored in the EM literature. In this paper, we offer proposals for improving the teaching and learning of diagnostic reasoning by EM residents.

Leveraging artificial intelligence to reduce diagnostic errors in emergency medicine: Challenges, opportunities, and future directions

Diagnostic errors in health care pose significant risks to patient safety and are disturbingly common. In the emergency department (ED), the chaotic and high-pressure environment increases the likelihood of these errors, as emergency clinicians must make rapid decisions with limited information, often under cognitive overload. Artificial intelligence (AI) offers promising solutions to improve diagnostic errors in three key areas: information gathering, clinical decision support (CDS), and feedback through quality improvement. AI can streamline the information-gathering process by automating data retrieval, reducing cognitive load, and providing clinicians with essential patient details quickly. AI-driven CDS systems enhance diagnostic decision making by offering real-time insights, reducing cognitive biases, and prioritizing differential diagnoses. Furthermore, AI-powered feedback loops can facilitate continuous learning and refinement of diagnostic processes by providing targeted education and outcome feedback to clinicians. By integrating AI into these areas, the potential for reducing diagnostic errors and improving patient safety in the ED is substantial. However, successfully implementing AI in the ED is challenging and complex. Developing, validating, and implementing AI as a safe, human-centered ED tool requires thoughtful design and meticulous attention to ethical and practical considerations. Clinicians and patients must be integrated as key stakeholders across these processes. Ultimately, AI should be seen as a tool that assists clinicians by supporting better, faster decisions and thus enhances patient outcomes.

Allied health professionals cognitive workload scale in Malacca, Malaysia: A psychometric properties evaluation

BackgroundCognitive workload has emerged as one of the most important topics that must be understood and addressed because of its impact on errors and work performance that will compromise patient safety. With increasing patient health demands, Allied Health Professionals (AHPs) tend to have heavier cognitive workloads and impact on personal well-being.ObjectiveOur study aims to determine the validity and reliability of a cognitive workload scale for AHP in Malacca, Malaysia and examine its effect on personal well-being.MethodThe instrument comprises items related to human reliability, human-computer interaction, decision-making, skilled performance, training, work stress and cognitive ergonomic effect. The content validation was conducted using the Content Validity Questionnaire with eight expert panels' responses. 120 AHP working in Malacca were recruited using purposive sampling and took part in the study, completing the online questionnaires. To evaluate the validity based on relationships with other measures, the SMEQ scale was also administered. AMOS Version 24 and IBM SPSS Version 26 were used in data analysis.ResultsThe instrument showed good content validity (CVI > 0.74). After the deletion of six items, the instrument has good convergent validity (AVE > 0.5), discriminant validity (HTMT Ratio < 0.85), composite reliability (CR > 0.7), internal consistency (alpha > 0.7), construct validity the ratio (1.865), CFI (0.900), PCFI (0.821), PNFI (0.738), RMSEA (0.085), IFI (0.90) and test-retest reliability (ICC > 0.6). The study found a positive correlation with the Malay version of SMEQ. This study also found that the AHP in the laboratory group have higher work stress and experiences more cognitive load effects, leading to lower personal well-being.ConclusionOverall, the final version of a scale measuring the cognitive workload is valid and reliable in assessing cognitive ergonomics among AHP. Testing cognitive workload on different work populations, including manual and non-manual workers, is recommended for future studies.

What is the learning effect of video review in postgraduate medical education: a systematic review

BACKGROUND

Video review is a feasible, commonly used learning tool, but current literature lacks a comprehensive review of its impact on learning in postgraduate medical education. This systematic review aims at examining the learning effect of video review of resident performance in clinical practice during postgraduate medical education.

METHODS

A systematic literature search was conducted from May 2023 to July 2023 with an update on 12/12/2023. Databases of MEDLINE (Pubmed), Web of Science, Embase and ERIC (through Webquest) were searched. Eligible articles had to describe the learning effects of video review in clinical practice in postgraduate medical education. The videos had to be actively recorded in a setting where a camera was not normally used for standard patient care. The investigated effect needed to be classified at least as a Kirkpatrick level 2. We iteratively developed a standardized data extraction form to extract study characteristics. The methodological quality of the individual studies was assessed using the Medical Education Research Quality Instrument.

RESULTS

Out of 9323 records after deduplication, 11 studies were included. The designs were randomised controlled trials (n = 4) and single-group pre-test post-tests trials (n = 7). The studies had outcomes related to knowledge and skills (n = 5), resident behaviours (n = 5) and patient outcome (n = 1). All studies reported outcomes regarding learning effect.

CONCLUSIONS

Video review appears to have a positive impact on residents' learning outcomes in postgraduate medical education. However, it is mostly not tailored to the specific learning needs of residents, and there is a lack of information regarding its optimal integration with other learning methods and within distinct clinical contexts. The heterogeneity observed among the included studies makes it challenging to formulate clear recommendations in the use of video.

The mental workload of ICU nurses performing human-machine tasks and associated factors: A cross-sectional questionnaire survey

AIMS

To assess the level of mental workload (MWL) of intensive care unit (ICU) nurses in performing different human-machine tasks and examine the predictors of the MWL.

DESIGN

A cross-sectional questionnaire study.

METHODS

Between January and February 2021, data were collected from ICU nurses (n = 427) at nine tertiary hospitals selected from five (east, west, south, north, central) regions in China through an electronic questionnaire, including sociodemographic questions, the National Aeronautics and Space Administration Task Load Index, General Self-Efficacy Scale, Difficulty-assessing Index System of Nursing Operation Technique, and System Usability Scale. Descriptive statistics, t-tests, one-way ANOVA and multiple linear regression models were used.

RESULTS

ICU nurses experienced a medium level of MWL (score 52.04 on a scale of 0-100) while performing human-machine tasks. ICU nurses' MWL was notably higher in conducting first aid and life support tasks (using defibrillators or ventilators). Predictors of MWL were task difficulty, system usability, professional title, age, self-efficacy, ICU category, and willingness to study emerging technology actively. Task difficulty and system usability were the strongest predictors of nearly all typical tasks.

CONCLUSION

ICU nurses experience a medium MWL while performing human-machine tasks, but higher mental, temporal, and effort are perceived compared to physical demands. The MWL varied significantly across different human-machine tasks, among which are significantly higher: first aid and life support and information-based human-machine tasks. Task difficulty and system availability are decisive predictors of MWL.

IMPACT

This is the first study to investigate the level of MWL of ICU nurses performing different representative human-machine tasks and to explore its predictors, which provides a reference for future research. These findings suggest that healthcare organizations should pay attention to the MWL of ICU nurses and develop customized management strategies based on task characteristics to maintain a moderate level of MWL, thus enabling ICU nurses to perform human-machine tasks better.

PATIENT OR PUBLIC CONTRIBUTION

No patient or public contribution.

The Transformative Teaching Framework: A roadmap for 21st century teaching

The US healthcare system has changed dramatically in the past several decades. Nursing education, conversely, has not. This disparity, with a widening academic-practice gap prompted The National Academies to call on nursing education bodies to lead transformational change in nursing education to create the entry level and advanced practice nurses needed in the 21st century healthcare system (Wakefield et al., 2021). The Publication of The Essentials: Core Competencies for Professional Nursing Education is the catalyst for this change. Revising curricula in nursing schools will not affect the changes needed without a transformation in how nurse educators approach their practice. The Transformative Teaching Framework provides a roadmap for faculty to embody their role differently. Adopting the new role of Faculty Coach, nurse educators cultivate a teacher-learner relationship grounded in the neuroscience of learning, relational and developmental actions aimed at the professional formation of clinicians, and mutual trust. The Transformative Teaching Framework has the power to guide faculty as they develop clinicians who can thrive in the 21st century healthcare system.

Can AnatomicalTerms.info with its synonyms and succinct open definitions be a solution to address variations in usage of anatomical terminology?

Anatomy, the study of human structure, is foundational to medicine. Its language has a long history, with contributions from authors hailing from diverse cultures and countries, adhering to various scientific traditions, speaking different languages, and practicing medicine across a wide gamut of specialties. The resultant disparity in terms provides challenges both for students in learning and for interdisciplinary communication. We report here on a user-friendly look-up web site, "AnatomicalTerms.info" that links a Terminologica Anatomica term to alternative terms in usage: synonyms, polysemes, eponyms, homonyms, and terms in other languages. Accompanying open-source definitions are generated with the help of "Definition Machine" software, that supports creating the most concise and accessible definitions for anatomical terms, eschewing superfluous description, thus reducing cognitive load of learners of anatomy looking up terms. AnatomicalTerms.info is a readily accessible online source for both the authoritative and alternatively used terms that can accurately cross-reference and/or disambiguate anatomical structures across disciplinary and cultural divides. As such, it can serve as a useful educational and clinical resource that is also flexibly open to additions and expansion as anatomical and clinical needs dictate.

The transformation of Cure4Kids: Expanding knowledge transfer capacity

Global survival disparities among children with cancer and other catastrophic diseases are the driving force behind Cure4Kids' sustained outreach to healthcare professionals. Congruent with this need, Cure4Kids was redesigned to meet the emergent demands of diverse healthcare professionals seeking free, web-based pediatric hematology/oncology education. Herein, we present an overview of each phase of the design and development process for the transformation and describe key features of the new Cure4Kids and future opportunities for expansion.

Implementation considerations for the adoption of artificial intelligence in the emergency department

OBJECTIVE

Artificial intelligence (AI) has emerged as a potentially transformative force, particularly in the realm of emergency medicine (EM). The implementation of AI in emergency departments (ED) has the potential to improve patient care through various modalities. However, the implementation of AI in the ED presents unique challenges that influence its clinical adoption. This scoping review summarizes the current literature exploring the barriers and facilitators of the clinical implementation of AI in the ED.

METHODS

We systematically searched Embase (Ovid), MEDLINE (Ovid), Web of Science, and Engineering Village. All articles were published in English through November 20th, 2023. Two reviewers screened the search results, with disagreements resolved through third-party adjudication.

RESULTS

A total of 8172 studies were included in the preliminary search, with 22 selected for the final data extraction. 10 studies were reviews and the remaining 12 were primary quantitative, qualitative, and mixed-methods studies. Out of the 22, 13 studies investigated a specific AI tool or application. Common barriers to implementation included a lack of model interpretability and explainability, encroachment on physician autonomy, and medicolegal considerations. Common facilitators to implementation included educating staff on the model, efficient integration into existing workflows, and sound external validation.

CONCLUSION

There is increasing literature on AI implementation in the ED. Our research suggests that the most common barrier facing AI implementation in the ED is model interpretability and explainability. More primary research investigating the implementation of specific AI tools should be undertaken to help facilitate their successful clinical adoption in the ED.

Attention Among Health Care Professionals : A Scoping Review

BACKGROUND

The concept of attention can provide insight into the needs of clinicians and how health systems design can impact patient care quality and medical errors.

PURPOSE

To conduct a scoping review to 1) identify and characterize literature relevant to clinician attention; 2) compile metrics used to measure attention; and 3) create a framework of key concepts.

DATA SOURCES

Cumulated Index to Nursing and Allied Health Literature (CINAHL), Medline (PubMed), and Embase (Ovid) from 2001 to 26 February 2024.

STUDY SELECTION

English-language studies addressing health care worker attention in patient care. At least dual review and data abstraction.

DATA EXTRACTION

Article information, health care professional studied, practice environment, study design and intent, factor type related to attention, and metrics of attention used.

DATA SYNTHESIS

Of 6448 screened articles, 585 met inclusion criteria. Most studies were descriptive (n = 469) versus investigational (n = 116). More studies focused on barriers to attention (n = 387; 342 descriptive and 45 investigational) versus facilitators to improving attention (n = 198; 112 descriptive and 86 investigational). We developed a framework, grouping studies into 6 categories: 1) definitions of attention, 2) the clinical environment and its effect on attention, 3) personal factors affecting attention, 4) relationships between interventions or factors that affect attention and patient outcomes, 5) the effect of clinical alarms and alarm fatigue on attention, and 6) health information technology's effect on attention. Eighty-two metrics were used to measure attention.

LIMITATIONS

Does not synthesize answers to specific questions. Quality of studies was not assessed.

CONCLUSION

This overview may be a resource for researchers, quality improvement experts, and health system leaders to improve clinical environments. Future systematic reviews may synthesize evidence on metrics to measure attention and on the effectiveness of barriers or facilitators related to attention.

PRIMARY FUNDING SOURCE

None.

Potential role of cannabis in ameliorating observed racialized disparities in cancer pain management

Cancer-related pain affects a large proportion of all patients with cancer yet remains inadequately managed, particularly among patients from certain racialized backgrounds. Recently, there has been increased research and clinical interest in the use of medical cannabis for cancer pain management, including its potential to ameliorate race-based disparities in cancer pain control. Although medical cannabis is not currently a US Food and Drug Administration-approved treatment option for cancer-related pain, many oncologists discuss and recommend its use with their patients, underscoring the need for researchers and clinicians to proactively identify barriers to cannabis for cancer pain management that may disproportionately affect patients from certain racial groups. In this commentary, we highlight challenges that patients from racialized backgrounds may face when incorporating cannabis into their palliative care regimens and discuss opportunities for researchers and clinicians to address these challenges should medical cannabis become a recommended treatment option for cancer pain management. In particular, we identify challenges at the structural (eg, lack of insurance coverage), clinician (eg, racialized stereotypes regarding addiction and pain), and individual (eg, internalized stigma) levels and emphasize the importance of multilevel approaches in combating these challenges as the evidence base regarding medical cannabis and its potential harms and therapeutic benefits continues to accumulate.

Use of Self-Efficacy Scale in Mass Casualty Incidents During Drill Exercises

INTRODUCTION

Medical First Responders (MFRs) in the emergency department SUMMA 112 are tasked with handling the initial management of Mass Casualty Incidents (MCI) and building response capabilities. Training plays a crucial role in preparing these responders for effective disaster management. Yet, evaluating the impact of such training poses challenges since true competency can only be proven amid a major event. As a substitute gauge for training effectiveness, self-efficacy has been suggested.

OBJECTIVE

The purpose of this study is to employ a pre- and post-test assessment of changes in perceived self-efficacy among MFRs following an intervention focused on the initial management of MCI. It also aimed to evaluate a self-efficacy instrument for its validity and reliability in this type of training.

METHOD

In this study, we used a pretest (time 1 = T1) - post-test (time 2 = T2) design to evaluate how self-efficacy changed after a training intervention with 201 MFRs in initial MCI management. ANOVA within-subjects and between subjects analyses were used.

RESULTS

The findings reveal a noteworthy change in self-efficacy before and after training among the 201 participants. This suggests that the training intervention positively affected participants' perceived capabilities to handle complex situations like MCI.

CONCLUSION

The results allow us to recommend a training program with theory components together with practical workshops and live, large-scale simulation exercises for the training of medical first responders in MCI, as it significantly increases their perception of the level of self-efficacy for developing competencies associated with disaster response.

Cognitive load theory in workplace-based learning from the viewpoint of nursing students: application of a path analysis

PURPOSE

The present study aimed to test the relationship between the components of the Cognitive Load Theory (CLT) including memory, intrinsic and extraneous cognitive load in workplace-based learning in a clinical setting, and decision-making skills of nursing students.

METHODS

This study was conducted at Shahid Sadoughi University of Medical Sciences in 2021-2023. The participants were 151 nursing students who studied their apprenticeship courses in the teaching hospitals. The three basic components of the cognitive load model, including working memory, cognitive load, and decision-making as the outcome of learning, were investigated in this study. Wechsler's computerized working memory test was used to evaluate working memory. Cognitive Load Inventory for Handoffs including nine questions in three categories of intrinsic cognitive load, extraneous cognitive load, and germane cognitive load was used. The clinical decision-making skills of the participants were evaluated using a 24-question inventory by Lowry et al. based on a 5-point scale. The path analysis of AMOS 22 software was used to examine the relationships between components and test the model.

FINDINGS

In this study, the goodness of fit of the model based on the cognitive load theory was reported (GIF = 0.99, CFI = 0.99, RMSEA = 0.03). The results of regression analysis showed that the scores of decision-making skills in nursing students were significantly related to extraneous cognitive load scores (p-value = 0.0001). Intrinsic cognitive load was significantly different from the point of view of nursing students in different academic years (p = 0.0001).

CONCLUSION

The present results showed that the CLT in workplace-based learning has a goodness of fit with the components of memory, intrinsic cognitive load, extraneous cognitive load, and clinical decision-making skill as the key learning outcomes in nursing education. The results showed that the relationship between nursing students' decision-making skills and extraneous cognitive load is stronger than its relationship with intrinsic cognitive load and memory Workplace-based learning programs in nursing that aim to improve students' decision-making skills are suggested to manage extraneous cognitive load by incorporating cognitive load principles into the instructional design of clinical education.

Teaching Before, During, and After a Surgical Resuscitation

Teaching during a surgical resuscitation can be difficult due to the infrequency of these events. Furthermore, when these events do occur, the trainee can experience cognitive overload and an overwhelming amount of stress, thereby impairing the learning process. The emergent nature of these scenarios can make it difficult for the surgical educator to adequately teach. Repeated exposure through simulation, role play, and "war games" are great adjuncts to teaching and preparation before crisis. However, surgical educators can further enhance the knowledge of their trainees during these scenarios by using tactics such as talking out loud, targeted teaching, and debriefing.

Trainee selection of tasks in postgraduate medical education: Is there a role for 'cherry-picking' to optimise learning?

PURPOSE

Learning is optimised when postgraduate trainees engage in clinical tasks in their zone of proximal development (ZPD). However, workplace learning environments impose additional non-learning goals and additional tasks that may lead to trainees engaging in tasks that do not fall within their ZPD. We do not fully understand how trainees select clinical tasks in the workplace learning environment. If we knew the goals and factors they consider when selecting a task, we could better equip trainees with strategies to select tasks that maximise learning. We explored how postgraduate trainees select clinical tasks using echocardiography interpretation as a model.

METHODS

Canadian General Cardiology residents and Echocardiography fellows were invited to participate in semi-structured interviews. Aligning with a theory-informed study, two independent researchers used a deductive, directed content analysis approach to identify codes and themes.

RESULTS

Eleven trainees from seven Canadian universities participated (PGY4 = 4, PGY5 = 3, PGY6 = 1 and echocardiography fellows = 3). Goals included learning content, fulfilling assessment criteria and contributing to clinical demands. Trainees switched between goals throughout the day, as it was too effortful for them to engage in tasks within their ZPD at all times. When trainees had sufficient mental effort available, they selected higher complexity tasks that could advance learning content. When available mental effort was low, trainees selected less complex tasks that fulfilled numerically based assessment goals or contributed to clinical demands. Trainees predominantly used perceived complexity of the echocardiogram as a factor to select tasks to achieve their desired goals.

CONCLUSION

Postgraduate trainees select tasks within their ZPD that enable them to maximise learning when they perceive to have sufficient mental effort available and workplace affordances are adequate. These findings can inform individual and systemic strategies to maximise learning when selecting tasks.

Evaluation of tracheostomy suctioning procedure among nursing and respiratory therapy students: wearable manikin vs. standard manikin

Introduction

This study aims to evaluate cognitive load (CL), emotional levels (EL), and stress levels (SL) of students when using a wearable manikin vs. a standard manikin for tracheostomy suctioning (TS).

Methods

This study was approved by the Institutional Review Board. Subjects were recruited by email. Subjects completed a baseline demographics questionnaire, then they were randomized into two groups: wearable manikin group (WMG) or standard manikin group (SMG). For the WMG, an actor simulated a patient by wearing the device. In phase I, both groups were educated on how to perform TS by video and offered hands-on practice. Then I put through a tracheostomy suctioning clinical simulation and completed a post sim-survey. In phase II, the same survey was repeated after encountering a real patient as part of their clinical rotation.

Results

A total of 30 subjects with a mean age 26.0 ± 5.5 years participated. 20 (66.7%) were respiratory care students and 10 (33.3%) were nursing students. In the WMG, the median stress level dropped significantly post phase II compared to post phase I [2(1,4) vs.3(1,5), p = 0.04]. There were no significant changes in median CL, confidence, and satisfaction levels between post phase II and post phase I (p > 0.05). In the SMG, the satisfaction level increased significantly post phase II compared to post phase I [5(4,5) vs.4(2,5), p = 0.004], but there were no significant changes in CL, SL, and confidence levels between post phase I and phase II. There was no significant difference in mean EL scores over time and these changes did not differ by group. Subjects in the WMG showed a higher mean competency score than those in the SMG (85.5 ± 13.6 vs. 78.5 ± 20.8, p = 0.14, Cohen's d = 0.4), yet not significant.

Conclusion

Our results showed that the WMG is beneficial in helping bridge the gap of learning TS from the sim setting to the real-world clinical setting. More studies with higher sample size and use of other CL scales that assesses the different types of CL are needed to validate our findings.

Collaboration Scripts or Checklists to Engage Novice Observers in Immersive Simulation?

INTRODUCTION

In simulation, students often observe their peers perform a task. It is still unclear how different types of instructional guidance can turn the observational phase into an active learning experience for novices. This mixed-method study aims to understand similarities and differences between use of collaboration scripts and checklists by observers in terms of cognitive load and perception of learning.

METHODS

Second-year pharmacy students ( N = 162) were randomly assigned to 1 of 4 conditions when observing a simulation: collaboration scripts (heuristic to analyze in dyads while observing), checklists, both, or no guidance. We measured observers' intrinsic and extraneous cognitive load and self-perceived learning and conducted focus group interviews.

RESULTS

Intrinsic cognitive load was significantly lower for checklists (M = 3.6/10) than for scripts (M = 4.7/10) or scripts and checklists combined (M = 4.7/10). Extraneous cognitive load was significantly lower for checklists (M = 1.5/10) than for scripts combined with checklists (M = 2.6/10) or no guidance (M = 1.8/10). There was no statistical difference between conditions for self-perceived learning. Coding of focus group interviews revealed 6 themes on observers' perception of learning under different conditions of instructional guidance. Students explained that collaboration scripts felt more complex, whereas checklists were perceived as a simple fact-checking exercise. Observing the simulation, regardless of guidance, was a meaningful learning experience.

CONCLUSIONS

With or without guidance, observers are actively engaged with the simulation, but their effort differed depending on instructions. When choosing between checklists or collaboration scripts, educators should be guided by the type of simulation task.

Cognitive load theory in action: e-learning modules improve performance in simulation-based education. A pilot study

PURPOSE

Learners participating in simulation-based education may experience cognitive overload with potential detrimental effects to learning and performance. Multiple strategies have been proposed to mitigate this detrimental response. However, these strategies have not fully considered the potential benefits of using online platforms, such as accessibility, cost-effectiveness, efficiency, and scalability. Addressing this gap in the literature, preparatory online modules were developed by applying concepts from cognitive load theory and simulation-based education. This study assessed whether using preparatory online modules to deliver weekly pre-briefing content could impact cognitive load and performance. The participants were first-year postgraduate medical trainees participating in a simulation-based resuscitation curriculum.

METHODS

Fifty-three trainees were allocated to receive preparatory online modules (online modules group, n = 27) or not (control group, n = 26) during the course component of a simulation-based resuscitation curriculum. Then, these trainees participated in a simulation-based objective structured clinical examination (OSCE). Sources of cognitive load (intrinsic, extraneous, and germane) were measured using a modified cognitive load questionnaire. Performance was assessed using the Ottawa Surgical Competency Operating Room Evaluation. Data were analyzed with descriptive statistics, and principal component analysis.

RESULTS

During the course component, the online modules group was found to have higher intrinsic and germane cognitive load, and lower extraneous cognitive load compared to the control group. During the OSCE, the online modules group scored significantly higher in performance scores (p = 0.0077, d = 0.39, 95% confidence interval = 0.10;0.68) compared to the control group. Principal component analysis supported the results obtained with the modified cognitive load questionnaire.

CONCLUSION

Trainees using preparatory online modules during the course component of a simulation-based resuscitation curriculum experienced cognitive load changes consistent with cognitive optimization. This may have contributed to their superior performance in the subsequent OSCE. Future research should explore the long-term impacts of online preparatory training and consider potential barriers to implementation in diverse healthcare environments.

Impact of training in the supervision of clinical reasoning in the pediatric emergency department on residents' perception of the on-call experience

BACKGROUND

In 2021, the prevalence of signs of burnout among medical residents was reported to be 67%. Being on call is particularly stressful for residents, notably due to their lack of medical experience. When they are on call, several factors contribute to a mismatch between the residents' theoretical knowledge and the operationalization of that knowledge in a clinical reasoning process. Using the script and cognitive load theories as a basis, we hypothesized that training clinician-teachers in the supervision of clinical reasoning could improve residents' perception of the experience of being on call.

METHODS

We performed a longitudinal, exploratory, controlled study with a cohort of medical residents who were on call in the pediatric emergency department during the semester from 1 November 2021 to 30 April 2022. During the night, the residents on call in the pediatric emergency department completed validated questionnaires investigating (1) mental effort, (2) cognitive weariness, (3) state anxiety, (4) feeling of self-efficacy, and (5) well-being. We compared the questionnaires of residents supervised by pediatricians trained in the supervision of clinical reasoning (supervision group) with those of residents in a control group, supervised by pediatricians with no specific pedagogical training.

RESULTS

A total of 284 questionnaires (174 supervision group, 110 controls) were collected from 38 residents in three pediatric emergency departments. The results confirm that being on call is difficult for residents. Compared to the control group, residents in the supervision group had lower cognitive weariness scores (mean 3.0 ± 1.1 vs. 3.5 ± 1.3). There was no significant difference between groups for any of the other dimensions of the on-call experience. In the supervision group, mental effort was significantly lower at the end of the study semester (5 [5-6] when on call in month 6 of the semester vs. 6 [5-7] when on call in months 1-5 of the semester; p = 0.01) and was greater for more senior residents (7 [6-8] for those in the 4th or higher semester of residency vs. 6 [5-7] for residents in their 1st, 2nd, or 3rd semester of residency; β = 0.92 ± 0.40; p = 0.02).

CONCLUSION

Beyond the positive effects for residents, this study illustrates the feasibility of implementing training for clinicians in the supervision of clinical reasoning.

The Assessment Burden in Competency-Based Medical Education: How Programs Are Adapting

Residents and faculty have described a burden of assessment related to the implementation of competency-based medical education (CBME), which may undermine its benefits. Although this concerning signal has been identified, little has been done to identify adaptations to address this problem. Grounded in an analysis of an early Canadian pan-institutional CBME adopter's experience, this article describes postgraduate programs' adaptations related to the challenges of assessment in CBME. From June 2019-September 2022, 8 residency programs underwent a standardized Rapid Evaluation guided by the Core Components Framework (CCF). Sixty interviews and 18 focus groups were held with invested partners. Transcripts were analyzed abductively using CCF, and ideal implementation was compared with enacted implementation. These findings were then shared back with program leaders, adaptations were subsequently developed, and technical reports were generated for each program. Researchers reviewed the technical reports to identify themes related to the burden of assessment with a subsequent focus on identifying adaptations across programs. Three themes were identified: (1) disparate mental models of assessment processes in CBME, (2) challenges in workplace-based assessment processes, and (3) challenges in performance review and decision making. Theme 1 included entrustment interpretation and lack of shared mindset for performance standards. Adaptations included revising entrustment scales, faculty development, and formalizing resident membership. Theme 2 involved direct observation, timeliness of assessment completion, and feedback quality. Adaptations included alternative assessment strategies beyond entrustable professional activity forms and proactive assessment planning. Theme 3 related to resident data monitoring and competence committee decision making. Adaptations included adding resident representatives to the competence committee and assessment platform enhancements. These adaptations represent responses to the concerning signal of significant burden of assessment within CBME being experienced broadly. The authors hope other programs may learn from their institution's experience and navigate the CBME-related assessment burden their invested partners may be facing.

The Effects of Reflective Pauses on Performance in Simulation Training

INTRODUCTION

The reflective pause, taking a pause during performance to reflect, is an important practice in simulation-based learning. However, for novice learners, it is a highly complex self-regulatory skill that cannot stand alone without guidance. Using educational theories, we propose how to design cognitive and metacognitive aids to guide learners with the reflective pause and investigate its effects on performance in a simulation training environment.

METHODS

These effects are examined in four aspects of performance: cognitive load, primary performance, secondary performance, and encapsulation. Medical students ( N = 72) performed tasks in simulation training for emergency medicine, under 2 conditions: reflection condition ( n = 36) where reflection was prompted and guided, and control condition ( n = 36) without such reflection.

RESULTS

The effects of reflective pauses emerged for 2 aspects of performance: cognitive load decreased and secondary performance improved. However, primary performance and encapsulation did not show significant difference.

CONCLUSIONS

The results demonstrate that reflective pauses with cognitive and metacognitive aids implemented can enhance some aspects of performance. We suggest that to secure these effects, feedback during reflection and an adaptation period should be provided.

Application of the R2C2 Model to In-the-Moment Feedback and Coaching

PURPOSE

The R2C2 (relationship, reaction, content, coaching) model is an iterative, evidence-based, theory-informed approach to feedback and coaching that enables preceptors and learners to build relationships, explore reactions and reflections, confirm content, and coach for change and cocreate an action plan. This study explored application of the R2C2 model for in-the-moment feedback conversations between preceptors and learners and the factors that influence its use.

METHOD

A qualitative study using framework analysis through the lens of experiential learning was undertaken with 15 trained preceptor-learner dyads. Data were collected during feedback sessions and follow-up interviews between March 2021 and July 2022. The research team familiarized themselves with the data, used a coding template to document examples of the model's application, reviewed the initial framework and revised the coding template, indexed and summarized the data, created a summary document, examined the transcripts for alignment with each model phase, and identified illustrative quotations and overarching themes.

RESULTS

Fifteen dyads were recruited from 8 disciplines (11 preceptors were paired with a single resident [n = 9] or a single medical student [n = 2]; 2 preceptors each had 2 residents). All dyads were able to apply the R2C2 phases of building relationships, exploring reactions and reflections, and confirming content. Many struggled with the coaching components, specifically in creating an action plan and follow-up arrangements. Preceptor skill in applying the model, time available for feedback conversations, and the nature of the relationship impacted how the model was applied.

CONCLUSIONS

The R2C2 model can be adapted to contexts where in-the-moment feedback conversations occur shortly after a clinical encounter. Experiential learning approaches applying the R2C2 model are critical. Skillful application of the model requires that learners and preceptors go beyond confirming an area of change and deliberately engage in coaching and cocreating an action plan.

Bilingual resuscitation training does not affect adherence to resuscitation guidelines but reduces leadership skills and overall team performance. An observational study with cross-border German-Polish training

Aim of study

This study aims to investigate feasibility and quality of a bilingual cardiopulmonary resuscitation training with interprofessional emergency teams from Germany and Poland.

Methods

As part of a cross-border European Territorial Cooperation (Interreg-VA) funded project a combined communication and simulation training was organised. Teams of German and Polish emergency medicine personnel jointly practised resuscitation. The course was held in both languages with consecutive translation.Quality of chest compression was assessed using a simulator with feedback application. Learning objectives (quality of cardiopulmonary resuscitation, adherence to guidelines, closed loop communication), and team performance were assessed by an external observer. Coopeŕs Team Emergency Assessment Measure questionnaire was used.

Results

Twenty-one scenarios with 17 participants were analysed. In all scenarios, defibrillation and medication were delivered with correct dosage and at the right time. Mean fraction of correct hand position was 85.7% ± 25.7 [95%-CI 74.0; 97.4], mean fraction of compression depth 75.1% ± 21.0 [95%-CI 65.6; 84.7], compression rate 117.7 min-1 ± 7.1 [95%-CI 114.4; 120.9], and chest compression fraction 83.3% ± 3.8 [95%-CI 81.6; 85.0].Quality of cardiopulmonary resuscitation was rated as "fair" to "good", adherence to guidelines as "good", and closed loop communication as "fair". Bilingual teams demonstrated good situational awareness, but lack of leadership and suboptimal overall team performance.

Conclusion

Bilingual and interprofessional cross-border resuscitation training in German and Polish tandem teams is feasible. It does not affect quality of technical skills such as high-quality chest compression but does affect performance of non-technical skills (e.g. closed loop communication and leadership).

Cognitive Ergonomics: A Review of Interventions for Outpatient Practice

Doctoring is difficult mental work, involving many cognitively demanding processes such as diagnosing, decision-making, parallel processing, communicating, and managing the emotions of others. According to cognitive load theory (CLT), working memory is a limited cognitive resource that can support a finite amount of cognitive load. While the intrinsic cognitive load is the innate load associated with a task, the extraneous load is generated by inefficiency or suboptimal work conditions. Causes of extraneous cognitive load in healthcare include inefficiency, distractions, interruptions, multitasking, stress, poor communication, conflict, and incivility. High levels of cognitive load are associated with impaired function and an increased risk of burnout among physicians. Cognitive ergonomics is the branch of human factors and ergonomics (HFE) focused on supporting the cognitive processes of individuals within a system. In health care, where the cognitive burden on physicians is high, cognitive ergonomics can establish practices and systems that decrease extraneous cognitive load and support pertinent cognitive processes. In this review, we present cognitive ergonomics as a useful framework for conceptualizing an oft-overlooked dimension of labor and apply theory to practice by summarizing evidence-based cognitive ergonomics interventions for outpatient care settings. Our proposed interventions are structured within four general recommendations: 1. minimize distractions, interruptions, and multitasking; 2. optimize the use of the electronic health record (EHR); 3. optimize the use of health information systems (HIS); and 4. support good communication and teamwork. Best practices in cognitive ergonomics can benefit patients, minimize practice inefficiency, and support physician career longevity.

Cognitive perspectives on maintaining physicians' medical expertise: I. Reimagining Maintenance of Certification to promote lifelong learning

Until recently, physicians in the USA who were board-certified in a specialty needed to take a summative test every 6-10 years. However, the 24 Member Boards of the American Board of Medical Specialties are in the process of switching toward much more frequent assessments, which we refer to as longitudinal assessment. The goal of longitudinal assessments is to provide formative feedback to physicians to help them learn content they do not know as well as serve an evaluation for board certification. We present five articles collectively covering the science behind this change, the likely outcomes, and some open questions. This initial article introduces the context behind this change. This article also discusses various forms of lifelong learning opportunities that can help physicians stay current, including longitudinal assessment, and the pros and cons of each.

Using cognitive load theory to evaluate and improve preparatory materials and study time for the flipped classroom

BACKGROUND

Preclinical medical education is content-dense and time-constrained. Flipped classroom approaches promote durable learning, but challenges with unsatisfactory student preparation and high workload remain. Cognitive load theory defines instructional design as "efficient" if learners can master the presented concepts without cognitive overload. We created a PReparatory Evaluation Process (PREP) to systematically assess and measure improvement in the cognitive-load efficiency of preparatory materials and impact on study time (time-efficiency).

METHODS

We conducted this study in a flipped, multidisciplinary course for ~ 170 first year students at Harvard Medical School using a naturalistic post-test design. For each flipped session (n = 97), we assessed cognitive load and preparatory study time by administering a 3-item PREP survey embedded within a short subject-matter quiz students completed before class. Over three years (2017-2019), we evaluated cognitive load- and time- based efficiency to guide iterative revisions of the materials by content experts. The ability of PREP to detect changes to the instructional design (sensitivity) was validated through a manual audit of the materials.

RESULTS

The average survey response rate was ≥ 94%. Content expertise was not required to interpret PREP data. Initially students did not necessarily allocate the most study time to the most difficult content. Over time, the iterative changes in instructional design increased the cognitive load- and time-based efficiency of preparatory materials with large effect sizes (p < .01). Furthermore, this increased the overall alignment of cognitive load with study time: students allocated more time to difficult content away from more familiar, less difficult content without increasing workload overall.

CONCLUSIONS

Cognitive load and time constraints are important parameters to consider when designing curricula. The PREP process is learner-centered, grounded in educational theory, and works independently of content knowledge. It can provide rich and actionable insights into instructional design of flipped classes not captured by traditional satisfaction-based evaluations.

Using cognitive load theory to develop an emergency airway management curriculum: the Queen's University Mastery Airway Course (QUMAC)

Emergency airway management requires the simultaneous coordination of clinical reasoning and therapeutic interventions in the complex and time-sensitive setting of emergency resuscitation. The cognitive demand associated with these situations is invariably high and must be taken into consideration when designing training programs for this core professional competency. The four-component instructional design model (4C/ID), based on cognitive load theory, was used to develop a 1-year longitudinal airway management curriculum for Emergency Medicine residents. The simulation-based curriculum was designed with the goal of facilitating the construction and automation of schemas by individual residents in preparation for the high cognitive demand associated with emergency airway management in the clinical environment.

Coaching the coach: A randomized controlled study of a novel curriculum for procedural coaching during intubation

Background

Videolaryngoscopy allows real-time procedural coaching during intubation. This study sought to develop and assess an online curriculum to train pediatric emergency medicine attending physicians to deliver procedural coaching during intubation.

Methods

Curriculum development consisted of semistructured interviews with 12 pediatric emergency medicine attendings with varying levels of airway expertise analyzed using a constructivist grounded theory approach. Following development, the curriculum was implemented and assessed through a multicenter randomized controlled trial enrolling participants in one of three cohorts: the coaching module, unnarrated video recordings of intubations, and a module on ventilator management. Participants completed identical pre and post assessments asking them to select the correct coaching feedback and provided reactions for qualitative thematic analysis.

Results

Content from interviews was synthesized into a video-enhanced 15-min online coaching module illustrating proper technique for intubation and strategies for procedural coaching. Eighty-seven of 104 randomized physicians enrolled in the curriculum; 83 completed the pre and post assessments (80%). The total percentage correct did not differ between pre and post assessments for any cohort. Participants receiving the coaching module demonstrated improved performance on patient preparation, made more suggestions for improvement, and experienced a greater increase in confidence in procedural coaching. Qualitative analysis identified multiple benefits of the module, revealed that exposure to video recordings without narration is insufficient, and identified feedback on suggestions for improvement as an opportunity for deliberate practice.

Conclusions

This study leveraged clinical and educational digital technology to develop a curriculum dedicated to the content expertise and coaching skills needed to provide feedback during intubations performed with videolaryngoscopy. This brief curriculum changed behavior in simulated coaching scenarios but would benefit from additional support for deliberate practice.

User Perceptions of ROTEM-Guided Haemostatic Resuscitation: A Mixed Qualitative-Quantitative Study

Viscoelastic point-of-care haemostatic resuscitation methods, such as ROTEM or TEG, are crucial in deciding on time-efficient personalised coagulation interventions. International transfusion guidelines emphasise increased patient safety and reduced treatment costs. We analysed care providers' perceptions of ROTEM to identify perceived strengths and areas for improvement. We conducted a single-centre, mixed qualitative-quantitative study consisting of interviews followed by an online survey. Using a template approach, we first identified themes in the responses given by care providers about ROTEM. Later, the participants rated six statements based on the identified themes on five-point Likert scales in an online questionnaire. Seventy-seven participants were interviewed, and 52 completed the online survey. By analysing user perceptions, we identified ten themes. The most common positive theme was "high accuracy". The most common negative theme was "need for training". In the online survey, 94% of participants agreed that monitoring the real-time ROTEM temograms helps to initiate targeted treatment more quickly and 81% agreed that recurrent ROTEM training would be beneficial. Anaesthesia care providers found ROTEM to be accurate and quickly available to support decision-making in dynamic and complex haemostatic situations. However, clinicians identified that interpreting ROTEM is a complex and cognitively demanding task that requires significant training needs.

Cognitive Load Management: An Invaluable Tool for Safe and Effective Surgical Training

This article highlights the importance of considering Cognitive Load (CL) and Cognitive Load Theory (CLT) during surgical training, focusing on the acquisition of intra-operative skills. It describes the basis of CLT with the overarching aim of describing CLT-based techniques to enhance current training strategies and surgical performance, many of which are instinctively already employed in surgical practice. Currently, methods of feedback and assessment are imperfect - typically subjective, unsystematic, opportunistic, or retrospective, and at risk of human bias. Surgical Sabermetrics, the advanced analytics of surgical and audio-visual data, aims to enhance this feedback by providing objective, real-time, digital-based feedback. This article introduces the benefit of real-time measurement of CL to enhance feedback and its applications to surgical performance that follow the ethos of Surgical Sabermetrics.¹ The 2022 theme for ICOSET was "Making it Better." Cognitive Load and Surgical Sabermetrics principles provide tools to make Surgical training better, with the goal of higher quality care for patients.

Critical design choices in healthcare simulation education: a 4C/ID perspective on design that leads to transfer

BACKGROUND

Healthcare simulation education often aims to promote transfer of learning: the application of knowledge, skills, and attitudes acquired during simulations to new situations in the workplace. Although achieving transfer is challenging, existing theories and models can provide guidance.

RECOMMENDATIONS

This paper provides five general recommendations to design simulations that foster transfer: (1) emphasize whole-task practice, (2) consider a cognitive task analysis, (3) embed simulations within more comprehensive programs, (4) strategically combine and align simulation formats, and (5) optimize cognitive load. We illustrate the application of these five recommendations with a blueprint for an educational program focusing on simulation activities.

CONCLUSIONS

More evidence-informed approaches to healthcare simulation might require a paradigm shift. We must accept that a limited number of simulations is not enough to develop complex skills. It requires comprehensive programs that combine simulation sessions with workplace learning.

Task complexity and cognitive load in simulation-based education: A randomised trial

INTRODUCTION

When designing simulation for novices, educators aim to design tasks and environments that are complex enough to promote learning but not too complex to compromise task performance and cause cognitive overload. This study aimed to determine the impact of modulating task and environment complexity on novices' performance and cognitive load during simulation.

METHODS

Second-year pharmacy students (N = 162) were randomly assigned to one of four conditions (2 × 2 factorial design) in simulation: simple task in simple environment, complex task in simple environment, simple task in complex environment and complex task in complex environment. Using video recordings, two raters assessed students' performance during the simulation. We measured intrinsic cognitive load (ICL) and extraneous cognitive load (ECL) with questionnaires after the task and tested knowledge after task and debriefing.

RESULTS

Mean performance scores in simple environment were 28.2/32 (SD = 3.8) for simple task and 25.8/32 (SD = 4.2) for complex task. In complex environment, mean performance scores were 24.6/32 (SD = 5.2) for simple task and 25.6/32 (SD = 5.3) for complex task. We found significant interaction effects between task and environment complexity for performance. In simple environment, mean ICL scores were 4.2/10 (SD = 2.2) for simple task and 5.7/10 (SD = 1.5) for complex task. In complex environment, mean ICL scores were 4.9/10 (SD = 1.8) for simple task and 5.1/10 (SD = 1.9) for complex task. There was a main effect of task complexity on ICL. For ECL, we found neither an interaction effect nor main effects of task and environment complexity. There was a main effect of task complexity on knowledge test after task and main effects of both task and environment complexity on knowledge after debriefing.

CONCLUSIONS

Performance was good, and cognitive load remained reasonable in all conditions, which suggests that, despite increased complexity, students seemed to strategically manage their own cognitive load and learn from the simulations. Our findings also indicate that environmental complexity contributes to ICL.

Virtual Reality Head-Mounted Displays in Medical Education: A Systematic Review

SUMMARY STATEMENT

Simulation-based training using virtual reality head-mounted displays (VR-HMD) is increasingly being used within the field of medical education. This article systematically reviews and appraises the quality of the literature on the use of VR-HMDs in medical education. A search in the databases PubMed/MEDLINE, Embase, ERIC, Scopus, Web of Science, Cochrane Library, and PsychINFO was carried out. Studies were screened according to predefined exclusion criteria, and quality was assessed using the Medical Education Research Study Quality Instrument. In total, 41 articles were included and thematically divided into 5 groups: anatomy, procedural skills, surgical procedures, communication skills, and clinical decision making. Participants highly appreciated using VR-HMD and rated it better than most other training methods. Virtual reality head-mounted display outperformed traditional methods of learning surgical procedures. Although VR-HMD showed promising results when learning anatomy, it was not considered better than other available study materials. No conclusive findings could be synthesized regarding the remaining 3 groups.

Randomized Trial Comparing Instructor-Delivered Feedback with Self-Assessment Using Video during Basic Skills Training

Feedback has been shown to be one of the most powerful and effective influences on student achievement; however, the optimal method for providing feedback to trainees during veterinary skills training has yet to be determined. A prospective mixed-methods study was undertaken to evaluate student perceptions and performance outcomes with self-assessment using video- or instructor-delivered feedback during skills training using a model. Forty participants naïve to intravenous (IV) catheter placement were randomly assigned either to self-assessment using video or to instructor-directed feedback. A questionnaire probing participants' perceptions of their knowledge level and confidence in their skills was completed before and after the training, and an interview was done at study completion. Final skill performance was recorded using video capture to permit blind evaluations using a standard assessment tool. A quantitative evaluation of the performance and questionnaire scores, as well as a qualitative assessment of the interviews, was performed. Questionnaire scores were significantly higher in the post-study questionnaire for 12 of the 14 questions in both groups. Students assigned to the instructor-directed group had significantly higher scores than students in the self-directed group on the skill performance (p < .05). Self-reported confidence in knowledge and skill related to the IV catheterization technique improved with both self-directed feedback using video and instructor-directed feedback. Skill performance, however, was superior following instructor-directed feedback. Participants expressed positive experiences associated with use of the models for skills training, the value of the learning materials including the video, and guidance during learning.

Process-oriented metrics to provide feedback and assess the performance of students who are learning surgical procedures: The percutaneous dilatational tracheostomy case

PURPOSE

Assessing competency in surgical procedures is key for instructors to distinguish whether a resident is qualified to perform them on patients. Currently, assessment techniques do not always focus on providing feedback about the order in which the activities need to be performed. In this research, using a Process Mining approach, process-oriented metrics are proposed to assess the training of residents in a Percutaneous Dilatational Tracheostomy (PDT) simulator, identifying the critical points in the execution of the surgical process.

MATERIALS AND METHODS

A reference process model of the procedure was defined, and video recordings of student training sessions in the PDT simulator were collected and tagged to generate event logs. Three process-oriented metrics were proposed to assess the performance of the residents in training.

RESULTS

Although the students were proficient in classic metrics, they did not reach the optimum in process-oriented metrics. Only in 25% of the stages the optimum was achieved in the last session. In these stages, the four more challenging activities were also identified, which account for 32% of the process-oriented metrics errors.

CONCLUSIONS

Process-oriented metrics offer a new perspective on surgical procedures performance, providing a more granular perspective, which enables a more specific and actionable feedback for both students and instructors.

Rapid-cycle deliberate practice telehealth as an integrative learning strategy in nurse practitioner education

ABSTRACT

Telehealth is a way for clinicians to deliver care and for patients to access care via the internet. This method of health care delivery has become an expectation of nurse practitioner practice. Rapid-cycle deliberate practice (RCDP) is a technique grounded in cognitive load theory used to teach a sequence of predetermined skills to learners through purposeful skill augmentation and strategic repetition. Throughout the process, students receive feedback based on well-defined objectives. Material is processed from working memory into long-term memory in small portions with the intent to prevent working memory overload. Advanced practice physical assessment in-person simulation laboratory sessions were framed and focused using the RCDP model. In-person sessions were followed by telehealth simulations for the skill area. Both the in-person laboratory and online telehealth visits followed a similar framework: isolate the skill, baseline knowledge, measurable objectives, practice expectations, and evaluation. Leveled telehealth competencies and domain descriptors were used as a guide for the telehealth sessions. Using the RCDP model to facilitate student translation of physical assessment skills from an in-person venue to the telehealth care environment yielded encouraging potential to isolate and evaluate specific skills, address measurable objectives, and identify behaviors that encompass multiple competencies, developmental milestones, and levels of proficiency. The RCDP telehealth simulations showed promise in the education of nurse practitioner students to accomplish key telehealth health assessment behaviors and progression toward readiness for practice.

A Cognitive Aid Improves Adherence to Guidelines for Critical Endotracheal Intubation in the Resuscitation Room: A Randomized Controlled Trial With Manikin-Based In Situ Simulation

INTRODUCTION

Emergency endotracheal intubation (ETI) is a high-risk procedure. Some of its adverse events are life-threatening, and guidelines emphasize the need to anticipate complications by thorough preparation. The emergency department (ED) can be an unpredictable environment, and we tested the hypothesis that a cognitive aid would help the emergency practitioners better follow guidelines. The main objective of this study was to determine whether the use of a cognitive aid focusing on both preintubation and postintubation items could improve ETI preparation and implementation in the ED resuscitation room regarding adherence to guidelines. The secondary objective was to measure and describe procedure times.

METHODS

We conducted a single-blind randomized controlled trial with manikin-based in situ simulation. The participants were not aware of the purpose of the study. The cognitive aid was developed using national guidelines and current scientific literature. The most relevant items were the preparation and implementation of a rapid sequence induction for ETI followed by mechanical ventilation. Emergency department physician-nurse pairs were randomized into a "cognitive aid" group and a "control" group. All pairs completed the same scenario that led to ETI in their own resuscitation room. An adherence to guidelines score of 30, derived from the 30 items of the cognitive aid (1 point per item), and preparation and intubation times were collected.

RESULTS

Seventeen pairs were included in each group. Adherence to guidelines scores were significantly higher in the cognitive aid group than in the control group (median = 28 of 30, interquartile range = 25-28, vs. median = 24 of 30, interquartile range = 21-26, respectively, P < 0.01). Preparation, intubation, and total procedure times were slightly longer in the cognitive aid group, but these results were not significant.

CONCLUSIONS

In an in situ simulation, a cognitive aid for the preparation and implementation of an emergency intubation procedure in the ED resuscitation room significantly improved adherence to guidelines without increasing procedure times. Further work is needed in a larger sample and in different settings to evaluate the optimal use of cognitive aids in critical situations.

The Effect of Animation-Guided Mindfulness Meditation on the Promotion of Creativity, Flow and Affect

Creativity is so important for social and technological development that people are eager to find an easy way to enhance it. Previous studies have shown that mindfulness has significant effects on positive affect (PA), working memory capacity, cognitive flexibility and many other aspects, which are the key to promoting creativity. However, there are few studies on the relationship between mindfulness and creativity. The mechanism between mindfulness and creativity is still uncertain. Meditation is an important method of mindfulness training, but for most people who do not have the basic training, it's difficult to master how to get into a state of mindfulness. Animation has been shown by many studies to help improve cognition and is often used as a guiding tool. Using animation as the guiding carrier of meditation is more convenient and easier to accept. Therefore, this study adopted the intervention method of animation-guided meditation, aiming to explore: (1) the effect of animation-guided meditation on enhancing creativity; (2) the role of flow and emotion in the influence of mindfulness on creativity. We advertised recruitment through the internal network of a creative industrial park, and the final 95 eligible participants were divided into two groups: animation (n = 48) and audio (n = 47) guided meditation. The animation group was given an animated meditation intervention, and the audio group was given an audio meditation intervention, both interventions were performed 3 times a week and last for 8 weeks. Results: (1) Animation-guided meditation significantly increased participants' mindfulness and creativity levels; Significantly reduced their cognitive load compared to audio-guided meditation. (2) Mindfulness has a significant direct effect on creativity, and significant indirect effects on creativity; Flow and PA act as the mediating variable. Conclusion: (1) Mindfulness, flow, and PA all helped to improve the subjects' work creativity. In addition to the direct positive impact of mindfulness on creativity, mindfulness can also have an indirect positive impact on creativity through flow and PA. (2) Compared with audio, animation can significantly reduce cognitive load and help improve users' cognitive ability, which is more suitable for the guidance materials of mindfulness meditation to enhance the effect of meditation.

A behavioural study of obedience in health professional students

Interprofessional Education and Collaborative Practice (IPECP) is a field of study suggested to improve team functioning and patient safety. However, even interprofessional teams are susceptible to group pressures which may inhibit speaking up (positive deviance). Obedience is one group pressure that can inhibit positive deviance leading to negative patient outcomes. To examine the influence of obedience to authority in an interprofessional setting, an experimental simulated clinical scenario was conducted with Respiratory Therapy (RT) (n = 40) and Advanced Care Paramedic (ACP) (n = 20) students. In an airway management scenario, it was necessary for students to challenge an authority, a senior anesthesiologist, to prevent patient harm. In a 2 × 2 design cognitive load and an interventional writing task designed to increase positive deviance were tested. The effect of individual characteristics, including Moral Foundations, and displacement of responsibility were also examined. There was a significant effect for profession and cognitive load: RT students demonstrated lower levels of positive deviance in the low cognitive load scenario than students in other conditions. The writing task did not have a significant effect on RT or ACP students' behaviour. The influence of Moral Foundations differed from expectations, In Group Loyalty was selected as a negative predictor of positive deviance while Respect for Authority was not. Displacement of responsibility was influential for some participants thought not for all. Other individual variables were identified for further investigation. Observational analysis of the simulation videos was conducted to obtain further insight into student behaviour in a compliance scenario. Individual differences, including experience, should be considered when providing education and training for positive deviance. Simulation provides an ideal setting to use compliance scenarios to train for positive deviance and for experimentation to study interprofessional team behaviour.

Sharing the Bandwidth in Cognitively Overloaded Teams and Systems: Mechanistic Insights from a Walk on the Wild Side of Clinical Reasoning

IssuePrevious work from the diagnostic error literature has provided indirect evidence that faulty clinical reasoning may be the most frequent cause of error when attaching a diagnostic label. The precise mechanisms underlying diagnostic error are unclear and continue to be subject to considerable theory informed debate in the clinical reasoning literature. Evidence: We take a theoretical approach to merging these two worlds of literature by first zooming out using distributed cognition as a social cognitive lens (macro theory) to develop a view of the process and outcome of clinical reasoning occurring in the wild - defined as the integrated clinical workplace - the natural habitat of clinicians working within teams. We then zoom in using the novel combination of cognitive load theory and distributed cognition to provide additional theoretical insights into the potential mechanisms of error. Implications: Through the lenses of distributed cognition and cognitive load theory, we can begin to prospectively investigate how cognitive overload is represented and shared within interprofessional teams over time and space and how this influences clinical reasoning performance and leads to error. We believe that this work will help teams manage cognitive load and prevent error.

The use of cognitive task analysis in clinical and health services research — a systematic review

Background

At times, clinical case complexity and different types of uncertainty present challenges to less experienced clinicians or the naive application of clinical guidelines where this may not be appropriate. Cognitive task analysis (CTA) methods are used to elicit, document and transfer tacit knowledge about how experts make decisions.

Methods

We conducted a methodological review to describe the use of CTA methods in understanding expert clinical decision-making. We searched MEDLINE, EMBASE and PsycINFO from inception to 2019 for primary research studies which described the use of CTA methods to understand how qualified clinicians made clinical decisions in real-world clinical settings.

Results

We included 81 articles (80 unique studies) from 13 countries, published from 1993 to 2019, most commonly from surgical and critical care settings. The most common aims were to understand expert decision-making in particular clinical scenarios, using expert decision-making in the development of training programmes, understanding whether decision support tools were warranted and understanding procedural variability and error identification or reduction. Critical decision method (CDM) and CTA interviews were most frequently used, with hierarchical task analysis, task knowledge structures, think-aloud protocols and other methods less commonly used. Studies used interviews, observation, think-aloud exercises, surveys, focus groups and a range of more CTA-specific methodologies such as the systematic human error reduction and prediction approach. Researchers used CTA methods to investigate routine/typical (n = 64), challenging (n = 13) or more uncommon, rare events and anomalies (n = 3).

Conclusions

In conclusion, the elicitation of expert tacit knowledge using CTA has seen increasing use in clinical specialties working under challenging time pressures, complexity and uncertainty. CTA methods have great potential in the development, refinement, modification or adaptation of complex interventions, clinical protocols and practice guidelines.

Registration

PROSPERO ID CRD42019128418.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40814-022-01002-6.

Teaching the technical performance of bronchoscopy to residents in a step-wise simulated approach: factors supporting learning and impacts on clinical work - a qualitative analysis

BACKGROUND

The ability to perform a bronchoscopy is a valuable clinical skill for many medical specialities. Learning this skill is demanding for residents, due to the high cognitive load. Lessons learned from cognitive load theory might provide a way to facilitate this learning. The aim of this study was to investigate residents' perception of factors that support and hinder learning, as well as outcome and acceptance of a workshop on flexible bronchoscopy.

METHODS

Three half-day workshops were designed to teach 12 residents the basics of handling a flexible bronchoscope. They consisted of four phases that alternated between short theoretical aspects and longer practical situations. The practical phases focussed initially on manoeuvring a bronchoscope through holes in panels inside a box, and then on examination and practice using a three-dimensional printed model of the bronchial tree. Afterwards, three audio- and video-recorded focus groups were conducted, transcribed and coded, and underwent reflexive thematic analysis.

RESULTS

Analysis of the focus groups defined two themes: (1) factors that supported a safe and positive learning environment were optimised for intrinsic load, simulated setting, absence of pressure, dyad practice (working in pairs), small group sizes and playful learning; and (2) impacts on clinical work were perceived as high levels of learning and improved patient safety. The residents did not report factors that hindered their learning. Some suggestions were made to improve the set-up of the wooden box.

CONCLUSIONS

The half-day workshop was designed according to several factors, including cognitive load theory in a simulated setting, and creation of a safe and positive learning environment. The residents perceived this as supporting learning and patient safety. Further studies can be designed to confirm these results in a quantitative setting.

TRIAL REGISTRATION

This study was not interventional, therefore was not registered.

The Cognitive Load of Inpatient Consults: Development of the Consult Cognitive Load Instrument and Initial Validity Evidence

PURPOSE

Fellows and residents provide inpatient consultations. Though consults vary considerably, measuring the associated cognitive load (CL) is key to guiding faculty on how to optimize learning during consults. However, existing CL instruments, such as the unidimensional Paas scale, cannot separate the 3 components of CL and may miss the nuances of consult CL. Therefore, the authors developed the Consult Cognitive Load (CCL) instrument to measure the 3 CL components during consults.

METHOD

In 2018-2019, the authors developed the CCL at the University of California, San Francisco, using Wilson's constructive approach to measurement. To generate content and response process validity evidence, the authors consulted the literature and experts to generate construct maps, items, and a scoring rubric and conducted cognitive interviews. They administered the CCL to internal medicine and psychiatry trainees across 5 University of California campuses and used Rasch family and linear regression models to assess internal structure validity and relationships to key predictor variables. They compared the CCL with the Paas scale using Wright maps and used latent correlations to support separating CL into 3 components.

RESULTS

Analysis revealed appropriate fit statistics, appropriate mean respondent location increases across all levels, threshold banding, and expected relationships with key predictor variables. The CCL provided more coverage of the 3 CL components compared with the Paas scale. Correlations among the 3 CL components were not strong, suggesting that the CCL offers more nuance than a unidimensional measure of CL in the context of consults.

CONCLUSIONS

This study generated initial validity evidence to support the CCL's use as a measure of consult CL and supports measuring the 3 CL components separately rather than as a single construct in the context of consults. Learners and faculty could compare learner CCL scores with reference scores to promote reflection, metacognition, and coaching.

Exploring the relationship between emotion and cognitive load types during patient handovers

Cognitive Load Theory has emerged as an important approach to improving instruction in the health professions workplace, including patient handovers. At the same time, there is growing recognition that emotion influences learning through numerous cognitive processes including motivation, attention, working memory, and long-term memory. This study explores how emotion influences the cognitive load experienced by trainees performing patient handovers. From January to March 2019, 693 (38.7%) of 1807 residents and fellows from a 24-hospital health system in New York city completed a survey after performing a handover. Participants rated their emotional state and cognitive load. The survey included questions about features of the learner, task, and instructional environment. The authors used factor analysis to identify the core dimensions of emotion. Regression analyses explored the relationship between the emotion factors and cognitive load types. Two emotion dimensions were identified representing invigoration and tranquility. In regression analyses, higher levels of invigoration, tranquility, and their interaction were independently associated with lower intrinsic load and extraneous load. The interaction of invigoration and tranquility predicted lower germane load. The addition of the emotion variables to multivariate models including other predictors of cognitive load types significantly increased the amount of variance explained. The study provides a model for measuring emotions in workplace learning. Because emotion appears to have a significant influence on cognitive load types, instructional designers should consider strategies that help trainees regulate emotion in order to reduce cognitive load and improve learning and performance.