Learner, Patient, and Supervisor Features Are Associated With Different Types of Cognitive Load During Procedural Skills Training: Implications for Teaching and Instructional Design

Ambiguity in robotic surgical instruction: lessons from remote and in-person simulation

The rise of robotic surgery has been accompanied by numerous educational challenges as surgeons and trainees learn skills unique to the robotic platform. Remote instruction is a solution to provide surgeons ongoing education when in-person teaching is not feasible. However, surgical instruction faces challenges from unclear communication. We aimed to describe, examine, and compare ambiguities in remote and in-person robotic instruction. We designed a simulation scenario in which a standardized learner performed tasks in robotic surgery while making pre-scripted errors. Instructors provided remote or in-person instruction to the standardized learner. We applied tools from discourse analysis to transcribe sessions, identify instructional instances, classify ambiguities, and select passages for further review. We used tests of proportions to compare ambiguities between the settings. We conducted four simulation sessions, including two remote and two in-person sessions, and identified 206 instructional instances. Within these, we found 964 occurrences of three common semantic ambiguities, or ambiguities arising from words alone. Instructors used visual tools - thus employing multimodality - to clarify semantic ambiguities in 32% of instructional instances. We identified a similar degree of referential ambiguity, or ambiguity for which context from multimodality did not provide clarifying information, during remote (60%) and in-person (48%) instructional instances (p = 0.08). We described, examined, and compared ambiguities in remote and in-person instruction for simulated robotic surgery. Based on the high prevalence of ambiguity in both settings, we recommend that robotic instructors decrease referential ambiguity. To do so, instructors can reduce semantic ambiguity, harness multimodality, or both.

A Cognitive Load Theory Perspective of the Undergraduate Anesthesia Curricula in South Africa

BACKGROUND

Safe anesthesia is indispensable to achieve global safe surgery and equitable health care access. The disease burden and lack of specialists in South Africa (SA) require junior, nonspecialist doctors to be fit-for-purpose from day 1 when they provide anesthetic services in peripheral hospitals with limited supervision. Graduating students report low self-perceived preparedness for administering anesthesia, but it is not known how their curricular experiences influence their learning. Cognitive load theory defines intrinsic, extraneous, and germane cognitive loads (subtypes). Intrinsic load relates to learning tasks, extraneous load to distractions, and germane load to students' learning processes. This study used a cognitive load theory lens to explore SA students' experiences of their undergraduate anesthesia training.

METHODS

In a constructivist cross-sectional descriptive study, we explored the qualitative factors that influenced students' curricular experience of undergraduate anesthesia training in SA. Two investigators analyzed the data independently in an initial coding round. An emerging theme of lack of time to achieve the expected outcomes, prompted the use of cognitive load theory as a conceptual framework for further analysis by the 3 authors. The subsequent analysis informed the development and refinement of a final cognitive load theory framework for anesthesia training, the COLOAD (COgnitive LOad in Anesthesia eDucation) framework.

RESULTS

Data were collected between November 2017 and February 2019. The 1336 respondents (79% participation) reported a variety of determinants of learning pertaining to all 3 cognitive load subtypes. Participants were novices in an inherently complex environment and experienced a high cognitive load during anesthesia training. The number-, complexity-, and interactivity of tasks influenced intrinsic load, while extraneous load was affected by ineffective instructional methods, external- and internal distractors. Program design, metacognition, and learner motivation impacted germane load.

CONCLUSIONS

Cognitive load theory provided a useful theoretical basis for understanding students' curricular experiences. The COLOAD framework suggests a microlevel interrelatedness of the constituting elements of the 3 cognitive load subtypes. This has implications for curriculum design, pedagogy, and student support. Learning outcomes development and curriculum mapping are important to ensure a lean curriculum, but measures to enhance germane cognitive load might be equally important to achieve competence. Attention to the hidden curriculum and active promotion of reflective practice might reduce cognitive load in complex learning environments such as anesthesia training.

Extraneous Load, Patient Census, and Patient Acuity Correlate With Cognitive Load During ICU Rounds

BACKGROUND

Cognitive load theory asserts that learning and performance degrade when cognitive load exceeds working memory capacity. This is particularly relevant in the learning environment of ICU rounds, when multidisciplinary providers integrate complex decision-making and teaching in a noisy, high-stress environment prone to cognitive distractions.

RESEARCH QUESTION

What features of ICU rounds correlate with high provider cognitive load?

STUDY DESIGN AND METHODS

This was an observational, multisite study of multidisciplinary providers during ICU rounds. Investigators recorded rounding characteristics and hourly extraneous cognitive load events during rounds (defined as distractions, episodes of split-attention or repetition, and deviations from standard communication format). After rounds, investigators measured each provider's cognitive load using the provider task load (PTL), an instrument derived from the National Aeronautics and Space Administration Task Load Index survey that assesses perceived workload associated with complex tasks. Relationships between rounding characteristics, extraneous load, and PTL score were evaluated using mixed-effects modeling.

RESULTS

A total of 76 providers were observed during 32 rounds from December 2020 to May 2021. The mean rounding census ± SD was 12.5 ± 2.9 patients. The mean rounding time ± SD was 2 h 17 min ± 49 min. The mean extraneous load ± SD was 20.5 ± 4.5 events per hour, or one event every 2 min 51 s. This included 8.6 ± 3.4 distractions, 8.2 ± 4.2 communication deviations, 1.9 ± 1.4 repetitions, and 1.8 ± 1.3 episodes of split-attention per hour. Controlling for covariates, the hourly extraneous load events, number of new patients, and number of higher acuity patients were each associated with increased PTL score (slope, 2.40; 95% CI, 0.76-4.04; slope, 5.23; 95% CI, 2.02-8.43; slope, 3.35; 95% CI, 1.34-5.35, respectively).

INTERPRETATION

Increased extraneous load, new patients, and patient acuity were associated with higher cognitive load during ICU rounds. These results can help direct how the ICU rounding structure may be modified to reduce workload and optimize provider learning and performance.

Exploring the Experiences of Undergraduate Medical Students on Surgical Placement - A Qualitative Study

OBJECTIVE

Multiple elements in the clinical learning environment have been found to influence medical students' learning experiences. A rich area of research, many factors are already known to influence students' experiences of learning which go on to impact later training choices. However, there is a knowledge gap specifically related to undergraduate medical students' experiences of surgical placement. This study aims to explore the lived experiences of medical students in their surgery rotation(s).

DESIGN

A phenomenological study using semistructured interviews was conducted. Transcribed interview recordings were thematically analyzed using an iterative approach.

SETTING

Participants were studying in a large medical school in the north of England.

PARTICIPANTS

Fitting with the method, 6 undergraduate medical students, with at least 1 surgery placement took part in the study.

RESULTS

Participants described issues including knowing the details of clinical opportunities, the clinical environment, and the portfolio; having a sense of involvement and previous surgical experiences; teaching and assessments; observation; and interactions. These experiences were also found to influence later career aspirations.

CONCLUSIONS

The findings suggest that undergraduate surgical learning experiences can be influenced by various themes: knowing the details of progression, the clinical environment, having a sense of involvement and previous experiences, constructive alignment of teaching and assessment, and professional identity formation. Future studies can explore methods such as personalized learning outcomes to enhance the overall learning experience of medical students.

Curriculum for diagnostic endoscopic ultrasound training in Europe: European Society of Gastrointestinal Endoscopy (ESGE) Position Statement

The European Society of Gastrointestinal Endoscopy (ESGE) has recognized the need to formalize and enhance training in diagnostic endoscopic ultrasound (EUS). This manuscript represents the outcome of a formal Delphi process resulting in an official Position Statement of the ESGE and provides a framework to develop and maintain skills in diagnostic EUS. This curriculum is set out in terms of the prerequisites prior to training; the recommended steps of training to a defined syllabus; the quality of training; and how competence should be defined and evidenced before independent practice. 1:  Trainees should have achieved competence in upper gastrointestinal endoscopy before training in diagnostic EUS. 2:  The development of diagnostic EUS skills by methods that do not involve patients is advisable, but not mandatory, prior to commencing formal training in diagnostic EUS. 3:  A trainee's principal trainer should be performing adequate volumes of diagnostic EUSs to demonstrate maintenance of their own competence. 4:  Training centers for diagnostic EUS should offer expertise, as well as a high volume of procedures per year, to ensure an optimal level of quality for training. Under these conditions, training centers should be able to provide trainees with a sufficient wealth of experience in diagnostic EUS for at least 12 months. 5:  Trainees should engage in formal training and supplement this with a range of learning resources for diagnostic EUS, including EUS-guided fine-needle aspiration and biopsy (FNA/FNB). 6:  EUS training should follow a structured syllabus to guide the learning program. 7:  A minimum procedure volume should be offered to trainees during diagnostic EUS training to ensure that they have the opportunity to achieve competence in the technique. To evaluate competence in diagnostic EUS, trainees should have completed a minimum of 250 supervised EUS procedures: 80 for luminal tumors, 20 for subepithelial lesions, and 150 for pancreaticobiliary lesions. At least 75 EUS-FNA/FNBs should be performed, including mostly pancreaticobiliary lesions. 8:  Competence assessment in diagnostic EUS should take into consideration not only technical skills, but also cognitive and integrative skills. A reliable valid assessment tool should be used regularly during diagnostic EUS training to track the acquisition of competence and to support trainee feedback. 9:  A period of supervised practice should follow the start of independent activity. Supervision can be delivered either on site if other colleagues are already practicing EUS or by maintaining contacts with the training center and/or other EUS experts. 10:  Key performance measures including the annual number of procedures, frequency of obtaining a diagnostic sample during EUS-FNA/FNB, and adverse events should be recorded within an electronic documentation system and evaluated.

Remembering to Resume: A Randomized Trial Comparing Combined Interruption Management Training and Simulation-Based Education to Simulation-Based Education Alone

AIM

This study aimed to determine if purposeful presimulation interruption management training impacts cognitive load and successful completion of simulation objectives more than the experience alone.

BACKGROUND

Practicing nurses are frequently interrupted, increasing the risk for error and task time. Novices are particularly vulnerable to interruption consequences.

METHOD

A between-subjects design and block randomization of prelicensure baccalaureate nursing students ( n = 146) was used to compare group differences in cognitive load, use of interruption management strategies, and completion of simulation required elements. Potential relationships between outcomes and age, mindfulness, and experience were explored.

RESULTS

An analysis of covariance demonstrated significantly lower perceived mental demand for those receiving training. Older learners and those receiving training implemented more interruption management strategies.

CONCLUSION

Combining simulation-based education (SBE) with purposeful training enhances interruption management more than SBE alone. Frequent interruption training and SBE are recommended to enhance risk awareness.

Evaluation of tracheostomy suctioning procedure among nursing and respiratory therapy students: wearable manikin vs. standard manikin

Introduction

This study aims to evaluate cognitive load (CL), emotional levels (EL), and stress levels (SL) of students when using a wearable manikin vs. a standard manikin for tracheostomy suctioning (TS).

Methods

This study was approved by the Institutional Review Board. Subjects were recruited by email. Subjects completed a baseline demographics questionnaire, then they were randomized into two groups: wearable manikin group (WMG) or standard manikin group (SMG). For the WMG, an actor simulated a patient by wearing the device. In phase I, both groups were educated on how to perform TS by video and offered hands-on practice. Then I put through a tracheostomy suctioning clinical simulation and completed a post sim-survey. In phase II, the same survey was repeated after encountering a real patient as part of their clinical rotation.

Results

A total of 30 subjects with a mean age 26.0 ± 5.5 years participated. 20 (66.7%) were respiratory care students and 10 (33.3%) were nursing students. In the WMG, the median stress level dropped significantly post phase II compared to post phase I [2(1,4) vs.3(1,5), p = 0.04]. There were no significant changes in median CL, confidence, and satisfaction levels between post phase II and post phase I (p > 0.05). In the SMG, the satisfaction level increased significantly post phase II compared to post phase I [5(4,5) vs.4(2,5), p = 0.004], but there were no significant changes in CL, SL, and confidence levels between post phase I and phase II. There was no significant difference in mean EL scores over time and these changes did not differ by group. Subjects in the WMG showed a higher mean competency score than those in the SMG (85.5 ± 13.6 vs. 78.5 ± 20.8, p = 0.14, Cohen's d = 0.4), yet not significant.

Conclusion

Our results showed that the WMG is beneficial in helping bridge the gap of learning TS from the sim setting to the real-world clinical setting. More studies with higher sample size and use of other CL scales that assesses the different types of CL are needed to validate our findings.

Impact of training in the supervision of clinical reasoning in the pediatric emergency department on residents' perception of the on-call experience

BACKGROUND

In 2021, the prevalence of signs of burnout among medical residents was reported to be 67%. Being on call is particularly stressful for residents, notably due to their lack of medical experience. When they are on call, several factors contribute to a mismatch between the residents' theoretical knowledge and the operationalization of that knowledge in a clinical reasoning process. Using the script and cognitive load theories as a basis, we hypothesized that training clinician-teachers in the supervision of clinical reasoning could improve residents' perception of the experience of being on call.

METHODS

We performed a longitudinal, exploratory, controlled study with a cohort of medical residents who were on call in the pediatric emergency department during the semester from 1 November 2021 to 30 April 2022. During the night, the residents on call in the pediatric emergency department completed validated questionnaires investigating (1) mental effort, (2) cognitive weariness, (3) state anxiety, (4) feeling of self-efficacy, and (5) well-being. We compared the questionnaires of residents supervised by pediatricians trained in the supervision of clinical reasoning (supervision group) with those of residents in a control group, supervised by pediatricians with no specific pedagogical training.

RESULTS

A total of 284 questionnaires (174 supervision group, 110 controls) were collected from 38 residents in three pediatric emergency departments. The results confirm that being on call is difficult for residents. Compared to the control group, residents in the supervision group had lower cognitive weariness scores (mean 3.0 ± 1.1 vs. 3.5 ± 1.3). There was no significant difference between groups for any of the other dimensions of the on-call experience. In the supervision group, mental effort was significantly lower at the end of the study semester (5 [5-6] when on call in month 6 of the semester vs. 6 [5-7] when on call in months 1-5 of the semester; p = 0.01) and was greater for more senior residents (7 [6-8] for those in the 4th or higher semester of residency vs. 6 [5-7] for residents in their 1st, 2nd, or 3rd semester of residency; β = 0.92 ± 0.40; p = 0.02).

CONCLUSION

Beyond the positive effects for residents, this study illustrates the feasibility of implementing training for clinicians in the supervision of clinical reasoning.

The Evidence Basis for Learning Theory and Technology in Surgical Skills Training

Orthopaedic trainees face a complex and challenging training environment that is currently becoming more competency driven. Associated with these changes are an increasing introduction and use of a variety of technologically driven surgical training augments. Although these new learning resources can positively transform the educational environment, they must be used appropriately by both learners and educators. To aid in this, we review learning theories because they apply to surgical skills training and highlight recent surgical training evidence that demonstrates how technology use can be optimized to promote surgical learning, with an emphasis on procedural learning theory and cognitive load theory. Specifically, we review the evidence demonstrating the importance of targeting technology to a learner's experience level and methods to optimize cognitive load by managing intrinsic load, minimizing extraneous load, and maximizing germane load.

Coaching the coach: A randomized controlled study of a novel curriculum for procedural coaching during intubation

Background

Videolaryngoscopy allows real-time procedural coaching during intubation. This study sought to develop and assess an online curriculum to train pediatric emergency medicine attending physicians to deliver procedural coaching during intubation.

Methods

Curriculum development consisted of semistructured interviews with 12 pediatric emergency medicine attendings with varying levels of airway expertise analyzed using a constructivist grounded theory approach. Following development, the curriculum was implemented and assessed through a multicenter randomized controlled trial enrolling participants in one of three cohorts: the coaching module, unnarrated video recordings of intubations, and a module on ventilator management. Participants completed identical pre and post assessments asking them to select the correct coaching feedback and provided reactions for qualitative thematic analysis.

Results

Content from interviews was synthesized into a video-enhanced 15-min online coaching module illustrating proper technique for intubation and strategies for procedural coaching. Eighty-seven of 104 randomized physicians enrolled in the curriculum; 83 completed the pre and post assessments (80%). The total percentage correct did not differ between pre and post assessments for any cohort. Participants receiving the coaching module demonstrated improved performance on patient preparation, made more suggestions for improvement, and experienced a greater increase in confidence in procedural coaching. Qualitative analysis identified multiple benefits of the module, revealed that exposure to video recordings without narration is insufficient, and identified feedback on suggestions for improvement as an opportunity for deliberate practice.

Conclusions

This study leveraged clinical and educational digital technology to develop a curriculum dedicated to the content expertise and coaching skills needed to provide feedback during intubations performed with videolaryngoscopy. This brief curriculum changed behavior in simulated coaching scenarios but would benefit from additional support for deliberate practice.

An Assessment of Upper-Extremity Surgical Technique Videos and Their Relationship With Procedural Learning Theory

PURPOSE

Our purpose was to ascertain how well award-winning and highly viewed upper-extremity surgical videos meet the needs of users and adhere to procedural learning theory. We hypothesized that upper-extremity videos hosted on academic society websites meet user needs better than upper-extremity videos hosted on a commercial website.

METHODS

Twenty-five upper-extremity videos were evaluated by 3 reviewers. A standardized scoring sheet was used to assess each video's content, production quality, and adequacy. Video lengths were compared. The inclusion frequencies of specific content categories, the adequacy of content, and meeting certain production standards, all of which assess consistency with procedural learning theory, were reported, stratified by video host. Associations between the video host and video content, production quality, and adequacy were assessed.

RESULTS

The median lengths of academically hosted and commercially hosted videos were similar. Regardless of the video host, no video contained information in all content categories. Sixty percent of the scored categories were present in less than 75% of evaluated videos. Academically hosted videos contained scored content more frequently than commercially hosted videos in 68.4% of categories. There were significant associations between academic hosts and inclusion of a case presentation, surgical indications, outcomes literature, a preoperative examination, follow-up visit intervals, and alternative surgical techniques. Overall, academically hosted videos had a higher percentage of adequate content categories compared with commercially hosted videos.

CONCLUSIONS

Videos on academic websites more consistently meet users' content needs and production expectations, as informed by procedural learning theory, while having higher rates of adequate content compared with videos on commercial websites.

CLINICAL RELEVANCE

While academically hosted videos appear to more consistently adhere to the tenets of procedural learning theory, opportunity exists for video creators to more consistently apply procedural learning theory, allowing for the creation of even more educationally beneficial online surgical videos.

Randomized Trial Comparing Instructor-Delivered Feedback with Self-Assessment Using Video during Basic Skills Training

Feedback has been shown to be one of the most powerful and effective influences on student achievement; however, the optimal method for providing feedback to trainees during veterinary skills training has yet to be determined. A prospective mixed-methods study was undertaken to evaluate student perceptions and performance outcomes with self-assessment using video- or instructor-delivered feedback during skills training using a model. Forty participants naïve to intravenous (IV) catheter placement were randomly assigned either to self-assessment using video or to instructor-directed feedback. A questionnaire probing participants' perceptions of their knowledge level and confidence in their skills was completed before and after the training, and an interview was done at study completion. Final skill performance was recorded using video capture to permit blind evaluations using a standard assessment tool. A quantitative evaluation of the performance and questionnaire scores, as well as a qualitative assessment of the interviews, was performed. Questionnaire scores were significantly higher in the post-study questionnaire for 12 of the 14 questions in both groups. Students assigned to the instructor-directed group had significantly higher scores than students in the self-directed group on the skill performance (p < .05). Self-reported confidence in knowledge and skill related to the IV catheterization technique improved with both self-directed feedback using video and instructor-directed feedback. Skill performance, however, was superior following instructor-directed feedback. Participants expressed positive experiences associated with use of the models for skills training, the value of the learning materials including the video, and guidance during learning.

Pediatric endoscopy training across Europe: a survey of the ESPGHAN National Societies Network 2016-2019

Background and study aims  The ability to perform endoscopy procedures safely and effectively is a key aspect of quality clinical care in Pediatric Gastroenterology, Hepatology and Nutrition (PGHN). The aim of this survey, which was part of a global survey on PGHN training in Europe, was to assess endoscopy training opportunities provided across Europe. Methods  Responses to standardized questions related to endoscopy training were collected from training centers across Europe through the presidents/representatives of the European Society for Paediatric Gastroenterology, Hepatology and Nutrition National Societies from June 2016 to December 2019. Results  A total of 100 training centers from 19 countries participated in the survey. In 57 centers, the endoscopy suit was attached to the PGHN center, while in 23, pediatric endoscopies were performed in adult endoscopy facilities. Ninety percent of centers reported the availability of specialized endoscopy nurses and 96 % of pediatric anesthetists. Pediatric endoscopies were performed by PGHN specialists in 55 centers, while 31 centers reported the involvement of an adult endoscopist and 14 of a pediatric surgeon. Dividing the number of procedures performed at the training center by the number of trainees, ≤ 20 upper, lower, or therapeutic endoscopies per trainee per year were reported by 0 %, 23 %, and 56 % of centers, respectively, whereas ≤ 5 wireless capsule endoscopies per trainee per year by 75 %. Only one country (United Kingdom) required separate certification of competency in endoscopy. Conclusions  Differences and deficiencies in infrastructure, staffing, and procedural volume, as well as in endoscopy competency assessment and certification, were identified among European PGHN training centers limiting training opportunities in pediatric endoscopy.

Academic Management in Uncertain Times: Shifting and Expanding the Focus of Cognitive Load Theory During COVID-19 Pandemic Education

Globally, the COVID-19 pandemic has forced medical education toward more "online education" approaches, causing specific implications to arise for medical educators and learners. Considering an unprecedented and highly threatening, constrained, and confusing social and educational environment caused by the COVID-19 pandemic, we decided to shift the traditional focus of the Cognitive Load Theory (CLT) from students to instructors. In this process, we considered recent suggestions to acknowledge the psychological environment in which learning happens. According to this fundamental fact, "Learning and instructional procedures do not occur in a situational vacuum." Following this assertion, we adapted and implemented principles of CLT to reduce the extraneous load for our faculty to facilitate continued scholarly activity and support the overall wellbeing of our faculty during these trying times. The adoption of these principles enabled our team to cultivate attitudes and skills across multiple domains, such as online presentation technologies, implementing and maintaining a "classroom atmosphere" in a virtual environment, encouraging discussion among large online groups of students, facilitating group work, providing virtual office hours, and proactively planning for subsequent sessions.

Teaching the technical performance of bronchoscopy to residents in a step-wise simulated approach: factors supporting learning and impacts on clinical work - a qualitative analysis

BACKGROUND

The ability to perform a bronchoscopy is a valuable clinical skill for many medical specialities. Learning this skill is demanding for residents, due to the high cognitive load. Lessons learned from cognitive load theory might provide a way to facilitate this learning. The aim of this study was to investigate residents' perception of factors that support and hinder learning, as well as outcome and acceptance of a workshop on flexible bronchoscopy.

METHODS

Three half-day workshops were designed to teach 12 residents the basics of handling a flexible bronchoscope. They consisted of four phases that alternated between short theoretical aspects and longer practical situations. The practical phases focussed initially on manoeuvring a bronchoscope through holes in panels inside a box, and then on examination and practice using a three-dimensional printed model of the bronchial tree. Afterwards, three audio- and video-recorded focus groups were conducted, transcribed and coded, and underwent reflexive thematic analysis.

RESULTS

Analysis of the focus groups defined two themes: (1) factors that supported a safe and positive learning environment were optimised for intrinsic load, simulated setting, absence of pressure, dyad practice (working in pairs), small group sizes and playful learning; and (2) impacts on clinical work were perceived as high levels of learning and improved patient safety. The residents did not report factors that hindered their learning. Some suggestions were made to improve the set-up of the wooden box.

CONCLUSIONS

The half-day workshop was designed according to several factors, including cognitive load theory in a simulated setting, and creation of a safe and positive learning environment. The residents perceived this as supporting learning and patient safety. Further studies can be designed to confirm these results in a quantitative setting.

TRIAL REGISTRATION

This study was not interventional, therefore was not registered.

Exploring the relationship between emotion and cognitive load types during patient handovers

Cognitive Load Theory has emerged as an important approach to improving instruction in the health professions workplace, including patient handovers. At the same time, there is growing recognition that emotion influences learning through numerous cognitive processes including motivation, attention, working memory, and long-term memory. This study explores how emotion influences the cognitive load experienced by trainees performing patient handovers. From January to March 2019, 693 (38.7%) of 1807 residents and fellows from a 24-hospital health system in New York city completed a survey after performing a handover. Participants rated their emotional state and cognitive load. The survey included questions about features of the learner, task, and instructional environment. The authors used factor analysis to identify the core dimensions of emotion. Regression analyses explored the relationship between the emotion factors and cognitive load types. Two emotion dimensions were identified representing invigoration and tranquility. In regression analyses, higher levels of invigoration, tranquility, and their interaction were independently associated with lower intrinsic load and extraneous load. The interaction of invigoration and tranquility predicted lower germane load. The addition of the emotion variables to multivariate models including other predictors of cognitive load types significantly increased the amount of variance explained. The study provides a model for measuring emotions in workplace learning. Because emotion appears to have a significant influence on cognitive load types, instructional designers should consider strategies that help trainees regulate emotion in order to reduce cognitive load and improve learning and performance.

Dual Process Theory and Cognitive Load: How Intensivists Make Diagnoses

Improving clinical reasoning in order to reduce frequency of diagnostic errors is an important area of study. The authors discuss dual process theory as a model of clinical reasoning and explore the role that cognitive load plays in clinical reasoning in the intensive care unit environment.

An exploratory investigation of the measurement of cognitive load on shift: Application of cognitive load theory in emergency medicine

BACKGROUND

Emergency physicians often experience a high cognitive load (CL) due to the inherent nature of working in acute care settings. CL has traditionally been measured in educational studies but has not been well studied in the clinical environment.

METHODS

Emergency medicine attending physicians and residents working in an academic urgent care center completed psychometric questionnaires while on shift to measure overall CL, intrinsic cognitive load (ICL), extraneous cognitive load (ECL), and acute stress. Data regarding the patient load, patient acuity, and the number of patients in the waiting room were also collected. Correlational analysis and simple linear regression were used to evaluate predictors of CL on shift.

RESULTS

Forty-two questionnaires were completed (26 by attending physicians, 16 by residents). Attending physicians carried a significantly higher patient load compared to residents (p < 0.001). No differences in mean overall CL, ICL, ECL, and acute stress were observed between attending physicians and residents. Bivariate analysis demonstrated associations between ICL, ECL, acute stress, and overall CL in attending physicians. In residents, acute stress was the only variable associated with overall CL and the number of high-acuity patients was associated with ICL.

CONCLUSIONS

Factors influencing reported CL during clinical work are different between attending emergency physicians and residents. Further study to appreciate the impact of these differences is required and may help educators elucidate strategies to better manage CL, thereby improving clinical performance and potentially improving patient care.

Experience Level Influences Users' Interactions With and Expectations For Online Surgical Videos: A Mixed-Methods Study

PURPOSE

Upper-extremity surgeons and trainees widely use online surgical videos, and the use of these videos can assist with procedural learning. The purpose of this study was to characterize online video use and understand the role videos play in the learning process of orthopedic residents and practicing surgeons. We hypothesized that the use of surgical videos and video content desired among orthopedic learners differs based on their experience level.

METHODS

Four focus groups were conducted to discuss online surgical videos and their role in the learning process of orthopedic learners. Participants were separated based on their experience level. Three reviewers qualitatively analyzed the transcripts of the focus groups using constant comparative methods to identify overarching themes and categories. Findings regarding the participants' desires for video content and production quality were translated into a survey. The survey results were analyzed to assess their associations with experience level.

RESULTS

The focus group analysis helped identify 4 overarching themes that reflected users' interactions with videos: prewatching experience, choosing a video, video use, and video design, with the users' comments differing based on their experience level. The survey results showed that the median ideal length for a video was 10 minutes and that all users, regardless of their experience level, ranked showing the surgical procedure as the most important part of a video. Junior residents more frequently desired background information and a written outline of surgical steps, whereas more senior learners placed greater emphasis on advanced surgical decision-making and the use of particular implants/devices.

CONCLUSIONS

Experience level influences users' interactions with videos, including how they are chosen and used, and their expectations in terms of content and production.

CLINICAL RELEVANCE

Video creators should specify their targeted audience's experience level and adjust content to meet users' needs. Our results can provide video creators and hosts a checklist for appropriate content and production standards.

Negative emotions, cognitive load, acceptance, and self-perceived learning outcome in emergency remote education during COVID-19

Learning related emotions (LREs) are determinant for students' achievement both in face-to-face and online education. Research has also shown that LREs tend to affect technology acceptance which in turn affects learning outcomes as well. Today though, the negative psychological impact of the COVID-19 crisis and the sudden transmission to obligatory remote education might yield different functions of emotions and acceptance on learning outcomes. In this context, the current study seeks to model the relations between students' negative emotions, acceptance of (emergency) remote education, and self-perceived knowledge improvement. The suggested model was examined and validated on 116 university students that attended fully remote courses in Greece during the COVID-19 crisis. The results suggested that negative emotions of boredom and cognitive load are significant predictors of students' acceptance of remote learning components: i) online attending a lecture, ii) online communicating with professor, and iii) online collaborating with peers. Anxiety directly affected perceived knowledge improvement, boredom, and cognitive load; Boredom was also affected by cognitive load. In addition, acceptance of remote learning components indirectly affected perceived knowledge improvement mediated by learnability. Boredom was the strongest predictor of online attending a lecture and online collaborating with peers, while online communication with professor was the strongest predictor of learnability. The contribution of this study and the structural findings are further discussed in the paper.

How do attending physicians describe cognitive overload among their workplace learners?

OBJECTIVES

Cognitive load theory (CLT) focuses on the limited bandwidth of working memory. Core to CLT is the concept of cognitive overload, which occurs when working memory demands exceed working memory capacity, and learning and performance suffer. Within health professions education (HPE), workplace learning settings are very complex, placing learners at high risk of cognitive overload. Although continuous monitoring of physiologic parameters can indicate states of high cognitive load, how to practically identify cognitively overloaded learners within everyday workplace settings is not well understood. We sought to characterise how attending physicians described their perceiving of cognitive overload among learners in two different workplace settings: the gastrointestinal endoscopy suite and the intensive care unit.

METHODS

We performed a secondary qualitative analysis of transcripts of interviews with workplace teachers that had been carried out during two previous studies. These studies had addressed different objectives but both were informed by CLT. Each included questions that prompted participants to reflect on how they perceived cognitive overload to manifest among learners in the workplace. To investigate the phenomenon of cognitive overload, we developed a new codebook and performed content analysis.

RESULTS

We analysed 42 interview transcripts (22 endoscopists, 12 hospitalists, eight intensivists). Participants described four behaviours they had witnessed among learners they thought were cognitively overloaded: poor performance on workplace tasks; non-verbal physical manifestations (including posture, eye and body movements and autonomic functions); verbal utterances (words and sounds), and interpersonal interactions with team members. Endoscopists often described individually oriented examples, whereas intensivists and hospitalists tended to frame examples within an interpersonal context.

CONCLUSIONS

We identified four overarching ways in which HPE workplace teachers perceived learners as appearing to be cognitively overloaded. Workplace teachers and learners should be mindful of and watch for these signs, which may signal states of cognitive overload. Earlier recognition of cognitive overload may facilitate timely action to reduce cognitive overload and promote learning.

Standardizing Endoscopy Training: A Workshop for Endoscopy Educators

INTRODUCTION

Endoscopy education in the US traditionally follows the apprenticeship model, in which educators often have little formal training in education, and the acquisition of procedural skills by trainees relies heavily on procedure volume and learning by doing. A growing appreciation of the need to formally educate endoscopy trainers has led to the development of mandatory training curricula in other countries, but the implementation of such courses in the US has been limited. This 1-hour workshop aimed to provide educators the rationale and skills to offer a more standardized approach to procedural training.

METHODS

We implemented a 1-hour interactive workshop designed for both gastroenterology faculty and trainees. The four sections of the workshop focused on: (1) rationale for standardized approach, (2) verbal and physical preparation for training, (3) training using standardized language and avoidance of cognitive overload, and (4) providing feedback. Four interactive video cases followed by large-group discussion were included.

RESULTS

A total of 13 gastroenterology faculty and trainees attended the workshop. Eight additional members of the gastroenterology faculty watched an online video of the workshop. Survey data revealed that the workshop was effective in helping faculty set goals with trainees (M_pre = 2.4, M_post = 3.6), identify standardized language to use during endoscopy (M_pre = 3.1, M_post = 3.8), and give feedback after sessions (M_pre = 3.4, M_post = 4.1).

DISCUSSION

A 1-hour lecture-based interactive workshop with video cases was an engaging and effective introduction to formal endoscopy education techniques. The format was easy to incorporate into faculty conferences and can help bridge the current gap in formal endoscopy faculty training.

Learning Challenges, Teaching Strategies, and Cognitive Load: Insights From the Experience of Seasoned Endoscopy Teachers

PURPOSE

Learners of medical procedures must develop, refine, and apply schemas for both cognitive and psychomotor constructs, which may strain working memory capacity. Procedures with limitations in visual and tactile information may add risk of cognitive overload. The authors sought to elucidate how experienced procedural teachers perceived learners' challenges and their own teaching strategies in the exemplar setting of gastrointestinal endoscopy.

METHOD

The authors interviewed 22 experienced endoscopy teachers in the United States, Canada, and the Netherlands between May 2016 and March 2019 and performed thematic analysis using template analysis method. Interviews addressed learner challenges and teaching strategies from the teacher participants' perspectives. Cognitive load theory informed data interpretation and analysis.

RESULTS

Participants described taking steps to "diagnose" trainee ability and identify struggling trainees. They described learning challenges related to trainees (performance over mastery goal orientation, low self-efficacy, lack of awareness), tasks (psychomotor challenges, mental model development, tactile understanding), teachers (teacher-trainee relationship, inadequate teaching, teaching variability), and settings (internal/external distractions, systems issues). Participants described employing strategies that could match intrinsic load to learners' levels (teaching along developmental continuum, motor instruction, technical assistance/takeover), minimize extraneous load (optimize environment, systems solutions, emotional support, define expectations), and optimize germane load (promote mastery, teach schemas, stop and focus).

CONCLUSIONS

Participants provided insight into possible challenges while learning complex medical procedures with limitations in sensory channels, as well as teaching strategies that may address these challenges at individual and systems levels. Using cognitive load theory, the authors provide recommendations for procedural teachers.

Effect of individualized feedback on learning curves in EGD and colonoscopy: a cluster randomized controlled trial

BACKGROUND AND AIMS

Gastroenterology fellowships need to ensure that trainees achieve competence in upper endoscopy (EGD) and colonoscopy. Because the impact of structured feedback remains unknown in endoscopy training, this study compared the effect of structured feedback with standard feedback on trainee learning curves for EGD and colonoscopy.

METHODS

In this multicenter, cluster, randomized controlled trial, trainees received either individualized quarterly learning curves or feedback standard to their fellowship. Assessment was performed in all trainees using the Assessment of Competency in Endoscopy tool on 5 consecutive procedures after every 25 EGDs and colonoscopies. Individual learning curves were created using cumulative sum (CUSUM) analysis. The primary outcome was the mean CUSUM score in overall technical and overall cognitive skills.

RESULTS

In all, 13 programs including 132 trainees participated. The intervention arm (6 programs, 51 trainees) contributed 558 EGD and 600 colonoscopy assessments. The control arm (7 programs, 81 trainees) provided 305 EGD and 468 colonoscopy assessments. For EGD, the intervention arm (-.7 [standard deviation {SD}, 1.3]) had a superior mean CUSUM score in overall cognitive skills compared with the control arm (1.6 [SD, .8], P = .03) but not in overall technical skills (intervention, -.26 [SD, 1.4]; control, 1.76 [SD, .7]; P = .06). For colonoscopy, no differences were found between the 2 arms in overall cognitive skills (intervention, -.7 [SD, 1.3]; control, .7 [SD, 1.3]; P = .95) or overall technical skills (intervention, .1 [SD, 1.5]; control, -.1 [SD, 1.5]; P = .77).

CONCLUSIONS

Quarterly feedback in the form of individualized learning curves did not affect learning curves for EGD and colonoscopy in a clinically meaningful manner. (Clinical trial registration number: NCT02891304.).

Best Practices in Teaching Endoscopy Based on a Delphi Survey of Gastroenterology Program Directors and Experts in Endoscopy Education

BACKGROUND AND AIMS

Teaching endoscopy is a key objective of gastroenterology (GI) fellowship programs but the best approach is not known. We sought to characterize which teaching competencies experts considered most critical for endoscopy education.

METHODS

We developed and refined 18 endoscopy teaching competencies based on literature review, personal experience, and interviews with experts. We invited GI fellowship program directors and endoscopy education experts to participate in a Delphi process to rate each proposed competency as essential, important but not essential, or not important using a 70% agreement threshold for consensus. Thirty-four GI fellowship program directors and 2 experts in endoscopy education participated (n = 36).

RESULTS

Most survey participants were male (61.8%), associate professors (55.9%), and had performed at least a quarter of procedures with fellows (80.6%). Survey response rates were 94% (34 of 36) for round 1 and 91% (31 of 34) for round 2 (overall 31 of 36; 86.1%). After 2 rounds we achieved the predefined consensus level for most competencies. Fourteen of 18 competencies (77.8%) reached consensus after round 2: 10 (55.6%) were deemed essential and 4 (22.2%) were deemed important but not essential. Essential competencies included the following: discusses patient history and plans for procedure with trainee (100%), assumes control of procedure when trainee is unable to progress or if patient safety concerns arise (100%), maintains attention throughout the case (96.8%), and discusses the next steps in management for the patient (96.8%).

CONCLUSIONS

In a national Delphi survey of endoscopy education experts, we identified 10 essential endoscopy teaching competencies. These can be used to frame faculty development and standardize GI fellowship programs to promote high-quality endoscopy education.

Learners and Luddites in the Twenty-first Century: Bringing Evidence-based Education to Anesthesiology

Anesthesiologists are both teachers and learners and alternate between these roles throughout their careers. However, few anesthesiologists have formal training in the methodologies and theories of education. Many anesthesiology educators often teach as they were taught and may not be taking advantage of current evidence in education to guide and optimize the way they teach and learn. This review describes the most up-to-date evidence in education for teaching knowledge, procedural skills, and professionalism. Methods such as active learning, spaced learning, interleaving, retrieval practice, e-learning, experiential learning, and the use of cognitive aids will be described. We made an effort to illustrate the best available evidence supporting educational practices while recognizing the inherent challenges in medical education research. Similar to implementing evidence in clinical practice in an attempt to improve patient outcomes, implementing an evidence-based approach to anesthesiology education may improve learning outcomes.

Trainee perception of cognitive load during observed faculty staff teaching of procedural skills

OBJECTIVES

Although teachers impact learners' cognitive load, how specific teaching activities affect intrinsic, germane and extraneous load during procedural skills training is unknown. We sought to characterise teaching activities used in the exemplar procedural setting of colonoscopy, and to explore how they were enacted and how learners perceived them as affecting intrinsic, germane and extraneous cognitive load.

METHODS

We observed 10 colonoscopies performed by eight different gastroenterology fellows and supervised by 10 different attending physicians at two hospitals, and recorded the teaching activities observed, as well as details of when they were used and how they were enacted. After the colonoscopy, each fellow completed the Cognitive Load Inventory for Colonoscopy to quantify intrinsic, germane and extraneous load. We then interviewed each fellow to determine how he or she perceived teaching as affecting cognitive load. Qualitative data were subjected to content analysis. Instances of germane load-promoting activities were correlated with measured germane load.

RESULTS

We observed 515 instances of teaching activities. The intensity of teaching varied substantially, ranging from 0.7 to 3.3 activities per minute, as did the pattern of teaching activities used by different attending physicians. Little teaching occurred immediately before or after a procedure. Fellows usually perceived teaching as affecting cognitive load in ways that promoted learning, particularly by reducing intrinsic load and increasing germane load. Fellows strongly perceived that the provision of autonomy promoted germane load. Conversely, fellows perceived that excessive teaching increased extraneous load. Instances of germane load-promoting teaching activities correlated moderately with measured germane load.

CONCLUSIONS

Teaching in the exemplar procedural setting of colonoscopy affected learners' cognitive load in mostly beneficial ways, yet even 'good' teaching activities had detrimental effects when used excessively. Teachers of procedures should consider learner experience, task complexity and environmental factors to modulate the modality, content and intensity of teaching to promote balanced cognitive load and learning. Teaching more reservedly during the procedure and taking advantage of pre- and post-procedure opportunities may help.

Cognitive load theory for training health professionals in the workplace: A BEME review of studies among diverse professions: BEME Guide No. 53

AIM

Cognitive load theory (CLT) is of increasing interest to health professions education researchers. CLT has intuitive applicability to workplace settings, yet how CLT should inform teaching, learning, and research in health professions workplaces is unclear.

METHOD

To map the existing literature, we performed a scoping review of studies involving cognitive load, mental effort and/or mental workload in professional workplace settings within and outside of the health professions. We included actual and simulated workplaces and workplace tasks.

RESULT

Searching eight databases, we identified 4571 citations, of which 116 met inclusion criteria. Studies were most often quantitative. Methods to measure cognitive load included psychometric, physiologic, and secondary task approaches. Few covariates of cognitive load or performance were studied. Overall cognitive load and intrinsic load were consistently negatively associated with the level of experience and performance. Studies consistently found distractions and other aspects of workplace environments as contributing to extraneous load. Studies outside the health professions documented similar findings to those within the health professions, supporting relevance of CLT to workplace learning.

CONCLUSION

The authors discuss implications for workplace teaching, curricular design, learning environment, and metacognition. To advance workplace learning, the authors suggest future CLT research should address higher-level questions and integrate other learning frameworks.

Cognitive load in internal medicine: What every clinical teacher should know about cognitive load theory

Internal medicine is an appropriate example of specialties in which to teach learners clinical reasoning skills, decision-making, and analytical thinking, as well as evidence-based, patient-oriented medicine. During daily clinical work, general internists always encounter a multitude of situations that lend themselves to educating medical trainees in ambulatory and inpatient settings. Application of existing learning theories to teaching has been shown to optimize teaching ability and to maximize the efficiency of teaching efforts. Cognitive Load Theory explains learning according to three important aspects: the types of memory (working and long-term memory), the learning process and the forms of cognitive load that affect our learning. The aim of this paper is to show the main perspectives and implications of the Cognitive Load Theory on clinical educational practices. It is important to give the right amount of information in the most effective way to learners, thereby making this information more useful. This article presents a concise overview of the basis of the Cognitive Load Theory in its first part, and, in its second part, it exposes the practical applications of this theory with examples. This learning theory will encourage clinical teachers to reflect on how to foster learning in medical trainees in the more effective way.

What Makes a Good Endoscopic Teacher: A Qualitative Analysis

OBJECTIVE

Teaching learners to perform endoscopic procedures is challenging, yet effective endoscopy teaching practices are not well-described in the literature, and prior studies have focused on perspectives of supervising physicians rather than learners. We sought to characterize, from the perspective of endoscopy learners, endoscopic teaching behaviors perceived as beneficial and detrimental to learning using qualitative methods.

DESIGN

This is a prospective qualitative content analysis. Gastroenterology fellows from 2 tertiary care centers anonymously provided feedback regarding supervising physicians' teaching behaviors during endoscopic training between March 2016 and December 2016. Preprinted cards were completed at the conclusion of procedures to document behaviors that fellows perceived as enhancing or hampering their learning. Two investigators performed content analysis of written comments; each identified behavior was assigned positive or negative valence.

SETTING

Mount Sinai Hospital in New York, New York and University of California San Francisco in San Francisco, California. Both institutions are academic tertiary care centers.

PARTICIPANTS

A total of 19 gastroenterology fellows at 2 training institutions participated.

RESULTS

A total of 239 teaching behaviors were identified by 19 fellows who worked with 31 supervising physicians; 29 unique behaviors were identified and organized into 7 themes: teaching, learning environment, autonomy, communication, coaching, feedback, and professionalism. Of all, 185 (77.4%) behaviors were reported as beneficial, and 54 (22.6%) as detrimental to the learning experience. Behaviors related to teaching were most often perceived as beneficial, while behaviors related to professionalism and communication were most often perceived as detrimental to learning.

CONCLUSIONS

Specific teaching behaviors may help or hinder learning of endoscopic skills. These behaviors may be useful for efforts related to teaching evaluation, faculty development, and direct teaching.

Training in Endoscopy

PURPOSE OF THE REVIEW

Progress towards the goal of high-quality endoscopy across health economies has been founded on high-quality structured training programmes linked to credentialing practice and ongoing performance monitoring. This review appraises the recent literature on training interventions, which may benefit performance and competency acquisition in novice endoscopy trainees.

RECENT FINDINGS

Increasing data on the learning curves for different endoscopic procedures has highlighted variations in performance amongst trainees. These differences may be dependent on the trainee, trainer and training programme. Evidence of the benefit of knowledge-based training, simulation training, hands-on courses and clinical training is available to inform the planning of ideal training pathway elements. The validation of performance assessment measures and global competency tools now also provides evidence on the effectiveness of training programmes to influence the learning curve. The impact of technological advances and intelligent metrics from national databases is also predicted to drive improvements and efficiencies in training programme design and monitoring of post-training outcomes. Training in endoscopy may be augmented through a series of pre-training and in-training interventions. In conjunction with performance metrics, these evidence-based interventions could be implemented into training pathways to optimise and quality assure training in endoscopy.

The effect of distributed virtual reality simulation training on cognitive load during subsequent dissection training

BACKGROUND

Complex tasks such as surgical procedures can induce excessive cognitive load (CL), which can have a negative effect on learning, especially for novices.

AIM

To investigate if repeated and distributed virtual reality (VR) simulation practice induces a lower CL and higher performance in subsequent cadaveric dissection training.

METHODS

In a prospective, controlled cohort study, 37 residents in otorhinolaryngology received VR simulation training either as additional distributed practice prior to course participation (intervention) (9 participants) or as standard practice during the course (control) (28 participants). Cognitive load was estimated as the relative change in secondary-task reaction time during VR simulation and cadaveric procedures.

RESULTS

Structured distributed VR simulation practice resulted in lower mean reaction times (32% vs. 47% for the intervention and control group, respectively, p < 0.01) as well as a superior final-product performance during subsequent cadaveric dissection training.

CONCLUSIONS

Repeated and distributed VR simulation causes a lower CL to be induced when the learning situation is increased in complexity. A suggested mechanism is the formation of mental schemas and reduction of the intrinsic CL. This has potential implications for surgical skills training and suggests that structured, distributed training be systematically implemented in surgical training curricula.