Trainee perception of cognitive load during observed faculty staff teaching of procedural skills

Curriculum for diagnostic endoscopic ultrasound training in Europe: European Society of Gastrointestinal Endoscopy (ESGE) Position Statement

The European Society of Gastrointestinal Endoscopy (ESGE) has recognized the need to formalize and enhance training in diagnostic endoscopic ultrasound (EUS). This manuscript represents the outcome of a formal Delphi process resulting in an official Position Statement of the ESGE and provides a framework to develop and maintain skills in diagnostic EUS. This curriculum is set out in terms of the prerequisites prior to training; the recommended steps of training to a defined syllabus; the quality of training; and how competence should be defined and evidenced before independent practice. 1:  Trainees should have achieved competence in upper gastrointestinal endoscopy before training in diagnostic EUS. 2:  The development of diagnostic EUS skills by methods that do not involve patients is advisable, but not mandatory, prior to commencing formal training in diagnostic EUS. 3:  A trainee's principal trainer should be performing adequate volumes of diagnostic EUSs to demonstrate maintenance of their own competence. 4:  Training centers for diagnostic EUS should offer expertise, as well as a high volume of procedures per year, to ensure an optimal level of quality for training. Under these conditions, training centers should be able to provide trainees with a sufficient wealth of experience in diagnostic EUS for at least 12 months. 5:  Trainees should engage in formal training and supplement this with a range of learning resources for diagnostic EUS, including EUS-guided fine-needle aspiration and biopsy (FNA/FNB). 6:  EUS training should follow a structured syllabus to guide the learning program. 7:  A minimum procedure volume should be offered to trainees during diagnostic EUS training to ensure that they have the opportunity to achieve competence in the technique. To evaluate competence in diagnostic EUS, trainees should have completed a minimum of 250 supervised EUS procedures: 80 for luminal tumors, 20 for subepithelial lesions, and 150 for pancreaticobiliary lesions. At least 75 EUS-FNA/FNBs should be performed, including mostly pancreaticobiliary lesions. 8:  Competence assessment in diagnostic EUS should take into consideration not only technical skills, but also cognitive and integrative skills. A reliable valid assessment tool should be used regularly during diagnostic EUS training to track the acquisition of competence and to support trainee feedback. 9:  A period of supervised practice should follow the start of independent activity. Supervision can be delivered either on site if other colleagues are already practicing EUS or by maintaining contacts with the training center and/or other EUS experts. 10:  Key performance measures including the annual number of procedures, frequency of obtaining a diagnostic sample during EUS-FNA/FNB, and adverse events should be recorded within an electronic documentation system and evaluated.

Trainee selection of tasks in postgraduate medical education: Is there a role for 'cherry-picking' to optimise learning?

PURPOSE

Learning is optimised when postgraduate trainees engage in clinical tasks in their zone of proximal development (ZPD). However, workplace learning environments impose additional non-learning goals and additional tasks that may lead to trainees engaging in tasks that do not fall within their ZPD. We do not fully understand how trainees select clinical tasks in the workplace learning environment. If we knew the goals and factors they consider when selecting a task, we could better equip trainees with strategies to select tasks that maximise learning. We explored how postgraduate trainees select clinical tasks using echocardiography interpretation as a model.

METHODS

Canadian General Cardiology residents and Echocardiography fellows were invited to participate in semi-structured interviews. Aligning with a theory-informed study, two independent researchers used a deductive, directed content analysis approach to identify codes and themes.

RESULTS

Eleven trainees from seven Canadian universities participated (PGY4 = 4, PGY5 = 3, PGY6 = 1 and echocardiography fellows = 3). Goals included learning content, fulfilling assessment criteria and contributing to clinical demands. Trainees switched between goals throughout the day, as it was too effortful for them to engage in tasks within their ZPD at all times. When trainees had sufficient mental effort available, they selected higher complexity tasks that could advance learning content. When available mental effort was low, trainees selected less complex tasks that fulfilled numerically based assessment goals or contributed to clinical demands. Trainees predominantly used perceived complexity of the echocardiogram as a factor to select tasks to achieve their desired goals.

CONCLUSION

Postgraduate trainees select tasks within their ZPD that enable them to maximise learning when they perceive to have sufficient mental effort available and workplace affordances are adequate. These findings can inform individual and systemic strategies to maximise learning when selecting tasks.

Senior trainee as endoscopy teacher: impact on trainee learning and attending experience

Objective

Training in how to effectively teach endoscopy is not included in most gastroenterology (GI) training programme curricula, yet many gastroenterologists are expected to teach endoscopy in their careers. Near-peer teaching could help senior GI trainees learn how to teach endoscopy and have benefits for junior trainees. We performed a qualitative study of a peer teaching initiative where senior trainees taught endoscopy to junior trainees under attending supervision.

Design

We observed endoscopy sessions where the senior trainee taught a junior trainee under attending supervision, and then conducted individual interviews with the senior trainee teacher, junior trainee learner and attending to characterise affordances and barriers to learning. We performed thematic analysis on anonymised interview transcripts.

Results

10 observations and 30 interviews were completed. Junior trainees reported senior trainees more approachable than attendings and explained concepts in more understandable ways. Senior trainees reported the teaching role improved skill at both teaching and performing endoscopy. Attendings reported positive impressions of the experience for senior trainees, and generally positive impressions with some reservations of the experience for junior trainees. A few barriers to learning were reported, but they were generally perceived as being outweighed by affordances. An area for improvement was setting clear expectations for senior trainee and attending roles before the session.

Conclusion

Near-peer endoscopy teaching was feasible and provided perceived affordances for junior and senior trainees alike, with few barriers. Incorporating formal training in teaching endoscopy into GI training programme curricula may produce both better endoscopists and better endoscopy teachers.

Cognitive Load Assessment Scales in Simulation: Validity Evidence for a Novel Measure of Cognitive Load Types

INTRODUCTION

Cognitive load (CL) theory provides a framework to inform simulation instructional design. Reliable measures of CL types (intrinsic [IL], extraneous [EL], and germane load [GL]) in simulation are lacking. We developed the novel Cognitive Load Assessment Scales in Simulation (CLAS-Sim) and report validity evidence using Kane's framework.

METHODS

This quasi-experimental study tested the effect of a segmented/pause-and-debrief or standard/end-of-case-debrief intervention on pediatric residents' performance and self-rated CL in 2 complex- and simple-case simulations. After each simulation, participants completed 22 items measuring CL types. Three validity inferences were examined: scoring (instrument development and principal component analysis); generalization (internal consistency reliability of CL-component items across cases); and extrapolation [CLAS-Sim correlations with the single-item Paas scale, which measures overall CL; differences in primary task performance (high vs low); and discriminant validity of IL under different instructional-design conditions].

RESULTS

Seventy-four residents completed both simulations and postcase CLAS-Sim measures. The principal component analysis yielded 3 components: 4-item IL, 4-item EL, and 3-item GL scales (Cronbach's α, 0.68-0.77). The Paas scores correlated with CLAS-Sim IL and total CL scores in both cases ( rs range, 0.39-0.70; P ≤ 0.001). High complex-case performers reported lower IL and total CL (analyses of variance, each P < 0.001). In multivariate analyses of variance, CLAS-Sim IL, GL, and total CL varied across both cases by arm (each P ≤ 0.018); the segmented-debrief arm reported lower IL than the standard-debrief arm in both cases (each P ≤ 0.01).

CONCLUSIONS

The CLAS-Sim demonstrates preliminary validity evidence for distinguishing 3 CL types but requires further study to evaluate the impact of simulation-design elements on CL and learning.

Adult Gastroenterology Trainees’ Experience of Receiving Feedback on Their Performance of Endoscopy in the Workplace

Background

Competency-based gastrointestinal endoscopy training is concerned with outcomes of the learning experience. Feedback allows for trainees to achieve the expected outcomes. However, little is known about trainees’ experience of receiving feedback. Gaining understanding of their experience could help improve feedback practices. The study was conducted to explore what it means for adult gastroenterology trainees to receive feedback on their performance of endoscopy in the workplace.

Methods

An interpretative phenomenological approach was used. Individual semi-structured interviews were conducted with six trainees from three Canadian adult gastroenterology residency programs. Interviews were audio-recorded and transcribed verbatim for analysis. Analysis was conducted to identify the phenomenological themes across participants’ accounts of lived experience to provide an insight into the meaning of experiencing the studied phenomenon.

Findings

Three phenomenological themes of experience were identified: taking pauses, negotiating understandings and accepting asymmetry. Taking pauses allowed for participants to receive feedback on their performance of endoscopy. Participants needed to negotiate attending gastroenterologists’ different understandings of gastrointestinal endoscopy while carrying their own whenever feedback was provided. They had to accept the asymmetry between the roles of care provider and learner as well.

Discussion

The study has captured the uniqueness and the complexity of the lived experience of receiving feedback on the performance of endoscopy in the workplace from the perspective of study participants. The gained understanding of this experience has enabled the authors to suggest how attending gastroenterologists’ feedback practices may be improved.

Learning Echocardiography in the Workplace: A Cognitive Load Perspective

PURPOSE

Although workplace learning environments provide authentic tasks to promote learning, elements of clinical settings may distract trainees and impede learning. The characteristics of workplace learning environments that require optimization are ill-defined. Applying principles of cognitive load theory (CLT) to optimize learning environments by managing intrinsic load (complexity of the task matched to learner knowledge and skill), minimizing extraneous load (any aspect that is not part of task completion), and increasing germane load (processing for storage in long-term memory) could be advantageous. The authors explored trainee perceptions of characteristics that helped or impaired learning from a cognitive load perspective. Echocardiography interpretation was used as a model.

METHOD

The authors conducted semistructured interviews between December 2018 and March 2019 with a purposeful sample of 10 cardiology trainees at the University of California, San Francisco, School of Medicine until thematic sufficiency was achieved. Participants represented a range of training levels (3 fourth-year trainees, 2 fifth-year trainees, 3 sixth-year trainees, and 2 advanced echocardiography fellows) and career aspirations (4 desired careers in imaging). Two independent coders analyzed interview transcripts using template analysis. Codes were mapped to CLT subcomponents.

RESULTS

Trainees selected their own echocardiograms to interpret; if trainees' skill levels and the complexity of the selected echocardiograms were mismatched, excess intrinsic load could result. Needing to look up information essential for task completion, interruptions, reporting software, and time pressures were characteristics that contributed to extraneous load. Characteristics that related to increasing germane load included the shared physical space (facilitating reading echocardiograms with attendings and just-in-time guidance from near peers) and the availability of final reports to obtain feedback independent of teachers.

CONCLUSIONS

As interpreted from a cognitive load perspective, findings highlight characteristics of workplace learning environments that could be optimized to improve learning. The findings have direct application to redesigning these learning environments.

How do attending physicians describe cognitive overload among their workplace learners?

OBJECTIVES

Cognitive load theory (CLT) focuses on the limited bandwidth of working memory. Core to CLT is the concept of cognitive overload, which occurs when working memory demands exceed working memory capacity, and learning and performance suffer. Within health professions education (HPE), workplace learning settings are very complex, placing learners at high risk of cognitive overload. Although continuous monitoring of physiologic parameters can indicate states of high cognitive load, how to practically identify cognitively overloaded learners within everyday workplace settings is not well understood. We sought to characterise how attending physicians described their perceiving of cognitive overload among learners in two different workplace settings: the gastrointestinal endoscopy suite and the intensive care unit.

METHODS

We performed a secondary qualitative analysis of transcripts of interviews with workplace teachers that had been carried out during two previous studies. These studies had addressed different objectives but both were informed by CLT. Each included questions that prompted participants to reflect on how they perceived cognitive overload to manifest among learners in the workplace. To investigate the phenomenon of cognitive overload, we developed a new codebook and performed content analysis.

RESULTS

We analysed 42 interview transcripts (22 endoscopists, 12 hospitalists, eight intensivists). Participants described four behaviours they had witnessed among learners they thought were cognitively overloaded: poor performance on workplace tasks; non-verbal physical manifestations (including posture, eye and body movements and autonomic functions); verbal utterances (words and sounds), and interpersonal interactions with team members. Endoscopists often described individually oriented examples, whereas intensivists and hospitalists tended to frame examples within an interpersonal context.

CONCLUSIONS

We identified four overarching ways in which HPE workplace teachers perceived learners as appearing to be cognitively overloaded. Workplace teachers and learners should be mindful of and watch for these signs, which may signal states of cognitive overload. Earlier recognition of cognitive overload may facilitate timely action to reduce cognitive overload and promote learning.

Standardizing Endoscopy Training: A Workshop for Endoscopy Educators

INTRODUCTION

Endoscopy education in the US traditionally follows the apprenticeship model, in which educators often have little formal training in education, and the acquisition of procedural skills by trainees relies heavily on procedure volume and learning by doing. A growing appreciation of the need to formally educate endoscopy trainers has led to the development of mandatory training curricula in other countries, but the implementation of such courses in the US has been limited. This 1-hour workshop aimed to provide educators the rationale and skills to offer a more standardized approach to procedural training.

METHODS

We implemented a 1-hour interactive workshop designed for both gastroenterology faculty and trainees. The four sections of the workshop focused on: (1) rationale for standardized approach, (2) verbal and physical preparation for training, (3) training using standardized language and avoidance of cognitive overload, and (4) providing feedback. Four interactive video cases followed by large-group discussion were included.

RESULTS

A total of 13 gastroenterology faculty and trainees attended the workshop. Eight additional members of the gastroenterology faculty watched an online video of the workshop. Survey data revealed that the workshop was effective in helping faculty set goals with trainees (M_pre = 2.4, M_post = 3.6), identify standardized language to use during endoscopy (M_pre = 3.1, M_post = 3.8), and give feedback after sessions (M_pre = 3.4, M_post = 4.1).

DISCUSSION

A 1-hour lecture-based interactive workshop with video cases was an engaging and effective introduction to formal endoscopy education techniques. The format was easy to incorporate into faculty conferences and can help bridge the current gap in formal endoscopy faculty training.