Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains

Skill Proficiency is Predicted by Intubation Frequency of Emergency Medicine Attending Physicians

Introduction

Airway management is a fundamental skill of emergency medicine (EM) practice, and suboptimal management leads to poor outcomes. Endotracheal intubation (ETI) is a procedure that is specifically taught in residency, but little is known how best to maintain proficiency in this skill throughout the practitioner’s career. The goal of this study was to identify how the frequency of intubation correlated with measured performance.

Methods

We assessed 44 emergency physicians for proficiency at ETI by direct laryngoscopy on a simulator. The electronic health record was then queried to obtain their average number of annual ETIs and the time since their last ETI, supervised and individually performed, over a two-year period. We evaluated the strength of correlation between these factors and assessment scores, and then conducted a receiver operator characteristic (ROC) curve analysis to identify factors that predicted proficient performance.

Results

The mean score was 81% (95% confidence interval, 76% – 86%). Scores correlated well with the mean number of ETIs performed annually and with the mean number supervised annually (r = 0.6, p = 0.001 for both). ROC curve analysis identified that physicians would obtain a proficient score if they had performed an average of at least three ETIs annually (sensitivity = 90%, specificity = 64%, AUC = 0.87, p = 0.001) or supervised an average of at least five ETIs annually (sensitivity = 90%, specificity = 59%, AUC = 0.81, p = 0.006) over the previous two years.

Conclusion

Performing at least three or supervising at least five ETIs annually, averaged over a two-year period, predicted proficient performance on a simulation-based skills assessment. We advocate for proactive maintenance and enhancement of skills, particularly for those who infrequently perform this procedure.

Improved Team Performance During Pediatric Resuscitations After Rapid Cycle Deliberate Practice Compared With Traditional Debriefing: A Pilot Study

INTRODUCTION

Simulation-based medical education (SBME) improves medical knowledge compared with no intervention. In traditional SBME, more time is spent debriefing than practicing skills. Rapid cycle deliberate practice (RCDP) simulation allows learners to practice skills repetitively, receive brief interspersed feedback, and has been shown to improve individual performance of resuscitation skills in simulation; it has not been compared with traditional simulation methods.

OBJECTIVE

The aim of the study was to compare traditional and RCDP SBME.

METHODS

Four pediatric resuscitation cases (3 for teaching and 1 for testing) were developed. For the RCDP arm, traditional cases were deconstructed into sequences of progressively difficult rounds. The last RCDP round served as the traditional arm scenario.Learners received 1 type of instruction on 2 separate days. Pretest and posttest performance during simulation were video recorded and scored using the Simulation Team Assessment Tool; satisfaction surveys were collected.

RESULTS

Pretest team performance was similar in both groups. Simulation Team Assessment Tool score improvement for RCDP was 7.2% (95% confidence interval, 3.4% to 11%) and traditional was 0.8% (95% confidence interval, -11% to 13%). The difference in improvement of the human factors subscore was statistically significant; RCDP improved 10.2% and traditional improved 1.7% (P = 0.013). The RCDP technique was well received by learners but caused fatigue.

CONCLUSIONS

This pilot study showed a trend toward greater improvement in team performance and significantly greater improvement for human factors with RCDP compared with traditional simulation. Future studies comparing RCDP with other methods are needed to identify best practices and applications of RCDP, including which learners and learning objectives are best suited to RCDP.

Impacts of a Pediatric Extracorporeal Cardiopulmonary Resuscitation (ECPR) Simulation Training Program

OBJECTIVE

To examine the impacts of a large-scale simulation-based extracorporeal cardiopulmonary resuscitation (ECPR) training program in an academic children's hospital.

METHODS

The study followed a quasi-experimental, mixed-method, time series design. Two-hour high-fidelity ECPR simulations were held monthly in the pediatric, cardiac, and neonatal intensive care units. Intensive care unit-specific cases were used in each unit. The learning objectives for all cases were the same. Each simulation included an average of 11 health care professionals, including nurses, physicians, respiratory therapist, and perfusionists. Impacts of training were examined using Kirkpatrick's 4-level model: reactions, learning, behaviors, and results. Participant surveys, semistructured interviews, facilitator observations, applied cognitive task analysis, and hospital code data were used to examine the impacts of training.

RESULTS

From February 2014 to October 2016, a total of 332 health care professionals participated in 29 ECPR simulations. Participants enjoyed the simulations and reported learning gains. Applied cognitive task analysis revealed 2 specific behaviors, coordination of compressions with surgical cannulation and performing sterile compressions, that were targeted for further training. The rate of adherence to the ECPR activation protocol improved from 83% (48/58) before simulations started to 95% (92/97) after simulations (P = .02). ECPR activation time decreased from 7 minutes (interquartile range, 4-9 minutes) before simulations started to 2 minutes (interquartile range, 1-4 minutes) after simulations (P < .01).

CONCLUSIONS

Large-scale simulation-based ECPR training was associated with positive reactions, learning gains, behavioral change, improved adherence to the ECPR activation protocols, and faster activation times. Other children's hospital that perform ECPR should consider simulation-based training.

Apprentissage par simulation en pédiatrie : l’exemple de l’arrêt cardiorespiratoire de l’enfant

La simulation en santé s’est diffusée très rapidement en pédiatrie à partir des années 2000 aux États-Unis et au Canada, puis à partir des années 2010 en France. L’arrêt cardiorespiratoire (ACR) de l’enfant représente le meilleur exemple des bénéfices qui peuvent être apportés par la simulation. La simulation peut reproduire à l’infini cette situation exceptionnelle, offre un apprentissage sans risque pour le patient ni pour l’apprenant, permet de travailler ses aspects cognitifs, techniques et humains. La simulation est effectivement associée à un gain en connaissance et en compétence chez les apprenants et participe à l’amélioration du pronostic des patients. Afin de maximiser l’efficacité pédagogique de l’enseignement de la prise en charge de l’ACR de l’enfant, les responsables pédagogiques devraient sans cesse évaluer leurs programmes, privilégier des curriculums qui associent la simulation avec d’autres modalités d’apprentissage et avoir pour objectif une pédagogie de la maîtrise. Les mannequins haute fidélité, s’ils sont appréciés par les apprenants, restent pédagogiquement équivalents aux mannequins basse fidélité pour l’apprentissage de la prise en charge de l’ACR de l’enfant.

ASGE EndoVators Summit: simulators and the future of endoscopic training

Interest in the use of simulation for acquiring, maintaining, and assessing skills in GI endoscopy has grown over the past decade, as evidenced by recent American Society for Gastrointestinal Endoscopy (ASGE) guidelines encouraging the use of endoscopy simulation training and its incorporation into training standards by a key accreditation organization. An EndoVators Summit, partially supported by a grant from the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) of the National Institutes of Health, (NIH) was held at the ASGE Institute for Training and Technology from November 19 to 20, 2017. The summit brought together over 70 thought leaders in simulation research and simulator development and key decision makers from industry. Proceedings opened with a historical review of the role of simulation in medicine and an outline of priority areas related to the emerging role of simulation training within medicine broadly. Subsequent sessions addressed the summit's purposes: to review the current state of endoscopy simulation and the role it could play in endoscopic training, to define the role and value of simulators in the future of endoscopic training and to reach consensus regarding priority areas for simulation-related education and research and simulator development. This white paper provides an overview of the central points raised by presenters, synthesizes the discussions on the key issues under consideration, and outlines actionable items and/or areas of consensus reached by summit participants and society leadership pertinent to each session. The goal was to provide a working roadmap for the developers of simulators, the investigators who strive to define the optimal use of endoscopy-related simulation and assess its impact on educational outcomes and health care quality, and the educators who seek to enhance integration of simulation into training and practice.

Impact of emergency physician experience on decision-making in patients with suspected community-acquired pneumonia and undergoing systematic thoracic CT scan

Objectives

To determine whether the impact of a thoracic CT scan on community-acquired pneumonia (CAP) diagnosis and patient management varies according to emergency physician’s experience (≤10 vs >10 years).

Methods

Early thoracic CT Scan for Community-Acquired Pneumonia at the Emergency Department is an interventional study conducted from November 2011 to January 2013 in four French emergency departments, and included suspected patients with CAP. We analysed changes in emergency physician CAP diagnosis classification levels before and after CT scan; and their agreement with an adjudication committee. We performed univariate analysis to determine the factors associated with modifying the diagnosis classification level to be consistent with the radiologist’s CT scan interpretation.

Results

319 suspected patients with CAP and 136 emergency physicians (75% less experienced with ≤10 years, 25% with >10 years of experience) were included. The percentage of patients whose classification was modified to become consistent with CT scan radiologist’s interpretation was higher among less-experienced than experienced emergency physicians (54.2% vs 40.2%; p=0.02). In univariate analysis, less emergency physician experience was the only factor associated with changing a classification to be consistent with the CT scan radiologist’s interpretation (OR 1.77, 95% CI 1.01 to 3.10, p=0.04). After CT scan, the agreement between emergency physicians and adjudication committee was moderate for less-experienced emergency physicians and slight for experienced emergency physicians (k=0.457 and k=0.196, respectively). After CT scan, less-experienced emergency physicians modified patient management significantly more than experienced emergency physicians (36.1% vs 21.7%, p=0.01).

Conclusions

In clinical practice, less-experienced emergency physicians were more likely to accurately modify their CAP diagnosis and patient management based on thoracic CT scan than more experienced emergency physicians.

Trial registration number

NCT01574066

Analysis of Perceptual Expertise in Radiology - Current Knowledge and a New Perspective

Radiologists rely principally on visual inspection to detect, describe, and classify findings in medical images. As most interpretive errors in radiology are perceptual in nature, understanding the path to radiologic expertise during image analysis is essential to educate future generations of radiologists. We review the perceptual tasks and challenges in radiologic diagnosis, discuss models of radiologic image perception, consider the application of perceptual learning methods in medical training, and suggest a new approach to understanding perceptional expertise. Specific principled enhancements to educational practices in radiology promise to deepen perceptual expertise among radiologists with the goal of improving training and reducing medical error.

Clinical reasoning as a threshold skill

Background: Threshold skills are defined as new ways of thinking about and performing in a discipline. They represent transformed ways of thinking and doing that are pivotal to learners' progress. Our aim was to establish whether clinical reasoning exhibited features of a threshold skill. Methods: Twenty-five final-year medical students were interviewed with a five-question protocol about how they were learning clinical reasoning. Students' responses were analyzed using a deductive method to identify features of threshold skills. Results: Students' descriptions of learning clinical reasoning exhibited five features: transformation, troublesomeness, integration, association with practice, and issues with transferability. Conclusions: Viewing clinical reasoning as a threshold skill is a novel interpretation of its nature and has implications for learning, teaching, and research. Students can be reassured that, although initially troublesome, with practice, they will not only learn the skill but also how to use it more effectively. Teachers can help students to understand that clinical reasoning is difficult to learn and will require time and repeated practice under supervision to develop.

Why Content and Cognition Matter: Integrating Conceptual Knowledge to Support Simulation-Based Procedural Skills Transfer

BACKGROUND

Curricular constraints require being selective about the type of content trainees practice in their formal training. Teaching trainees procedural knowledge about "how" to perform steps of a skill along with conceptual knowledge about "why" each step is performed can support skill retention and transfer (i.e., the ability to adapt knowledge to novel problems). However, how best to organize how and why content for procedural skills training is unknown.

OBJECTIVES

We examined the impact of different approaches to integrating why and how content on trainees' skill retention and transfer of simulation-based lumbar puncture (LP).

DESIGN AND PARTICIPANTS

We randomized medical students (N = 66) to practice LP for 1 h using one of three videos. One video presented only the how content for LP (Procedural Only). Two other videos presented how and why content (e.g., anatomy) in two ways: Integrated in Sequence, with why content followed by how content, or Integrated for Causation, with how and why content integrated throughout.

MAIN MEASURES

Pairs of blinded raters scored participants' retention and transfer LP performances on a global rating scale (GRS), and written tests assessed participants' procedural and conceptual knowledge.

KEY RESULTS

Simple mediation regression analyses showed that participants receiving an integrated instructional video performed significantly better on transfer through their intervention's positive impact on conceptual knowledge (all p < 0.01). Further, the Integrated for Causation group performed significantly better on transfer than the Integrated in Sequence group (p < 0.01), again mediated by improved conceptual knowledge. We observed no mediation of participants' skill retention (all p > 0.01).

CONCLUSIONS

When teaching supports cognitive integration of how and why content, trainees are able to transfer learning to new problems because of their improved conceptual understanding. Instructional designs for procedural skills that integrate how and why content can help educators optimize what trainees learn from each repetition of practice.

Examining the Efficacy of Online Self-Paced Interactive Video-Recordings in Nursing Skill Competency Learning: Seeking Preliminary Evidence Through an Action Research

A key challenge in nursing education is how to teach the students clinical competencies effectively and to provide opportunities for practicing the fundamental nursing skills safely. The purpose of this study was to examine the competency scores of practicing a clinical skill and the satisfaction level of nursing students on three instructional methods using an action research: the online self-paced interactive video learning, demonstration-only method, and a video demonstration in class. Participants were both male and female nursing students enrolled in the Foundations of Nursing Course (N = 26, 6 males and 20 females; mean age = 19.42 ± 0.50) and were evaluated at precycle, postcycle 1, and postcycle 2. Each cycle of inquiry was planned to address the problems quickly and efficiently through four steps: planning, acting, observing, and reflecting. A triangulation technique was employed for data collection using a competency skill evaluation checklist, a satisfaction questionnaire, and a focus group feedback questionnaire. A video was developed in the researcher's college pertaining to the practical skills. Each research cycle was successively built up on one another using the reflections and feedback from the students based on the previous cycle. The competency skills at various cycles did not demonstrate significant differences between three instructional methods, whereas satisfaction score was the highest with the online self-paced interactive video demonstration. Online video learning use as a supplement in nursing instruction is well supported and offers a promising alternative in teaching clinical skill compared with other teaching strategies. However, more rigorous studies are required to get further empirical evidence in replacing the demonstration method, for teaching nursing practical skill and in improving students' learning ability and competence.

Debriefing for the Transfer of Learning: The Importance of Context

The advent of simulation-based education has caused a renewed interest in feedback and debriefing. However, little attention has been given to the issue of transfer of learning from the simulation environment to real-life and novel situations. In this article, the authors discuss the importance of context in learning, based on the frameworks of analogical transfer and situated cognition, and the limitations that context imposes on transfer. They suggest debriefing strategies to improve transfer of learning: positioning the lived situation within its family of situations and implementing the metacognitive strategies of contextualizing, decontextualizing, and recontextualizing. In contextualization, the learners' actions, cognitive processes, and frames of reference are discussed within the context of the lived experience, and their mental representation of the situation and context is explored. In decontextualization, the underlying abstract principles are extracted without reference to the situation, and in recontextualization, those principles are adapted and applied to new situations and to the real-life counterpart. This requires that the surface and deep features that characterize the lived situation be previously compared and contrasted with those of the same situation with hypothetical scenarios ("what if"), of new situations within the same family of situations, of the prototype situation, and of real-life situations. These strategies are integrated into a cyclical contextualization, decontextualization, and recontextualization model to enhance debriefing.

Common Ground: Frameworks for Teaching Improvisational Ability in Medical Education

Issue: The practice of medicine is intrinsically unpredictable. Clinicians must respond skillfully to this uncertainty; therefore, medical educators are using improvisational theater training methods to teach improvisational ability in areas such as communication and professionalism. This teaching approach is called "medical improv." Although early reports of medical improv suggest promise, the collective descriptions of curricular content lack consistency. This ambiguity creates impediments for further implementation and research of this new educational technique. To address this challenge, the author presents two unifying conceptual frameworks for medical improv curricula. Evidence: Medical improv evolved from previous work done in improvisational (improv) theater and "applied improv," which is the broader category of improv-based training in nontheater environments. The author synthesized curricular elements from all three fields of improv into two conceptual frameworks: core curricular components (skills, principles, and exercises) and core skill groups (attunement, affirmation, and advancement). The curricular component framework simplifies terminology and clarifies a previously vague distinction between skills and principles. The skill group framework harnesses a redundant and wide-ranging list of improv skills into three categories. Together, the frameworks provide a simple structure that encompasses and organizes the core concepts of medical improv. Implications: These curricular frameworks enable educators and learners to more easily understand the scope and depth of medical improv concepts and to identify areas where medical improv could enhance existing medical education strategies. For example, there is substantial overlap between improvisation skills and current curricular objectives for communication skills, as outlined by Accreditation Council for Graduate Medical Education benchmarks (e.g., Milestones, Competencies, Entrustable Professional Activities). Medical improv courses could be an efficient way to achieve many of these objectives. In addition, improv-based exercises represent an experiential learning modality that is underutilized in communication skills training; therefore, exercises could be integrated into existing coursework to bridge the learning pathway between texts and simulation. Furthermore, the deliberate cultivation of affirmation skills could enhance resilience and wellness in clinical and learning environments. In summary, through their conceptual simplicity, these curricular frameworks for medical improv can help educators understand, study, and optimize teaching of improvisation in medical education.

Development of a structured virtual reality curriculum for laparoscopic appendicectomy

BACKGROUND

Laparoscopic appendicectomy (LA) is a common surgical emergency procedure mainly performed by trainees. The aim was to develop a step-wise structured virtual reality (VR) curriculum for LA to allow junior surgeons to hone their skills in a safe and controlled environment.

METHODS

A prospective randomized study was designed using a high-fidelity VR simulator. Thirty-five novices and 25 experts participated in the assessment and their performances were compared to assess construct validity. Learning curve analysis was performed.

RESULTS

Five of the psychomotor tasks and all appendicectomy tasks showed construct validity. Learning was demonstrated in the majority of construct-valid tasks. A novel goal-directed VR curriculum for LA was constructed.

CONCLUSIONS

A step-wise structured VR curriculum for LA is proposed with a framework which includes computer generated metrics and supports deliberate practice, spacing intervals, human instruction/feedback and assessment. Future study should test the feasibility of its implementation and transferability of acquired skill.

Virtual Standardized Patient Simulation: Case Development and Pilot Application to High-Value Care

INTRODUCTION

High-value care (HVC) suggests that good history taking and physical examination should lead to risk stratification that drives the use or withholding of diagnostic testing. This study describes the development of a series of virtual standardized patient (VSP) cases and provides preliminary evidence that supports their ability to provide experiential learning in HVC.

METHODS

This pilot study used VSPs, or natural language processing-based patient avatars, within the USC Standard Patient platform. Faculty consensus was used to develop the cases, including the optimal diagnostic testing strategies, treatment options, and scored content areas. First-year resident physician learners experienced two 90-minute didactic sessions before completing the cases in a computer laboratory, using typed text to interview the avatar for history taking, then completing physical examination, differential diagnosis, diagnostic testing, and treatment modules for each case. Learners chose a primary and 2 alternative "possible" diagnoses from a list of 6 to 7 choices, diagnostic testing options from an extensive list, and treatments from a brief list ranging from 6 to 9 choices. For the history-taking module, both faculty and the platform scored the learners, and faculty assessed the appropriateness of avatar responses. Four randomly selected learner-avatar interview transcripts for each case were double rated by faculty for interrater reliability calculations. Intraclass correlations were calculated for interrater reliability, and Spearman ρ was used to determine the correlation between the platform and faculty ranking of learners' history-taking scores.

RESULTS

Eight VSP cases were experienced by 14 learners. Investigators reviewed 112 transcripts (4646 learner query-avatar responses). Interrater reliability means were 0.87 for learner query scoring and 0.83 for avatar response. Mean learner success for history taking was scored by the faculty at 57% and by the platform at 51% (ρ correlation of learner rankings = 0.80, P = 0.02). The mean avatar appropriate response rate was 85.6% for all cases. Learners chose the correct diagnosis within their 3 choices 82% of the time, ordered a median (interquartile range) of 2 (2) unnecessary tests and completed 56% of optimal treatments.

CONCLUSIONS

Our avatar appropriate response rate was similar to past work using similar platforms. The simulations give detailed insights into the thoroughness of learner history taking and testing choices and with further refinement should support learning in HVC.

Computer Simulation Training for Mandibular All-on-Four/All-on-Three Surgery

Mandibular all-on-4 implant reconstruction techniques are less complex than maxillary but more complex than routine dental implant surgery, requiring advanced technical skills, deeper understanding of prosthodontic principles, and more complex surgical planning. Surgical simulation may assist experienced surgeons seeking to acquire new skills through increased planning ability, improved intraspecialty communication, and enhanced technical competence. Achieving competence is different for the trainee devoted to the learning process and the practicing surgeon with limited time and balancing other roles and responsibilities. Well-constructed continuing education incorporating simulation, 3-dimensional printed models, and computer-assisted planning may offer the most efficient path to competence.

Comparison of 2 canine celiotomy closure models for training novice veterinary students

OBJECTIVE

To compare a low-fidelity foam and fabric (FF) model to a high fidelity silicone (SI) model for teaching canine celiotomy closure.

STUDY DESIGN

Prospective blinded comparison of learning outcomes.

SAMPLE POPULATION

Second-year veterinary students who had never performed surgery as a primary surgeon (n = 46) and veterinarians experienced in performing canine celiotomy (n = 10).

METHODS

Veterinary students performed a digitally recorded celiotomy closure on a canine cadaver before and after participation in 4 facilitated laboratory training sessions on their randomly assigned model. Recordings were scored by masked, trained educators with an 8-item task-specific rubric. Students completed surveys evaluating the models. Experienced veterinarians tested the models and provided feedback on their features.

RESULTS

Completed pretest and posttest recordings were available for 38 of 46 students. Students' performance improved regardless of the model used to practice (P = .04). The magnitude of improvement did not differ between the 2 groups (P = .10). All students (n = 46) described their models favorably. Ninety percent of veterinarians thought both models were helpful for training students and gave similar ratings on all measures except for realism, which was rated higher for the SI model's skin (median, agree) compared with the FF model (median, neutral, P = .02).

CONCLUSION

Model-based training was effective at improving students' surgical skills. Less experienced learners achieved similar skill gains after practicing with FF or SI models.

CLINICAL SIGNIFICANCE

The acquisition of surgical skills required to perform celiotomy closure in companion animals occurs similarly well on models made of foam and fabric or of silicone, providing flexibility in model selection.

Emerging Role of Drills and Simulations in Patient Safety

Ensuring patient safety and optimizing outcomes in obstetrics and gynecology through improving technical skills, enhancing team performance, and decreasing medical errors has resulted in significant interest in incorporating drills and simulation into medical training, continuing education, and multidisciplinary team practice. Drills and simulations are ideal because of their wide range of application with various learners and settings. They provide a safe space to learn and maintain technical skills and to improve knowledge, confidence, communication, and teamwork behaviors, particularly for less common, high-stakes clinical scenarios.

An innovative academic-practice partnership to enhance the development and training of military nurses

Academic-practice partnerships have been identified by the American Association of Colleges of Nursing as a best practice for advancing the profession of nursing in a collaborative manner by sharing goals, knowledge, and respect in a mutually beneficial line of effort. Training military nurses poses a unique challenge to academia and military nurse corps to produce competent nursing professionals who are also effective military officers. The academic-practice partnership between the United States Army Cadet Command's ROTC program and the University of San Francisco's School of Nursing is a prime example of such a partnership. Through the innovative month-long nurse summer training internship program, Army nursing students work one-on-one with an experienced Army nurse preceptor to receive an intense clinical experience with a minimum of 150 h of hands-on patient care in a military medical treatment facility. This example of cognitive apprenticeship learning provides an adjunct to nursing program curricula in addition to an introduction of the roles and responsibilities of a military officer. This academic-practice partnership helps develop a strong group of novice nurses who are confident leaders and critical thinkers that easily make the transition from academia to professional practice.

Efficacy of Trauma Surgery Technical Skills Training Courses

OBJECTIVE

Because open surgical skills training for trauma is limited in clinical practice, trauma skills training courses were developed to fill this gap, The aim of this report is to find supporting evidence for efficacy of these courses. The questions addressed are: What courses are available and is there robust evidence of benefit?

DESIGN

We performed a systematic review of the training course literature on open trauma surgery procedural skills courses for surgeons using Kirkpatrick's framework for evaluating complex educational interventions. Courses were identified using Pubmed, Google Scholar and other databases.

SETTING AND PARTICIPANTS

The review was carried out at the University of Maryland, Baltimore with input from civilian and military trauma surgeons, all of whom have taught and/or developed trauma skills courses.

RESULTS

We found 32 course reports that met search criteria, including 21 trauma-skills training courses. Courses were of variable duration, content, cost and scope. There were no prospective randomized clinical trials of course impact. Efficacy for most courses was with Kirkpatrick level 1 and 2 evidence of benefit by self-evaluations, and reporting small numbers of respondents. Few courses assessed skill retention with longitudinal data before and after training. Three courses, namely: Advanced Trauma Life Support (ATLS), Advanced Surgical Skills for Exposure in Trauma (ASSET) and Advanced Trauma Operative Management (ATOM) have Kirkpatrick's level 2-3 evidence for efficacy. Components of these 3 courses are included in several other courses, but many skills courses have little published evidence of training efficacy or skills retention durability.

CONCLUSIONS

Large variations in course content, duration, didactics, operative models, resource requirements and cost suggest that standardization of content, duration, and development of metrics for open surgery skills would be beneficial, as would translation into improved trauma patient outcomes. Surgeons at all levels of training and experience should participate in these trauma skills courses, because these procedures are rarely performed in routine clinical practice. Faculty running courses without evidence of training benefit should be encouraged to study outcomes to show their course improves technical skills and subsequently patient outcomes. Obtaining Kirkpatrick's level 3 and 4 evidence for benefits of ASSET, ATOM, ATLS and for other existing courses should be a high priority.

Using Low-Cost Virtual Reality Simulation to Build Surgical Capacity for Cervical Cancer Treatment

PURPOSE

Worldwide, more than 80% of people diagnosed with cancer will require surgery during their disease course, but only 5% to 20% of low- and middle-income countries have access to safe, affordable, and timely surgery. Developing surgical oncology skills requires significant time and mentoring. Virtual reality (VR) simulators can reduce the time required to master surgical procedures but are prohibitively expensive. We sought to determine whether a VR simulator using low-cost computer gaming equipment could train novice surgeons in Africa to perform a virtual radical abdominal (open) hysterectomy (RAH).

METHODS

Our RAH VR simulator used the Oculus Rift (Oculus VR, Menlo Park, CA), a VR headset with hand controllers that costs less than $1,500. Surgical novices learned to perform five key steps of a virtual RAH. We measured and identified predictors of movement and time efficiency for the simulation.

RESULTS

Ten novice surgeons in Lusaka, Zambia, enrolled in the study. Movement and time efficiency greatly improved over time. Independent predictors of movement efficiency were number of simulations, surgical experience, and time since college graduation. Independent predictors of time efficiency were number of simulations, surgical experience, days between simulation sessions, age, sex, and an interaction between number of simulations and surgical experience.

CONCLUSION

Low-cost VR may be an effective tool to help surgical novices learn complex surgical oncology procedures. If learning to perform VR surgical procedures with low-cost hardware leads to faster mastery of surgical procedures in the operating room, low-cost VR may represent one of the solutions to increasing access to surgical cancer care globally.

Prospective Trial of Low-Fidelity Deliberate Practice of Aortic and Coronary Anastomoses (TECoG 002)

OBJECTIVE

We sought to examine the feasibility of a home practice curriculum of vascular anastomosis in cardiovascular surgery using a low-fidelity simulation platform and to examine its effectiveness in skill acquisition in senior surgical trainees.

DESIGN

We organized a multicenter prospective randomized study of senior residents and fellows, who were oriented to a low-fidelity cardiac simulator and an 8-week curriculum of independent practice of aortic and coronary anastomosis. "Treatment" trainees received a simulator and the curriculum. Control trainees received only their usual operative experience. The groups then crossed over; all were studied for 16 weeks in total. Video skill assessments were captured at 0, 8, and 16 weeks and were scored by one blinded investigator using the Joint Council on Thoracic Surgery Education Assessment tool. A post-hoc survey was distributed to invited participants following study completion.

SETTING

University of Minnesota Department of Surgery, Mayo Clinic Department of Cardiovascular Surgery, and the University of Texas Health Science Center at Houston. Participants used the simulator in offices, call rooms, and their homes.

PARTICIPANTS

Program participation in the study was solicited through the Thoracic Education Cooperative Group. Four institutions expressed interest and a total of 29 trainees were invited to the study and randomized. Of these, 12 (38%) completed the curriculum and submitted the requisite 3 sets of videos (6 treatment, 6 control). All were senior residents and fellows in general and cardiothoracic surgery.

RESULTS

No significant differences were detected in assessment scores before and after the curriculum nor before or after the control period in the overall or postgraduate year-stratified populations. Participant case numbers during the study did not have a significant effect on assessment scores. Randomized participants reported strong interest in deliberate practice of technical skills but identified competing clinical and personal obligations and significant barriers to simulation.

CONCLUSIONS

Considerable variability in performance existed among participants who completed the study, but overall, the curriculum alone was insufficient to improve simulator Joint Council on Thoracic Surgery Education scores compared to those not undergoing the curriculum. Among senior residents and fellows, provision of a practice curriculum and simulator for repeated practice is feasible but clinical and personal responsibilities were barriers to repetitive practice.

Segmenting and classifying activities in robot-assisted surgery with recurrent neural networks

PURPOSE

Automatically segmenting and classifying surgical activities is an important prerequisite to providing automated, targeted assessment and feedback during surgical training. Prior work has focused almost exclusively on recognizing gestures, or short, atomic units of activity such as pushing needle through tissue, whereas we also focus on recognizing higher-level maneuvers, such as suture throw. Maneuvers exhibit more complexity and variability than the gestures from which they are composed, however working at this granularity has the benefit of being consistent with existing training curricula.

METHODS

Prior work has focused on hidden Markov model and conditional-random-field-based methods, which typically leverage unary terms that are local in time and linear in model parameters. Because maneuvers are governed by long-term, nonlinear dynamics, we argue that the more expressive unary terms offered by recurrent neural networks (RNNs) are better suited for this task. Four RNN architectures are compared for recognizing activities from kinematics: simple RNNs, long short-term memory, gated recurrent units, and mixed history RNNs. We report performance in terms of error rate and edit distance, and we use a functional analysis-of-variance framework to assess hyperparameter sensitivity for each architecture.

RESULTS

We obtain state-of-the-art performance for both maneuver recognition from kinematics (4 maneuvers; error rate of [Formula: see text]; normalized edit distance of [Formula: see text]) and gesture recognition from kinematics (10 gestures; error rate of [Formula: see text]; normalized edit distance of [Formula: see text]).

CONCLUSIONS

Automated maneuver recognition is feasible with RNNs, an exciting result which offers the opportunity to provide targeted assessment and feedback at a higher level of granularity. In addition, we show that multiple hyperparameters are important for achieving good performance, and our hyperparameter analysis serves to aid future work in RNN-based activity recognition.

Using deliberate practice framework to assess the quality of feedback in undergraduate clinical skills training

BACKGROUND

In this research paper we report on the quality of feedback provided in the logbooks of pre-clinical undergraduate students based on a model of 'actionable feedback'. Feedback to clinical learners about their performance is crucial to their learning, which ultimately impacts on their development into competent clinicians. Due to students' concerns regarding the inconsistency and quality of feedback provided by clinicians, a structured feedback improvement strategy to move feedback forward was added to the clinical skills logbook. The instrument was also extended for peer assessment. This study aims to assess the quality of feedback using the deliberate practice framework.

METHODS

A feedback scoring system was used to retrospectively assess the quality of tutor and peer logbook feedback provided to second and third year medical students to identify deliberate practice components i.e. task, performance gap and action plan. The sample consisted of 425 second year and 600 third year feedback responses over a year.

RESULTS

All three deliberate practice components were observed in the majority of the written feedback for both classes. The frequency was higher in peer (83%, 89%) than tutor logbook assessments (51%, 67%) in both classes respectively. Average tutor and peer task, gap and action feedback scores ranged from 1.84-2.07 and 1.93-2.21 respectively. The overall quality of feedback provided by the tutor and peer was moderate and less specific (average score < or = 2). The absence of the three components was noted in only 1% of the feedback responses in both 2nd and 3rd year.

CONCLUSION

This study found that adding in a feed-forward strategy to the logbooks increased the overall quality of tutor and peer feedback as the task, gap and action plans were described. Deliberate practice framework provides an objective assessment of tutor and peer feedback quality and can be used for faculty development and training. The findings from our study suggest that the ratings from the tool can also be used as guidelines to provide feedback providers with feedback on the quality of feedback they provided. This includes specifically describing a task, performance gap and providing a learning plan as feed-forward to enhance feedback given.

Feedback learning opportunities from medical student logs of paediatric patients

BACKGROUND

Feedback can alter medical student logging practices, although most learners feel feedback is inadequate. A varied case mix in rural and urban contexts offers diverse clinical encounters. Logs are an indicator of these clinical experiences, and contain opportunities for feedback, which can greatly influence learning: we labelled these 'feedback learning opportunities' (FLOs). We asked: How often do FLOs occur? What are the case complexities of rural compared to urban paediatric logs? Do more complex cases result in more FLOs?

METHODS

In Western Australia, 25% of medical students are dispersed in a Rural Clinical School (RCSWA) up to 2175 miles (3500 km) from the city. Urban students logged 20 written cases; rural students logged a minimum of 25 paediatric cases electronically. These were reviewed to identify FLOs, using a coding convention. FLO categories provided a structure for feedback: medical, professionalism, insufficient, clinical reasoning, student wellbeing, quality and safety, and sociocultural. Each log was assigned an overall primary, secondary or tertiary case complexity.

RESULTS

There were 76 consenting students in each urban and rural group, providing 3034 logs for analysis after exclusions. FLOs occurred in more than half the logs, with significantly more rural (OR 1.35 95% CI 1.17, 1.56; p < 0.0001). Major FLOs occurred in over a third of logs, but with no significant difference between rural and urban (OR 1.10 95% CI 0.94, 1.28; p = 0.24). Medical FLOs were the most common, accounting for 64.0% of rural and 75.2% of urban FLOs (OR 1.71 95% CI 1.37, 2.12; p < 0.0001). Students logged cases with a variety of complexities. Most cases logged by urban students in a tertiary healthcare setting were of primary and secondary complexity. Major medical FLOs increased with increasing patient complexity, occurring in 32.1% of tertiary complexity cases logged by urban students (p < 0.001).

CONCLUSIONS

Case logs are a valuable resource for medical educators to enhance students' learning by providing meaningful feedback. FLOs occurred often, particularly in paediatric cases with multiple medical problems. This study strengthens recommendations for regular review and timely feedback on student logs. We recommend the FLOs categories as a framework for medical educators to identify FLOs.

Comparative evaluation of video-based on-line course versus serious game for training medical students in cardiopulmonary resuscitation: A randomised trial

Purpose

To estimate the effect size of a serious game for cardiopulmonary resuscitation (CPR) training in comparison with a video-based on-line course in terms of learning outcomes among medical students before simulation-based CPR using a manikin.

Methods

Participants were 45 first-year medical students randomly assigned to CPR self-training using either a video-based Apple Keynote presentation (n = 22) or a serious game developed in a 3D learning environment (n = 23) for up to 20 min. Each participant was evaluated on a written, multiple-choice test (theoretical test) and then on a scenario of cardiac arrest (practical test) before and after exposure to the self-learning methods. The primary endpoint was change in theoretical and practical baseline scores during simulated CPR. This study was conducted in 2017.

Results

Both groups improved scores after exposure. The video group had superior performance in both the theoretical test (7.56±0.21 vs 6.51±0.21 for the game group; p = 0.001) and the practical test (9.67±0.21 vs 8.40±0.21 for the game group; p < 0.001). However, students showed a preference for using games, as suggested by the longer time they remained interested in the method (18.57±0.66 min for the game group vs 7.41±0.43 for the video group; p < 0.001).

Conclusions

The self-training modality using a serious game, after a short period of exposure, resulted in inferior students’ performance in both theoretical and practical CPR tests compared to the video-based self-training modality. However, students showed a clear preference for using games rather than videos as a form of self-training.

Objectively Assessing Intraoperative Arthroscopic Skills Performance and the Transfer of Simulation Training in Knee Arthroscopy: A Randomized Controlled Trial

PURPOSE

To objectively investigate the transfer validity of simulation training using wireless elbow-worn motion sensors intraoperatively to assess whether surgical simulation leads to improvements in intraoperative arthroscopic performance.

METHODS

In this randomized controlled trial, postgraduate year 2 to 3 trainees in nationally approved orthopaedic surgery posts were randomized to standard junior residency training (control group) or standard training plus additional weekly simulation training (intervention group). Both groups performed a supervised real-life diagnostic knee arthroscopy in the operating room at 13 weeks. Performance was measured using wireless elbow-worn motion sensors recording objective surgical performance metrics: number of hand movements, smoothness, and time taken. A participant-supervisor performance ratio was used to adjust for variation in case mix and difficulty. The study took place in a surgical simulation suite and the orthopaedic operating rooms of a university teaching hospital.

RESULTS

The intervention group objectively outperformed the control group in all outcome metrics. Procedures performed by the intervention group required fewer hand movements (544 [interquartile range (IQR), 465-593] vs 893 [IQR, 747-1,242]; P < .001), had smoother movements (25,842 ms^-3 [IQR, 20,867-27,468 ms^-3] vs 36,846 ms^-3 [IQR, 29,840-53,949 ms^-3]; P < .001), and took less time (320 seconds [IQR, 294-392 seconds] vs 573 seconds [IQR, 477-860 seconds]; P < .001) than those performed by the control group. The cases were comparable between the groups. Standardized to the supervisor's performance, the intervention group required fewer hand movements (1.9 [IQR, 1.5-2.1] vs 3.3 [IQR, 2.2-4.8]; P = .0091), required less time (1.2 [IQR, 1.1-1.7] vs 2.6 [IQR, 1.6-3.0]; P = .0037), and were smoother (2.1 [IQR, 1.8-2.8] vs 4.3 [IQR, 2.8-5.4]; P = .0037) than the control group, but they did not perform as well as their supervisors.

CONCLUSIONS

This study uses intraoperative motion-analysis technology to objectively show that surgical simulation training improves actual intraoperative technical skills performance.

CLINICAL RELEVANCE

The described wireless objective assessment method complements the subjective observational performance assessments commonly used. Further studies are required to assess how these measures of intraoperative performance correlate to patient outcomes. Intraoperative motion analysis is translatable across surgical specialties, offering potential for objective assessment of progression through competency-based training, revalidation, and talent selection for specialist training.

A Simple Low-Cost Method to Integrate Telehealth Interprofessional Team Members During In Situ Simulation

INTRODUCTION

With the growth of telehealth, simulation personnel will be called upon to support training that integrates these new technologies and processes. We sought to integrate remote telehealth electronic intensive care unit (eICU) personnel into in situ simulations with rural emergency department (ED) care teams. We describe how we overcame technical challenges of creating shared awareness of the patient's condition and the care team's progress among those executing the simulation, the care team, and the eICU.

METHODS

The objective of the simulations was to introduce telehealth technology and new processes of engaging the eICU via telehealth during sepsis care in 2 rural EDs. Scenario development included experts in sepsis, telehealth, and emergency medicine. We describe the operational systems challenges, alternatives considered, and solutions used. Participants completed surveys on self-confidence presimulation/postsimulation in using telehealth and in managing patients with sepsis (1-10 Likert scale, with 10 "completely confident"). Pre-post responses were compared by two-tailed paired t test.

RESULTS

We successfully engaged the staff of two EDs: 42 nurses, 9 physicians or advanced practice providers, and 9 technicians (N = 60). We used a shared in situ simulation clinical actions observational checklist, created within an off-the-shelf survey software program, completed during the simulations by an on-site observer, and shared with the eICU team via teleconferencing software, to message and cue eICU nurse engagement. The eICU nurse also participated in debriefing via the telehealth video system with successful simulation engagement. These solutions avoided interfering with real ED or eICU operations. The postsimulation mean ± SD ratings of confidence using telehealth increased from 5.3 ± 2.9 to 8.9 ± 1.1 (Δ3.5, P < 0.05) and in managing patients with sepsis increased from 7.1 ± 2.5 to 8.9 ± 1.1 (Δ1.8, P < 0.05).

CONCLUSIONS

We created shared awareness between remote eICU personnel and in situ simulations in rural EDs via a low-cost method using survey software combined with teleconferencing methods.

Deliberate Practice as an Effective Remediation Strategy for Underperforming Medical Students Focused on Clinical Skills: a Prospective Longitudinal Study

BACKGROUND

It is critical to develop remedial education for underperforming medical students, but little is known about how to create an effective remediation program. Deliberate practice (DP) is a structured and reflective activity that is designed to optimize performance. Here we applied the concept of DP to create remedial education to improve the clinical practices of medical students. We also analyzed the effectiveness of the remediation program.

METHODS

Based on the expert performance approach of DP, we designed a 4-week remedial program for clinical performance that included feedback and reflection. There were 74 student participants in this program from 2014 to 2017. Their clinical performance was re-evaluated after completion, and changes in their clinical performance scores were analyzed.

RESULTS

Students who completed the remediation program showed significant improvements in clinical performance scores (P < 0.001). Most students found the program to be instructive and helpful for improving their clinical performance. They reported that role play with peers was the most helpful for improving their skills.

CONCLUSION

The DP-based remediation program improved the clinical performance of failing medical students. This remediation program should continue to be offered to underperforming students to ensure that medical school graduates are competent.

Simulation in endoscopy: Practical educational strategies to improve learning

In gastrointestinal endoscopy, simulation-based training can help endoscopists acquire new skills and accelerate the learning curve. Simulation creates an ideal environment for trainees, where they can practice specific skills, perform cases at their own pace, and make mistakes with no risk to patients. Educators also benefit from the use of simulators, as they can structure training according to learner needs and focus solely on the trainee. Not all simulation-based training, however, is effective. To maximize benefits from this instructional modality, educators must be conscious of learners' needs, the potential benefits of training, and associated costs. Simulation should be integrated into training in a manner that is grounded in educational theory and empirical data. In this review, we focus on four best practices in simulation-based education: deliberate practice with mastery learning, feedback and debriefing, contextual learning, and innovative educational strategies. For each topic, we provide definitions, supporting evidence, and practical tips for implementation.

Feasibility and Perceived Usefulness of Using Head-Mounted Cameras for Resident Video Portfolios

BACKGROUND

There is limited guidance on how to longitudinally administer simulation materials or to incorporate video recordings into assessment portfolios of simulated surgical skills.

MATERIALS AND METHODS

We launched a longitudinal weekly simulation curriculum for PGY1-PGY3 surgical residents based on the ACS/APDS Curriculum. Residents underwent monthly objective structured assessment of technical skills (OSATS) while wearing head-mounted cameras. Videos of OSATS performance accrued into individual online video portfolios. Residents were surveyed about their attitudes toward video recording.

RESULTS

Twenty-seven general surgical residents participated, completing 161 OSATS encompassing 11 distinct skills and generating 258 videos of simulated skills performance. The overall survey response rate was 88%. Residents viewed the curriculum favorably overall, and 36.4% of residents accessed their videos. Of those who did not watch their videos, 78.6% cited not having enough time, whereas 28.6% did not think the videos would be useful. Over 95% of surveyed residents expressed interest in having a video library of attending-performed procedures, 59.1% were interested in having their own operations recorded, and 45.5% were interested in video-based coaching.

CONCLUSIONS

Residents viewed longitudinal administration of the ACS/APDS Curriculum positively. Although video recording in simulation is feasible, resident interest may be higher for intraoperative recordings than for simulated skills.

Neonatal Intubation Competency Assessment Tool: Development and Validation

BACKGROUND

Neonatal tracheal intubation (NTI) is an important clinical skill. Suboptimal performance is associated with patient harm. Simulation training can improve NTI performance. Improving performance requires an objective assessment of competency. Competency assessment tools need strong evidence of validity. We hypothesized that an NTI competency assessment tool with multisource validity evidence could be developed and be used for formative and summative assessment during simulation-based training.

METHODS

An NTI assessment tool was developed based on a literature review. The tool was refined through 2 rounds of a modified Delphi process involving 12 subject-matter experts. The final tool included a 22-item checklist, a global skills assessment, and an entrustable professional activity (EPA) level. The validity of the checklist was assessed by having 4 blinded reviewers score 23 videos of health care providers intubating a neonatal simulator.

RESULTS

The checklist items had good internal consistency (overall α = 0.79). Checklist scores were greater for providers at greater training levels and with more NTI experience. Checklist scores correlated with global skills assessment (ρ = 0.85; P < .05), EPA levels (ρ = 0.87; P < .05), percent glottic exposure (r = 0.59; P < .05), and Cormack-Lehane scores (ρ = 0.95; P < .05). Checklist scores reliably predicted EPA levels.

CONCLUSIONS

We developed an NTI competency assessment tool with multisource validity evidence. The tool was able to discriminate NTI performance based on experience. The tool can be used during simulation-based NTI training to provide formative and summative assessment and can aid with entrustment decisions.

Cognitive load theory for training health professionals in the workplace: A BEME review of studies among diverse professions: BEME Guide No. 53

AIM

Cognitive load theory (CLT) is of increasing interest to health professions education researchers. CLT has intuitive applicability to workplace settings, yet how CLT should inform teaching, learning, and research in health professions workplaces is unclear.

METHOD

To map the existing literature, we performed a scoping review of studies involving cognitive load, mental effort and/or mental workload in professional workplace settings within and outside of the health professions. We included actual and simulated workplaces and workplace tasks.

RESULT

Searching eight databases, we identified 4571 citations, of which 116 met inclusion criteria. Studies were most often quantitative. Methods to measure cognitive load included psychometric, physiologic, and secondary task approaches. Few covariates of cognitive load or performance were studied. Overall cognitive load and intrinsic load were consistently negatively associated with the level of experience and performance. Studies consistently found distractions and other aspects of workplace environments as contributing to extraneous load. Studies outside the health professions documented similar findings to those within the health professions, supporting relevance of CLT to workplace learning.

CONCLUSION

The authors discuss implications for workplace teaching, curricular design, learning environment, and metacognition. To advance workplace learning, the authors suggest future CLT research should address higher-level questions and integrate other learning frameworks.

Enhancing Educational Scholarship Through Conceptual Frameworks: A Challenge and Roadmap for Medical Educators

Historically, health sciences education has been guided by tradition and teacher preferences rather than by the application of practices supported by rigorous evidence of effectiveness. Although often underutilized, conceptual frameworks-theories that describe the complexities of educational and social phenomenon-are essential foundations for scholarly work in education. Conceptual frameworks provide a lens through which educators can develop research questions, design research studies and educational interventions, assess outcomes, and evaluate the impact of their work. Given this vital role, conceptual frameworks should be considered at the onset of an educational initiative. Use of different conceptual frameworks to address the same topic in medical education may provide distinctive approaches. Exploration of educational issues by employing differing, theory-based approaches advances the field through the identification of the most effective educational methods. Dissemination of sound educational research based on theory is similarly essential to spark future innovation. Ultimately, this rigorous approach to medical education scholarship is necessary to allow us to establish how our educational interventions impact the health and well-being of our patients.

Transition to active learning in rural Nepal: an adaptable and scalable curriculum development model

BACKGROUND

Traditional medical education in much of the world has historically relied on passive learning. Although active learning has been in the medical education literature for decades, its incorporation into practice has been inconsistent. We describe and analyze the implementation of a multidisciplinary continuing medical education curriculum in a rural Nepali district hospital, for which a core objective was an organizational shift towards active learning.

METHODS

The intervention occurred in a district hospital in remote Nepal, staffed primarily by mid-level providers. Before the intervention, education sessions included traditional didactics. We conducted a mixed-methods needs assessment to determine the content and educational strategies for a revised curriculum. Our goal was to develop an effective, relevant, and acceptable curriculum, which could facilitate active learning. As part of the intervention, physicians acted as both learners and teachers by creating and delivering lectures. Presenters used lecture templates to prioritize clarity, relevance, and audience engagement, including discussion questions and clinical cases. Two 6-month curricular cycles were completed during the study period. Daily lecture evaluations assessed ease of understanding, relevance, clinical practice change, and participation. Periodic lecture audits recorded learner talk-time, the proportion of lecture time during which learners were talking, as a surrogate for active learning. Feedback from evaluation and audit results was provided to presenters, and pre- and post-curriculum knowledge assessment exams were conducted.

RESULTS

Lecture audits showed a significant increase in learner talk-time, from 14% at baseline to 30% between months 3-6, maintained at 31% through months 6-12. Lecture evaluations demonstrated satisfaction with the curriculum. Pre- and post-curriculum knowledge assessment scores improved from 50 to 64% (difference 13.3% ± 4.5%, p = 0.006). As an outcome for the measure of organizational change, the curriculum was replicated at an additional clinical site.

CONCLUSION

We demonstrate that active learning can be facilitated by implementing a new educational strategy. Lecture audits proved useful for internal program improvement. The components of the intervention which are transferable to other rural settings include the use of learners as teachers, lecture templates, and provision of immediate feedback. This curricular model could be adapted to similar settings in Nepal, and globally.

Interprofessional provider educational needs and preferences regarding the provision of sexual and reproductive health care in cystic fibrosis

BACKGROUND

Sexual and reproductive health (SRH) is an important disease-specific concern for adolescent and young adult (AYA) women that is not consistently addressed in cystic fibrosis (CF) centers. This study identifies educational needs and preferences of interprofessional CF providers regarding SRH in AYA women with CF.

METHODS

Interprofessional CF providers participated in an anonymous survey regarding general and CF-specific SRH knowledge and skills, factors for optimizing SRH care, and preferred approaches for SRH training. We calculated descriptive statistics for all respondents and stratified by provider type.

RESULTS

A total of 523 providers completed the survey (39% physicians/advanced practice providers, 19% nurses, 20% social workers, and 22% other disciplines). Half reported comfort responding to female AYA SRH concerns; however, only one-third were comfortable asking appropriate questions and confident taking a sexual history. Only 29% were comfortable with their current CF-specific SRH knowledge. Respondents' preferred SRH topics for further training included: pregnancy/parenthood planning, sexual functioning, urinary incontinence, intimate partner violence, and taking a sexual history. Nearly two-thirds felt having connection to women's health specialists familiar with CF would facilitate SRH care. Approximately one-third desired SRH educational materials for providers to view at point-of-care or through online case-based learning; <10% were interested in role playing SRH skills.

CONCLUSION

Many interprofessional CF providers lack comfort and skills in addressing SRH with AYA women with CF. Provider training needs and approaches identified in this study can be used to develop tailored educational interventions to improve comprehensive CF care.

Healthcare professionals' perceptions of learning communication in the healthcare workplace: an Australian interview study

OBJECTIVES

The literature focuses on teaching communication skills in the 'classroom', with less focus on how such skills are informally learnt in the healthcare workplace. We grouped healthcare work based on the cure:care continuum to explore communication approaches based on work activities. This study asks: 1) How do healthcare professionals believe they learn communication in the workplace? 2) What are the differences (if any) across the 'type of work' as represented by the cure:care continuum?

DESIGN

This qualitative study used semi-structured individual interviews.

SETTING

Community care and acute hospitals in Australia (Victoria and New South Wales).

PARTICIPANTS

Twenty qualified healthcare professionals (medicine n=4, nursing n=3, allied health n=13) from various clinical specialties (eg, acute, rehabilitation, surgery, palliative care) participated.

METHODS

Data were analysed using framework analysis, which involved the development of a thematic coding framework. Findings were mapped to participants' descriptions of work using the cure:care continuum.

RESULTS

Three themes were identified that varied across the cure:care continuum: professional discourse-tying communication approaches to work activities; personal identities-the influence of personal identities on healthcare communication and role modelling-the influence of others in the socially bound context of healthcare work.

CONCLUSIONS

This study highlights the influence of professional, personal and social factors on the learning of healthcare communication in the workplace. Our study illuminates differences in communication practice related to work activities, as conceptualised by the cure:care continuum. The results call for further examination of the 'nature' of work activities and the concomitant influence on developing healthcare communication.

Teaching Critical Thinking: A Case for Instruction in Cognitive Biases to Reduce Diagnostic Errors and Improve Patient Safety

Diagnostic errors contribute to as many as 70% of medical errors. Prevention of diagnostic errors is more complex than building safety checks into health care systems; it requires an understanding of critical thinking, of clinical reasoning, and of the cognitive processes through which diagnoses are made. When a diagnostic error is recognized, it is imperative to identify where and how the mistake in clinical reasoning occurred. Cognitive biases may contribute to errors in clinical reasoning. By understanding how physicians make clinical decisions, and examining how errors due to cognitive biases occur, cognitive bias awareness training and debiasing strategies may be developed to decrease diagnostic errors and patient harm. Studies of the impact of teaching critical thinking skills have mixed results but are limited by methodological problems.This Perspective explores the role of clinical reasoning and cognitive bias in diagnostic error, as well as the effect of instruction in metacognitive skills on improvement of diagnostic accuracy for both learners and practitioners. Recent literature questioning whether teaching critical thinking skills increases diagnostic accuracy is critically examined, as are studies suggesting that metacognitive practices result in better patient care and outcomes. Instruction in metacognition, reflective practice, and cognitive bias awareness may help learners move toward adaptive expertise and help clinicians improve diagnostic accuracy. The authors argue that explicit instruction in metacognition in medical education, including awareness of cognitive biases, has the potential to reduce diagnostic errors and thus improve patient safety.

Be like water: a personal strategy for clinical psychiatric research

OBJECTIVES:

This paper describes, from the personal perspective of a mid-career researcher, principles and advice regarding the development of an embedded clinical psychiatric research program within a medical school and public sector mental health service. From this experience, some general principles are drawn.

CONCLUSIONS:

Through careful strategic planning, together with collaboration with the mental health service, it is possible to bootstrap and develop an embedded clinical research program.

Cognitive load in internal medicine: What every clinical teacher should know about cognitive load theory

Internal medicine is an appropriate example of specialties in which to teach learners clinical reasoning skills, decision-making, and analytical thinking, as well as evidence-based, patient-oriented medicine. During daily clinical work, general internists always encounter a multitude of situations that lend themselves to educating medical trainees in ambulatory and inpatient settings. Application of existing learning theories to teaching has been shown to optimize teaching ability and to maximize the efficiency of teaching efforts. Cognitive Load Theory explains learning according to three important aspects: the types of memory (working and long-term memory), the learning process and the forms of cognitive load that affect our learning. The aim of this paper is to show the main perspectives and implications of the Cognitive Load Theory on clinical educational practices. It is important to give the right amount of information in the most effective way to learners, thereby making this information more useful. This article presents a concise overview of the basis of the Cognitive Load Theory in its first part, and, in its second part, it exposes the practical applications of this theory with examples. This learning theory will encourage clinical teachers to reflect on how to foster learning in medical trainees in the more effective way.

Three-Dimensional Printed Pediatric Airway Model Improves Novice Learners' Flexible Bronchoscopy Skills With Minimal Direct Teaching From Faculty

INTRODUCTION

Training in pediatric flexible bronchoscopy (FB) is predominantly completed on patients. Early trainees are less accurate and slower than experienced bronchoscopists. This report describes the development of a three-dimensional printed airway model and describes how the model was used to teach learners basic FB skills.

METHODS

Postgraduate year two (PGY2) pediatric residents completing a 1-month pediatric pulmonology rotation with minimal previous exposure to FB were randomized into a simulation trainee group (n = 18) or a control resident group (n = 9). The simulation group received four 15-minute practice sessions (3 self-directed, 1 with feedback). Participants completed a bronchoscopy assessment on the model at prestudy, poststudy, and delayed (at least 2 months after the rotation) time points. Outcomes were identification of markers located in the six lung areas and completion time.

RESULTS

There was no difference in prestudy scores between groups. In the poststudy assessment, the simulation participants correctly identified more lung area markers (median = 6 vs 1.5, P < 0.001) and were faster (median = 102 vs 600 seconds, P < 0.001). In the delayed assessment, correct marker identification trended toward improvement in the simulation group compared with controls (median = 4 vs 2, P = 0.077).

CONCLUSIONS

With 1 hour of practice time, requiring 15 minutes of direct teaching, novice resident bronchoscopists are able to more accurately identify and visualize the five lung lobes and lingula via FB and are able to do so in less time than control residents. This anatomically accurate model could be used to train basic FB skills at a low cost compared with other models.

Use of Emergency Manuals During Actual Critical Events in China: A Multi-Institutional Study

INTRODUCTION

Emergency manuals (EMs) can help healthcare providers respond to crises more efficiently. Three anesthesia EMs have been translated into Chinese. These EMs have been made publicly available as a free document downloadable in China. A year after these Chinese versions of EMs were published, we conducted a multi-institutional survey in China to assess the progress of how well EM had been adapted and used in the setting of critical events.

METHODS

Our study used a multi-institutional, anonymous electronic survey. We included hospitals that had conducted group studies of EMs as well as simulation trainings. The survey consisted of the five-point Likert scale, yes or no boxes, and multiple-choice questions with five possible choices. Statistical analysis included Pearson correlation coefficient and χ test.

RESULTS

Nine hospitals were included in the study. The overall response rate was 56.4%. More than 70% of all respondents reported using an EM during at least one critical event within the past 6 months in China. A total of 87.7% of all respondents self-reviewed or group studied EMs. A total of 69% participated in multidisciplinary simulation training. Emergency manual use during a critical event showed a positive correlation with multidisciplinary simulation training (R = 0.896) and self-review/group study (R = 0.5234). The average self-reported use of EMs during clinical critical events is twice per anesthesiologist.

CONCLUSIONS

This study demonstrated the nascent success of EM implementation in multiple Chinese institutions. Simulation training enhances the implementation and clinical usage of EM. Simulation training in an operating room was sufficient to learn how to use EM.

Utilising the Delphi Process to Develop a Proficiency-based Progression Train-the-trainer Course for Robotic Surgery Training

CONTEXT

As the role of robot-assisted surgery continues to expand, development of standardised and validated training programmes is becoming increasingly important.

OBJECTIVE

To provide guidance on an optimised "train-the-trainer" (TTT) structured educational programme for surgical trainers, in which delegates learn a standardised approach to training candidates in skill acquisition. We aim to describe a TTT course for robotic surgery based on the current published literature and to define the key elements within a TTT course by seeking consensus from an expert committee formed of key opinion leaders in training.

EVIDENCE ACQUISITION

The project was carried out in phases: a systematic review of the current evidence was conducted, a face-to-face meeting was held in Philadelphia, and then an initial survey was created based on the current literature and expert opinion and sent to the committee. Thirty-two experts in training, including clinicians, academics, and industry, contributed to the Delphi process. The Delphi process underwent three rounds of survey in total. Additions to the second- and third-round surveys were formulated based on the answers and comments from the previous rounds. Consensus opinion was defined as ≥80% agreement.

EVIDENCE SYNTHESIS

There was 100% consensus that there was a need for a standardized TTT course in robotic surgery. A consensus was reached in multiple areas, including the following: (1) definitions and terminologies, (2) qualifications to attend, (3) course objectives, (4) precourse considerations, (5) requirement of e-learning, (6) theory and course content, and (7) measurement of outcomes and performance level verification. The resulting formulated curriculum showed good internal consistency among experts, with a Cronbach alpha of 0.90.

CONCLUSIONS

Using the Delphi methodology, we achieved an international consensus among experts to develop and reach content validation for a standardised TTT curriculum for robotic surgery training. This defined content lays the foundation for developing a proficiency-based progression model for trainers in robotic surgery. This TTT curriculum will require further validation.

PATIENT SUMMARY

As the role of robot-assisted surgery continues to expand, development of standardised and validated training programmes is becoming increasingly important. There is currently a lack of high-level evidence on how best to train trainers in robot-assisted surgery. We report a consensus view on a standardised "train-the trainer" curriculum focused on robotic surgery. It was formulated by training experts from the USA and Europe, combining current evidence for training with experts' knowledge of surgical training.