Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains

The Transformative Teaching Framework: A roadmap for 21st century teaching

The US healthcare system has changed dramatically in the past several decades. Nursing education, conversely, has not. This disparity, with a widening academic-practice gap prompted The National Academies to call on nursing education bodies to lead transformational change in nursing education to create the entry level and advanced practice nurses needed in the 21st century healthcare system (Wakefield et al., 2021). The Publication of The Essentials: Core Competencies for Professional Nursing Education is the catalyst for this change. Revising curricula in nursing schools will not affect the changes needed without a transformation in how nurse educators approach their practice. The Transformative Teaching Framework provides a roadmap for faculty to embody their role differently. Adopting the new role of Faculty Coach, nurse educators cultivate a teacher-learner relationship grounded in the neuroscience of learning, relational and developmental actions aimed at the professional formation of clinicians, and mutual trust. The Transformative Teaching Framework has the power to guide faculty as they develop clinicians who can thrive in the 21st century healthcare system.

Demystifying unsupervised learning: how it helps and hurts

Humans and machines rarely have access to explicit external feedback or supervision, yet manage to learn. Most modern machine learning systems succeed because they benefit from unsupervised data. Humans are also expected to benefit and yet, mysteriously, empirical results are mixed. Does unsupervised learning help humans or not? Here, we argue that the mixed results are not conflicting answers to this question, but reflect that humans self-reinforce their predictions in the absence of supervision, which can help or hurt depending on whether predictions and task align. We use this framework to synthesize empirical results across various domains to clarify when unsupervised learning will help or hurt. This provides new insights into the fundamentals of learning with implications for instruction and lifelong learning.

Deliberate Practice as an Effective Method for Reducing Diagnostic Error in Identifying Burn and Bruise Injuries Suspicious for an Abusive Injury

OBJECTIVE

To examine the effectiveness of an education intervention for reducing physician diagnostic error in identifying pediatric burn and bruise injuries suspicious for abuse, and to determine case-specific variables associated with an increased risk of diagnostic error.

STUDY DESIGN

This was a multicenter, prospective, cross-sectional study. A convenience sample of pediatricians and other front-line physicians who treat acutely injured children in the United States and Canada were eligible for participation. Using a web-based education and assessment platform, physicians deliberately practiced with a spectrum of 300 pediatric burn and bruise injury image-based cases. Participants were asked if there was a suspicion for abuse present or absent, were given corrective feedback after every case, and received summative diagnostic performance overall (accuracy), suspicion for abuse present (sensitivity), and absent (specificity).

RESULTS

Of the 93/137 (67.9%) physicians who completed all 300 cases, there was a significant reduction in diagnostic error (initial 16.7%, final 1.6%; delta -15.1%; 95% CI -13.5, -16.7), sensitivity error (initial 11.9%, final 0.7%; delta -11.2%; 95% CI -9.8, -12.5), and specificity error (initial 23.3%, final 6.6%; delta -16.7%; 95% CI -14.8, -18.6). Based on 35 627 case interpretations, variables associated with diagnostic error included patient age, sex, skin color, mechanism of injury, and size and pattern of injury.

CONCLUSIONS

The education intervention substantially reduced diagnostic error in differentiating the presence vs absence of a suspicion for abuse in children with burn and bruise injuries. Several case-based variables were associated with diagnostic error, and these data can be used to close specific skill gaps in this clinical domain.

A Systematic Investigation of Assessment Scores, Self-Efficacy, and Clinical Practice: Are They Related?

A considerable amount of continuing professional development (CPD) for health professionals is online and voluntary. There is evidence that some CPD activities impact clinical practice outcomes from self-reported and objective, administrative data. Some studies have shown that there is a potential mediating effect of knowledge/competency and/or self-efficacy between participation in CPD activities and the outcomes of that participation, specifically clinical practice. However, because clinical practice in those studies has been self-report, little is known about how this relationship impacts real world clinical practice. The purpose of the current study is to examine the relationship between knowledge/competency, self-efficacy, and real-world clinical practice so that we can begin to understand whether our focus on knowledge/competency and self-efficacy to change real-world clinical practice is empirically supported. We employed secondary data analysis from pre-participation questionnaire and medical and pharmacy claims data originally collected in three evaluations of online CPD interventions to examine if the relationship between knowledge/competency and self-efficacy contributed to physicians' real-world clinical practice. Results show an association between knowledge/competency scores and ratings of self-efficacy and suggest unique contributions of knowledge/competency and self-efficacy to clinical practice. Study results support the value of knowledge/competency scores and self-efficacy ratings as predictors of clinical practice. The effect size was larger for self-efficacy suggesting it may be a more practical indicator of clinical practice for CPD evaluators because its process of question development is simpler than the process for knowledge and case-based decision-making questions. However, it is important to conduct thorough need assessments which may include knowledge/competency assessments to identify topics to cover in CPD activities that are more likely to increase self-efficacy and ultimately, clinical practice.

Inside the Black Box of Deliberate Practice: How do Coaches Coach to Improve Trauma Triage

INTRODUCTION

Deliberate practice, goal-oriented training with feedback from a coach, is a common tool for improving physicians' performance. However, little is known about how coaches foster performance improvement.

METHODS

A content analysis of video-recorded training sessions was performed to analyze the coaches' behaviors during a pilot randomized trial of deliberate practice in trauma triage. The intervention consisted of three video-conference sessions during which trial physicians, under the supervision of a coach, played a customized video game designed to review trauma triage principles. A multidisciplinary team specified tasks (e.g., create collaborative learning environment) that coaches should complete, and suggested 19 coaching strategies (e.g., encourage culture of error) to allow execution of these tasks. Two independent raters translated those strategies into a coding framework and applied it deductively to the recorded sessions. The frequencies of the coaching strategies were summarized, and tested for variation across coaches and time.

RESULTS

Thirty physicians received the intervention across two 1-mo blocks. Most (28 [93%]) completed three sessions, each covering two (interquartile range 1-2) triage principles. Coaches used coaching strategies 18 (interquartile range 14.5-22) times per triage principle, using some often (2-3 times/principle) and others infrequently (<1 time/principle). The three coaches used similar numbers (20 versus 16 versus 18.5, P = 0.07) and types of strategies. However, use increased over time (16.8 [Block 1] versus 20 [Block 2] P = 0.018).

CONCLUSIONS

Coaches used 19 coaching strategies to deliver this deliberate practice intervention, with behavior that evolved over time. Future trials should isolate the most potent strategies and should assess the best method of standardizing coaching.

Video-Based Performance Analysis in Pituitary Surgery - Part 2: Artificial Intelligence Assisted Surgical Coaching

BACKGROUND

Superior surgical skill improves surgical outcomes in endoscopic pituitary adenoma surgery. Video-based coaching programs, pioneered in professional sports, have shown promise in surgical training. In this study, we developed and assessed a video-based coaching program using artificial intelligence (AI) assistance.

METHODS

An AI-assisted video-based surgical coaching was implemented over 6 months with the pituitary surgery team. The program consisted of 1) monthly random video analysis and review; and 2) quarterly 2-hour educational meetings discussing these videos and learning points. Each video was annotated for surgical phases and steps using AI, which improved video interactivity and allowed the calculation of quantitative metrics. Primary outcomes were program feasibility, acceptability, and appropriateness. Surgical performance (via modified Objective Structured Assessment of Technical Skills) and early surgical outcomes were recorded for every case during the 6-month coaching period, and a preceding 6-month control period. Beta and logistic regression were used to assess the change in modified Objective Structured Assessment of Technical Skills scores and surgical outcomes after the coaching program implementation.

RESULTS

All participants highly rated the program's feasibility, acceptability, and appropriateness. During the coaching program, 63 endoscopic pituitary adenoma cases were included, with 41 in the control group. Surgical performance across all operative phases improved during the coaching period (P < 0.001), with a reduction in new postoperative anterior pituitary hormone deficit (P = 0.01).

CONCLUSIONS

We have developed a novel AI-assisted video surgical coaching program for endoscopic pituitary adenoma surgery - demonstrating its viability and impact on surgical performance. Early results also suggest improvement in patient outcomes. Future studies should be multicenter and longer term.

Assessment of a Novel, Adjustable Task Trainer for Cardiac Surgical Skills

INTRODUCTION

A recent needs assessment in Canadian cardiac surgery programs identified the desire for a coronary artery bypass (CABG) and aortic valve replacement (AVR) simulation model for home practice. We aimed to develop and assess a portable, adjustable task trainer for cardiac surgical skills with high functional task alignment.

METHODS

Intraoperative measurements were taken from patients undergoing elective CABG and AVR (N = 30). Measurements were taken in 3 axes and used to create a chest cavity that resembles the mediastinal constraints of a patient undergoing CABG and AVR. The task trainer is adjustable on the following 3 levels: (1) size of the incision, (2) depth of the chest, and (3) relative position of coronary artery or aortic valve model within the chest. Three groups (novices, intermediates, and experts) of cardiac surgery members evaluated the task trainer for functional task alignment and construct validity.

RESULTS

The CABG and AVR model had high functional task alignment. There was a high satisfaction for both models and all participants would recommend the AVR and CABG model as an educational tool. Performance time significantly differed between the groups for both models (CABG: P = 0.032 and AVR: P = 0.001), as well as number of errors (CABG: P = 0.04 and AVR: P = 0.043).

CONCLUSIONS

Using real patient data, we were able to develop an adjustable task trainer for training principles of CABG and AVR. Our pilot study provides preliminary sources of evidence for validity and future study will look to assess transferability of skill to the operating room.

Integrating Formative and Summative Clinical Skills Examinations to Promote Learning for Early Medical Students: A Mixed Methods Study

Background

Medical educators aim to train students with high-quality clinical skills through the promotion of self-regulated learning and the development of lifelong learning skills. Formative clinical skills examinations (FCSE) allow for real-time learner-centered feedback and coaching which are key in promoting the development of expertise in early learners. This study assessed the impact of the integration of FCSE with learner-centered, real-time feedback and coaching based on an "educational plan-do-study-act" (PDSA) cycle on early medical students' experience and performance.

Methods

A mixed methods study was designed to assess the integration of FCSE for first- and second-year medical students. FCSE consisted of linked stations: students gathered a history from a standardized patient (SP), performed a hypothesis-driven physical examination followed by real-time learner-centered feedback and coaching. Each student met with one faculty and one SP to reflect on their performance, identify areas for improvement, re-practice of skills, and identify a plan for ongoing practice improvement. Students were surveyed upon completion of formative and summative clinical skills examinations. Student communication and clinical reasoning performance were compared to historical controls.

Results

Students reported that FSCE improved the learning environment and helped prepare them for subsequent summative clinical skills examinations. Students appreciated the opportunity for practice and real-time feedback and reported applying their take-home points on subsequent exams. Student longitudinal performance was not impacted by the transition to FSCE.

Conclusion

While labor-intensive, FCSE with real-time feedback and coaching are an effective means of promoting learning and should be considered for integration early in medical school curricula.

Making narrative feedback meaningful

BACKGROUND

Narrative written feedback given to students by faculty often fails to identify areas for improvement and recommended actions to lead to this improvement. When these elements are missing, it is challenging for students to improve and for medical schools to use narrative feedback in promotion decisions, to guide coaching plans and to pass on meaningful information to residency programs. Large-group faculty development has improved narrative written feedback, but less is known about individualised faculty development to supplement large-group sessions. To fill this gap, we built a curriculum with general and individualised faculty development to improve narrative written feedback from Internal Medicine faculty to clerkship students.

APPROACH

We used Kern's steps to build a curriculum with general and individualised one-on-one faculty development to improve the problem of inadequate narrative written feedback. We used a novel narrative feedback rubric for pre and post-intervention faculty scores.

RESULTS/FINDINGS/EVALUATION

Through general and individualised one-on-one faculty development with peer comparison scores, we were able to improve narrative written feedback from 3.7/6 to 4.6/6, for an increase of 23%.

IMPLICATIONS

We found our faculty development program effective in improving feedback and was easy to implement. Our rubric was easy to use, and faculty were receptive to feedback in one-on-one meetings. We plan to extend this work locally to other divisions/departments and into graduate medical education; it should also be easily extended to other medical disciplines or health professions.

Colonoscopy Training on Virtual-Reality Simulators or Physical Model Simulators: A Randomized Controlled Trial

OBJECTIVE

This study employed a randomized controlled trial to assess the efficacy of virtual-reality (VR) simulators and physical model simulators on colonoscopy training to explore the optimal and evidence-based simulation training.

DESIGN

Forty participants were divided into 2 groups and randomized as dyads: the VR simulator group and the physical model simulator group. All the participants performed a baseline test through porcine colonoscopy. After a 6 h simulation training, each participant underwent a post-test on a pig after bowel preparation, and the procedures were video-recorded. Both the baseline test and the post-test were blindly assessed by 2 experienced assistant director physicians based on the GAGES-C scoring system.

SETTING

Simulation center, Renji Hospital, Shanghai Jiaotong University School of Medicine, Shanghai.

PARTICIPANTS

Forty surgical residents without colonoscopy experience.

RESULTS

Both the VR simulator group and the physical model simulator group improved significantly over the baseline test. The VR simulator group performed significantly better than the physical model simulator group, p=0.042. The participants in both groups expressed a high level of simulator satisfaction.

CONCLUSIONS

Novice residents can benefit from both VR simulators and physical model simulators. The VR simulator was shown to be more effective for colonoscopy training. VR simulators were more recommended for novices conducting basic colonoscopy training.

Unravelling the differences between observation and active participation in simulation-based education

BACKGROUND

In simulation-based education, the effectiveness of observation or active participation on the retention of knowledge and skills is uncertain. The aim of the study was to investigate knowledge retention, technical and non-technical skills and self-efficacy among observers and active participants in a simulated palliative extubation.

METHOD

We included medical and nursing undergraduates and residents. On the first day, participants were divided into observers and active participants, each with one participant from medical and nursing backgrounds. We presented a recorded lecture, followed by knowledge and self-efficacy tests for all participants before and after the simulation. After fourteen days, both groups actively participated in the scenario, without observers. We assessed technical and non-technical skills during the simulation and repeated the knowledge and self-efficacy tests after the training.

RESULTS

Forty-four individuals participated in this study, half from each training programme. Knowledge improved after the first training in both groups, with a significant drop only for active participants after 14 days. Self-efficacy increased in both groups, being higher for the active participants. After 14 days, active participants performed better in technical skills compared to observers, but it was similar in both groups for non-technical skills.

CONCLUSIONS

Active participation seems superior to observation in the development of self-efficacy and the retention of technical skills. Observation may be superior to active participation in knowledge retention. Retention of non-technical skills appears to be similar with both observation and active participation. The findings have important implications for current simulation-based education, but further research is recommended.

Near-Peer Coaching to Enhance Operative Learning: An Educational Innovation for Surgical Training

Objective

To design, implement, and evaluate a near-peer coaching model to enhance operative learning in general surgery training.

Background

There is an urgent need to maximize operative learning in surgical education. Trainees find barriers to operative learning difficult to navigate and often sacrifice educational opportunities for the sake of impression management.

Methods

A prospective cohort study was conducted over a 6-month period following design and implementation of a trainee-led near-peer coaching model; "SPICE" (Set goals, Plan, Imagine, Comment and feedback, Evaluate and reflect). Semistructured interviews were conducted to explore trainees' experiences of the model.

Results

Twelve trainees participated in the study. The near-peer coaching encounters provided trainees with the psychological safety to be honest about learning needs, validated insecurities, and mitigated the pressures associated with impression management that consistently shaped consultant-trainee relationships. Trainees described improved operative performance, increased self-confidence, and a greater ability to adapt to the unexpected. Trainees adapted the use of the SPICE model to conventional consultant-trainee dynamics, which facilitated learning conversations and negotiation of operative opportunities. On a broader scale, trainees noticed an improvement in the teaching culture of the unit, describing that the use of the model legitimized the importance of perioperative learning conversations and increased consultant enthusiasm for teaching.

Conclusions

Near-peer coaching created a unique psychological safety that facilitated authentic reflection and goal setting and improved trainee confidence. The benefits of the SPICE model were translated to other contexts and facilitated entrustment in conventional consultant-trainee relationships.

Training healthcare professionals to be ready for practice in an era of social distancing: a realist evaluation

BACKGROUND

Programme changes due to the COVID-19 pandemic have impacted variably on preparation for practice of healthcare professional students. Explanations for such variability need exploration. The aim of our study was to understand what clinical learning, whilst under socially distanced restrictions, worked and why (or why not).

METHODS

We conducted a realist evaluation of the undergraduate healthcare programmes at one UK university in 2020-21. Initial programme theories to be tested in this study were derived from discussions with programme leads about the changes they implemented due to the pandemic. Study participants were students and teaching faculty. Online interview transcripts were coded, identifying why interventions had worked or not. This resulted in a set of 'context-mechanism-outcome' (CMO) statements about each intervention. The initial programme theories were refined as a result.

RESULTS AND DISCUSSION

29 students and 22 faculty members participated. 18 CMO configurations were identified relating to clinical skills learning and 25 relating to clinical placements. Clinical skills learning was successful whether in person, remote or hybrid if it followed the steps of: demonstration-explanation-mental rehearsal-attempt with feedback. Where it didn't work there was usually a lack of observation and corrective feedback. Placements were generally highly valued despite some deficiencies in student experience. Being useful on placements was felt to be good preparation for practice. If student numbers are to expand, findings about what works in distance learning of clinical skills and the value of various modes of induction to clinical workplace activity may also be relevant post-pandemic.

Teaching and Assessment of Clinical Reasoning Skills in a Case-Based Veterinary Cardiology Elective

Clinical reasoning (CR) is an important clinical competency for effective veterinary practice. We hypothesized that implementing an explicit 7-week CR curriculum taught in a large-enrollment elective veterinary cardiology course would improve students' awareness of clinical reasoning principles, self-efficacy of CR skills, and application of CR principles in clinical case analyses. A secondary aim was to assess the impact of peer review as a means of providing feedback in a large classroom setting. A mixed method approach was used with veterinary students (N = 78) in a cardiology elective course meeting twice weekly for a half-semester (7 weeks). Course content included a 1-week introduction to CR led by the instructor and 6 weeks of instructor-facilitated, case-based learning. Quantitative and qualitative data were collected, including pre- and post-course surveys, weekly peer reviews for six clinical case assignments, and instructor-graded clinical cases for three case assignments. Students reported improved self-efficacy across all CR skill categories (p < .001) and significant improvement in applied CR skills was demonstrated in both peer- (p < .001) and instructor-graded assignments (p < .001). Peer reviews provided a means for students to reflect on and internalize CR skills, which may play a role in improved self-efficacy. In an elective cardiology course, implementing an explicit CR curriculum resulted in improved student awareness and self-efficacy of CR, as well as improved applied CR skills.

Development and Evaluation of a Surgical Simulator and Assessment Rubric for Standing Castration of the Horse

In veterinary education, simulators are models or devices that can imitate a real patient or scenario and allow students to practice skills without the need for live patients. Castration is a common surgical procedure in all species, and the standing, open technique is frequently performed in horses. Although a simulator has been developed for equine closed castration, a simulator for standing castration in the horse has not yet been described. This two-part study focused on the design, creation, and evaluation of a simulator for teaching standing castration in the horse. A low-technology simulator was created using molded silicone testicles, cohesive bandage, stockings, and socks. A rubric was created for assessing performance using the simulator. Participants were recruited from three groups: university academic staff members (n = 12, majority equine veterinarians), equine veterinarians working in private practice (n = 9), and final-year veterinary students (n = 28). Each group tested the simulator while being graded using the developed rubric, and participants completed an anonymous online feedback questionnaire. Feedback was positive overall, with 98% of respondents (n = 48/49) stating that the model would be a useful addition to the veterinary curriculum. Furthermore, 100% of students reported that using the simulator increased their confidence in performing standing castration in horses. Evaluation of the model included assessment of responses from veterinarians and students regarding realism and usefulness of the simulator, comparison of rubric scores between veterinarians and students, and assessment of the reliability of the rubric. Median student rubric score was significantly lower than qualified veterinarians (p < .001), and Cronbach's alpha demonstrated that there was adequate internal reliability in rubric scoring (α = .85). It was determined that the simulator is effective for teaching the steps of the surgical procedure and for increasing student confidence.

Integrating ChatGPT in Orthopedic Education for Medical Undergraduates: Randomized Controlled Trial

BACKGROUND

ChatGPT is a natural language processing model developed by OpenAI, which can be iteratively updated and optimized to accommodate the changing and complex requirements of human verbal communication.

OBJECTIVE

The study aimed to evaluate ChatGPT's accuracy in answering orthopedics-related multiple-choice questions (MCQs) and assess its short-term effects as a learning aid through a randomized controlled trial. In addition, long-term effects on student performance in other subjects were measured using final examination results.

METHODS

We first evaluated ChatGPT's accuracy in answering MCQs pertaining to orthopedics across various question formats. Then, 129 undergraduate medical students participated in a randomized controlled study in which the ChatGPT group used ChatGPT as a learning tool, while the control group was prohibited from using artificial intelligence software to support learning. Following a 2-week intervention, the 2 groups' understanding of orthopedics was assessed by an orthopedics test, and variations in the 2 groups' performance in other disciplines were noted through a follow-up at the end of the semester.

RESULTS

ChatGPT-4.0 answered 1051 orthopedics-related MCQs with a 70.60% (742/1051) accuracy rate, including 71.8% (237/330) accuracy for A1 MCQs, 73.7% (330/448) accuracy for A2 MCQs, 70.2% (92/131) accuracy for A3/4 MCQs, and 58.5% (83/142) accuracy for case analysis MCQs. As of April 7, 2023, a total of 129 individuals participated in the experiment. However, 19 individuals withdrew from the experiment at various phases; thus, as of July 1, 2023, a total of 110 individuals accomplished the trial and completed all follow-up work. After we intervened in the learning style of the students in the short term, the ChatGPT group answered more questions correctly than the control group (ChatGPT group: mean 141.20, SD 26.68; control group: mean 130.80, SD 25.56; P=.04) in the orthopedics test, particularly on A1 (ChatGPT group: mean 46.57, SD 8.52; control group: mean 42.18, SD 9.43; P=.01), A2 (ChatGPT group: mean 60.59, SD 10.58; control group: mean 56.66, SD 9.91; P=.047), and A3/4 MCQs (ChatGPT group: mean 19.57, SD 5.48; control group: mean 16.46, SD 4.58; P=.002). At the end of the semester, we found that the ChatGPT group performed better on final examinations in surgery (ChatGPT group: mean 76.54, SD 9.79; control group: mean 72.54, SD 8.11; P=.02) and obstetrics and gynecology (ChatGPT group: mean 75.98, SD 8.94; control group: mean 72.54, SD 8.66; P=.04) than the control group.

CONCLUSIONS

ChatGPT answers orthopedics-related MCQs accurately, and students using it excel in both short-term and long-term assessments. Our findings strongly support ChatGPT's integration into medical education, enhancing contemporary instructional methods.

TRIAL REGISTRATION

Chinese Clinical Trial Registry Chictr2300071774; https://www.chictr.org.cn/hvshowproject.html ?id=225740&v=1.0.

Development and Integration of Models for Teaching Ram Breeding Soundness Examinations in Veterinary Education

Proficiency with ram breeding soundness examinations requires competency with palpation, a skill that can be difficult to teach and assess. There are limited small ruminant clinical skills models available, despite the advantages they offer in veterinary education. We developed reusable models for teaching ram breeding soundness examinations, focusing on scrotal assessment and palpation. Then we integrated these models into a practical session where multiple clinical aspects were included. We created anatomically normal ("sound") testes using 3D modeling software before editing these to display common abnormalities ("unsound" testes). Then, we 3D printed two-part molds and cast the silicone testes. Testes were inserted into siliconized, lubricated stockings facilitating free movement during palpation. Scrotal sacs were sewn from polar fleece and suspended to mimic natural orientation in a live, standing ram. As well as for scheduled classes, we used the models as a station in our course's Objective Structured Clinical Examination (OSCE) assessment. Our models offer advantages in the veterinary education context. Their relatively low cost and durability facilitates their classification as "open access" within our skills lab for student deliberate practice outside scheduled classes. They provide a uniform student learning experience that does not rely on live animals or clinical case load and aligns with best-practice recommendations from accrediting bodies. Student engagement and OSCE outcomes were good, but going forward it would be ideal to collaborate with a program that uses live rams for teaching and assessing this skill to directly examine the impact of our models on confidence and competence.

Challenges in Learning Procedural Skills: Student Perspectives and Lessons Learned for Curricular Design

Phenomenon: Developing foundational clinical procedural skills is essential to becoming a competent physician. Prior work has shown that medical students and interns lack confidence and competence in these skills. Thus, understanding the student's perspective on why these skills are more difficult to acquire is vital for developing and reforming medical curricula. Approach: This study explored procedural skills learning experiences of medical students with qualitative methods. Through purposive sampling, 52 medical students from the third, fourth, and final years were selected for inclusion. Data were collected using six audio-recorded, semi-structured focus group discussions. Transcripts were manually coded and analyzed using inductive content analysis. Findings: Students provided rich and insightful perspectives regarding their experiences in learning procedural skills that fell into three broad categories: 1) barriers to procedural learning, 2) reasons for learning, and 3) suggestions for better learning outcomes. Students described a range of barriers that stemmed from both patient and clinician interactions. Students were reluctant to make demands for their own benefit during clerkships. The most commonly expressed reason for wanting to learn procedural skills was the desire to be a competent and independent intern. The motivators suggested that students felt empathetic toward interns and visualized a successful internship as a learning goal. Participants suggested peer learning, improved teaching of procedural skills, assessments, and feedback to improve their learning. Insights: This study generated valuable information to promote critical reflection on the existing curriculum and pedagogical approaches to procedural skills development. Medical educators need to sensitize the clinical teachers to student perspectives and what students are really learning to make impactful changes to teaching and learning procedural skills. Students' self-advocacy skills and self-directed learning skills need to be developed for them to seek out learning opportunities and to promote life-long learning. Lessons from this study may also apply to curriculum design in general, especially in teaching clinical skills. Empowering the learner and embracing a learner-centered approach to teaching and learning procedural skills will benefit future clinicians and their patients.

A Targeted Clinical Reasoning Remediation Program for Residents and Fellows in Need

Background There is no standardized, widely accepted process for individualized clinical reasoning remediation. Objective We describe a novel, targeted assessment and coaching process that allows for individualized intervention for residents and fellows struggling with clinical reasoning. Methods Residents and fellows at the University of Virginia with performance concerns are referred to COACH (Committee on Achieving Competence Through Help) and assessed by a remediation expert. A subset is referred to a clinical reasoning remediation coach who performs an additional assessment and cocreates an individualized remediation plan. Following remediation, residents and fellows are reassessed by their respective programs. We report the frequency of struggle, remediation time invested, and academic outcomes. Results From 2017 to 2022, 114 residents and fellows referred to COACH met inclusion criteria, of which 38 (33%) had a deficiency in clinical reasoning. Targeted assessment revealed the following microskill deficits: hypothesis generation (16 of 38, 42%); data gathering (6 of 38, 16%); problem representation (7 of 38, 18%); hypothesis refinement (3 of 38, 8%); and management (6 of 38, 16%). Remediation required a mean of nearly 23 hours per trainee. Of the 38 trainees, 33 (87%) are in good standing at the time of writing. Conclusions Our unique program offers a feasible, targeted approach to clinical reasoning remediation based on our current understanding of the clinical reasoning process. Early hypothesis generation was the most common microskill deficit identified.

Mental Practice: Applying Successful Strategies in Sports to the Practice of Emergency Medicine

Emergency physicians are expected to learn and maintain a large and varied set of competencies for clinical practice. These include high acuity, low occurrence procedures that may not be encountered frequently in the clinical environment and are difficult to practice with high fidelity and frequency in a simulated environment. Mental practice is a form of a cognitive walk-through that has been shown to be an effective method for improving motor and cognitive skills, with literature in sports science and emerging evidence supporting its use in medicine. In this article, we review the literature on mental practice in sports and medicine as well as the underlying neuroscientific theories that support its use. We review best-known practices and provide a framework to design and use mental imagery scripts to augment learning and maintaining the competencies necessary for physicians at all levels of training and clinical environments in the practice of emergency medicine.

Paediatric resident identification of cardiac emergencies

OBJECTIVES

Critical CHD is associated with morbidity and mortality, worsened by delayed diagnosis. Paediatric residents are front-line clinicians, yet identification of congenital CHD remains challenging. Current exposure to cardiology is limited in paediatric resident education. We evaluated the impact of rapid cycle deliberate practice simulation on paediatric residents' skills, knowledge, and perceived competence to recognise and manage infants with congenital CHD.

METHODS

We conducted a 6-month pilot study. Interns rotating in paediatric cardiology completed a case scenario assessment during weeks 1 and 4 and participated in paired simulations (traditional debrief and rapid cycle deliberate practice) in weeks 2-4. We assessed interns' skills during the simulation using a checklist of "cannot miss" tasks. In week 4, they completed a retrospective pre-post knowledge-based survey. We analysed the data using summary statistics and mixed effect linear regression.

RESULTS

A total of 26 interns participated. There was a significant increase in case scenario assessment scores between weeks 1 and 4 (4, interquartile range 3-6 versus 8, interquartile range 6-10; p-value < 0.0001). The percentage of "cannot miss" tasks on the simulation checklist increased from weeks 2 to 3 (73% versus 83%, p-value 0.0263) and from weeks 2-4 (73% versus 92%, p-value 0.0025). The retrospective pre-post survey scores also increased (1.67, interquartile range 1.33-2.17 versus 3.83, interquartile range 3.17-4; p-value < 0.0001).

CONCLUSION

Rapid cycle deliberate practice simulations resulted in improved recognition and initiation of treatment of simulated infants with congenital CHD among paediatric interns. Future studies will include full implementation of the curriculum and knowledge retention work.

The Impact of Self-Directed Arthrocentesis Model Practice on Student Stress and Procedural Performance of Live Donkey Arthrocentesis

Arthrocentesis is an essential procedure for diagnosing and treating equine lameness. However, veterinary students may receive insufficient practice on live equids, and cadaver training is suboptimal due to difficulty procuring cadavers, autolysis, and inability to use cadavers repeatedly. We evaluated the impact of third year students' equine model arthrocentesis practice on their performance of arthrocentesis on a live donkey. After baseline salivary cortisol and trait anxiety testing, students received didactic training on arthrocentesis. The model-trained group performed self-directed tibiotarsal arthrocentesis on an equine hindlimb model using a needle and syringe that emitted an auditory stimulus when the joint space was entered. All students (model group and control group) subsequently performed arthrocentesis on a live donkey. Immediately before and after arthrocentesis on the model and donkey, students' salivary cortisol and situational and trait anxiety were measured. Groups did not differ in number of attempts, time, or performance score on the donkey. Students' cortisol levels were highest at baseline and lowest immediately prior to live arthrocentesis, suggesting that veterinary students have a high baseline level of stress and that focusing on performing a single procedure may have a paradoxical stress-reducing effect. Students' situational anxiety was highest immediately after performing live arthrocentesis, suggesting that they reflected on their performance with self-criticism. One short session of self-directed model training was not effective at improving students' performance or reducing their stress levels associated with performing arthrocentesis on a donkey.

Education in Laparoscopic Cholecystectomy: Design and Feasibility Study of the LapBot Safe Chole Mobile Game

BACKGROUND

 Major bile duct injuries during laparoscopic cholecystectomy (LC), often stemming from errors in surgical judgment and visual misperception of critical anatomy, significantly impact morbidity, mortality, disability, and health care costs.

OBJECTIVE

 To enhance safe LC learning, we developed an educational mobile game, LapBot Safe Chole, which uses an artificial intelligence (AI) model to provide real-time coaching and feedback, improving intraoperative decision-making.

METHODS

 LapBot Safe Chole offers a free, accessible simulated learning experience with real-time AI feedback. Players engage with intraoperative LC scenarios (short video clips) and identify ideal dissection zones. After the response, users receive an accuracy score from a validated AI algorithm. The game consists of 5 levels of increasing difficulty based on the Parkland grading scale for cholecystitis.

RESULTS

 Beta testing (n=29) showed score improvements with each round, with attendings and senior trainees achieving top scores faster than junior residents. Learning curves and progression distinguished candidates, with a significant association between user level and scores (P=.003). Players found LapBot enjoyable and educational.

CONCLUSIONS

 LapBot Safe Chole effectively integrates safe LC principles into a fun, accessible, and educational game using AI-generated feedback. Initial beta testing supports the validity of the assessment scores and suggests high adoption and engagement potential among surgical trainees.

Extended Reality-Based Head-Mounted Displays for Surgical Education: A Ten-Year Systematic Review

Surgical education demands extensive knowledge and skill acquisition within limited time frames, often limited by reduced training opportunities and high-pressure environments. This review evaluates the effectiveness of extended reality-based head-mounted display (ExR-HMD) technology in surgical education, examining its impact on educational outcomes and exploring its strengths and limitations. Data from PubMed, Cochrane Library, Web of Science, ScienceDirect, Scopus, ACM Digital Library, IEEE Xplore, WorldCat, and Google Scholar (Year: 2014-2024) were synthesized. After screening, 32 studies comparing ExR-HMD and traditional surgical training methods for medical students or residents were identified. Quality and bias were assessed using the Medical Education Research Study Quality Instrument, Newcastle-Ottawa Scale-Education, and Cochrane Risk of Bias Tools. Results indicate that ExR-HMD offers benefits such as increased immersion, spatial awareness, and interaction and supports motor skill acquisition theory and constructivist educational theories. However, challenges such as system fidelity, operational inconvenience, and physical discomfort were noted. Nearly half the studies reported outcomes comparable or superior to traditional methods, emphasizing the importance of social interaction. Limitations include study heterogeneity and English-only publications. ExR-HMD shows promise but needs educational theory integration and social interaction. Future research should address technical and economic barriers to global accessibility.

Unveiling the nonlinear dynamics of player performance in China's super league as a function of age

To explore the dynamics in physical and technical performance of professional football players and changes across age groups. Match statistics were collected from 1900 games across ten seasons (2012-2021) in the Chinese Super League. Generalized additive models visualized age-related trends in 12 key performance indicators including technical and physical variables. Revealed nonlinear trajectories characterized by rapid early declines, stable peak periods and accelerated late decreases. Physical indicators decreased progressively from the early 20 s before stabilizing briefly then declining further after 30. Conversely, technical metrics gradually improved into the late 20 s and early 30 s prior to decreasing again. This study provides novel evidence that football performance changes nonlinearly across age. Targeted training and development strategies should be tailored to the specific needs of different career stages.

Procedural simulation in venipuncture for medical undergraduates and its transfer to the bedside: a cluster randomized study

Simulation is accepted as an effective method of learning procedural skills. However, the translational outcomes of skills acquired through simulation still warrants investigation. We designed this study to assess if skills laboratory training in addition to bedside learning (intervention group [IG]) would provide better learning results than bedside learning alone (control group [CG]) in the context of venipuncture training. This prospective, cluster-randomized, single-blind study took place at the Faculty of Medicine, University of Kelaniya, Sri Lanka. Seventeen clusters of second-year medical students were randomly assigned to either IG or CG. The IG trained on venipuncture in the skills laboratory, receiving instruction after modified Payton's Four Step Method. Following the training, students of both IG and CG underwent bedside learning for one month. Afterward, students of both groups performed venipuncture on actual patients in a clinical setting. An independent, blinded assessor scored students' performance using the Integrated Procedural Protocol Instrument (IPPI) and a checklist. Patients assessed students' performance with the Communication Assessment Tool (CAT). Eight and nine clusters were randomized to the intervention and control groups, respectively. IG completed significantly more single steps of the procedure correctly (IG: 19.36 ± 3.87 for checklist items; CG: 15.57 ± 4.95; p < 0.001). IG also scored significantly better on IPPI ratings (median: IG: 27 (12) vs. CG: 21 (8); p < 0.001). Rated by patients, students' communication skills did not significantly differ between the two groups. Simulation-based venipuncture training enabled students to perform the procedure on actual patients with a higher technical accuracy than students who learned venipuncture at the bedside. Students were able to transfer the skills acquired through venipuncture training at the skill laboratory to the bedside.

Progress test as an assessment for learning approach in an Infectious Diseases Residency Program: a case study

Assessment is an essential component for all educational programs and must check competence acquirement while foster and promote learning. Progress Test (PT) is well recognized to assess cognitive knowledge, clinical reasoning and decision making in the clinical context, offering important information about the individual performance and program quality. It is widely used in Brazilian and international medical schools; however, it still has little role in assessing medical residents in Brazil. We present the experience of a PT pilot implementation in an Infectious Diseases residency program over two years. The first, second and third-year residents did four serial exams with 40 multiple choice questions (item)/each. Preceptors were trained on best practices on item writing. All the items were reviewed by a panel of experts and, after approval, included in the item bank. All participants answered a survey on their perceptions about the experience. The final score was higher for the third-year residents in all exam applications. The level of satisfaction was high among the participants, who mentioned the learning opportunity with the exam and the feedback. PT can improve residents' assessment along the training period and residents' performance should guide review and improvement of the programs.

Surgeons vs ChatGPT: Assessment and Feedback Performance Based on Real Surgical Scenarios

INTRODUCTION

Artificial intelligence tools are being progressively integrated into medicine and surgical education. Large language models, such as ChatGPT, could provide relevant feedback aimed at improving surgical skills. The purpose of this study is to assess ChatGPT´s ability to provide feedback based on surgical scenarios.

METHODS

Surgical situations were transformed into texts using a neutral narrative. Texts were evaluated by ChatGPT 4.0 and 3 surgeons (A, B, C) after a brief instruction was delivered: identify errors and provide feedback accordingly. Surgical residents were provided with each of the situations and feedback obtained during the first stage, as written by each surgeon and ChatGPT, and were asked to assess the utility of feedback (FCUR) and its quality (FQ). As control measurement, an Education-Expert (EE) and a Clinical-Expert (CE) were asked to assess FCUR and FQ.

RESULTS

Regarding residents' evaluations, 96.43% of times, outputs provided by ChatGPT were considered useful, comparable to what surgeons' B and C obtained. Assessing FQ, ChatGPT and all surgeons received similar scores. Regarding EE's assessment, ChatGPT obtained a significantly higher FQ score when compared to surgeons A and B (p = 0.019; p = 0.033) with a median score of 8 vs. 7 and 7.5, respectively; and no difference respect surgeon C (score of 8; p = 0.2). Regarding CE´s assessment, surgeon B obtained the highest FQ score while ChatGPT received scores comparable to that of surgeons A and C. When participants were asked to identify the source of the feedback, residents, CE, and EE perceived ChatGPT's outputs as human-provided in 33.9%, 28.5%, and 14.3% of cases, respectively.

CONCLUSION

When given brief written surgical situations, ChatGPT was able to identify errors with a detection rate comparable to that of experienced surgeons and to generate feedback that was considered useful for skill improvement in a surgical context performing as well as surgical instructors across assessments made by general surgery residents, an experienced surgeon, and a nonsurgeon feedback expert.

Correlating Simulation Training and Assessment With Clinical Performance: A Feasibility Study

OBJECTIVE

Simulation education and assessment are increasingly used in prehospital curriculums. The objective of this study was to assess the challenges and feasibility of correlating evaluation data from an airway management simulation assessment with clinical performance.

METHODS

This study was undertaken in Ontario, the most populous province in Canada, where 13 bases are distributed in geographically diverse areas, from urban to rural and remote locations. This is a retrospective cohort study of paramedics who had completed simulation education and assessment in rapid sequence intubation. Logistic regression was used to assess for correlation between assessment scores (ie, the global score and the overall score and the definitive airway sans hypoxia/hypotension on the first attempt [DASH-1A] success in the field).

RESULTS

DASH-1A success when grouped by base varied from 25% to 100%. The odds of DASH-1A success increased for paramedics who had a higher overall score (odds ratio [OR]: 1.03; 95% confidence interval [CI], 0.96-1.11) and for paramedics who had a higher global rating (OR: 1.27; CI, 0.73-2.21) when accounting for base intubation frequency. The odds of DASH-1A success increased for paramedics who had a higher overall score (OR: 1.01; CI, 0.93-1.09) and decreased for paramedics who had a higher global rating (OR: 0.96; CI, 0.47-1.96) when accounting for base geography.

CONCLUSION

Although this study lacked a sample size large enough to draw conclusions, it provides a foundation and areas to improve in future work exploring the relationship between simulation assessments and clinical performance.

Stakeholders' priorities in the development of evidence-based practice competencies in rehabilitation students: a nominal group technique study

PURPOSE

Clinically integrated teaching (CIT) is an effective approach for promoting evidence-based practice (EBP) competencies among medical students. Challenges towards the implementation of CIT in rehabilitation curricula include educators' different conceptualizations of EBP, the perceived complexity of EBP and the boundaries between the academic and the clinical setting. This study aimed to identify tailored strategies to implement in rehabilitation programs and their affiliated clinical sites to support the development of EBP competencies among students in occupational therapy (OT), physical therapy (PT) and speech-language pathology (S-LP).

MATERIALS AND METHODS

Nominal group technique (NGT) with stakeholders from three rehabilitation programs in Canada, offering the professional master's in OT and PT (n = 35 participants) and in S-LP (n = 8).

RESULTS

The top two strategies identified in the OT/PT NGT were: 1) Developing a flexible definition of EBP that recognizes its complexity; 2) Providing clinicians with more access to the teaching content by pairing faculty with preceptors. The top two strategies identified in the S-LP NGT were: 1) Providing students with opportunities for decision-making with experienced clinicians; 2) Increasing interactions between faculty and preceptors using formal group meetings.

CONCLUSION

Findings laid foundations for future integrated knowledge translation projects to collaboratively implement, and test identified strategies.

Pneumonia diagnosis performance in the emergency department: a mixed-methods study about clinicians' experiences and exploration of individual differences and response to diagnostic performance feedback

OBJECTIVES

We sought to (1) characterize the process of diagnosing pneumonia in an emergency department (ED) and (2) examine clinician reactions to a clinician-facing diagnostic discordance feedback tool.

MATERIALS AND METHODS

We designed a diagnostic feedback tool, using electronic health record data from ED clinicians' patients to establish concordance or discordance between ED diagnosis, radiology reports, and hospital discharge diagnosis for pneumonia. We conducted semistructured interviews with 11 ED clinicians about pneumonia diagnosis and reactions to the feedback tool. We administered surveys measuring individual differences in mindset beliefs, comfort with feedback, and feedback tool usability. We qualitatively analyzed interview transcripts and descriptively analyzed survey data.

RESULTS

Thematic results revealed: (1) the diagnostic process for pneumonia in the ED is characterized by diagnostic uncertainty and may be secondary to goals to treat and dispose the patient; (2) clinician diagnostic self-evaluation is a fragmented, inconsistent process of case review and follow-up that a feedback tool could fill; (3) the feedback tool was described favorably, with task and normative feedback harnessing clinician values of high-quality patient care and personal excellence; and (4) strong reactions to diagnostic feedback varied from implicit trust to profound skepticism about the validity of the concordance metric. Survey results suggested a relationship between clinicians' individual differences in learning and failure beliefs, feedback experience, and usability ratings.

DISCUSSION AND CONCLUSION

Clinicians value feedback on pneumonia diagnoses. Our results highlight the importance of feedback about diagnostic performance and suggest directions for considering individual differences in feedback tool design and implementation.

Use of Self-Efficacy Scale in Mass Casualty Incidents During Drill Exercises

INTRODUCTION

Medical First Responders (MFRs) in the emergency department SUMMA 112 are tasked with handling the initial management of Mass Casualty Incidents (MCI) and building response capabilities. Training plays a crucial role in preparing these responders for effective disaster management. Yet, evaluating the impact of such training poses challenges since true competency can only be proven amid a major event. As a substitute gauge for training effectiveness, self-efficacy has been suggested.

OBJECTIVE

The purpose of this study is to employ a pre- and post-test assessment of changes in perceived self-efficacy among MFRs following an intervention focused on the initial management of MCI. It also aimed to evaluate a self-efficacy instrument for its validity and reliability in this type of training.

METHOD

In this study, we used a pretest (time 1 = T1) - post-test (time 2 = T2) design to evaluate how self-efficacy changed after a training intervention with 201 MFRs in initial MCI management. ANOVA within-subjects and between subjects analyses were used.

RESULTS

The findings reveal a noteworthy change in self-efficacy before and after training among the 201 participants. This suggests that the training intervention positively affected participants' perceived capabilities to handle complex situations like MCI.

CONCLUSION

The results allow us to recommend a training program with theory components together with practical workshops and live, large-scale simulation exercises for the training of medical first responders in MCI, as it significantly increases their perception of the level of self-efficacy for developing competencies associated with disaster response.

Training in the use of the water jet and cold atmospheric plasma jet for the decontamination of dental implants

OBJECTIVES

Clinical trials testing new devices require prior training on dummies to minimize the "learning curve" for patients. Dentists were trained using a novel water jet device for mechanical cleaning of dental implants and with a novel cold plasma device for surface functionalisation during a simulated open flap peri-implantitis therapy. The hypothesis was that there would be a learning curve for both devices.

MATERIALS AND METHODS

11 dentists instrumented 44 implants in a dummy-fixed jaw model. The effect of the water jet treatment was assessed as stain removal and the effect of cold plasma treatment as surface wettability. Both results were analysed using photographs. To improve treatment skills, each dentist treated four implants and checked the results immediately after the treatment as feedback.

RESULTS

Water jet treatment significantly improved from the first to the second implant from 62.7% to 75.3% stain removal, with no further improvement up to the fourth implant. The wettability with cold plasma application reached immediately a high level at the first implant and was unchanged to the 4th implant (mean scores 2.7 out of 3).

CONCLUSION

A moderate learning curve was found for handling of the water jet but none for handling of the cold plasma.

CLINICAL RELEVANCE

Scientific rational for study: Two new devices were developed for peri-implantitis treatment (Dental water jet, cold plasma). Dentists were trained in the use of these devices prior to the trial to minimize learning effects.

PRINCIPAL FINDINGS

Experienced dentists learn the handling of the water jet very rapidly and for cold plasma they do not need much training.

PRACTICAL IMPLICATIONS

A clinical study is in process. When the planned clinical study will be finished, we will find out, if this dummy head exercise really minimised the learning curve for these devices.

Integration of a respiratory function monitor into newborn positive pressure ventilation training; development of a standardised training intervention

Objective

One in twenty newborns require resuscitation with positive pressure ventilation (PPV) at birth. Newborn face mask ventilation is often poorly performed. To address this, the potential role of respiratory function monitors (RFM) in newborn resuscitation training has been highlighted. The objective of this study was to develop a standardised training intervention on newborn PPV using an RFM with a simple visual display to identify and correct suboptimal ventilations.

Methods

We adapted the framework from a simulation development guideline to create a hands-on intervention on newborn PPV using an RFM with simple visual feedback (Monivent NeoTraining). We enrolled a group of healthcare professionals to a manikin-based pilot study as part of this process, conducting a series of teaching sessions to refine the intervention. Suggested changes were gathered from participants and instructors. Our main objective was to develop a standardised, reproducible training intervention.

Results

A standardised training intervention on newborn PPV was systematically developed. Twenty-six healthcare professionals working in tertiary neonatal care participated in a pilot study, consisting of eight training sessions. Each iteration of the intervention was informed by the previous session. Instructions for the delivery of teaching were standardised and a training algorithm was developed.

Conclusion

RFM's have been shown to be effective tools in research settings, addressing poor technique and face mask leak. They are not routinely used in newborn resuscitation training. To address this, we developed a standardised training intervention on newborn PPV using an RFM with simple visual feedback.

Impact of Longitudinal Mechanical Ventilation Curriculum on Decay of Knowledge

Background

Prior evidence suggests that critical care trainees and attendings may have trouble recognizing common, potentially life-threatening mechanical ventilation (MV) waveform asynchronies. Although dedicated workshops may improve knowledge in MV, this knowledge may be prone to decay over time. Longitudinal, preceptorial-based curriculums may prevent this decay in knowledge.

Objective

To determine if the addition of a year-long, longitudinal MV preceptorial curriculum to a two-part, small-group, simulation-based education block curriculum reduces decay in MV knowledge compared with the education block curriculum alone.

Methods

This was a multicenter prospective cohort study including 123 first-year fellows from 12 critical care fellowship programs who completed a two-part simulation-based education block (control) after the first and sixth months of fellowship. Fellows from one of these programs also participated in a year-long preceptorial curriculum (intervention). MV waveform examination scores over time during fellowship were compared between control versus intervention groups.

Results

Mean test scores increased for both control and intervention groups after the education block courses at Months 1 and 6 of fellowship. Mean (standard deviation) test scores at Month 12 were higher for the intervention group than the control group (89.3 [14.8] vs. 47.7 [21.4]; P < 0.0001). Between 6 months and 3 years of fellowship, there was a significant decay in test scores for the control group (slope estimate [standard error], -13.4 [1.7]; P < 0.0001). However, there was no significant decay in test scores for the intervention group (slope estimate, -2.0 [4.7]; P = 0.67; difference in slope estimates, 11.4 [5.0]; P = 0.02).

Conclusion

The ability of critical care fellows to identify MV waveform asynchronies declines over fellowship training, despite a dedicated two-part, simulation-based MV educational curriculum. The addition of an MV preceptorial course decreased decay of MV knowledge over the course of fellowship training.

Development and Validation of a Simulation Model for Collection of Canine Vaginal Samples

Vaginal cytology is a widely used cytological technique mostly taught by observation, either through direct tutoring or videos. To the best of our knowledge, vaginal cytology simulators have never been assessed in veterinary medicine. Twenty-five undergraduate students with no prior experience in canine vaginal sampling were randomly assigned to two groups that practiced the procedure in either a simulator or a live animal. An inverted classroom design was followed. After observing a video tutorial, students practiced with the simulator/live animal for two classes. Three weeks later, they performed a vaginal cytology on a live animal being recorded. The videos were evaluated through an objective structured clinical examination (OSCE) by an observer blinded to the student's groups. The learning outcome was compared through OSCE pass rates and questionnaires. The simulation model was made by 3D printing and soft silicone for the vulvar labia, having pink and blue colored vaseline in the correct and incorrect locations for sampling. The model was economic and accurately replicated the female reproductive tract. It provided immediate feedback to students, who obtained pink or blue swabs from the correct and incorrect locations, respectively. Students reported that three to five or more attempts were needed to properly learn the procedure, thus justifying the need for a simulator. No differences in the OSCE pass rates were observed between the groups. The simulation model was effective for learning the vaginal cytology procedure, replacing the use of live animals. This low-cost model should be incorporated in the tool-kit of reproduction classes. This translation was provided by the authors. To view the full translated article visit: https://doi.org/10.3138/jvme-2022-0141.pt.

Teaching clinical reasoning: principles from the literature to help improve instruction from the classroom to the bedside

Clinical reasoning has been characterized as being an essential aspect of being a physician. Despite this, clinical reasoning has a variety of definitions and medical error, which is often attributed to clinical reasoning, has been reported to be a leading cause of death in the United States and abroad. Further, instructors struggle with teaching this essential ability which often does not play a significant role in the curriculum. In this article, we begin with defining clinical reasoning and then discuss four principles from the literature as well as a variety of techniques for teaching these principles to help ground an instructors' understanding in clinical reasoning. We also tackle contemporary challenges in teaching clinical reasoning such as the integration of artificial intelligence and strategies to help with transitions in instruction (e.g., from the classroom to the clinic or from medical school to residency/registrar training) and suggest next steps for research and innovation in clinical reasoning.

Finding Your Voice: A Large-Scale Nursing Training in Speaking up and Listening Skills

BACKGROUND

Training in speaking up skills for nursing professionals provides the groundwork for promoting a culture of curiosity and inquiry. At the foundation of speaking up is psychological safety for team members to disagree, offer alternative ideas, and ask questions.

METHOD

A large-scale training session, Finding Your Voice: Speaking Up & Listening Skills, was designed and delivered to 1,306 nurses at an academic medical center.

RESULTS

Most participants reported that the session met the training goals (97%). There was an increase in participants' confidence in speaking up (pretraining 69% ± 19%; posttraining 73% ± 15%; p < .0001), and listening (pretraining 68% ± 19%; post-training 74% ± 15%; p < .0001). Leaders showed greater increases in confidence in listening and responding to nurses speaking up (leaders 5.6% vs. nonleaders 4.2%, p < .00001).

CONCLUSION

Nurses benefited from an interactive educational experience by practicing strategies for speaking up and listening. [J Contin Educ Nurs. 2024;55(6):309-316.].

Virtual reality simulation training in laparoscopic surgery - does it really matter, what simulator to use? Results of a cross-sectional study

BACKGROUND

Virtual reality simulation training plays a crucial role in modern surgical training, as it facilitates trainees to carry out surgical procedures or parts of it without the need for training "on the patient". However, there are no data comparing different commercially available high-end virtual reality simulators.

METHODS

Trainees of an international gastrointestinal surgery workshop practiced in different sequences on LaparoS® (VirtaMed), LapSim® (Surgical Science) and LapMentor III® (Simbionix) eight comparable exercises, training the same basic laparoscopic skills. Simulator based metrics were compared between an entrance and exit examination.

RESULTS

All trainees significantly improved their basic laparoscopic skills performance, regardless of the sequence in which they used the three simulators. Median path length was initially 830 cm and 463 cm on the exit examination (p < 0.001), median time taken improved from 305 to 167 s (p < 0.001).

CONCLUSIONS

All Simulators trained efficiently the same basic surgery skills, regardless of the sequence or simulator used. Virtual reality simulation training, regardless of the simulator used, should be incorporated in all surgical training programs. To enhance comparability across different types of simulators, standardized outcome metrics should be implemented.

Programmatic Assessment of Clinical Reasoning: New Opportunities to Meet an Ongoing Challenge

Issue: Clinical reasoning is essential to physicians' competence, yet assessment of clinical reasoning remains a significant challenge. Clinical reasoning is a complex, evolving, non-linear, context-driven, and content-specific construct which arguably cannot be assessed at one point in time or with a single method. This has posed challenges for educators for many decades, despite significant development of individual assessment methods. Evidence: Programmatic assessment is a systematic assessment approach that is gaining momentum across health professions education. Programmatic assessment, and in particular assessment for learning, is well-suited to address the challenges with clinical reasoning assessment. Several key principles of programmatic assessment are particularly well-aligned with developing a system to assess clinical reasoning: longitudinality, triangulation, use of a mix of assessment methods, proportionality, implementation of intermediate evaluations/reviews with faculty coaches, use of assessment for feedback, and increase in learners' agency. Repeated exposure and measurement are critical to develop a clinical reasoning assessment narrative, thus the assessment approach should optimally be longitudinal, providing multiple opportunities for growth and development. Triangulation provides a lens to assess the multidimensionality and contextuality of clinical reasoning and that of its different, yet related components, using a mix of different assessment methods. Proportionality ensures the richness of information on which to draw conclusions is commensurate with the stakes of the decision. Coaching facilitates the development of a feedback culture and allows to assess growth over time, while enhancing learners' agency. Implications: A programmatic assessment model of clinical reasoning that is developmentally oriented, optimizes learning though feedback and coaching, uses multiple assessment methods, and provides opportunity for meaningful triangulation of data can help address some of the challenges of clinical reasoning assessment.

Preceptorship in robotic colorectal surgery: experience from the Australian private sector

This article describes a post-fellowship preceptorship training program to train sub-specialty colorectal surgeons in gaining proficiency in robotic colorectal surgery using a dual-surgeon model in the Australian private sector. The Australian colorectal surgeon faces challenges in gaining robotic colorectal surgery proficiency with limited exposure and experience in the public setting where the majority of general and colorectal surgery training is currently conducted. This training model uses graded exposure with a range of simulation training, wet lab training, and clinical operative cases to progress through both competency and proficiency in robotic colorectal surgery which is mutually beneficial to surgeons and patients alike. Ongoing audit of practice has shown no adverse impacts.

Applying the master adaptive learner framework to just-in-time training of procedures

Background

Just-in-time training (JITT) occurs in the clinical context when learners need immediate guidance for procedures due to a lack of proficiency or the need for knowledge refreshment. The master adaptive learner (MAL) framework presents a comprehensive model of transforming learners into adaptive experts, proficient not only in their current tasks but also in the ongoing development of lifelong skills. With the evolving landscape of procedural competence in emergency medicine (EM), trainees must develop the capacity to acquire and master new techniques consistently. This concept paper will discuss using JITT to support the development of MALs in the emergency department.

Methods

In May 2023, an expert panel from the Society for Academic Emergency Medicine (SAEM) Medical Educator's Boot Camp delivered a comprehensive half-day preconference session entitled "Be the Best Teacher" at the society's annual meeting. A subgroup within this panel focused on applying the MAL framework to JITT. This subgroup collaboratively developed a practical guide that underwent iterative review and refinement.

Results

The MAL-JITT framework integrates the learner's past experiences with the educator's proficiency, allowing the educational experience to address the unique requirements of each case. We outline a structured five-step process for applying JITT, utilizing the lumbar puncture procedure as an example of integrating the MAL stages of planning, learning, assessing, and adjusting. This innovative approach facilitates prompt procedural competence and cultivates a positive learning environment that fosters acquiring adaptable learning skills with enduring benefits throughout the learner's career trajectory.

Conclusions

JITT for procedures holds the potential to cultivate a dynamic learning environment conducive to nurturing the development of MALs in EM.

Use of Simulation For Training Advanced Colorectal Procedures

OBJECTIVE

Simulation training for minimally invasive colorectal procedures is in developing stages. This study aims to assess the impact of simulation on procedural knowledge and simulated performance in laparoscopic low anterior resection (LLAR) and robotic right colectomy (RRC).

DESIGN

LLAR and RRC simulation procedures were designed using human cadaveric models. Resident case experience and simulation selfassessments scores for operative ability and knowledge were collected before and after the simulation. Colorectal faculty assessed resident simulation performance using validated assessment scales (OSATS-GRS, GEARS). Paired t-tests, unpaired t-tests, Pearson's correlation, and descriptive statistics were applied in analyses.

SETTING

Barnes-Jewish Hospital/Washington University School of Medicine in St. Louis, Missouri.

PARTICIPANTS

Senior general surgery residents at large academic surgery program.

RESULTS

Fifteen PGY4/PGY5 general surgery residents participated in each simulation. Mean LLAR knowledge score increased overall from 10.0 ±  2.0 to 11.5  ±  1.6 of 15 points (p = 0.0018); when stratified, this increase remained significant for the PGY4 cohort only. Mean confidence in ability to complete LLAR increased overall from 2.0 ±  0.8 to 2.8  ± 0.9 on a 5-point rating scale (p = 0.0013); when stratified, this increase remained significant for the PGY4 cohort only. Mean total OSATS GRS score was 28  ±  6.3 of 35 and had strong positive correlation with previous laparoscopic colorectal experience (r = 0.64, p = 0.0092). Mean RRC knowledge score increased from 9.4 ±  2.2 to 11.1 ±  1.5 of 15 points (p = 0.0030); when stratified, this increase again remained significant for the PGY4 cohort only. Mean confidence in ability to complete RRC increased from 1.9 ±  0.9 to 3.2  ±  1.1 (p = 0.0002) and was significant for both cohorts.

CONCLUSIONS

Surgical trainees require opportunities to practice advanced minimally invasive colorectal procedures. Our simulation approach promotes increased procedural knowledge and resident confidence and offers a safe complement to live operative experience for trainee development. In the future, simulations will target trainees on the earlier part of the learning curve and be paired with live operative assessments to characterize longitudinal skill progression.

Using simulation to teach paediatric complex care

BACKGROUND

Training paediatric residents regarding the care of children with medical complexity (CMC) remains an important challenge given how frequently these patients are treated by trainees and the lack of educational activities specific to these patients. Our goal was to develop and assess a novel simulation regarding the acute care of CMC to improve residents' perceived confidence in areas related to CMC care.

APPROACH

We developed a case of a patient with multiple chronic medical conditions who presented with acute vital sign changes and worsening discomfort due to an occult femur fracture related to a recent transfer. Paediatric residents worked in teams to complete a full physical exam, create a differential diagnosis, evaluate laboratory and imaging results and create a management plan.

EVALUATION

Thirty-three residents out of a total possible sample of 97 (34%) participated in the simulation, which was evaluated using pre- and post-surveys immediately before and after the simulation assessing resident confidence completing tasks related to CMC care. Residents perceived significant improvement in confidence regarding evaluating a differential diagnosis of vital sign and exam changes in CMC (p = 0.023), managing vital sign and exam changes in CMC (p = 0.009) and communicating with team members of CMC (p = 0.049).

IMPLICATIONS

An innovative high-fidelity and low-stakes simulation was effective in teaching trainees about acute management of concerns related to CMC. This simulation may be appropriate for implementation at other institutions, serving as a foundation for use in resident education regarding CMC.

Evaluation of a novel home-based laparoscopic and core surgical skills programme (Monash Online Surgical Training)

INTRODUCTION

Limitations to surgical education access were exacerbated during the COVID-19 Pandemic. In response, we created a national home-based comprehensive surgical skills course: Monash Online Surgical Training (MOST). Our aim was to evaluate the educational impact of this approach.

METHODS

A remote, 6-week course was designed with learning objectives aligned to the national surgical training. Participants received a personal laparoscopic bench trainer, instrument tracking software, live webinars, access to an online theoretical learning platform, and individualised feedback by system-generated or expert surgeons' assessments. Mixed method analysis of instrument tracking metrics, pre- and post-course questionnaires (11 core surgical domains) and participant comments was utilised. Data were analysed using the Mann-Whitney U test, and a p-value of < 0.05 was considered statistically significant.

RESULTS

A total of 54 participants with varied levels of experience (1 to > 6 years post-graduate level) completed MOST. All 11 learning-outcome domains demonstrated statistically significant improvement including core laparoscopic skills (1.4/5 vs 2.8/5, p < 0.0001) and handling laparoscopic instruments (1.5/5 vs 2.8/5, p < 0.0001). A total of 3460 tasks were completed reflecting 158.2 h (9492 min) of practice, 394 were submitted for formal feedback. Participants rated the course (mean 8.5/10, SD 1.6), live webinars (mean 8.9/10, SD 1.6) and instrument tracking software (mean 8.6, SD 1.7) highly. Qualitative analysis revealed a paradigm shift including the benefits of a safe learning environment and self-paced, self-directed learning.

CONCLUSION

The MOST course demonstrates the successful implementation of a fully remote laparoscopic simulation course which participants found to be an effective tool to acquire core surgical skills.

The Rapid and International Expansion of Veterinary Clinical Skills Laboratories: A Survey to Establish Recent Developments

Veterinary clinical skills laboratories are used for teaching a wide range of practical, clinical, and surgical skills on models and simulators. A survey conducted in 2015 identified the role of such facilities in veterinary education in North America and Europe. The current study aimed to capture recent changes using a similar survey with three sections to collect data about the structure of the facility, its uses in teaching and assessment, and the staffing. The survey consisted of multiple choice and free text questions, was administered online using Qualtrics and was disseminated in 2021 via clinical skills networks and Associate Deans. Responses were received from 91 veterinary colleges in 34 countries; 68 had an existing clinical skills laboratory and 23 were planning to open one within 1-2 years. Collated information from the quantitative data described the facility, teaching, assessment, and staffing. Major themes emerged from the qualitative data relating to aspects of the layout, location, integration in the curriculum, contributions to student learning, and the team managing and supporting the facility. Challenges were associated with budgeting, the ongoing need for expansion and leadership of the program. In summary, veterinary clinical skills laboratories are increasingly common around the world and the contributions to student learning and animal welfare were well recognized. The information about existing and planned laboratories and the tips from those managing the facilities provides valuable guidance for anyone intending to open or expand an existing clinical skills laboratory.

Improving the Reliability of Peer Review Without a Gold Standard

Peer review plays a crucial role in accreditation and credentialing processes as it can identify outliers and foster a peer learning approach, facilitating error analysis and knowledge sharing. However, traditional peer review methods may fall short in effectively addressing the interpretive variability among reviewing and primary reading radiologists, hindering scalability and effectiveness. Reducing this variability is key to enhancing the reliability of results and instilling confidence in the review process. In this paper, we propose a novel statistical approach called "Bayesian Inter-Reviewer Agreement Rate" (BIRAR) that integrates radiologist variability. By doing so, BIRAR aims to enhance the accuracy and consistency of peer review assessments, providing physicians involved in quality improvement and peer learning programs with valuable and reliable insights. A computer simulation was designed to assign predefined interpretive error rates to hypothetical interpreting and peer-reviewing radiologists. The Monte Carlo simulation then sampled (100 samples per experiment) the data that would be generated by peer reviews. The performances of BIRAR and four other peer review methods for measuring interpretive error rates were then evaluated, including a method that uses a gold standard diagnosis. Application of the BIRAR method resulted in 93% and 79% higher relative accuracy and 43% and 66% lower relative variability, compared to "Single/Standard" and "Majority Panel" peer review methods, respectively. Accuracy was defined by the median difference of Monte Carlo simulations between measured and pre-defined "actual" interpretive error rates. Variability was defined by the 95% CI around the median difference of Monte Carlo simulations between measured and pre-defined "actual" interpretive error rates. BIRAR is a practical and scalable peer review method that produces more accurate and less variable assessments of interpretive quality by accounting for variability within the group's radiologists, implicitly applying a standard derived from the level of consensus within the group across various types of interpretive findings.