Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains

Investigating mental rehearsal's applicability in guiding independent E-learning (IMAGINE) of eye examination skills during the pandemic

BACKGROUND

COVID-19's infection control policies have hindered the Deliberate Practice of clinical examinations. Guided Mental Rehearsal (GMR) may overcome this obstacle by facilitating independent, repetitive practice. Underpinned by the 'Motor Simulation Theory,' GMR reinforces similar neuro-circuit activations during physical practice and was proven effective in surgical training.

METHODS

This prospective, randomized controlled study evaluated the efficacy of GMR versus 'peer-learning' of Confrontational Visual Field Examination (CVFE). Third-year medical-students without clinical Ophthalmology experience were recruited. Controls (n = 40) watched an e-learning instructional video (8-min CVFE tutorial) followed by 6-min of 'peer-learning.' GMR-students (n = 40) had 'peer-learning' replaced by a 6-min GMR audio-recording (CVFE running commentary). Pre-test and post-test MCQs were administered to determine baseline knowledge and knowledge acquisition, respectively. 28 controls and 26 GMR-students performed CVFE on simulated patients with right homonymous hemianopia. Four Ophthalmologists graded their performances using a checklist-based marking scheme.

RESULTS

Both groups did not exhibit a significant difference in pre-test scores (8.550 vs. 7.947, p = 0.266); outcome of sub-group analysis of CVFE-performing candidates was similar (8.214 vs. 7.833, p = 0.561). Post-test scores were significantly higher than pre-test in both groups (all p < .001), without inter-group difference (14.000 vs. 15.000, p = 0.715). GMR-group had significantly higher scores on CVFE performance than controls (85.354 vs. 73.679%, p = .001).

CONCLUSIONS

GMR improved psychomotor but not cognitive aspect of learning CVFE. This may be attributable to GMR's theoretical resemblance with physical practice, with additional expert guidance. By enabling independent learning, GMR may also reduce the demand for teaching manpower and thus education cost in the future.

Investigating and acquiring motor expertise using virtual reality

After just months of simulated training, on January 19, 2019 a 23-year-old E-sports pro-gamer, Enzo Bonito, took to the racetrack and beat Lucas di Grassi, a Formula E and ex-Formula 1 driver with decades of real-world racing experience. This event raised the possibility that practicing in virtual reality can be surprisingly effective for acquiring motor expertise in real-world tasks. Here, we evaluate the potential of virtual reality to serve as a space for training to expert levels in highly complex real-world tasks in time windows much shorter than those required in the real world and at much lower financial cost without the hazards of the real world. We also discuss how VR can also serve as an experimental platform for exploring the science of expertise more generally.

Implementation of a virtual student placement to improve the application of theory to practice

BACKGROUND

The primary aim of undergraduate, pre-registration nursing education is to prepare students to be nurses who can apply theory to practice, with clinical placements to support the practice element of the clinical programme. However, the theory-practice gap is a longstanding problem within nurse education, as nurses continue to practise with incomplete knowledge to support their actions.

PROBLEM

In April 2020, the COVID-19 pandemic caused a reduction in clinical placement capacity that affected student learning opportunities.

APPROACH

Based on Miller's pyramid of learning, a virtual placement was created using evidence-based learning theories and an array of multimedia technologies with the intention of replicating real-life experiences and promoting problem-based learning. Scenarios and case studies were collated from clinical experiences and mapped against student proficiencies to produce an authentic and immersive learning environment.

CONCLUSION

This innovative pedagogy provides an alternative to the placement experience while enhancing the application of theory to practice.

Development and Evaluation of a Child Neurology Resident Curriculum for Communication Around Serious Illness

Background: Communication around serious illness is a core competency for all residencies. One-fifth of neurology residencies have no curriculum. Published curricula use didactics or role-play to assess confidence performing this skill without evaluation in clinical settings. The SPIKES mnemonic (Setting, Perception, Invitation, Knowledge, Empathy, Strategy/Summary) outlines 6 evidence-based steps for communication around serious illness. It is unknown whether child neurology residents can incorporate SPIKES into communication around serious illness in clinical settings. Objective: To develop and evaluate a curriculum on communication around serious illness using SPIKES for child neurology residents that shows long-term skill retention in clinical settings at a single institution. Methods: In 2019, we created a pre-post survey and skills checklist based on SPIKES, with 20 total including 10 core skills. Faculty observed residents' (n  =  7) communication with families and completed both preintervention and postintervention checklists for comparison. Residents underwent training in SPIKES during a 2-hour session using didactic and coached role-play. Results: All (n  =  7) residents completed preintervention surveys, 4 of 6 completed postintervention. All (n  =  6) participated in the training session. Following the training, 75% of residents reported improved confidence in use of SPIKES, though 50% were still unsure about appropriately responding to emotions. There was improvement in all SPIKES skills, with significant improvement in 6 of 20 skills up to 1 year following training. Conclusion: This is the first evaluation of the implementation of a communication around serious illness curriculum for child neurology residents. We identified improved comfort with SPIKES after training. Successful acquisition and utilization of this framework in our program suggests it could be incorporated into any residency program.

The Evidence Basis for Learning Theory and Technology in Surgical Skills Training

Orthopaedic trainees face a complex and challenging training environment that is currently becoming more competency driven. Associated with these changes are an increasing introduction and use of a variety of technologically driven surgical training augments. Although these new learning resources can positively transform the educational environment, they must be used appropriately by both learners and educators. To aid in this, we review learning theories because they apply to surgical skills training and highlight recent surgical training evidence that demonstrates how technology use can be optimized to promote surgical learning, with an emphasis on procedural learning theory and cognitive load theory. Specifically, we review the evidence demonstrating the importance of targeting technology to a learner's experience level and methods to optimize cognitive load by managing intrinsic load, minimizing extraneous load, and maximizing germane load.

Quantifying social performance: A review with implications for further work

Human social performance has been a focus of theory and investigation for more than a century. Attempts to quantify social performance have focused on self-report and non-social performance measures grounded in intelligence-based theories. An expertise framework, when applied to individual differences in social interaction performance, offers novel insights and methods of quantification that could address limitations of prior approaches. The purposes of this review are 3-fold. First, to define the central concepts related to individual differences in social performance, with a particular focus on the intelligence-based framework that has dominated the field. Second, to make an argument for a revised conceptualization of individual differences in social-emotional performance as a social expertise. In support of this second aim, the putative components of a social-emotional expertise and the potential means for their assessment will be outlined. To end, the implications of an expertise-based conceptual framework for the application of computational modeling approaches in this area will be discussed. Taken together, expertise theory and computational modeling methods have the potential to advance quantitative assessment of social interaction performance.

Assessment methods in laparoscopic colorectal surgery: a systematic review of available instruments

BACKGROUND

Laparoscopic surgery has become the golden standard for many procedures, requiring new skills and training methods. The aim of this review is to appraise literature on assessment methods for laparoscopic colorectal procedures and quantify these methods for implementation in surgical training.

MATERIALS AND METHODS

PubMed, Embase and Cochrane Central Register of Controlled Trials databases were searched in October 2022 for studies reporting learning and assessment methods for laparoscopic colorectal surgery. Quality was scored using the Downs and Black checklist. Included articles were categorized in procedure-based assessment methods and non-procedure-based assessment methods. A second distinction was made between capability for formative and/or summative assessment.

RESULTS

In this systematic review, nineteen studies were included. These studies showed large heterogeneity despite categorization. Median quality score was 15 (range 0-26). Fourteen studies were categorized as procedure-based assessment methods (PBA), and five as non-procedure-based assessment methods. Three studies were applicable for summative assessment.

CONCLUSIONS

The results show a considerable diversity in assessment methods with varying quality and suitability. To prevent a sprawl of assessment methods, we argue for selection and development of available high-quality assessment methods. A procedure-based structure combined with an objective assessment scale and possibility for summative assessment should be cornerstones.

The Role of Collaborative Observational Practice and Feedback-Discourse to Promote Remote Acquisition of Technical Surgical Skills

INTRODUCTION

Acquisition of technical skills remotely in a decentralized model requires an efficacious way of providing feedback. The primary objective was to test the efficacy of various forms of feedback on the acquisition of surgical skills by medical students.

METHODS

Forty volunteers were randomized to four experimental groups, differing from the nature of feedback (free text versus structured) and who provided the feedback (expert versus peer learners). They had to perform sutures and upload attempts on a learning management system to receive interactive feedback. The pretest and retention test performances were assessed.

RESULTS

All groups significantly improved from pretests to retention tests; however, participants using checklist showed statistically lower improvements than the other groups, which did not differ from each other.

CONCLUSIONS

Remote learners can acquire surgical skills, and most importantly, peers who provide feedback, are as effective as experts if they use open-ended comments and not checklists.

Impact and effectiveness of a mandatory competency-based simulation program for pediatric emergency medicine faculty

Introduction

Pediatric emergency medicine physicians struggle to maintain their critical procedural and resuscitation skills. Continuing professional development programs incorporating simulation and competency-based standards may help ensure skill maintenance. Using a logic model framework, we sought to evaluate the effectiveness of a mandatory annual competency-based medical education (CBME) simulation program.

Methods

The CBME program, evaluated from 2016 to 2018, targeted procedural, point-of-care ultrasound (POCUS) and resuscitation skills. Delivery of educational content included a flipped-classroom website, deliberate practice, mastery-based learning, and stop-pause debriefing. Participants' competence was assessed using a 5-point global rating scale (GRS; 3 = competent, 5 = mastery). Statistical process control charts were used to measure the effect of the CBME program on team performance during in situ simulations (ISS), measured using the Team Emergency Assessment Measure (TEAM) scale. Faculty completed an online program evaluation survey.

Results

Forty physicians and 48 registered nurses completed at least one course over 3 years (physician mean ± SD 2.2 ± 0.92). Physicians achieved competence on 430 of 442 stations (97.3%). Mean ± SD GRS scores for procedural, POCUS, and resuscitation stations were 4.34 ± 0.43, 3.96 ± 0.35, and 4.17 ± 0.27, respectively. ISS TEAM scores for "followed standards and guidelines" improved significantly. No signals of special cause variation emerged for the other 11 TEAM items, indicating skills maintenance. Physicians rated CBME training as highly valuable (mean question scores 4.15-4.85/5). Time commitment and scheduling were identified as barriers to participation.

Conclusions

Our mandatory simulation-based CBME program had high completion rates and very low station failures. The program was highly rated and faculty improved or maintained their ISS performance across TEAM scale domains.

Taking the Pulse of the Current State of Simulation

Simulation in health-care professions has grown in the last few decades. We provide an overview of the history of simulation in other fields, the trajectory of simulation in health professions education, and research in medical education, including the learning theories and tools to assess and evaluate simulation programs. We also propose future directions for simulation and research in health professions education.

Coaching the coach: A randomized controlled study of a novel curriculum for procedural coaching during intubation

Background

Videolaryngoscopy allows real-time procedural coaching during intubation. This study sought to develop and assess an online curriculum to train pediatric emergency medicine attending physicians to deliver procedural coaching during intubation.

Methods

Curriculum development consisted of semistructured interviews with 12 pediatric emergency medicine attendings with varying levels of airway expertise analyzed using a constructivist grounded theory approach. Following development, the curriculum was implemented and assessed through a multicenter randomized controlled trial enrolling participants in one of three cohorts: the coaching module, unnarrated video recordings of intubations, and a module on ventilator management. Participants completed identical pre and post assessments asking them to select the correct coaching feedback and provided reactions for qualitative thematic analysis.

Results

Content from interviews was synthesized into a video-enhanced 15-min online coaching module illustrating proper technique for intubation and strategies for procedural coaching. Eighty-seven of 104 randomized physicians enrolled in the curriculum; 83 completed the pre and post assessments (80%). The total percentage correct did not differ between pre and post assessments for any cohort. Participants receiving the coaching module demonstrated improved performance on patient preparation, made more suggestions for improvement, and experienced a greater increase in confidence in procedural coaching. Qualitative analysis identified multiple benefits of the module, revealed that exposure to video recordings without narration is insufficient, and identified feedback on suggestions for improvement as an opportunity for deliberate practice.

Conclusions

This study leveraged clinical and educational digital technology to develop a curriculum dedicated to the content expertise and coaching skills needed to provide feedback during intubations performed with videolaryngoscopy. This brief curriculum changed behavior in simulated coaching scenarios but would benefit from additional support for deliberate practice.

Procedural training in neonatology

PURPOSE OF REVIEW

To discuss a structured training process that can be used to guide curricula development in procedural skills in neonatal perinatal medicine training programs.

RECENT FINDINGS

Achieving proficiency in life savings skills such as neonatal endotracheal intubation does not occur for all graduates of neonatal perinatal medicine programs. Innovations in procedural skills training offer opportunities to enhance the current educational environment and improve competency at all levels of learning.

SUMMARY

A deliberate process of planning for procedural skills training and assessment of training outcomes is essential to ensure competence among graduates and practicing clinicians.

Towards best practice in developing motor skills: a systematic review on spacing in VR simulator-based psychomotor training for surgical novices

OBJECTIVE

Repeated practice, or spacing, can improve various types of skill acquisition. Similarly, virtual reality (VR) simulators have demonstrated their effectiveness in fostering surgical skill acquisition and provide a promising, realistic environment for spaced training. To explore how spacing impacts VR simulator-based acquisition of surgical psychomotor skills, we performed a systematic literature review.

METHODS

We systematically searched the databases PubMed, PsycINFO, Psychology and Behavioral Sciences Collection, ERIC and CINAHL for studies investigating the influence of spacing on the effectiveness of VR simulator training focused on psychomotor skill acquisition in healthcare professionals. We assessed the quality of all included studies using the Medical Education Research Study Quality Instrument (MERSQI) and the risk of bias using the Cochrane Collaboration's risk of bias assessment tool. We extracted and aggregated qualitative data regarding spacing interval, psychomotor task performance and several other performance metrics.

RESULTS

The searches yielded 1662 unique publications. After screening the titles and abstracts, 53 publications were retained for full text screening and 7 met the inclusion criteria. Spaced training resulted in better performance scores and faster skill acquisition when compared to control groups with a single day (massed) training session. Spacing across consecutive days seemed more effective than shorter or longer spacing intervals. However, the included studies were too heterogeneous in terms of spacing interval, obtained performance metrics and psychomotor skills analysed to allow for a meta-analysis to substantiate our outcomes.

CONCLUSION

Spacing in VR simulator-based surgical training improved skill acquisition when compared to massed training. The overall number and quality of available studies were only moderate, limiting the validity and generalizability of our findings.

Can mixed reality technologies teach surgical skills better than traditional methods? A prospective randomised feasibility study

BACKGROUND

Basic surgical skills teaching is often delivered with didactic audio-visual content, and new digital technologies may allow more engaging and effective ways of teaching to be developed. The Microsoft HoloLens 2 (HL2) is a multi-functional mixed reality headset. This prospective feasibility study sought to assess the device as a tool for enhancing technical surgical skills training.

METHODS

A prospective randomised feasibility study was conducted. 36 novice medical students were trained to perform a basic arteriotomy and closure using a synthetic model. Participants were randomised to receive a structured surgical skills tutorial via a bespoke mixed reality HL2 tutorial (n = 18), or via a standard video-based tutorial (n = 18). Proficiency scores were assessed by blinded examiners using a validated objective scoring system and participant feedback collected.

RESULTS

The HL2 group showed significantly greater improvement in overall technical proficiency compared to the video group (10.1 vs. 6.89, p = 0.0076), and a greater consistency in skill progression with a significantly narrower range of scores (SD 2.48 vs. 4.03, p = 0.026). Participant feedback showed the HL2 technology to be more interactive and engaging with minimal device related problems experienced.

CONCLUSIONS

This study has demonstrated that mixed reality technology may provide a higher quality educational experience, improved skill progression and greater consistency in learning when compared to traditional teaching methodologies for basic surgical skills. Further work is required to refine, translate, and evaluate the scalability and applicability of the technology across a broad range of skills-based disciplines.

Perioperative Reflection: An Understudied Yet Common Practice Among Surgical Residents

OBJECTIVE

Directed reflection, a descriptive, analytical, and critical reasoning process, has been implemented in several professional fields as a method of developing expertise. In surgery, investigation of reflection has been limited. To date, we are unaware of any study that has sought to define or characterize the independent reflective practices of surgical trainees. In this small pilot study, we characterize the independent operative reflection activities among surgical residents at a single academic institution.

DESIGN

An unvalidated survey was developed through cognitive interviews and pilot testing to assess 5 aspects of operative reflection. An IRB approved electronic survey was developed and distributed to all general surgery residents at an academic institution. Responses were divided by post-graduate year into junior residents (JR; PGY 1-3) and senior residents (SR; PGY 4-5).

RESULTS

A response rate of 46% (23/50) was attained. All respondents self-identified as operative reflectors. Three primary methods of reflection were identified: mental, written, and oral. Mental reflection was the primary reflection method of 75% of our respondents as identified by step-by-step mental rehearsal, internal narration, and question series. Reflection was practiced everyday by 42% of respondents. Topics of reflection focused on weaknesses (50%), self-improvement (35%) and judgment (15%). Several respondents (57%) indicated that reflection-based learning tools would be useful. No statistically significant changes in the method or frequency were established between junior and senior residents (p = 0.378, p = 0.464, respectively). Variation in mental reflection activities among JR and SR groups were found (p = 0.029, p = 0.00004, respectively).

CONCLUSIONS

The enduring role of reflection in experiential learning has been established in many professional fields but remains under-utilized in surgical education. Our study suggests surgical residents reflect independently of curriculum in individual and categorizable ways. Further investigation is required to adequately characterize reflective habits of the surgical resident and evaluate its impact on competency.

A Consensus-Driven Revision of the Accreditation Council for Graduate Medical Education Case Log System: Pediatric Anesthesiology Fellowship Education

BACKGROUND

Clinical experiences, quantified by case logs, are an integral part of pediatric anesthesiology fellowship programs. Accreditation of pediatric anesthesiology fellowships by the Accreditation Council of Graduate Medical Education (ACGME) and establishment of case log reporting occurred in 1997 and 2009, respectively. The specialty has evolved since then, but the case log system remains largely unchanged. The Pediatric Anesthesiology Program Directors Association (PAPDA) embarked on the development of an evidence-based case log proposal through the efforts of a case log task force (CLTF). This proposal was part of a larger consensus-building process of the Society for Pediatric Anesthesia (SPA) Task Force for Pediatric Anesthesiology Graduate Medical Education. The primary aim of case log revision was to propose an evidence-based, consensus-driven update to the pediatric anesthesiology case log system.

METHODS

This study was executed in 2 phases. The CLTF, composed of 10 program directors representing diverse pediatric anesthesiology fellowship programs across the country, utilized evidence-based literature to develop proposed new categories. After an approval vote by PAPDA membership, this proposal was included in the nationally representative, stakeholder-based Delphi process executed by the SPA Task Force on Graduate Medical Education. Thirty-seven participants engaged in this Delphi process, during which iterative rounds of surveys were used to select elements of the old and newly proposed case logs to create a final revision of categories and minimums for updated case logs. The Delphi methodology was used, with a two-thirds agreement as the threshold for inclusion.

RESULTS

Participation in the Delphi process was robust, and consensus was almost completely achieved by round 2 of 3 survey rounds. Participants suggested that total case minimums should increase from 240 to 300 (300-370). Participants agreed (75.86%) that the current case logs targeted the right types of cases, but requirements were too low (82.75%). They also agreed (85.19%) that the case log system and minimums deserved an update, and that this should be used as part of a competency-based assessment in pediatric anesthesia fellowships (96%). Participants supported new categories and provided recommended minimum numbers.

CONCLUSIONS

The pediatric anesthesiology case log system continues to have a place in the assessment of fellowship programs, but it requires an update. This Delphi process established broad support for new categories and benchmarked minimums to ensure the robustness of fellowship programs and to better prepare the pediatric anesthesiology workforce of the future for independent clinical practice.

How Good is Good Enough?: Current-Day Pediatric Residency Program Directors' Challenges in Assessing and Achieving Resident Procedural Competency

OBJECTIVE

Significant gaps exist in the pediatric resident (PR) procedural experience. Graduating PRs are not achieving competency in the 13 ACGME recommended procedures. It is unclear why PR are not able to achieve competency, or how existing gaps may be addressed.

METHODS

We performed in-depth one-on-one semistructured interviews with 12 pediatric residency program directors (PPDs). The interviews were audio-recorded, and transcribed verbatim. Coding of the data using conventional content analysis led to generation of categories, which were validated through consensus development.

RESULTS

We identified 4 main categories, including (1) programs struggle to ensure adequate training in procedural skills for PRs, with various barriers reported; (2) programs develop individualized strategies to address challenges in procedural skills training, and multiple options are necessary; (3) PPDs face challenges defining procedural competency and standardizing expectations; and (4) expectations for PR procedural training may require modification based upon current practice environments. Solutions include simulation, procedural boot camps, and procedural/subspecialty electives.

CONCLUSIONS

Numerous methods to combat challenges in PR procedural training have been identified by participating PPDs, including simulation, tailoring electives, and developing institutional guidelines. However, accreditation bodies may need to update procedural expectations based on individual resident career goals and realities of current day practice.

Identification of factors associated with diagnostic performance variation in reporting of mammograms: A review

OBJECTIVES

This narrative review aims to identify what factors are linked to diagnostic performance variation for those who interpret mammograms. Identification of influential factors has potential to contribute to the optimisation of breast cancer diagnosis. PubMed, ScienceDirect and Google Scholar databases were searched using the following terms: 'Radiology', 'Radiologist', 'Radiographer', 'Radiography', 'Mammography', 'Interpret', 'read', 'observe' 'report', 'screen', 'image', 'performance' and 'characteristics.' Exclusion criteria included articles published prior to 2000 as digital mammography was introduced at this time. Non-English articles language were also excluded. 38 of 2542 studies identified were analysed.

KEY FINDINGS

Influencing factors included, new technology, volume of reads, experience and training, availability of prior images, social networking, fatigue and time-of-day of interpretation. Advancements in breast imaging such as digital breast tomosynthesis and volume of mammograms are primary factors that affect performance as well as tiredness, time-of-day when images are interpreted, stages of training and years of experience. Recent studies emphasised the importance of social networking and knowledge sharing if breast cancer diagnosis is to be optimised.

CONCLUSION

It was demonstrated that data on radiologist performance variability is widely available but there is a paucity of data on radiographers who interpret mammographic images.

IMPLICATIONS FOR PRACTICE

This scarcity of research needs to be addressed in order to optimise radiography-led reporting and set baseline values for diagnostic efficacy.

What is the Current State of Extended Reality Use in Otolaryngology Training? A Scoping Review

OBJECTIVE

To map current literature on the educational use of extended reality (XR) in Otolaryngology-Head and Neck Surgery (OHNS) to inform teaching and research.

STUDY DESIGN

Scoping Review.

METHODS

A scoping review was conducted, identifying literature through MEDLINE, Ovid Embase, and Web of Science databases. Findings were reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping review checklist. Studies were included if they involved OHNS trainees or medical students who used XR for an educational purpose in OHNS. XR was defined as: fully-immersive virtual reality (VR) using head-mounted displays (HMDs), non-immersive and semi-immersive VR, augmented reality (AR), or mixed reality (MR). Data on device use were extracted, and educational outcomes were analyzed according to Kirkpatrick's evaluation framework.

RESULTS

Of the 1,434 unique abstracts identified, 40 articles were included. All articles reported on VR; none discussed AR or MR. Twenty-nine articles were categorized as semi-immersive, none used occlusive HMDs therefore, none met modern definitions of immersive VR. Most studies (29 of 40) targeted temporal bone surgery. Using the Kirkpatrick four-level evaluation model, all studies were limited to level-1 (learner reaction) or level-2 (knowledge or skill performance).

CONCLUSIONS

Current educational applications of XR in OHNS are limited to VR, do not fully immerse participants and do not assess higher-level learning outcomes. The educational OHNS community would benefit from a shared definition for VR technology, assessment of skills transfer (level-3 and higher), and deliberate testing of AR, MR, and procedures beyond temporal bone surgery. Laryngoscope, 133:227-234, 2023.

An online immunohematology educational resource for post-graduate hematology trainees: LearnSerology.ca

BACKGROUND

Canadian hematology residents are required to demonstrate competencies in transfusion medicine by the end of their 2-year training. Prior evaluation of final year trainees revealed significant variation in knowledge. To address the lack of standardization in serology teaching, an online educational immunohematology resource was created and evaluated.

STUDY DESIGN AND METHODS

All Canadian post-graduate trainees completing a residency program in adult hematology during the 2018/2019 academic year were invited to participate. Only trainees from one university were exposed to the program curriculum. A validated exam was administered to trainees at both exposed and unexposed sites at the start of the academic year as a pre-test and in the following year as a post-test. The effectiveness of the program was assessed by both comparing the degree of improvement from pre- to post-test, and by comparing performance on the post-test.

RESULTS

57 trainees from 13 universities completed the pre-test, and 45 trainees from 14 universities completed the post-test. A strong trend towards better performance in the exposed vs non-exposed trainees on the post-test was observed, and the difference was more pronounced, and statistically significant, when analysis was limited to two questions relating to interpretation of an antibody investigation panel.

DISCUSSION

LearnSerology.ca is effective and may be potentially superior to traditional immunohematology teaching. The interactive capability of the platform can improve skills related to the resolution of red cell antibody panels.

The Impact of the COVID-19 Pandemic on Veterinary Clinical and Professional Skills Teaching Delivery and Assessment Format

The limitations posed by the COVID-19 pandemic have been particularly challenging for courses teaching clinical and professional skills. We sought to identify how the COVID-19 pandemic has impacted the delivery of veterinary clinical and professional skills courses, including modifications to teaching and assessment, and to establish educators' perceptions of the efficacy of selected delivery methods. A branching survey was deployed to 35 veterinary schools in North America in March and April 2021. The survey collected data about curriculum and assessment in spring 2020, fall 2020, and spring 2021. Educators at 16 veterinary schools completed the survey (response rate: 46%). Educators quickly adapted curriculum to meet the requirements of their institutions and governments. Early in the pandemic (spring 2020), curriculum was delayed, delivered remotely, or canceled. Assessment methods frequently included virtual objective structured clinical examinations (OSCEs) and video-recorded skills assessments. Later in the pandemic (fall 2020, spring 2021), in-person clinical skills sessions resumed at many schools, often in smaller groups. Professional skills instruction typically remained virtual, as benefits were noted. Assessment methods began to normalize with in-person OSCEs resuming with precautions, though some schools maintained virtual assessments. Educators noted some advantages to instructional methods used during COVID, including smaller group sizes, better prepared students, better use of in-person lab time, more focus on essential course components, provision of models for at-home practice, and additional educators' remote involvement. Following the pandemic, educators should consider retaining some of these changes while pursuing further advancements, including improving virtual platforms and relevant technologies.

Evolution of Cleft Lip and Palate Surgical Training in the UK: A Qualitative Study

BACKGROUND

Although the United Kingdom (UK) cleft surgeons follow a similar training pathway, and cleft centers adhere to similar protocols regarding the timing of palate surgery and surgical technique, speech outcomes still vary between centers.

OBJECTIVE

To explore the training experiences of consultant cleft lip and palate (CL/P) surgeons, performing a Sommerlad radical intravelar veloplasty (IVVP) and their approach to teaching others.

DESIGN

An exploratory, qualitative approach was adopted to understand the views of UK cleft surgeons performing a Sommerlad radical IVVP and discuss what was important during training and upon qualifying as a consultant.

METHOD

A semi-structured interview schedule was designed, interviews were conducted in-person or via videoconferencing, depending on preference and availability, with interested surgeons. The interviews were recorded, transcribed, and checked for accuracy. Analysis involved inductive thematic analysis.

RESULTS

Fourteen cleft consultants from the UK participated (3F:11M). Seven of the consultants were trained in plastic surgery and four in maxillofacial surgery. Seven themes were identified from the thematic analysis. Three themes, namely Learning to perform palate repair, Teaching others to perform palate repair, and Ongoing learning as a consultant are discussed.

CONCLUSIONS

Cleft palate repair is clearly a technically challenging procedure to learn and teach with the potential to cause harm if performed incorrectly. Positive changes have been made to improve exposure to palate surgery, encourage practice away from the patient, and increase supervised practical experience. The role of colleagues in providing mentorship and support appears invaluable. We provide some simple recommendations that may improve the training experience and ensure parity for all trainees.

Universal meta-competencies of operative performances: a literature review and qualitative synthesis

BACKGROUND

Prioritizing patient health is essential, and given the risk of mortality, surgical techniques should be objectively evaluated. However, there is no comprehensive cross-disciplinary system that evaluates skills across all aspects among surgeons of varying levels. Therefore, this study aimed to uncover universal surgical competencies by decomposing and reconstructing specific descriptions in operative performance assessment tools, as the basis of building automated evaluation system using computer vision and machine learning-based analysis.

METHODS

The study participants were primarily expert surgeons in the gastrointestinal surgery field and the methodology comprised data collection, thematic analysis, and validation. For the data collection, participants identified global operative performance assessment tools according to detailed inclusion and exclusion criteria. Thereafter, thematic analysis was used to conduct detailed analyses of the descriptions in the tools where specific rules were coded, integrated, and discussed to obtain high-level concepts, namely, "Skill meta-competencies." "Skill meta-competencies" was recategorized for data validation and reliability assurance. Nine assessment tools were selected based on participant criteria.

RESULTS

In total, 189 types of skill performances were extracted from the nine tool descriptions and organized into the following five competencies: (1) Tissue handling, (2) Psychomotor skill, (3) Efficiency, (4) Dissection quality, and (5) Exposure quality. The evolutionary importance of these competences' different evaluation targets and purpose over time were assessed; the results showed relatively high reliability, indicating that the categorization was reproducible. The inclusion of basic (tissue handling, psychomotor skill, and efficiency) and advanced (dissection quality and exposure quality) skills in these competencies enhanced the tools' comprehensiveness.

CONCLUSIONS

The competencies identified to help surgeons formalize and implement tacit knowledge of operative performance are highly reproducible. These results can be used to form the basis of an automated skill evaluation system and help surgeons improve the provision of care and training, consequently, improving patient prognosis.

Ticket to perform: an explorative study of trainees' engagement in and transfer of surgical training

BACKGROUND

Research suggests that simulation-based surgical skills training translates into improved operating room performance. Previous studies have predominantly focused on training methods and design and subsequent assessable performances and outcomes in the operating room, which only covers some aspects of training engagement and transfer of training. The purpose of this qualitative study was to contribute to the existing body of literature by exploring characteristics of first-year trainees' engagement in and perceptions of transfer of surgical skills training.

METHODS

We conducted an explorative study based on individual interviews with first-year trainees in General Surgery, Urology, and Gynaecology and Obstetrics who participated in a laparoscopic skills training program. Informants were interviewed during and two months after the training program. A thematic cross-case analysis was conducted using systematic text condensation.

RESULTS

We interviewed 12 informants, which produced 24 transcripts for analysis. We identified four main themes: (1) sportification of training, (2) modes of orientation, (3) transferrable skills, and (4) transfer opportunities. Informants described their surgical training using sports analogies of competition, timing, and step-by-step approaches. Visual orientations, kinaesthetic experiences, and elicited dialogues characterised training processes and engagement. These characteristics were identified in both the simulated and the clinical environment. Experiences of specific skills transfer included ambidexterity, coordination, instrument handling, and visuospatial ability. General transfer experiences were salient in informants' altered training approaches. Informants considered the simulation-based training an entry ticket to perform in the operating room and mentioned supervisor-trainee relationships and opportunities in the workplace as critical conditions of transfer.

CONCLUSIONS

Our findings elucidate characteristics of surgical training engagement that can be interpreted as self-regulated learning processes that transcend surgical training environments. Despite appreciating the immediate skills improvements resulting from training, trainees' narratives reflected a struggle to transfer their training to the clinical setting. Tensions existed between perceptions of transferable skills and experiences of transfer within the clinical work environments. These results resonate with research emphasising the importance of the work environment in the transfer process. Our findings provide insights that may inform the development of training programs that support self-regulated learning and transfer of training from the simulated to the clinical environment.

Hybrid PBL and Pure PBL: Which one is more effective in developing clinical reasoning skills for general medicine clerkship?-A mixed-method study

This study aims to compare the effectiveness of Hybrid and Pure problem-based learning (PBL) in teaching clinical reasoning skills to medical students. The study sample consisted of 99 medical students participating in a clerkship rotation at the Department of General Medicine, Chiba University Hospital. They were randomly assigned to Hybrid PBL (intervention group, n = 52) or Pure PBL group (control group, n = 47). The quantitative outcomes were measured with the students' perceived competence in PBL, satisfaction with sessions, and self-evaluation of competency in clinical reasoning. The qualitative component consisted of a content analysis on the benefits of learning clinical reasoning using Hybrid PBL. There was no significant difference between intervention and control groups in the five students' perceived competence and satisfaction with sessions. In two-way repeated measure analysis of variance, self-evaluation of competency in clinical reasoning was significantly improved in the intervention group in "recalling appropriate differential diagnosis from patient's chief complaint" (F(1,97) = 5.295, p = 0.024) and "practicing the appropriate clinical reasoning process" (F(1,97) = 4.016, p = 0.038). According to multiple comparisons, the scores of "recalling appropriate history, physical examination, and tests on clinical hypothesis generation" (F(1,97) = 6.796, p = 0.011), "verbalizing and reflecting appropriately on own mistakes," (F(1,97) = 4.352, p = 0.040) "selecting keywords from the whole aspect of the patient," (F(1,97) = 5.607, p = 0.020) and "examining the patient while visualizing his/her daily life" (F(1,97) = 7.120, p = 0.009) were significantly higher in the control group. In the content analysis, 13 advantage categories of Hybrid PBL were extracted. In the subcategories, "acquisition of knowledge" was the most frequent subcategory, followed by "leading the discussion," "smooth discussion," "getting feedback," "timely feedback," and "supporting the clinical reasoning process." Hybrid PBL can help acquire practical knowledge and deepen understanding of clinical reasoning, whereas Pure PBL can improve several important skills such as verbalizing and reflecting on one's own errors and selecting appropriate keywords from the whole aspect of the patient.

Can teaching serious illness communication skills foster multidimensional empathy? A mixed-methods study

BACKGROUND

To investigate the impact of a serious illness communication skills training course on medical students' attitudes regarding clinical empathy, self-efficacy in empathic communication, and learning on different dimensions of empathy.

METHODS

A mixed-methods design was used. A blended learning Serious Illness Communication Skills Training (SI-CST) course was delivered to sixth-year medical students. Students (n=185) completed questionnaires with the 20-item Jefferson Scale of Empathy (JSE) and self-rated preparedness level for five empathic communication tasks at baseline (T1), six weeks (T2), and three-to-six months post-training (T3). Written reflections on key lessons learned were analyzed using inductive thematic analysis.

RESULTS

Total JSE scores significantly improved from T1 to T2 (111.4 vs 113.9, P=.01) and from T1 to T3 (111.4 vs 113.9, P=.01). There was an increase in Standing in Patient's Shoes subscale of the JSE with an effect size of 0.56 whereas the Perspective-Taking and Compassionate Care subscales showed no significant changes. Self-rated preparedness for all five empathic communication tasks significantly improved from T1 to T2 (P ≤ .001) and from T1 to T3 (P ≤ .001) with large effect sizes (1.09-1.41). Four key themes emerged from the qualitative analysis. They were appreciating the important role of empathy in clinical care (moral empathy), learning skills in detecting and understanding patient emotions (cognitive empathy), learning skills in responding to emotion with empathy (behavioral empathy), and appreciating that communication skills can be improved with continual practice and self-reflection.

CONCLUSIONS

Our results revealed that SI-CST improved medical students' empathic attitudes and self-efficacy in empathic communication. Qualitative results found learning on the cognitive, behavioral and moral dimensions of empathy.

Researching the application of virtual reality in medical education: one-year follow-up of a randomized trial

BACKGROUND

Compared with traditional tendon repair teaching methods, using a virtual reality (VR) simulator to teach tendon suturing can significantly improve medical students' exercise time, operation flow and operation knowledge. At present, the purpose of this study is to explore the long-term influence of VR simulator teaching on the practice performance of medical students.

METHOD

This is a one-year long-term follow-up study of a randomized controlled study. A total of 117 participants who completed the initial study were invited to participate in the follow-up study. Participants in the VR group and the control group were required to complete a questionnaire developed by the authors and the teachers in the teaching and research department and to provide their surgical internship scores and Objective Structure Clinical Examination(OSCE) graduation scores.

RESULTS

Of the 117 invitees, 108 completed the follow-up. The answers to the questions about career choice and study habits were more positive in the VR group than in the control group (p < 0.05). The total score for clinical practice in the VR group was better than that in the control group, and the difference was statistically significant (p < 0.05). In the OSCE examination, the scores for physical examination, suturing and knotting and image reading were higher in the VR group than in the control group, and the difference was statistically significant (p < 0.05).

CONCLUSION

The results of the one-year long-term follow-up indicated that compared with medical students experiencing the traditional teaching mode, those experiencing the VR teaching mode had more determined career pursuit and active willingness to learn, better evaluations from teachers in the process of surgical clinical practice, and better scores in physical examination, suturing and knotting and image reading in the OSCE examination. In the study of nonlinear dynamics to cultivate a good learning model for medical students, the VR teaching model is expected to become an effective and stable initial sensitive element.

TRIAL REGISTRATION

Chinese Clinical Trial Registry(25/05/2021, ChiCTR2100046648); http://www.chictr.org.cn/hvshowproject.aspx?id=90180 .

Origami Box Folding Exercise: A laparoscopic box simulation training and assessment method in facilitating laparoscopic psychomotor skills with minimal preparation

OBJECTIVE

Laparoscopic box simulation training is widely recognized as an assessment tool to facilitate psychomotor skills especially for novice surgeons. However, current commercialized training modules including pegs, gauze, clips, pins etc. are generally costly and relatively inaccessible. We introduce a simple and pioneer surgical training drill, the Origami Box Folding Exercise (OBFE), based on the validated evaluating system of objective structured assessment of technical skills (OSATS) constructed with the scoring system of procedure-specific checklist (PSC) and global rating scale (GRS).

MATERIALS AND METHODS

Face and content validation of the OBFE and OSATS are evaluated by five endoscopic experts from two medical centers in Taiwan. This is a prospective observational study analyzing the pre-test/post-test result of OBFE from 37 participants in two individual workshops as training and evaluating method for laparoscopic psychomotor skills. Both the pre and post tests are video recorded with a time limit of 5 min graded by two independent evaluators based on the OSATS scoring system.

RESULTS

The reliability of PSC, GRS, and intergroup value between PSC and GRS were 0.923, 0.926 and 0.933, respectively. Inter-rater reliability of PSC, GRS, and both were 0.985, 0.932 and 0.977, respectively. Construct validity of PSC and GRS were statistically significant, with p-value 0.006 and 0.001, respectively.

CONCLUSION

OBFE enhances laparoscopic psychomotor skills with requirement of a single piece of paper. The associated OSATS tool for a 5-min OBFE test was validated. OBFE training is an efficient training and assessment system to promote psychomotor skills in laparoscopic box simulation drill which requires simple and economical preparation.

Clinical Stress and Clinical Performance in Prelicensure Nursing Students: A Systematic Review

BACKGROUND

Stress within clinical learning environments often has been associated with nursing education. However, in the past decade, the perceived stress levels of prelicensure nursing students have not only been sustained, they have actually increased. Increased and sustained stress levels negatively affect nursing students' perceptions of their competence, confidence, and ultimately, their clinical performance.

METHOD

A systematic review of the relationship between nursing students' perceived clinical stress and perceived clinical performance was conducted following PRISMA guidelines.

RESULTS

The review highlighted what is currently known about the relationship between perceived clinical stress in prelicensure nursing students and perceived clinical performance, providing implications for future research in clinical education. Three main themes were identified: nursing student gender, academic year, and clinical skill preparation.

CONCLUSION

Future research with rigorous methodological designs is necessary to examine the relationship between perceived clinical stress in prelicensure nursing students and perceived clinical performance. [J Nurs Educ. 2023;62(1):36-41.].

Utilization of Video Otoscopes for Otoscopy Skills Training of Third Year Medical Students

Purpose

Effective teaching and assessment of otologic examinations are challenging. Current methods of teaching otoscopy using traditional otoscopes have significant limitations. We hypothesized that use of all-in-one video otoscopes provides students with an opportunity for real-time faculty feedback and re-practicing of skills, increasing self-reported confidence.

Methods

An otoscopy microskills competency checklist was provided to third-year medical students during their pediatric clerkship to self-assess otoscopy technique during patient examinations, and to clinical preceptors to assess and provide feedback during exams. Over the course of two years, we collected data from students randomly assigned to train on a video otoscope or a traditional otoscope during the clerkship. Pre- and post-clerkship surveys measured confidence in performing otoscopy microskills, making a diagnosis and documentation of findings. For those students who trained on the video otoscope, we solicited post-clerkship feedback on the experience of using a video otoscope.

Results

Pre-clerkship confidence did not differ between the groups, but the video otoscope trained group had significantly higher scores than the traditional otoscope trained group on all self-reported technical and diagnostic microskills confidence questions items post-clerkship. Students trained on video otoscopes had a significant increase in confidence with all microskills items (p-values<0.001), however confidence in the traditional otoscope trained group did not change over time (p-values>0.10). Qualitative feedback from the video otoscope trained group reflected positive experiences regarding "technique/positioning" and "feedback from preceptors.".

Conclusion

Teaching otoscopy skills to pediatric clerkship medical students using a video otoscope significantly enhanced confidence compared to those training on a traditional otoscope by 1. enabling preceptors and students to simultaneously visualize otoscopy findings 2. allowing preceptors to provide real-time feedback and 3. providing opportunity for deliberate practice of microskills. We encourage the use of video otoscopes to augment student confidence and self-efficacy when training in otoscopy.

The use of an educational time-out in thyroid and parathyroid surgery to move the needle in periprocedural education

BACKGROUND

As surgical training shifts toward a competency-based paradigm, deliberate practice for procedures must be a point of focus. The purpose of this study was to assess the impact of an educational time-out intervention on educational experience and operative performance in endocrine surgery.

METHODS

For 12 months, third-year general surgery residents used the educational time-out to establish an operative step of focus for thyroidectomy and parathyroidectomy procedures. Data were collected using the System for Improving and Measuring Procedural Learning application and post-rotation surveys. The Zwisch scale was used to classify supervision, with meaningful autonomy defined as passive help or supervision only.

RESULTS

Eight residents and 3 attending surgeons performed the educational time-out for a total of 211 operations (93% completion rate). At the end of each rotation, there was improvement in the frequency of goal setting. There was strong agreement (90%) that the intervention strengthened the educational experience. For most cases (52%), the residents were rated at active help. Residents performed a median of 3/6 thyroidectomy steps at meaningful autonomy and a median of 2/5 parathyroidectomy steps at meaningful autonomy. Review of the qualitative data revealed that optimal feedback was provided in 46% of cases.

CONCLUSION

The educational time-out strengthened educational experiences. Stepwise procedural data revealed the varying levels of supervision that exist within an operation. Broader implementation of this intervention could facilitate competency-based procedural education.

Twelve tips for developing a systematic acute care curriculum for medical students

There are inadequacies in the practice-readiness of junior doctors for providing acute care in areas of clinical deterioration. In addition, the existing undergraduate curricula are fragmented in how acute care is taught in medical schools. We propose twelve tips for developing a systematic acute care curriculum, including what to teach, how to teach it and, how to assess. Furthermore, we propose and incorporate an acute care learning dashboard as an assessment tool which collates and demonstrates the occurrence of learning, faculty feedback, and students' reflection. We also summarise the existing online resources available for acute care training. We hope to address the existing issues and improve acute care training to prepare the graduates to become practice-ready professionals.

Am I doing this right? Structured self-assessment during simulation training of mastoidectomy improves cadaver dissection performance: a prospective educational study

PURPOSE

Temporal bone surgery requires excellent surgical skills and simulation-based training can aid novices' skills acquisition. However, simulation-based training is challenged by early stagnation of performance after few performances. Structured self-assessment during practice might enhance learning by inducing reflection and engagement in the learning task. In this study, structured self-assessment was introduced during virtual reality (VR) simulation of mastoidectomy to investigate the effects on subsequent performance during cadaveric dissection.

METHODS

A prospective educational study with comparison with historical controls (reference cohort). At a temporal bone dissection course, eighteen participants performed structured self-assessment during 3 h of VR simulation mastoidectomy training before proceeding to cadaver dissection (intervention cohort). At a previous course, eighteen participants received identical VR simulation training but without the structured self-assessment (reference cohort). Final products from VR simulation and cadaveric dissection were recorded and assessed by two blinded raters using a 19-point modified Welling Scale.

RESULTS

The intervention cohort completed fewer procedures (average 4.2) during VR simulation training than the reference cohort (average 5.7). Nevertheless, the intervention cohort achieved a significantly higher average performance score both in VR simulation (11.1 points, 95% CI [10.6-11.5]) and subsequent cadaveric dissection (11.8 points, 95% CI [10.7-12.8]) compared with the reference cohort, who scored 9.1 points (95% CI [8.7-9.5]) during VR simulation and 5.8 points (95% CI [4.8-6.8]) during cadaveric dissection.

CONCLUSIONS

Structured self-assessment is a valuable learning support during self-directed VR simulation training of mastoidectomy and the positive effect on performance transfers to subsequent cadaveric dissection performance.

Developing artificial intelligence models for medical student suturing and knot-tying video-based assessment and coaching

BACKGROUND

Early introduction and distributed learning have been shown to improve student comfort with basic requisite suturing skills. The need for more frequent and directed feedback, however, remains an enduring concern for both remote and in-person training. A previous in-person curriculum for our second-year medical students transitioning to clerkships was adapted to an at-home video-based assessment model due to the social distancing implications of COVID-19. We aimed to develop an Artificial Intelligence (AI) model to perform video-based assessment.

METHODS

Second-year medical students were asked to submit a video of a simple interrupted knot on a penrose drain with instrument tying technique after self-training to proficiency. Proficiency was defined as performing the task under two minutes with no critical errors. All the videos were first manually rated with a pass-fail rating and then subsequently underwent task segmentation. We developed and trained two AI models based on convolutional neural networks to identify errors (instrument holding and knot-tying) and provide automated ratings.

RESULTS

A total of 229 medical student videos were reviewed (150 pass, 79 fail). Of those who failed, the critical error distribution was 15 knot-tying, 47 instrument-holding, and 17 multiple. A total of 216 videos were used to train the models after excluding the low-quality videos. A k-fold cross-validation (k = 10) was used. The accuracy of the instrument holding model was 89% with an F-1 score of 74%. For the knot-tying model, the accuracy was 91% with an F-1 score of 54%.

CONCLUSIONS

Medical students require assessment and directed feedback to better acquire surgical skill, but this is often time-consuming and inadequately done. AI techniques can instead be employed to perform automated surgical video analysis. Future work will optimize the current model to identify discrete errors in order to supplement video-based rating with specific feedback.

Exploring the Study of Simulation as a Continuing Professional Development Strategy for Physicians

INTRODUCTION

Practicing physicians have the responsibility to engage in lifelong learning. Although simulation is an effective experiential educational strategy, physicians seldom select it for continuing professional development (CPD) for reasons that are poorly understood. The objective of this study was to explore existing evidence on simulation-based CPD and the factors influencing physicians' engagement in simulation-based CPD.

METHODS

A scoping review of the literature on simulation-based CPD included MEDLINE, Embase, and CINAHL databases. Studies involving the use of simulation for practicing physicians' CPD were included. Information related to motivations for participating in simulation-based CPD, study objectives, research question(s), rationale(s), reasons for using simulation, and simulation features was abstracted.

RESULTS

The search yielded 8609 articles, with 6906 articles undergoing title and abstract screening after duplicate removal. Six hundred sixty-one articles underwent full-text screening. Two hundred twenty-five studies (1993-2021) were reviewed for data abstraction. Only four studies explored physicians' motivations directly, while 31 studies described incentives or strategies used to enroll physicians in studies on simulation-based CPD. Most studies focused on leveraging or demonstrating the utility of simulation for CPD. Limited evidence suggests that psychological safety, direct relevance to clinical practice, and familiarity with simulation may promote future engagement.

DISCUSSION

Although simulation is an effective experiential educational method, factors explaining its uptake by physicians as a CPD strategy are unclear. Additional evidence of simulation effectiveness may fail to convince physicians to participate in simulation-based CPD unless personal, social, educational, or contextual factors that shape physicians' motivations and choices to engage in simulation-based CPD are explored.

"Technology Proficiency" in Medical Education: Worthiness for Worldwide Wonderful Competency and Sophistication

PURPOSE

Advances in bioinformatics, information technology, advanced computing, imaging techniques are changing fundamentally the way physicians define, diagnose, treat, and prevent disease. New disciplines - Artificial Intelligence, Machine Learning, Computational Biology - are improving healthcare. Digital health solutions have immense scope. Education and practice need to keep pace.

METHODS

We aimed at assessment of "Technology proficiency" required by medical graduates and its implementation, if found useful. All this in a conceptual framework of "TP" model, having categories (a) proper assessment (b) pertinent treatment (c) progress monitoring (d) prevention applications (e) professional standards. A search of the literature was performed using MedLine & Cochrane Central Register of Controlled Trials databases, for systematic reviews and meta-analysis articles published in the last five years using keyword "technology". Analysis of those relevant to the role all medical graduates should play. An analysis of worldwide statutory medical institutions guidelines.

RESULTS

Twenty-three systematic studies and meta-analysis were studied. Eighteen show clear evidence for 'Technology proficiency", while 5 recommend further studies. The findings are discussed suiting the roles of doctors in the "TP" model. Medical institutions guidelines worldwide diligence suggests need of including "Technology proficiency" as a definite and distinct strategic plan. Medical Council of India mandates "use information technology for appropriate patient care and continued learning". General Medical Council, UK and Medical Council India have been proactive in technology training. GMC recommends technology use for learning, prescribing, communication, and interpersonal skills. It should be expanding technology proficiency in practice as an essential professional capability.

CONCLUSION

"Technology proficiency" is found pertinently fruitful. It should be included as a definitive requirement and a distinct strategic plan worldwide. Modern curriculum development is proposed (i) Educational goals and objectives as the proposed Conceptual framework "Technology proficiency" model (ii) Instructional strategies 'Five Bs' (iii) Implementation 'Five Ms'.

Testing the feasibility, acceptability, and preliminary effect of a novel deliberate practice intervention to reduce diagnostic error in trauma triage: a study protocol for a randomized pilot trial

BACKGROUND

Non-compliance with clinical practice guidelines in trauma remains common, in part because physicians make diagnostic errors when triaging injured patients. Deliberate practice, purposeful participation in a training task under the oversight of a coach, effectively changes behavior in procedural domains of medicine but has rarely been used to improve diagnostic skill. We plan a pilot parallel randomized trial to test the feasibility, acceptability, and preliminary effect of a novel deliberate practice intervention to reduce physician diagnostic errors in trauma triage.

METHODS

We will randomize a national convenience sample of physicians who work at non-trauma centers (n = 60) in a 1:1 ratio to a deliberate practice intervention or to a passive control. We will use a customized, theory-based serious video game as the basis of our training task, selected based on its behavior change techniques and game mechanics, along with a coaching manual to standardize the fidelity of the intervention delivery. The intervention consists of three 30-min sessions with content experts (coaches), conducted remotely, during which physicians (trainees) play the game and receive feedback on their diagnostic processes. We will assess (a) the fidelity with which the intervention is delivered by reviewing video recordings of the coaching sessions; (b) the acceptability of the intervention through surveys and semi-structured interviews, and (c) the effect of the intervention by comparing the performance of trainees and a control group of physicians on a validated virtual simulation. We hypothesize that trainees will make ≥ 25% fewer diagnostic errors on the simulation than control physicians, a large effect size. We additionally hypothesize that ≥ 90% of trainees will receive their intervention as planned.

CONCLUSIONS

The results of the trial will inform the decision to proceed with a future hybrid effectiveness-implementation trial of the intervention. It will also provide a deeper understanding of the challenges of using deliberate practice to modify the diagnostic skill of physicians.

TRIAL REGISTRATION

Clinical trials.gov ( NCT05168579 ); 23 December 2021.

An Automated Virtual Reality Training System for Teacher-Student Interaction: A Randomized Controlled Trial

BACKGROUND

Shortages in qualified supervision and other resources prevent education personnel from rehearsing effective practices. Interactive simulations, although increasingly used in education, frequently require instructor management. Automated simulations rarely engage trainees in skills related to practice (eg, speech).

OBJECTIVE

We evaluated the capability of delivering behavioral skills training through an automated virtual reality (VR) simulation using artificial intelligence to improve the implementation of a nondirective mathematical questioning strategy.

METHODS

We recruited and randomly assigned 30 college-aged participants to equivalent treatment (ie, lecture, modeling, and VR; 15/30, 50%) and control groups (ie, lecture and modeling only; 15/30, 50%). The participants were blind to treatment conditions. Sessions and assessments were conducted face to face and involved the use of VR for assessment regardless of the condition. Lessons concerned the use of a nondirective mathematical questioning strategy in instances where a simulated student provided correct or incorrect answers to word problems. The measures included observed and automated assessments of participant performance and subjective assessments of participant confidence. The participants completed the pretest, posttest, and maintenance probes each week over the course of 3 weeks.

RESULTS

A mixed ANOVA revealed significant main effects of time (F_2,27=124.154; P<.001; η_p²=0.816) and treatment (F_1,28=19.281; P<.001; η_p²=0.408) as well as an interaction effect (F_2,28=8.429; P<.001; η_p²=0.231) for the average percentage of steps in the questioning procedure. Posttest scores for the intervention group (mean 88%, SD 22.62%) exceeded those of the control group (mean 63.33%, SD 22.64%), with t₂₈=3.653, P<.001, and Cohen d=1.334. Maintenance scores indicated a positive effect of the intervention (mean 83.33%, SD 24.40%) relative to the control (mean 54.67%, SD 15.98%), t₂₈=3.807, P<.001, Cohen d=1.39. A Mann-Whitney U test indicated that the treatment groups' self-ratings of confidence (mean 2.41, SD 0.51) were higher than those of the control group (mean 2.04, SD 0.52), U=64, P=.04, r=0.137.

CONCLUSIONS

The results demonstrate the potential of artificial intelligence-augmented VR to deliver effective, evidence-based training with limited instructor management. Additional work is needed to demonstrate the cascading effect of training on authentic practice and to encompass a wider range of skills.

Surgical residents' approach to training: are elements of deliberate practice observed?

Background: Deliberate practice research has consistently shown that intense, concentrated, goal-oriented practice in a focused domain, such as medicine, can improve skill development and performance. To date, little is known about how surgical residents approach their surgical training, how they evaluate their current weaknesses, and how they plan to transition from one milestone to another. Without knowledge of residents' role in their development, educators miss the opportunity to optimize progression of these lifelong learning skills. Therefore, the purpose of this study was to gain a better understanding of how surgical residents approach their surgical training from the perspective of the surgical residents themselves and to explore if elements of deliberate practice are observed. Methods: Eight surgical trainees participated in one of two focus groups depending on their training level (five junior residents; three senior residents). With the exploratory nature of this research, a focus group methodology was utilized. Results: By employing both deductive and inductive thematic analysis techniques, three themes were extracted from the data: learning resources and strategies, role of a junior/senior, and approaching weaknesses. Conclusions: Although elements of deliberate practice were discussed, higher functioning is necessary to achieve performance excellence, leading to improved patient outcomes.

The impact of teacher's presence on learning basic surgical tasks with virtual reality headset among medical students

BACKGROUND

The aim of this study was to investigate whether the presence of a teacher affects learning related outcomes in teaching basic surgical tasks with a Virtual Reality (VR) headset.

METHODS

26 fourth-year medical studentsparticipated in a voluntary exercise. Students practiced basic surgical procedure exercises using the VR4HEALTHCARE application in VR with OCULUS Rift S glasses. 12 students performed the exercises under the guidance of a teacher and 14 without the teacher present. After the exercise, the groups filled out a feedback form. Statistical analysis was performed using IBM SPSS Statistics 25.0 software using the Mann-Whitney U test and multivariate analysis of variance.

RESULTS

The most important data collected related to whether the student learned something new and whether VR adds value to medical education. Ratings were based on a scale of 0-10 (0 = worst, 10 = best). When the teacher was present, on average, the students felt that they were learning something new and gave an average rating of 7.8 ± 1.8, and when the teacher was not present 5.3 ± 2.6 (p = 0.003). VR added value to teaching with a rating of 7.8 ± 1.7 when the teacher was present and 5.5 ± 3.0 when not present (p = 0.045). This study also analyzed specific use of VR for abscess incision, suturing and insertion of a suprapubic catheter.

DISCUSSION

When a teacher was present VR added value to teaching and the usefulness and usability of VR was experienced more positively. The student should also have adequate knowledge of the subject to be taught before VR training.

CONCLUSIONS

VR adds value to teaching, but VR exercises may not completely replace high-quality traditional teaching methods. Consequently, it is important to determine the differences between VR and traditional teaching methods and how to combine these methods in the future.

How I Teach: Ultrasound-guided Peripheral Venous Access

Ultrasound-guided peripheral intravenous (IV) placement is often required for patients with difficult IV access and is associated with a reduction in central line placement. Despite the importance, there is no standardized technical approach, and there is limited ability to attain mastery through simulation. We describe our step-by-step approach for teaching ultrasound-guided IV placement at the bedside using short-axis dynamic guidance, with emphasis on advancing the needle and catheter device almost entirely into the vessel before threading the catheter. Our teaching approach allows the opportunity for trainees to maximize the learning potential of a single insertion experience, which includes focused preprocedure hands-on practice, instruction with real-time feedback at the bedside, and a post-procedure debrief with reinforcement of concepts.

Bridging simulation technology with positive behavioral supports to promote student engagement and behavior

Simulation technology provides opportunities for teachers to engage in extended practice using positive behavioral supports to promote student engagement and behavior. These training models are rapidly emerging and if effective, create an infrastructure for scaling up positive behavioral supports in classrooms and schools. However, there is limited research examining teacher skill transfer or student outcomes. This study examined the incremental benefits of Interactive Virtual Training for Teachers (IVT-T) in combination with professional learning communities (PLCs) in one high poverty school district. Using a quasi-experimental design, teachers (N = 90; n = 52 IVT-T + PLC condition; n = 38 PLC condition) and students (N = 100; n = 60 IVT-T + PLC condition; n = 40 PLC only) participated across six K-8 schools. Both training conditions were rated as moderately acceptable. One and two-level generalized linear models indicated teachers who used IVT-T increased their use of praise (b = 0.75, p = .03) and decreased their use of behavioral corrective feedback (b = -0.32, p = .02). Their students were also more passively engaged (b = 0.42, p = .05) and showed fewer inappropriate physical behaviors (b = -0.87, p = .002). IVT-T hours predicted increases in praise statements (b = 0.07, p < .001) and decreases in vague directives (b = -0.07, p = .006) whereas PLC hours predicted increases in teachers' use of vague directives (b = 0.07, p = .05). There was a significant positive effect of IVT-T hours on student passive engagement (b = 0.04, p = .01) and a negative effect of PLC hours on rates of inappropriate physical behaviors (b = 0.1, p = .04). Study limitations and future directions for research and practice are discussed.

Teaching, coaching, or debriefing With Good Judgment: a roadmap for implementing "With Good Judgment" across the SimZones

Simulation-based learning occurs in multiple contexts, and one teaching style cannot adequately cover the needs at each learning level. For example, reflective debriefing, often used following a complex simulation case, is not what is needed when learning new skills. When to use which facilitation style is a question that educators often overlook or struggle to determine. SimZones is a framework used to clarify the multiple contexts in simulation. This framework, combined with elements of Debriefing With Good Judgment, can help educators match the appropriate facilitation style with learner needs and learning context. We have distilled the core elements of the "with good judgment" approach to debriefing and applied them to the SimZones framework to guide educators with (1) what type of learning can be expected with each learning context, (2) what behaviors and activities can be expected of the learners in each learning context, (3) what instructional strategies are most effectively used at each stage, and (4) what are the implications for the teacher-learner relationship.

Best Practices in Medical Documentation: A Curricular Module

OBJECTIVE

To create and validate a checklist for high-quality documentation and pilot a multi-modal, immersive educational module across multiple institutions. We hypothesized that this module would improve knowledge, skills, and attitudes in medical documentation.

METHODS

Module design was grounded in an established curriculum design framework. We conducted the study across 12 pediatric critical care fellowship programs between September 2017 and January 2018. Workshops were allotted 90 minutes for completion. We utilized a pre-/post- study design to determine the workshop's impact. Changes in knowledge were assessed through pre and post testing. Changes in skills were evaluated with a validated checklist for inclusion of key documentation elements. Changes in attitudes were determined through learner self-assessment RESULTS: 83 of 138 eligible fellows (60%) started the module and 62 of 83 (75%) completed data sets for analysis. Immediate post-testing demonstrated modest statistically significant improvement in knowledge, skills, and attitudes. The workshop was easily disseminated and deployed CONCLUSIONS: This study demonstrates that a multi-modal educational intervention can lead to improvement in medical documentation knowledge, skills, and attitudes in a cohort of PCCM fellows and be easily disseminated for use by other specialties and types of clinicians.