Learn, see, practice, prove, do, maintain: an evidence-based pedagogical framework for procedural skill training in medicine

Instructional design features in ultrasound-guided regional anaesthesia simulation-based training: a systematic review

INTRODUCTION

Ultrasound-guided regional anaesthesia enhances pain control, patient outcomes and lowers healthcare costs. However, teaching this skill effectively presents challenges with current training methods. Simulation-based medical education offers advantages over traditional methods. However, the use of instructional design features in ultrasound-guided regional anaesthesia simulation training has not been defined. This systematic review aimed to identify and evaluate the prevalence of various instructional design features in ultrasound-guided regional anaesthesia simulation training and their correlation with learning outcomes using a modified Kirkpatrick model.

METHODS

A comprehensive literature search was conducted including studies from inception to August 2024. Eligibility criteria included randomised controlled trials; controlled before-and-after studies; and other experimental designs focusing on ultrasound-guided regional anaesthesia simulation training. Data extraction included study characteristics; simulation modalities; instructional design features; and outcomes.

RESULTS

Of the 2023 articles identified, 62 met inclusion criteria. Common simulation modalities included live-model scanning and gel phantom models. Instructional design features such as the presence of expert instructors, repetitive practice and multiple learning strategies were prevalent, showing significant improvements across multiple outcome levels. However, fewer studies assessed behaviour (Kirkpatrick level 3) and patient outcomes (Kirkpatrick level 4).

DISCUSSION

Ultrasound-guided regional anaesthesia simulation training incorporating specific instructional design features enhances educational outcome; this was particularly evident at lower Kirkpatrick levels. Optimal combinations of instructional design features for higher-level outcomes (Kirkpatrick levels 3 and 4) remain unclear. Future research should standardise outcome measurements and isolate individual instructional design features to better understand their impact on clinical practice and patient safety.

Procedural Entrustment Alignment Between Pediatric Residents and Their Preceptors in the Pediatric Emergency Department

OBJECTIVE

Entrustment describes the balance of supervision and autonomy between resident and preceptor to complete doctoring tasks like procedures. Entrustment alignment between resident and preceptor facilitates safe, successful outcomes, and promotes learning. Study objectives describe procedural entrustment alignment between senior pediatric residents and their preceptors and report the impact of a simulation-based formative assessment (SFA) on entrustment alignment.

METHODS

This prospective observational study enrolled a convenience sample of senior pediatric residents in 2023. The SFA was videoed, consisted of obtaining informed consent and performing simulated procedures (laceration [LAC] and lumbar puncture [LP]). Residents self-assessed their entrustability pre/post-SFA. A PEM preceptor panel individually rated videos of the residents. PEM panel's scores were compared to residents' scores on both an 8-point scale and the dichotomized variable of needing "in versus out" of the room entrustment.

RESULTS

Twenty-four residents' SFAs were rated by 9 panelists. Before the SFA, entrustment alignments on the 8-point scale were as follows: resident LAC 4.08 vs PEM panel 4.97 ( P  < 0.001), and resident LP 4.75 vs PEM panel 5.31 ( P  = 0.15). After the SFA, entrustment alignments were as follows: resident LAC 5.21 vs PEM panel 4.97 ( P  = 0.32), and resident LP 5.54 vs PEM panel 5.31 ( P  = 0.52). The dichotomized analyses revealed improved alignment post-SFA: LAC-pre-kappa = 0.03 vs LAC-post 0.46, and LP-pre-kappa = (-0.03) vs LP-post = 0.24.

CONCLUSIONS

Our findings indicate senior pediatric residents desire less entrustment (more supervision) for procedures but better align with preceptors after an SFA. This work offers insight into procedural entrustment decision making and the potential of SFA's to facilitate procedural learning.

Quality and accuracy of cardiopulmonary resuscitation teaching in short videos: an analysis across three major short video platforms

OBJECTIVE

Cardiopulmonary resuscitation (CPR) is vital for saving patients experiencing cardiac arrest. Teaching CPR skills through short videos offers numerous advantages. However, potential inaccuracies or misinformation could mislead the public and impact the effectiveness of CPR education. This study aims to evaluate the quality and accuracy of CPR instructional videos shared on three major short video platforms in China (TikTok, Bilibili, and REDnote), analyze common irregular or erroneous practices, and provide valuable suggestions for content optimization.

METHODS

The collected videos were evaluated using a five-point scoring criterion based on 2020 American Heart Association (AHA) Guidelines for Cardiopulmonary Resuscitation (CPR) and Emergency Cardiovascular Care (ECC). The videos were categorized into three levels: excellent, moderate, and poor, based on their video quality scores for CPR procedures and non-procedural content. Further categorization was made by video duration (≤5 min as short; >5 min as long). Additionally, the most critical and prevalent irregularities or errors were documented, and a detailed analysis of the most popular video from each platform was carried out. The relationship between video quality and popularity, and video duration and popularity were examined separately.

RESULTS

A total of 100 CPR instructional videos were analyzed. While 86% of the videos were produced by healthcare professionals, substantial errors were identified in critical areas such as the extra time spent removing foreign body airway obstruction (67%), and incorrect hand position during compression (62%). Other issues with non-procedural content were identified, including video acceleration (13%), lack of step-by-step explanations (61%), etc. Statistical analysis revealed no significant differences in popularity across videos of different quality or duration (p = 0.876 among video quality groups for CPR procedures, p = 0.988 among video quality groups for non-procedural content, p = 0.260 between video duration groups).

CONCLUSIONS

This study identified the necessity for improvements in CPR procedures and non-procedural content of CPR instructional videos. To enhance video quality, measures such as rigorous review mechanisms, public feedback and promotion of certified high-quality videos are recommended.

Application of peer-assisted learning under the LSPPDM mode in resident clinical skill training

BACKGROUND

Currently, several studies have explored the LSPPDM teaching model and peer-assisted learning to enhance teaching outcomes. Nevertheless, no study has integrated the LSPPDM model with peer mutual learning to explore its possible beneficial effects. The present study aims to explore the role of peer-assisted learning under the LSPPDM mode in improving the clinical competency of residents.

METHODS

A total of 129 residents of Zhongnan Hospital of Wuhan University were selected as study subjects, including 68 residents in Grade 2022 as the control group (traditional teaching mode) and 61 residents in Grade 2023 as the experimental group (peer-assisted learning under the LSPPDM mode). To compare the grades of the basic clinical skills course and the after-department examination performance of the two groups of residents and to analyze the residents' evaluation of the effectiveness of their teaching, questionnaires were used.

RESULTS

The experimental group achieved a significantly higher total score in the clinical basic skills course (90.62) compared to the control group (86.23, P < 0.05). The average scores of theory, skills and case reports of the residents in the experimental group were 83.75, 90.98 and 89.74, respectively, which were higher than the 82.83, 89.11 and 87.41, respectively, in the control group. The difference between the skill score and case report score was statistically significant (P < 0.05), and the theoretical score difference was not statistically significant (p = 0.476). Residents in the experimental group were significantly satisfied with each teaching session compared with the test value (4 points = satisfaction) (P < 0.001).

CONCLUSION

Peer-assisted learning under the LSPPDM mode significantly improves residents' clinical competency and achieves high satisfaction levels, offering valuable insights for optimizing clinical skill training in other hospitals.

Exploring the role of virtual reality in preparing emergency responders for mass casualty incidents

BACKGROUND

The increasing complexity of mass casualty incidents (MCIs) necessitates highly effective training for emergency responders. Traditional training methods, while effective in teaching core skills, often fail to replicate the dynamic, high-pressure environments responders face in real-world crises. Virtual reality (VR) offers a novel approach to emergency training, providing an immersive, controlled setting that can simulate real-life scenarios. This study explores the effectiveness of VR in training paramedic students for MCIs and compares the outcomes to those from conventional training methods.

METHODS

A comparative study was conducted with 37 paramedic students who underwent either VR-based training or conventional training using mannequins and real-world equipment. The VR application simulated a mass casualty car accident, focusing on triage and patient management. Both groups were assessed based on their performance in key areas, including the accuracy of situational reporting (METHANE), patient triage, heart rate monitoring, and perceived demand using the NASA Task Load Index (NASA-TLX).

RESULTS

The VR group demonstrated significantly lower mental demand (p < 0.001) and frustration levels (p = 0.021) compared to traditional training. However, task completion times were slower in the VR setting (p < 0.001), likely due to the interface's unfamiliarity. Accuracy in situational reporting was higher in VR (p = 0.002), while heart rate monitoring did not reveal a significant difference between the groups (p = 0.516). Although VR did not reduce temporal demand (p = 0.057), it showed potential for improving focus and precision in training. Error rates in triage were similar across both training methods (p = 0.882), indicating comparable performance levels in patient classification.

CONCLUSIONS

VR presents a promising tool for training emergency responders, particularly in situations that require rapid upskilling, such as crises or wars. The ability to simulate realistic, high-pressure scenarios in a controlled environment can enhance both cognitive and emotional preparedness. Further research is necessary to optimize VR systems and interfaces, making them more efficient for real-time decision-making. As VR technology advances, it holds potential as a key component in future emergency preparedness strategies.

How Does the Novice Become the Expert? An Instrumental Case Study of Procedural Educators

PURPOSE

The classic paradigm of procedural education in medical training has involved trainees learning and performing invasive bedside procedures and subsequently teaching these procedures to more junior trainees. Many existing resident-as-teacher curricula focus on cognitive domains; there has been a lack of literature examining the transition from learner to teacher in procedural education. This hypothesis-generating instrumental case study explored how expert procedural educators transitioned from novice procedural educators to experts.

METHOD

A constructivist approach with semistructured interviews was used to explore the individual narratives and experiences of faculty of the Hospitalist Procedure Service at the University of California San Francisco as they reflected on their journey from learners to teachers, focusing on the faculty of the hospitalist procedure team at the University of California San Francisco. All 12 Hospitalist Procedure Service faculty members received invitations to be interviewed, and 9 agreed to participate. Interviews were conducted between July and October 2023.

RESULTS

The 9 interviews created a rich and complex picture of the individual experiences and perceptions of procedural teaching. The faculty members varied in experience, ranging from 2 years on the procedure service faculty to more than 15 years of experience. Four main themes emerged from the interviews: methods for building teaching skills, tools that facilitate further educator growth, essential behaviors of effective educators, and common challenges. Inductive thematic analysis revealed trial and error as a major means of building procedural pedagogy and the use of precise communication as a crucial skill to manage learner cognitive load and the emotional challenges associated with learning and teaching procedures.

CONCLUSIONS

The use of precise communication as a tool for both educator and learner to navigate the complexities of procedural teaching highlights the essential role of clear instruction and feedback in the learning process.

Ultrasound in pediatric emergency medicine simulation: evaluation of a longitudinal curriculum

OBJECTIVES

Pediatric resuscitations involving shock and trauma are rare but they are high-stakes events in the pediatric emergency department (ED). Effective use of point-of-care ultrasound (POCUS) can expedite diagnosis and treatment in such cases. This study aimed to assess the impact of a longitudinal pediatric emergency medicine simulation curriculum and high-fidelity POCUS simulator on residents' clinical practice, comfort level, and motivation to learn resuscitative ultrasound.

METHODS

This mixed-methods study involved 12 pediatric emergency medicine residents who participated in a 12-month simulation curriculum integrating resuscitative ultrasound. The POCUS simulator was integrated and made available for use during all simulations. Assessment and program evaluation occurred at multiple levels, according to Kirkpatrick's hierarchy, using both qualitative and quantitative methods. The residents were surveyed at baseline, 4, 8 and 12 months. Semi-structured interviews were conducted at the end of the 12-month study period.

RESULTS

Twelve residents participated in 23 simulation cases over the 12-month longitudinal curriculum. The hybrid POCUS simulator was used by participants in 18/23 (78.2%) cases. Comparing pre- and post-curriculum changes, large effect sizes were seen in residents' comfort using ultrasound in resuscitation (including in cases of trauma and undifferentiated shock). Accordingly, the mean number of POCUS scans performed per resident clinically on shift increased from a mean (SD) of 5.7 (± 2.3) scans/month to 12.4 (± 5.1) scans/month. Qualitative analysis highlighted several themes, including the value of simulation for teaching the integration of resuscitative ultrasound in high-acuity low-occurrence events and the effect of repeat exposures to resuscitative ultrasound.

CONCLUSION

Our study demonstrated that a longitudinal, simulation-based curriculum focused on resuscitative ultrasound increased residents' confidence, their motivation and likelihood of using these skills in the clinical setting. Repeated simulation exposures to resuscitative ultrasound can help participants translate this critical skill into use at the bedside, especially in high-acuity low-occurrence events.

From Questions to Answers: Teaching Evidence-Based Medicine Question Formulation and Literature Searching Skills to First-Year Medical Students

Introduction

Medical students may arrive at medical school with some research background but not necessarily evidence-based medicine (EBM) skills. First-year preclinical medical students require foundational skills for EBM (formulating background and foreground questions, navigating information sources, and conducting database searches) before critically appraising evidence and applying it to clinical scenarios.

Methods

We developed a flipped classroom EBM workshop for preclinical students combining prework modules and a 60-minute in-person session. After completing the online modules on foundational EBM skills, students participated in an in-person activity based on patient cases. In small groups, students formulated background and foreground questions based on a case and looked for evidence in resources assigned to each group. Small groups reported back to the whole group how they searched for information for their patient cases. A total of 105 first-year medical students were required to complete this workshop after concluding their basic sciences courses.

Results

Because current EBM assessment tools do not assess the early steps of EBM, we developed an assessment tool for foundational EBM tools. Before the modules, students completed a pretest on formulating questions and searching for information. After the workshop, students completed a posttest. Students showed improvement in differentiating background and foreground questions (p < .001), formulating answerable clinical questions (p < .001), and developing appropriate database searches (p < .001 and p = .002).

Discussion

This flipped classroom approach to teaching foundational EBM skills may be adapted for different contexts, but educators should consider time limitations, group size, and tools for interactivity.

Curriculum mapping to audit and grow longitudinal graduate medical education leadership training

BACKGROUND

Residents need and want practical leadership training, yet leadership curricula are lacking in graduate medical education (GME). We describe our process of curriculum mapping, a method for auditing a curriculum, and its role in iterative leadership curriculum development.

AIMS

To show how to create a curriculum map for auditing a curriculum using examples from our leadership curriculum and to demonstrate its value through case examples of leadership education integration into existing resident experiences.

METHODS

We selected our recent systematic review on current leadership curricula to prioritise leadership content given it was the basis for our initial curriculum. We identified existing resident experiences where training can occur. We use the selected content and training environments, layered with a modified Miller's pyramid, to construct a curriculum map.

RESULTS

Our curriculum map provides an example of curriculum auditing that reveals opportunities for leadership training that could be integrated into current residency experiences. We provide case examples of application.

DISCUSSION

Effective leadership training should address critical topics and capitalise on experiential learning opportunities that exist within residency training programmes. The training must be seamlessly integrated into the demanding obligations of GME trainees, a process that can be achieved using curriculum mapping. Curriculum mapping can provide insight into a residency programme's leadership curriculum and create a direction for future leadership curriculum development.

Teaching Procedural Skills: Integrating Educational Theory Into Practice

Introduction

Teaching procedural skills is an essential part of health professions education, yet formal training is often lacking from traditional curricula.

Methods

A workshop on teaching procedural skills was developed as part of a clinician educator track at a large health professions university. Participants included medical residents and fellows (postgraduate years 2-6) from various training programs. The 90-minute, interactive training integrated Gagne's model of instructional design with evidence-based teaching practices. Workshop outcomes were evaluated with pre- and postworkshop surveys. Learner reactions (Kirkpatrick level 1) were assessed via course evaluation. Learning and behavior (Kirkpatrick level 2) were evaluated via attitudinal and knowledge-based questions. Data were collected from three cohorts of participants (2022-2024). Responses were analyzed by paired t test.

Results

Residents and fellows from 11 different disciplines participated in the workshops. The survey response rate was 30 out of 35 (86%). Course evaluations were positive for all six questions (mean scores: 4.8-5.0 on a 5-point Likert scale [1 = strongly disagree, 5 = strongly agree]). Postworkshop scores improved significantly for all five attitudinal questions, including "I can apply instructional design theory when teaching procedural skills" (pre: 2.2 vs. post: 4.3 on a 5-point scale, p < .01). The number of participants correctly answering the knowledge-based questions also increased following the workshop.

Discussion

A workshop focused on evidence-based teaching of procedural skills was well reviewed and improved participants' attitudes and knowledge. Strengths of the workshop include its appeal to a broad range of medical trainees, integration of educational theory, and interactive design.

2024 American Heart Association and American Red Cross Guidelines for First Aid

Codeveloped by the American Heart Association and the American Red Cross, these guidelines represent the first comprehensive update of first aid treatment recommendations since 2010. Incorporating the results of structured evidence reviews from the International Liaison Committee on Resuscitation, these guidelines cover first aid treatment for critical and common medical, traumatic, environmental, and toxicological conditions. This update emphasizes the continuous evolution of evidence evaluation and the necessity of adapting educational strategies to local needs and diverse community demographics. Existing guidelines remain relevant unless specifically updated in this publication. Key topics that are new, are substantially revised, or have significant new literature include opioid overdose, bleeding control, open chest wounds, spinal motion restriction, hypothermia, frostbite, presyncope, anaphylaxis, snakebite, oxygen administration, and the use of pulse oximetry in first aid, with the inclusion of pediatric-specific guidance as warranted.

Evaluation of high-fidelity and virtual reality simulation platforms for assessing fourth-year medical students' encounters with patients in need of urgent or emergent care

BACKGROUND

Medical students in the U.S. must demonstrate urgent and emergent care competence before graduation. Urgent and emergent care competence involves recognizing, evaluating and initiating management of an unstable patient. High-fidelity (HF) simulation can improve urgent and emergent care skills, but because it is resource intense, alternative methods are needed.

STUDY OBJECTIVE

Our primary purpose was to use program evaluations to compare medical student experiences with HF and virtual reality (VR) simulations as assessment platforms for urgent and emergent care skills.

METHODS

During their emergency medicine clerkship, students at The Ohio State University College of Medicine must demonstrate on HF manikins, competence in recognizing and initiating care of a patient requiring urgent or emergent care. Students evaluated these simulations on a five-point quality scale and answered open-ended questions about simulation strengths and weaknesses. Faculty provided feedback on student competence in delivering urgent or emergent care. In 2022, we introduced VR as an alternative assessment platform. We used Wilcoxon Signed Ranks and Boxplots to compare ratings of HF to VR and McNemar Test to compare competence ratings. Comments were analyzed with summative content analysis or thematic coding.

RESULTS

We received at least one evaluation survey from 160 of 216 (74.1%) emergency medicine clerkship students. We were able to match 125 of 216 (57.9%) evaluation surveys for students who completed both. Average ratings of HF simulations were 4.6 of 5, while ratings of VR simulations were slightly lower at 4.4. Comments suggested that feedback from both simulation platforms was valued. Students described VR as novel, immersive, and good preparation for clinical practice. Constructive criticism identified the need for additional practice in the VR environment. Student performance between platforms was significantly different with 91.7% of students achieving competence in HF, but only 65.5% in VR (p≤.001, odds-ratio = 5.75).

CONCLUSION

VR simulation functions similarly to HF for formative assessment of urgent and emergent care competence. However, using VR simulation for summative assessment of urgent and emergent care competence must be considered with caution because students require considerable practice and acclimation to the virtual environment.

A Pilot Study of a Simulation-Based Mastery Learning Procedural Curriculum for Pediatric Emergency Medicine Fellows

OBJECTIVES

Pediatric emergency medicine (PEM) fellows are expected to perform high-risk procedures across a wide range of patient age, size, and physiology including procedures that are no longer required during pediatric residency training. Examples include central venous catheter (CVC) placement, endotracheal intubation of children and adolescents, and tube thoracostomy placement. Simulation-based mastery learning has demonstrated decreased patient morbidity. In this study, we describe implementation of a simulation-based mastery learning (SBML) procedural curriculum for PEM fellows.

METHODS

Our PEM fellows underwent an SBML procedural curriculum for lumbar puncture (LP), CVC placement, endotracheal intubation, and tube thoracostomy placement. These procedures are mandatory for fellows to learn, have known association with potential iatrogenic injury, and are widely available commercial task trainers. Fellows underwent baseline assessments, group demonstration, deliberate practice, and then postassessments. For both pre- and postassessments, we used internally developed checklists with minimum passing scores (MPSs) calculated by the Mastery-Angoff technique.

RESULTS

Nineteen pediatrics residency-trained PEM fellows underwent this curriculum over a 2-year period. Six fellows (31.58%) achieved the MPS on all four procedures during their first posttest attempt. All fellows achieved the MPS on all four procedures by the second posttest attempt. Most fellows (17/19 or 89.47%) did not achieve the MPS on baseline LP assessments, despite inclusion of this procedure as an Accreditation Council of Graduate Medical Education (ACGME) requirement during their pediatric residency training.

CONCLUSIONS

All participating PEM fellows demonstrated competency after training on four procedures associated with iatrogenic injuries. Using an SBML framework is a feasible method to teach procedural skills to PEM fellows, allowing them to demonstrate objective measures of competency in the simulation laboratory.

Comparing didactic approaches for practical skills learning in Scandinavian nursing simulation centres: A qualitative comparative study

AIM

To explore and compare the didactic approaches to practical skills learning at simulation centres in Scandinavian universities and university colleges.

BACKGROUND

Academic simulation centres are an important arena for learning practical nursing skills which are essential to ensure competent performance regarding patient safety and quality of care. Knowledge of didactic approaches to enhance learning is essential in promoting the provision and retention of students' practical nursing skills. However, research on didactical approaches to practical nursing skills learning is lacking.

DESIGN

A qualitative comparative design was used.

METHODS

During November and December 2019, interviews were conducted with a total of 37 simulation centre directors or assistant directors, each of whom possessed in-depth knowledge of practical skills in teaching and learning. They represented bachelor nursing education in Denmark, Norway and Sweden. A qualitative deductive content analysis was conducted.

RESULTS

The results revealed all five predetermined didactical components derived from the didactical relationship model. Twenty-two corresponding categories that described a variation in didactic approaches to practical skills learning in Scandinavian nursing simulation centres were identified. The didactical components of Learning process revealed mostly similarities, Setting mostly differences and Assessment showed only differences in didactic approaches.

CONCLUSION

Although various didactic approaches were described across the countries, no common approach was found. Nursing educational institutions are encouraged to cooperate in developing a shared understanding of how didactic approaches can enhance practical skills learning.

IMPLICATIONS FOR PROFESSION AND/OR PATIENT CARE

Cross-country comparisons of practical nursing skills learning in Scandinavian countries highlight the importance of educator awareness concerning the impact diverse didactic approaches may have on competent performance in nursing education. Competent performance is pivotal for ensuring patient safety and the provision of high-quality care.

PATIENT OR PUBLIC CONTRIBUTION

No Patient or Public Contribution.

REPORTING METHOD

This study followed the Consolidated Criteria for Reporting Qualitative Research reporting guidelines.

Evaluating the Confidence of Non-specialty Doctors Working in Trauma and Orthopedics in Performing Knee Arthrocentesis Through Simulation-Based Teaching

Introduction Acute monoarthropathies that present in emergency settings include septic arthritis, where urgent joint arthrocentesis is the diagnostic gold standard. Literature indicates low confidence among trainee doctors in performing knee aspirations. Simulation-based teaching can be used to supplement procedural skills training and improve their confidence in performing such procedures. Methods This study aimed to assess the self-rated confidence of non-specialty doctors (N=8) in Trauma and Orthopedics in conducting knee aspirations using simulation-based teaching with an anatomically accurate knee model. Pre- and post-intervention questionnaires investigated self-reported confidence using a 10-point Likert-type scale and participant experience using a 7-point Likert scale. Pre- and post-intervention surveys further qualitatively explored attitudes toward conducting the skill. Results Pre-intervention mean confidence was rated 3.9 (SD=2.70) out of 10, with a noted increase to 8.1 (SD=1.25) out of 10, providing a mean difference of 4.2 (SD=2.82) out of 10 with p=0.007. All attendees agreed or strongly agreed on the usefulness and satisfaction of the activity. Qualitative analysis indicated themes of nervousness and lack of confidence pre-intervention and attitudes of increased confidence in the skill post-intervention. Conclusions Overall, increased statistically significant confidence was concluded among non-specialty doctors in conducting knee arthrocentesis following simulation-based teaching, with perceived usefulness and satisfaction of the activity. Nonetheless, we must consider potential limitations of clinical accuracy and realism through such procedural skills training.

The effectiveness of serious games on undergraduate nursing students' knowledge and skills: A systematic review and meta-analysis

AIM

To determine the effect of serious games on undergraduate nursing students by the meta-analysis method.

BACKGROUND

There is a need for greater focus on enhancing the knowledge and skills of undergraduate nursing students. Generation Z students desire active engagement in the learning process. When compare with conventional learning approaches, serious games can enhance pupil interest by making the learning process more captivating.

DESIGN

Systematic review and meta-analysis.

METHOD

A total of nine databases were systematically searched from inception to April 2024. The Cochrane RoB-2 tool and the Joanna Brigg's Institute Critical Appraisal Tool for quasi-experimental designs were used to undertake quality appraisal. A narrative synthesis, a meta-analysis and subgroup analysis were conducted to analyze the study outcomes.

RESULTS

In the study, 19 experimental studies included 14 randomized controlled trials and five quasi-experimental studies. When compare with control groups, serious games in RCTs showed significant improvements in knowledge (SMD 1.24, 95 % CI 0.52-1.96; P<0.001) and skills (SMD 0.50, 95 % CI 0.13-0.87; P<0.01). Subgroup analysis for technical skills outcomes demonstrated that serious games in RCTs were more effective than control groups (SMD 0.62, 95 % CI 0.20-1.05; P<0.001).

CONCLUSION

Serious games had a beneficial impact on the knowledge and skills of undergraduate nursing students. In the context of serious game intervention, it is imperative to carefully consider the approach.

Explor-A-Thora: A Novel Three-Dimensionally Printed Pleural Simulator

Background

For procedural education, the shift from the traditional apprenticeship model to simulation-based mastery has become increasingly accepted as the gold standard and has underscored the importance of high-fidelity, cost-effective training options. However, cost-effective pleural procedure simulators providing both realistic haptic feedback and ultrasound compatibility are lacking.

Objective

We aimed to create a pleural procedure simulator with characteristics of human tissue, at low cost and with ultrasound compatibility.

Methods

This work used design-based research principles and a collaborative rapid iteration approach in collaboration with the University of California, San Francisco, Makers Lab and design-based researchers at the University of California, Berkeley, which led to the creation of a three-dimensionally printed pleural procedure simulator.

Results

The needs assessment indicated significant discomfort with pleural procedures and a request for more accessible simulation opportunities. Iterative prototyping resulted in a three-dimensionally printed rib cage and a series of innovations in the fluid pocket and skin layers to provide realistic tactile feedback and ultrasound imaging compatibility. The final model costs significantly less than commercial simulators, with durable components and replaceable parts that can be reused multiple times.

Conclusion

The development of a low-cost, high-fidelity pleural procedure simulator addresses the current limitations of commercially available pleural simulators. By integrating three-dimensional printing technology and easily accessible materials, we were able to produce a simulator that closely replicates the feel of human tissue, allows ultrasound use, and is adaptable for different patient anatomies and clinical scenarios. This novel simulator is a scalable solution to elevate the standard of procedural education and ultimately positively affect patient care.

Learner evaluation of an immersive virtual reality mass casualty incident simulator for triage training

Background

To minimize loss of life, modern mass casualty response requires swift identification, efficient triage categorization, and rapid hemorrhage control. Current training methods remain suboptimal. Our objective was to train first responders to triage a mass casualty incident using Virtual Reality (VR) simulation and obtain their impressions of the training's quality and effectiveness.We trained subjects in a triage protocol called Sort, Assess, Lifesaving interventions, and Treatment and/or Transport (SALT) Triage then had them respond to a terrorist bombing of a subway station using a fully immersive virtual reality simulation. We gathered learner reactions to their virtual reality experience and post-encounter debriefing with a custom electronic survey. The survey was designed to gather information about participants' demographics and prior experience, including roles, triage training, and virtual reality experience. We then asked them to evaluate the training and encounter and the system's potential for training others.

Results

We received 375 completed evaluation surveys from subjects who experienced the virtual reality encounter. Subjects were primarily paramedics, but also included medical learners as well as other emergency medical service (EMS) professionals. Most participants (95%) recommended the experience for other first responders and rated the simulation (95%) and virtual patients (91%) as realistic. Ninety-four percent (94%) of participants rated the virtual reality simulator as "excellent" or "good." We observed some differences between emergency medical service and medical professionals regarding their prior experience with disaster response training and their opinions on how much the experience contributed to their learning. We observed no differences between subjects with extensive virtual reality experience and those without.

Conclusions

Our virtual reality simulator is an automated, customizable, fully immersive virtual reality system for training and assessing personnel in the proper response to a mass casualty incident. Participants perceived the simulator as an adequate alternative to traditional triage and treatment training and believed that the simulator was realistic and effective for training. Prior experience with virtual reality was not a prerequisite for the use of this system.

Supplementary Information

The online version contains supplementary material available at 10.1186/s44247-024-00117-5.

New learning technique based on real-time kinematic feedback from an inertial sensor for manual therapy in shoulder joint: a randomised trial

BACKGROUND

Reducing teacher subjectivity and checking skill corrections have an impact on the manual therapy learning, one of the most crucial components of physical therapy clinical practise. The aim of this study was to analyse the effectiveness of a kinematic real-time feedback strategy (KRTF) with an inertial sensor as a new methodology for the learning of glenohumeral joint mobilisation, comparing it with the traditional teaching method.

METHODS

This study was a randomised trial. 59 undergraduate students without experience in manual therapy were randomised into two different groups (G1: Traditional methods group; G2: KRTF group). G1: students would practice the technique while an expert in manual therapy would supervise them. G2: could perform the mobilisation and observe the kinematic characteristics of the technique on a laptop. For the two movements that compose the mobilisation (angulation and translation), the result variables extracted were: maximum displacement, minimum displacement, area under the curve and the difference between the area under the curve of angulation and translation. In addition, the consistency of the measurement and reliability were calculated, too.

RESULTS

Some significant differences were observed within groups, between groups and in the group x time interaction, the difference between the angulation and translation area. The synchronization of the movements in in the post comparison was better in G2 because the differences in the areas of both movements were significantly smaller (Mean Difference G1 vs. G2 = 1111.4°s (p > 0.05)).

CONCLUSIONS

After comparing the kinematic variables recorded between the two intervention groups analysed in the present study, we observed that the kinematic registers were significantly different between the two groups, with a higher evolution in the KRTF group compared to the traditional learning method. The effectiveness of KRTF was proved over the traditional teaching methods in facilitating the learning process of the glenohumeral joint mobilisation.

CLINICALTRIALS

GOV ID

NCT02504710, 22/07/2015.

Continuing professional development for primary care physicians: a pre-post study on lung point-of-care ultrasound curriculum

BACKGROUND

Point-of-care ultrasound is rapidly gaining traction in clinical practice, including primary care. Yet, logistical challenges and geographical isolation hinder skill acquisition. Concurrently, an evidentiary gap exists concerning such guidance's effectiveness and optimal implementation in these settings.

METHODS

We developed a lung point-of-care ultrasound (POCUS) curriculum for primary care physicians in a rural, medically underserved region of the south of Israel. The course included recorded lectures, pre-course assessments, hands-on training, post-workshop lectures, and individual practice. To evaluate our course, we measured learning outcomes and physicians' proficiency in different lung POCUS domains using hands-on technique assessment and gathered feedback on the course with a multi-modal perception approach: an original written pre- and post-perception and usage questionnaire.

RESULTS

Fifty primary care physicians (PCPs) showed significant improvement in hands-on skills, increasing from 6 to 76% proficiency (p < 0.001), and in identifying normal versus abnormal views, improving from 54 to 74% accuracy (p < 0.001). Ten weeks after training, primary care physicians reported greater comfort using lung ultrasound, rising from 10 to 54% (p < 0.001), and improved grasp of its potential and limits, increasing from 27.5% to 84% (p < 0.001). Weekly usage increased from none to 50%, and the number of primary care physicians not using at all decreased from 72 to 26% (p < 0.001).

CONCLUSIONS

A two-day focused in-person and remote self-learning lung-POCUS training significantly improved primary care physicians' lung ultrasound skills, comfort, and implementation.

How to deliver effective paediatric simulation based education

Simulation based education (SBE) is an educational tool increasingly used in the approach to the initial and ongoing education of healthcare professionals. Like all education tools, SBE needs to be used appropriately to achieve the desired outcomes. Using Cognitive Load Theory (CLT) in the instructional design of simulations is essential to maximise participant learning by reducing extraneous load and optimising intrinsic load. Educators can modify task fidelity, task complexity and instructional support to optimise learning. Specific methodologies can be used in program design such as rapid cycle deliberate practice, round the table teaching, low dose high frequency and flipped classroom. Fidelity and authenticity are important factors to consider when choosing design elements to ensure learner engagement, but not to overwhelm cognitive load. An integral part of SBE is the feedback or debriefing component. Several evidence-based methodologies can be employed to facilitate post simulation learning, including Debriefing with Good Judgement and PEARLS. Educators also need to consider faculty education and development, such as the discovery, growth and maturity model.

A novel model for developing thrust joint manipulation skills: a teaching and learning perspective

Spinal and extremity thrust joint manipulation (TJM) has been shown to be an effective intervention when treating patients with various musculoskeletal conditions. Learning skilled TJM requires the proper execution of many discrete tasks. If any of these are missing, effectiveness and safety may be limited. While it is accepted that practice and feedback are important when physical therapists are learning clinical tasks, the best type of practice has not been identified for learning to perform TJM tasks. In this paper, we propose an educational model for instruction of joint manipulation that: 1) standardizes feedback terminology and 2) describes a core set of four discrete tasks (lift, drop, pull, and combination-rotation) that apply to most TJM tasks. The model includes instructing TJM tasks followed by identifying key errors related to the components of setup and thrust. Once these key errors have been identified, intentional practice activities are provided to address the noted positional and movement errors. Finally, reassessment is performed to determine if errors have diminished. This model is similar to the test-retest approach that is commonly used when treating patients. We hope this educational model will provide a framework for teaching TJM and will also foster future research.

The dental microscope in endodontic education: A feasibility study of a distance learning course

This study aimed to evaluate the feasibility of preclinical training, specifically in root canal preparation, using a virtual educational system equipped with an operating microscope. Ten postgraduate general dentistry trainees and practitioners undergoing postgraduate training in endodontics participated. The telesimulation course included three steps: theory, demonstration of practical work by the teacher and lastly practical training by the participants. The digital environment including the dental microscope was presented, and the feedback was collected with a questionnaire. The majority of participants considered that the online video conference format allowed them to acquire theoretical content but also practical knowledge and skills, owing to the contribution of the operating microscope. The technical feasibility of endodontic telesimulation was demonstrated. The operating microscope has a potential role in distance education, enabling teaching to occur synchronously and collaboratively. This allows learners to interact with each other and demonstrators in real time.

The Efficacy and Cost-Effectiveness of a Simulation-Based Primary Care Procedural Skills Training Program for Advanced Practice Providers

INTRODUCTION

The purpose of this program evaluation was to investigate the efficacy of simulation-based primary care procedural skills training to increase participant confidence, knowledge, and skill in performing the procedures included in the training and to evaluate the cost-effectiveness of the training.

METHODS

A retrospective, within-subjects analysis of the change in perceived confidence, skill, and knowledge in procedure performance after the simulation-based primary care procedural skills training program measured by pretraining and post-training Likert scale surveys and change in clinical procedure performance frequency for abscess incision and drainage and laceration repair up to 6 months before and 6 months after the training in the outpatient setting was performed.

RESULTS

Participants self-reported higher median confidence, perceived skill, and perceived knowledge of all procedures included in the training course, with statistically significant increases for all procedures. A mean increase in laceration repairs in the clinical setting of 10% after training was found. Higher median performance of abscess incision and drainage after training (median = 20.00%, n = 25) compared with before training (median = 0.00%, n = 25) and a mean increase in performance of abscess incision and drainage in the clinical setting of 6% after training was found, but increases were not statistically significant.

DISCUSSION

Participation in a 2-day simulation-based primary care procedural skills training program was an effective method to increase confidence, perceived skill, and knowledge of outpatient procedures among practicing providers. Further evaluation to establish return on investment is needed, because statistically significant increases in clinical procedure performance were unable to be demonstrated.

In-Person Versus Online Training in Simulations of Helping Babies Breathe: A Randomized Controlled Trial

BACKGROUND

Birth asphyxia is a leading cause of neonatal deaths, but simple interventions may prevent it. The Helping Babies Breathe (HBB) course has significantly reduced neonatal mortality rates in lower and middle-income countries (LMICs) by training healthcare providers (i.e. midwives and nurses) on the essential skills of bag-and-mask ventilation and postnatal care. Although several studies have supported the efficacy of virtual learning in other medical education programs, there is still a lack of knowledge regarding a virtual approach to HBB. This study aims to compare the effectiveness of online versus in-person learning of the HBB course among medical and nursing students.

METHODS

The study is a two-arm parallel randomized non-inferiority controlled trial, that includes medical and nursing students. Participants were randomly assigned to either online or in-person debriefing during the hands-on simulations of HBB. They attended a pre-recorded lecture before being assigned to one of three instructors for the simulation lab. Participants completed a seven-point anonymous Likert-based questionnaire and a standardized Debriefing Assessment for Simulation in Healthcare Student Version (DASH-SV) Short Form. The primary outcome was the Objective Structured Clinical Exam (OSCE) grade. The trial is listed on ClinicalTrials.gov with the registration number NCT05257499.

RESULTS

47 participants completed the study, with similar baseline characteristics in each arm (gender, age, and class). The participants in both arms reported high levels of satisfaction and confidence, with no significant difference between the two arms. The DASH score over 7 was also similar in the online arm (6.27±0.26) compared to the in-person arm (6.55±0.13) (p=0.07). The mean OSCE score in the online arm (45.8±5.2) was comparable to the mean OSCE score in the in-person arm (41.3±5.0) (p=0.22). Both online and in-person participants failed the OSCE.

CONCLUSION

The survey responses conveyed that online simulation training is comparable to in-person simulation for the HBB course. Both online and in-person participants failed the OSCE most likely because they needed more training on HBB. This could be due to the fact that the material is too new to the students who needed more practice to pass the OSCE. Further research is needed to confirm these results and explore the long-term impact of online neonatal resuscitation training.

The Power of Faculty Development: The Impact on Teaching a Procedural Skill Framework

BACKGROUND

Teaching outpatient procedures is a skill often overlooked in faculty development. This oversight may lead to faculty employing a haphazard approach. Competency in procedural skills is inherent, and acquiring proficiency in procedural skills is necessary across all medical specialties, with some centers moving toward a blended simulation-based approach rather than the traditional Halstedian "see one, do one, teach one" mantra. While both formats have their pros and cons, they share the unifying concept of performance-based assessments and a standardized method for teaching procedures, which has typically been lacking a formal framework.

OBJECTIVE

This study aimed to implement and evaluate the impact of teaching an educational technique in a multidisciplinary faculty education workshop about the Sawyer framework for psychomotor skill acquisition.

METHODS

 An interactive 90-minute workshop through the Uniformed Services University Faculty Development Program was developed and presented from February 2021 to October 2023 at multiple military treatment facilities. Participants enrolled in the workshop either by online registration or by walking in on the day of the workshop. A postworkshop survey was collected voluntarily. Through the survey, participants self-evaluated their current teaching strategy and made changes to their future strategy based on the framework they learned during the workshop. This was a mixed methods approach with quantitative survey data that were analyzed using Microsoft Excel (Microsoft Corporation, Redmond, WA) and qualitative data through thematic analysis using a constructivist inductive approach.

RESULTS

 There were 52 sessions with a total of 570 participants across 22 unique specialties. The response rate was 50%. Before the workshop, 22% of responding participants had no teaching strategy, and 49% had a partial but not explicit strategy for teaching. After the workshop, 89% of respondents answered that they would either implement a new or modify an existing strategy. Ninety-three percent of respondents reported that the Sawyer method was applicable to their future teaching. The overall themes from participants were that this procedural framework allowed for personal improvement in clear communication, individualized learner-centered teaching, and improved intentionality of teaching procedures.

CONCLUSION

 Almost two-thirds of the faculty did not have a formal teaching method before this course, which is consistent with current data. Implementing a standardized framework for teaching procedures through faculty development workshops for multidisciplinary medical faculty educators can improve the educational quality of procedural skills.

Development and validation of an assessment tool for adult simulated ultrasound-guided fascia iliaca block: a prospective monocentric study

BACKGROUND

Fascia iliaca block (FIB) is an effective technique for analgesia. While FIB using ultrasound is preferred, there is no current standardised training technique or assessment scale. We aimed to create a valid and reliable tool to assess ultrasound-guided FIB.

METHOD

This prospective observational study was conducted in the ABS-Lab simulation centre, University of Poitiers, France between 26-29 October and 14-17 December 2021. Psychometric testing included validity analysis and reliability between two independent observers. Content validity was established using the Delphi method. Three rounds of feedback were required to reach consensus. To validate the scale, 26 residents and 24 emergency physicians performed a simulated FIB on SIMLIFE, a simulator using a pulsated, revascularised and reventilated cadaver. Validity was tested using Cronbach's α coefficient for internal consistency. Comparative and Spearman's correlation analysis was performed to determine whether the scale discriminated by learner experience with FIB and professional status. Reliability was analysed using the intraclass correlation (ICC) coefficient and a correlation score using linear regression (R2).

RESULTS

The final 30-item scale had 8 parts scoring 30 points: patient positioning, preparation of aseptic and tools, anatomical and ultrasound identification, local anaesthesia, needle insertion, injection, final ultrasound control and signs of local anaesthetic systemic toxicity. Psychometric characteristics were as follows: Cronbach's α was 0.83, ICC was 0.96 and R2 was 0.91. The performance score was significantly higher for learners with FIB experience compared with those without experience: 26.5 (22.0; 29.0) vs 22.5 (16.0; 26.0), respectively (p=0.02). There was a significant difference between emergency residents' and emergency physicians' scores: 20.5 (17.0; 25.0) vs 27.0 (26.0; 29.0), respectively (p=0.0001). The performance was correlated with clinical experience (Rho=0.858, p<0.0001).

CONCLUSION

This assessment scale was found to be valid, reliable and able to identify different levels of experience with ultrasound-guided FIB.

Teaching Medical Procedural Skills for Performance

Procedures are a core element of medical professional practice. Today's training approach was formulated in the mid-twentieth century based on a computer analogue of the brain. Despite minor modifications, the system has remained relatively unchanged for the past 70 years. It delivers competence. However, competence is not reliable performance. The inability to adapt to the variety of patients and variations in the performance environments, such as the operating room, results in patient morbidity and mortality. There is a need for changes in the development and training of medical procedural skills based on current theories of skill acquisition, movement theory, and motor control. Achieving optimal performance necessitates the ability to adapt through training in diverse patient and performance environments rather than merely imitating prescribed movements. We propose a novel model of training, the Constraints-Led Approach, which allows for robust training by altering the factors affecting skill acquisition and lifelong learning.

Applying the master adaptive learner framework to just-in-time training of procedures

Background

Just-in-time training (JITT) occurs in the clinical context when learners need immediate guidance for procedures due to a lack of proficiency or the need for knowledge refreshment. The master adaptive learner (MAL) framework presents a comprehensive model of transforming learners into adaptive experts, proficient not only in their current tasks but also in the ongoing development of lifelong skills. With the evolving landscape of procedural competence in emergency medicine (EM), trainees must develop the capacity to acquire and master new techniques consistently. This concept paper will discuss using JITT to support the development of MALs in the emergency department.

Methods

In May 2023, an expert panel from the Society for Academic Emergency Medicine (SAEM) Medical Educator's Boot Camp delivered a comprehensive half-day preconference session entitled "Be the Best Teacher" at the society's annual meeting. A subgroup within this panel focused on applying the MAL framework to JITT. This subgroup collaboratively developed a practical guide that underwent iterative review and refinement.

Results

The MAL-JITT framework integrates the learner's past experiences with the educator's proficiency, allowing the educational experience to address the unique requirements of each case. We outline a structured five-step process for applying JITT, utilizing the lumbar puncture procedure as an example of integrating the MAL stages of planning, learning, assessing, and adjusting. This innovative approach facilitates prompt procedural competence and cultivates a positive learning environment that fosters acquiring adaptable learning skills with enduring benefits throughout the learner's career trajectory.

Conclusions

JITT for procedures holds the potential to cultivate a dynamic learning environment conducive to nurturing the development of MALs in EM.

Development and usability of a virtual reality umbilical venous catheter placement simulator

PURPOSE

Exposure to procedures varies in the neonatal intensive care unit (NICU). A method to teach procedures should be available without patient availability, expert oversight, or simulation laboratories. To fill this need, we developed a virtual reality (VR) simulation for umbilical vein catheter (UVC) placement and sought to establish its face and content validity and usability.

METHODS

Engineers, software developers, graphic designers, and neonatologists developed a VR UVC placement simulator following a participatory design approach. The software was deployed on the Meta Quest 2 head-mounted display (HMD). Neonatal nurse practitioners (NNPs) from a level 4 NICU used the simulator and completed an 11-item questionnaire to establish face and content validity. Participants also completed the validated simulation task load index and system usability scale to assess the usability of the simulator. Group 1 tested the VR simulation, which was optimized based on feedback, prior to Group 2's participation.

RESULTS

A total of 14 NNPs with 2-37 years of experience participated in testing. Participants scored the content and face validity of the simulator highly, with most giving scores ≥ 4/5. Usability was established with relatively high average system usability scores for both groups (Group 1: 67.14 ± 7.8, Group 2: 71 ± 14.1) and low SIM-TLX scores indicating manageable load while using the simulator.

CONCLUSION

After optimization, Group 2 found the UVC simulator to be realistic and effective. Both groups felt the simulator was easy to use and did not cause physical or cognitive strain. All participants felt the UVC simulator provided a safe environment to make mistakes, and the majority would recommend this experience to trainees.

Design and implementation of a training programme on ultrasound-guided lower limb peripheral nerve blockade: An Advanced Clinical Practitioner's personal journey

Increased demand in services, workforce pressures and continued financial constraints has resulted in a significant expansion in advanced clinical practice roles in the United Kingdom. This article will describe the personal experience of a perioperative Advanced Clinical Practitioner in the design and implementation of a training programme to achieve competence in ultrasound-guided lower limb peripheral nerve blockade. Three specific lower limb peripheral nerve blockade were included in the training programme, namely sciatic nerve block at the popliteal fossa, saphenous nerve block, and femoral nerve block. Key service drivers underpinning development, rationale for Advanced Clinical Practitioner involvement in lower limb peripheral nerve blockade and governance will also be discussed.

Beyond the Procedure Log: Using Individualized Learning Plans to Set Learner-Specific Milestones for Procedural Skills Acquisition

ABSTRACT

Procedural training for nonsurgical fields, such as internal medicine, is an important component of medical education. However, recent changes to accreditation guidelines have resulted in less formal guidance on procedural competency, not only leading to opportunities for individualizing training but also creating potential problems for trainees and training programs. In this article, the authors use internal medicine as an exemplar to review current strategies for procedural education in nonsurgical fields, including procedural simulation, dedicated procedural rotations, and advanced subspecialty training, and highlight an emerging need for learner-specific terminal milestones in procedural training. Individualized learning plans (ILPs), collections of trainee-specific objectives for learning, are arguably a useful strategy for organizing procedural training. The role of ILPs as a framework to support setting learner-specific terminal milestones, guide skill acquisition, and allocate procedural learning opportunities based on trainees' anticipated career plans is subsequently explored, and how an ILP-based approach might be implemented within the complex educational milieu of a clinical training program is examined. The limitations and pitfalls of an ILP-based approach, including the need for development of coaching programs, are considered. The authors conclude that, despite the limitations of ILPs, when combined with other current strategies for building trainees' procedural competence, these plans may help trainees maximize the educational benefits of their training period and can encourage effective, safer, and equitable allocation of procedural practice opportunities.

A Staged Defragmented Simultaneous Debriefing Model As Integrated Micro-debriefing Components Inside Online Simulation for Competencies Formation

Background Currently, there are no separate debriefing models for online simulation training, and existing models simply imitate the traditional models used in on-site simulation training (the physical presence of individuals, such as students or trainees, in a simulation center). This involves hands-on, in-person training within a simulated environment to enhance practical skills and knowledge in a controlled setting. This scenario does not fully meet the requirements and capabilities of distance learning. Objective To develop a staged defragmented debriefing model as integrated micro-debriefing components inside an online simulation to support the development of clinical decision-making and competencies formation within medical education and offer recommendations to support the use of this debriefing model as a teaching strategy. Methods This descriptive study was conducted from August 2020 to September 2023. To build a staged defragmented debriefing model as integrated micro-debriefing components inside an online simulation for competencies formation the traditional debriefing model's components for on-site simulation training, simulation type, and structure, modern concepts of e-learning, and classification of the seriousness of medication errors were used. The main focus of this study was on providing a detailed account of the debriefing components for online simulation training, features, and implementation of this new teaching model. A total of 38 participants, healthcare professionals, were recruited for this study. The participants were randomly assigned to two groups: one experiencing the staged defragmented debriefing model (n = 20) and the other control group, which received traditional debriefing following simulation training (n = 18). Results The results allowed us to successfully develop a staged defragmented debriefing model inside the simulation that integrates micro-debriefing components located at different points of the simulation scenarios. This teaching approach was successfully implemented in online clinical case scenarios in the "ClinCaseQuest" Simulation Training Platform for continuous medical education. Additionally, an internal validation experiment comparing the effectiveness of the staged defragmented debriefing model with the traditional debriefing method demonstrated superior learning outcomes and participant satisfaction in the staged debriefing group. Conclusions The staged defragmented debriefing model, when integrated into online simulations, represents a promising strategy for advancing clinical decision-making skills and competencies formation in medical education. Implementation of this debriefing model as a teaching strategy holds promise for enhancing learning outcomes in medical education settings. Further research, validation, and implementation are recommended to maximize the model's potential impact on medical education and training.

Teaching and Assessing Bedside Procedures: A Standardized Cross-Disciplinary Framework for Graduate Medical Education

ABSTRACT

Performing bedside procedures requires knowledge, reasoning, physical adeptness, and self-confidence; however, no consensus on a specific, comprehensive strategy for bedside procedure training and implementation is available. Bedside procedure training and credentialing processes across large institutions may vary among departments and specialties, leading to variable standards, creating an environment that lacks consistent accountability, and making quality improvement difficult. In this Scholarly Perspective, the authors describe a standardized bedside procedure training and certification process for graduate medical education with a common, institution-wide educational framework for teaching and assessing the following 7 important bedside procedures: paracentesis; thoracentesis; central venous catheterization; arterial catheterization; bladder catheterization or Foley catheterization; lumbar puncture; and nasogastric, orogastric, and nasoenteric tube placement. The proposed framework is a 4-stage process that includes 1 preparatory learning stage with simulation practice for knowledge acquisition and 3 clinical stages to guide learners from low-risk to high-risk practice and from high to low supervision. The pilot rollout took place at Henry Ford Hospital from December 2020 to July 2021 for 165 residents in the emergency medicine and/or internal medicine residency programs. The program was fully implemented institution-wide in July 2021. Assessment strategies encompass critical action checklists to confirm procedural understanding and a global rating scale to measure performance quality. A major aim of the bedside procedure training and certification was to standardize assessments so that physician trainers from multiple specialties could train, assess, and supervise any participating trainee, regardless of discipline. The authors list considerations revealed from the pilot rollout regarding electronic tracking systems and several benefits and implementation challenges to establishing institution-wide standards. The proposed framework was assembled by a multidisciplinary physician task force and will assist other institutions in adopting best approaches for training physicians in performing these critically important and difficult-to-perform procedures.

Examining the pedagogical practices that support cultural proficiency development in graduate health science students

BACKGROUND

Health disparities are often a function of systemic discrimination and healthcare providers' biases. In recognition of this, health science programs have begun to offer training to foster cultural proficiency (CP) in future professionals. However, there is not yet consensus about the best ways to integrate CP into didactic and clinical education, and little is known about the role of clinical rotations in fostering CP.

METHODS

Here, a mixed-methods approach was used to survey students (n = 131) from a private all-graduate level osteopathic health sciences university to gain insight into the training approaches students encountered related to CP and how these may vary as a function of academic progression. The research survey included instruments designed to quantify students' implicit associations, beliefs, and experiences related to the CP training they encountered through the use of validated instruments, including Implicit Association Tests and the Ethnocultural Empathy Inventory, and custom-designed questions.

RESULTS

The data revealed that most students (73%) had received CP training during graduate school which primarily occurred via discussions, lectures, and readings; however, the duration and students' perception of the training varied substantially (e.g., training range = 1-100 hours). In addition, while students largely indicated that they valued CP and sought to provide empathetic care to their patients, they also expressed personal understandings of CP that often fell short of advocacy and addressing personal and societal biases. The results further suggested that clinical rotations may help students attenuate implicit biases but did not appear to be synergistic with pre-clinical courses in fostering other CP knowledge, skills, and attitudes.

CONCLUSIONS

These findings highlight the need to utilize evidence-based pedagogical practices to design intentional, integrated, and holistic CP training throughout health science programs that employ an intersectional lens and empowers learners to serve as advocates for their patients and address systemic challenges.

Impact of a Multidisciplinary Simulation-Based Training Program on the Multiple Techniques of Intraosseous Access: A Prospective Multicentric Study

OBJECTIVES

The aim of this study was to assess intraosseous (IO) access placement performance during a multidisciplinary simulation-based training (SBT) program according to the professional status, experience of caregivers, and the setting of the course.

METHOD

This prospective, multicentric study included emergency physicians, residents, certified registered nurse anesthetists, registered nurses, and students. It was carried out between April 6, 2020 and April 30, 2021 in emergency medical services, an emergency department, and a simulation center. Trainee performance was evaluated by 2 independent observers using a validated scale, before and after SBT. Self-assessment of satisfaction was carried out. Interobserver reproducibility was analyzed by intraclass correlation coefficient. The continuous variables were compared using a Student t test or a nonparametric Mann-Whitney U test. Comparative analysis between the different groups used analysis of variance. Correlation analysis was performed by a nonparametric Spearman test. A P value of 0.05 was considered significant.

RESULTS

Ninety-eight participants were included. Intraclass correlation coefficient between the 2 observers was 0.96. Performance significantly increased after training, regardless of the site or device used (for the semiautomatic device, P = 0.004 in tibia and P = 0.001 in humeral; for the manual device, P < 0.001). Simulation-based training significantly reduced time for IO access ( P = 0.02). After SBT, no difference was found according to professional status and the setting of the course. Performance was not correlated with professional experience. All trainees were satisfied with the training.

CONCLUSIONS

Simulation-based training improved the IO access using a semiautomatic or a manual device, regardless of the experience or status of the trainees. Simulation-based training would work for many disciplines regardless of locations (simulation or clinical facilities).

'Gear up and get ready': Collaborative curriculum for radiographers supporting percutaneous nephrolithotomy in the operating theatre

INTRODUCTION

Newly qualified radiographers often find working in the operating theatre (OT) challenging and intimidating. These perceptions, which inhibit confidence, may hinder their effectiveness in interprofessional teamwork, which may in turn adversely affect patient outcomes. A collaborative education programme was designed, building upon the foundations of competency-based education (CBE) and simulation-based mastery learning (SBML) to examine its potential in mitigating these perceptions. The objective of this research was to assess participants' experience and level of competency after attending the curated collaborative educational programme.

METHODS

The programme was developed based on the Analysis, Design, Development, Implementation, and Evaluation (ADDIE) model and comprises two teaching and learning phases: educational session and simulation. A collaborative approach was undertaken to develop an assessment checklist for the interprofessional simulation. Requirements for the simulation, such as scenario design, information and storyboard, task trainer, logistics, and learners' briefing, debrief, and feedback, were identified and assembled. The radiographers' performance was recorded using a practical skills assessment checklist and a theory assessment.

RESULTS

Twelve radiographers participated and showed improvement in their self-rating of learning objectives before and after the programme. The median (interquartile range) score achieved in the theory assessment, out of a possible of 11, was 9.00 (7.75-9.50). The median (interquartile range) score achieved in the simulation component, out of a possible of 16, was 15.00 (14.00-15.00). There was statistically significant difference in self-perceived performance in all learning objective domains.

CONCLUSION

The findings from the programme were promising. The use of simulation and an assessment checklist proved to be useful learning tools in preparing newly qualified radiographers for work in the OT.

IMPLICATIONS FOR PRACTICE

Assessment checklists are valuable tools that should be considered to facilitate teaching and learning. The use of interprofessional simulation activities can support radiographers in developing knowledge, professional skills, and clinical competency. It should be conducted in a timely manner to facilitate the introduction to role understanding and effective communication.

Advances in Pediatric Surgery Simulation-Based Training

Pediatric surgery is the diagnostic, operative, and postoperative surgical care of children with congenital and acquired anomalies and diseases. The early history of the specialty followed the classic "see one, do one, teach one" philosophy of training but has since evolved to modern methods including simulation-based training (SBT). Current trainees in pediatric surgery face numerous challenges, such as the decreasing incidence of congenital disease and reduced work hours. SBT consists of several modalities that together assist in the acquisition of technical skills and improve performance in the operating room. SBT has evolved to incorporate simulator models and video gaming technology, in parallel with the development of simulation in other surgical and non-surgical pediatric fields. SBT has advanced to a level of sophistication that means that it can improve the skills of not only pediatric surgery trainees but also practicing attending surgeons. In this review, we will discuss the history of pediatric surgery, simulation in pediatric surgery training, and the potential direction of pediatric surgical simulation training in the future.

Barriers and enablers to achieving clinical procedure competency-based outcomes in a national paediatric training/residency program-a multi-centered qualitative study

BACKGROUND

In 2018, the Royal College of Physicians of Ireland revised its paediatric training program to a competency-based medical education (CBME) training/residency curriculum. This included a requirement to achieve competence in a number of core procedural skills to progress within the program. Internationally, simulation-based medical education (SBME) is gaining interest as an effective teaching pedagogy for training procedural skill competency. The objectives of this study were to (1) identify enablers and barriers for paediatric trainees to achieve their required procedural competencies, (2) gain insight on the feasibility of achieving the required procedural skills, and (3) explore what simulation-based resources are used as well as their role in achieving the required procedural skill competencies.

METHODS

A multi-centered qualitative study using semi-structured interviews was performed. Twenty-four paediatric consultants and trainees were recruited from two academic tertiary hospitals using purposive and snowball sampling. Interviews were conducted between March and September 2021, audio recorded, transcribed, and analyzed using thematic analysis.

RESULTS

Three main themes regarding enablers for achieving procedural competencies were reported and include having protected training time, routine assessments, and a standardized curriculum. Barriers to achieving procedural competencies focused mainly on limited clinical exposure. The use of SBME was recommended by all participants (n = 24, 100%) to assist in achieving procedural competencies and most (n = 15, 62.5%) reported it is feasible to attain the required procedural skills in the paediatric CBME program.

CONCLUSION

It is feasible to achieve the required procedural competencies for most paediatric trainees, but this can be improved with protected training time, routine assessments, and a standardized curriculum. Barriers to achieving these skills mainly center on limited clinical exposure, which can be remedied by SBME. Further research is warranted to determine the costs and types of SBME tools available as well as teaching pedagogies to support paediatric trainees achieve their required procedural competencies.

A Low-Cost, High-Fidelity Simulator for Transabdominal Chorionic Villus Sampling

INTRODUCTION

Chorionic villus sampling (CVS) remains essential for first-trimester genetic diagnosis, yet clinical volume may be insufficient to train new clinicians in the technique. Available simulation models are expensive, require animal parts or specialized resins, and cannot be stored for repeated use.

METHODS

We present a model for trans-abdominal CVS (TA-CVS) which is constructed from readily available materials costing less than $10 and can be refrigerated and re-used to train maternal-fetal medicine fellows in CVS.

RESULTS

All three attending physicians performing TA-CVS at our institution described the model as an accurate visual and tactile simulation, prompting its integration into our fellowship curriculum. To date, two senior fellows have achieved competency on the simulator and begun to perform clinical CVS under supervision, one of whom is an author on this paper. Both fellows and attendings indicated that the simulator provided a valuable tool for repeated practice prior to clinical CVS. Simulators are now maintained on the unit and have been re-used for 3 months and dozens of simulated procedures each without any apparent qualitative degradation in performance.

DISCUSSION/CONCLUSION

We describe a low-cost easily constructed, durable, high-fidelity simulator for TA-CVS.

Stepwise approach to skills teaching in resuscitation: A systematic review

Aim

To compare the effectiveness of Peyton's four-step approach for teaching resuscitation skills with alternative approaches.

Methods

For this systematic review, we followed the PICOST format (population, intervention, comparison, outcome, study design, timeframe) using Peyton's four-step approach as the standard. We included all studies analyzing skills training related to resuscitation and First Aid in any educational setting. Eligible were randomized controlled trials (RCTs) and non-randomized studies (non-randomized controlled trials, interrupted time series, controlled before-and-after studies, cohort studies, published conference abstracts, and case series where n ≥ 5). We excluded unpublished results (e.g. trial protocols), commentaries, editorials, reviews. Medline, Embase, PsycINFO, ERIC, CINAHL, and Cochrane were searched from inception until November 10, 2020 (updated November 25, 2022) for publications in all languages as long as there was an English abstract. Titles and abstracts of the papers retrieved were screened, and eligible publications were analysed in full text. From the final set of papers, data were extracted into a spreadsheet, subsequently risk of bias assessment was performed (using RoB2 and ROBINS-I), and the certainty of evidence (using GRADE) for each paper was assessed. Screening of studies, data extraction, risk-of-bias assessment, and assessment of certainty of evidence were all performed by two independent researchers. This review was conducted in adherence with PRISMA standards and was registered with PROSPERO (CRD42023377398).

Results

Overall, the search identified 2,574 studies from which 17 were included in the final analysis (14 RCTs, and 3 non-RCTs). The studies involved a total of 2,906 participants from various populations (from lay persons to health care professionals) and analysed nine different resuscitation skills being taught (ranging from chest compressions to needle cricotomy). The alternative teaching approaches ranged from two-steps to five-steps with various modifications of single steps. High methodological and clinical heterogeneity precluded a meta-analysis from being conducted. The risk of bias assessment showed considerable variation between the studies ranging from 'low' to 'serious'. Across all studies, certainty of evidence was rated as very low due to imprecision and inconsistency. Overall, 14 out of 17 studies showed no difference in skill acquisition or retention when comparing Peyton's four steps to other stepwise approaches.

Conclusions

Very low certainty evidence suggest that Peyton's four-step approach was not more effective in resuscitation skills training compared to alternative approaches.

Funding

None.

Enhancing professional competency in clinical procedures using head-mounted display virtual reality - a mixed method study

BACKGROUND

The maintenance of nursing professional competency is essential to ensure patients' health outcomes. With the current shortage of nursing workforce, a novel approach is necessary to refresh clinical skills and update practice.

OBJECTIVE

This study aims to examine the effectiveness of using head-mounted display virtual reality to refresh knowledge and skills and explore nurses' perceptions towards using this technology for refresher training.

DESIGN

A pre-test post-test mixed-method experimental design was employed.

RESULTS

Participants (n = 88) were registered nurses with a diploma in nursing. The intravenous therapy and subcutaneous injection procedures were implemented using head-mounted display virtual reality. The study showed significant improvement in knowledge for the procedures, cognitive absorption, online readiness, self-directed learning, and motivation for learning. In the qualitative focus group discussions, three themes were identified using thematic analyses: enjoyable way to refresh clinical knowledge; learning outside classroom and limitations in maneuver.

CONCLUSION

Using head-mounted display virtual reality is promising in refreshing clinical skills for nurses. Training and refresher courses can explore using this novel technology, which may be a viable alternative to ensure professional competence with reduced manpower and resources used by the healthcare institution.

Simulation in a blended learning curriculum for neonatology

Blended learning is a learner-centered educational method that combines online and traditional face-to-face educational strategies. Simulation is a commonly utilized platform for experiential learning and an ideal component of a blended learning curriculum. This section describes blended learning, including its strengths and limitations, educational frameworks, uses within health professions education, best practices, and challenges. Also included is a brief introduction to simulation-based education, along with theoretical and real-world examples of how simulation may be integrated into a blended learning curriculum. Examples of blended learning in Neonatal-Perinatal Medicine, specifically within the Neonatal Resuscitation Program, procedural skills training, and the National Neonatology Curriculum, are reviewed.

Competency-based assessment in neonatal simulation-based training

Simulation is a cornerstone of training in neonatal clinical care, allowing learners to practice skills in a safe and controlled environment. Competency-based assessment provides a systematic approach to evaluating technical and behavioral skills observed in the simulation environment to ensure the learner is prepared to safely perform the skill in a clinical setting. Accurate assessment of competency requires the creation of tools with evidence of validity and reliability. There has been considerable work on the use of competency-based assessment in the field of neonatology. In this chapter, we review neonatal simulation-based training, examine competency-based assessment tools, explore methods to gather evidence of the validity and reliability, and review an evidence-based approach to competency-based assessment using simulation.

Putting the "learning" in "pre-learning": effects of a self-directed study hall on skill acquisition in a simulation-based central line insertion course

BACKGROUND

Opportunities to practice procedural skills in the clinical learning environment are decreasing, and faculty time to coach skills is limited, even in simulation-based training. Self-directed learning with hands-on practice early in a procedural skill course might help maximize the benefit of later faculty coaching and clinical experience. However, it may also lead to well-learned errors if learners lack critical guidance. The present study sought to investigate the effects of a hands-on, self-directed "study hall" for central line insertion among first-year residents.

METHODS

Learner cohorts before vs. after introduction of the study hall (n = 49) were compared on their pre- and post-test performance of key procedural behaviors that were comparable across cohorts, with all learners receiving traditional instructor-led training between tests.

RESULTS

Study hall participants spent a median of 116 min in hands-on practice (range 57-175). They scored higher at pre-test (44% vs. 27%, p = .00; Cohen's d = 0.95) and at post-test (80% vs. 72%, p = .02; Cohen's d = 0.69). A dose-response relationship was found, such that 2 h of study hall were roughly equivalent to the performance improvement seen with four clinical observations or supervised insertions of central lines.

CONCLUSIONS

Self-directed, hands-on "study hall" supported improved procedural skill learning in the context of limited faculty availability. Potential additional benefits make the approach worth further experimentation and evaluation.

Neonatal resuscitation workshop for trainees in standardized medical residency training-a pilot practice in Shenzhen, China

Background

Neonatal resuscitation is an important skillset for clinicians attending deliveries. Accredited neonatal resuscitation training is not obligatory in most training centers of standardized medical residency programs before 2022 in China. We investigated the feasibility and effectiveness of neonatal resuscitation simulation training (neo-RST) in residents in Shenzhen, China.

Methods

Four two-day neo-RST workshops were conducted in the University of Hong Kong-Shenzhen Hospital and Shenzhen Health Capacity Building and Continuing Education Center in 2020-2021. The workshops had Neonatal Resuscitation Program (NRP)® update, skill stations and simulation practice with debriefing. Each participant had the integrated skill station assessment (ISSA) at the end of workshop. Participants of workshops included residents of different disciplines and health care providers (HCPs) of neonatal and obstetrical departments. We compared demographic characteristics, neonatal resuscitation knowledge before training, ISSA overall and categorical scores on skill sets between residents and HCPs.

Results

In 2020-2021, 4 neo-RST workshops were conducted with 48 residents and 48 HCPs. The residents group had less working experience, less prior experience in neo-RST and lower neonatal resuscitation knowledge scores than those of HCPs group. After the workshop, residents had higher overall ISSA score than that of HCPs group (90.2 ± 5.9 vs. 86.3 ± 6.6%, P = 0.003, respectively). There was no significant difference in the numbers of participants scored <80% in residents and HCPs group (3 [6.3%] vs. 7 [14.6%], respectively). Regarding the categorical scores, residents scored significantly higher in preparation, ventilation, crisis resource management and behavioral skills but lower in appropriate oxygen use, when compared with the HCPs.

Conclusion

Neo-RST for residents is feasible with promising short-term educational outcomes. Neo-RST could be implemented in standardized medical residency programs in China.

Learning surgical knot tying and suturing technique - effects of different forms of training in a controlled randomized trial with dental students

Objective

The acquisition of surgical skills requires motor learning. A special form of this is intermanual transfer by transferring motor skills from the nondominant hand (NDH) to the dominant hand (DH). The purpose of this study was to determine the learning gains that can be achieved for the DH by training with the DH, the NDH, and by non-surgical alternative training (AT).

Methods

124 preclinical (n=62) and clinical (n=62) dental students completed surgical knot tying and suturing technique training with the DH, with the NDH, and an AT in a controlled randomized trial.

Results

A statistically significant learning gain in knot tying and suture technique with the DH was evident only after training with the DH when compared to training with the NDH (p<0.001 and p=0.004, respectively) and an AT (p=0.001 and p=0.010, respectively). Of those students who achieved a learning gain ≥4 OSATS points, 46.4% (n=32) benefited in their knot tying technique with the DH from training with the DH, 29.0% (n=20) from training with the NDH, and 24.6% (n=17) from an AT while 45.7% (n=32) benefited in their suturing technique with the DH from training with the DH, 31.4% (n=22) from training with the NDH, and 22, 9% (n=16) from an AT.

Conclusions

Training with the DH enabled significantly better learning gains in the surgical knot tying and suturing techniques with the DH.