Taking advantage of asynchronous digital feedback: development of an at-home basic suture skills training program for undergraduate medical students that facilitates skills retention

Improving Medical Student Performance With Unsupervised Simulation and Remote Asynchronous Feedback

OBJECTIVE

This study aims to assess the effectiveness of training medical students to perform two clinical procedures using unsupervised simulation with remote asynchronous feedback, compared to an intensive workshop with in-person feedback.

DESIGN, SETTING, AND PARTICIPANTS

Third-year medical students were recruited and randomized into 2 groups: Thoracentesis or paracentesis. Within each group, participants were further randomized into either unsupervised simulation with remote asynchronous feedback (experimental group; EG) or a 2-hour workshop (control group; CG). The EG underwent two unsupervised 20-minute training sessions and received remote asynchronous feedback. The CG had a 2-hour workshop where they received in-person feedback. After training, students were assessed using the objective structured assessment of technical skills (OSATS) scale. Twenty students in thoracentesis and 23 in paracentesis training completed the 2 training sessions with remote and asynchronous feedback, and 30 students for both thoracentesis and paracentesis groups completed the 2-hour workshop.

RESULTS

The EG achieved a significantly higher passing rate than the CG on both procedures (thoracentesis 80% vs. 43%, paracentesis 91% vs. 67%, p-value< 0.05).

CONCLUSION

The asynchronous educational method allowed EG students to achieve higher performance than CG students. This novel modality allowed students and instructors to train and assess at their own pace.

Simulation-Based Training Program for Peripherally Inserted Central Catheter Placement: Randomized Comparative Study of in-Person Training With Synchronous Feedback Versus Distance Training With Asynchronous Feedback

INTRODUCTION

Simulation training that includes deliberate practice is effective for procedural skill training. Delivering feedback remotely and asynchronously has been examined for more cost-efficient training. This prospective randomized study aimed to compare 2 feedback techniques for simulation training: synchronous direct feedback versus asynchronous distance feedback (ASYNC).

METHODS

Forty anesthesia and internal medicine residents were recruited after study approval by the institutional ethics committee. Residents reviewed instructional material on an online platform and performed a pretraining assessment (PRE) for peripherally inserted central catheter (PICC) placement. Each resident was then randomly assigned to 1 of 2 training types, practice with synchronous direct feedback (SYNC) or practice with ASYNC. Training consisted of four, 1-hour practice sessions; each was conducted once per week. Both groups underwent posttraining evaluation (POST). The PRE and POST assessments were videotaped and evaluated by 2 independent, blinded reviewers using a global rating scale.

RESULTS

Thirty-five residents completed the training program and both evaluations. Both groups had significantly improved global rating scale scores after 4 sessions. The SYNC group improved from 28 to 45 points ( P < 0.01); the ASYNC group improved from 26.5 to 46 points ( P < 0.01). We found no significant between-group differences for the PRE ( P = 0.42) or POST assessments ( P = 0.13).

CONCLUSION

This simulation-based training program significantly improved residents' peripherally inserted central venous catheter placement skills using either modality. With these results, we are unable to demonstrate the superiority of synchronous feedback over ASYNC. Asynchronous feedback training modality represents a new, innovative approach for health care procedural skills training.

From FUSE to a hands-on electrosurgery course using a cadaveric model

INTRODUCTION

Surgical procedures in contemporary practice frequently employ energy-based devices, yet comprehensive education surrounding their safety and effectiveness remains deficient. We propose an innovative course for residents that aims to provide basic electrosurgery knowledge and promote the safe use of these devices.

METHODS

We developed a simulated training course for first-year general surgery and orthopedic residents. First, a survey was conducted regarding their knowledge perception about energy devices. The course consisted of two online theoretical sessions, followed by three in-person practical sessions. First-year residents performed three video-recorded attempts using a cadaveric model and were assessed through a digital platform using the Objective Structured Assessment of Technical Skill (OSATS), a Specific Rating Scale (SRS), and a surgical energy-based devices scale (SEBS). Third-year residents were recruited as a control group.

RESULTS

The study included 20 first-year residents and 5 third-year residents. First-year residents perceived a knowledge gap regarding energy devices. Regarding practical performance, both OSATS and checklist scores were statistically different between novices at their first attempt and the control group. When we analyzed the novice's performance, we found a significant increase in OSATS (13 vs 21), SRS (13 vs 17.5), and SEBS (5 vs 7) pre- and post-training scores. The amount of feedback referred to skin burns with the electro-scalpel reduced from 18 feedbacks in the first attempt to 2 in the third attempt (p-value = 0.0002). When comparing the final session of novices with the control group, no differences were found in the SRS (p = 0.22) or SEBS (p = 0.97), but differences remained in OSATS (p = 0.017).

CONCLUSION

This study supports the implementation of structured education in electrosurgery among surgical trainees. By teaching first-year residents about electrosurgery, they can acquire a skill set equivalent to that of third-year residents. The integration of such courses can mitigate complications associated with energy device misuse, ultimately enhancing patient safety.

Innovations in surgical training: exploring the role of artificial intelligence and large language models (LLM)

The landscape of surgical training is rapidly evolving with the advent of artificial intelligence (AI) and its integration into education and simulation. This manuscript aims to explore the potential applications and benefits of AI-assisted surgical training, particularly the use of large language models (LLMs), in enhancing communication, personalizing feedback, and promoting skill development. We discuss the advancements in simulation-based training, AI-driven assessment tools, video-based assessment systems, virtual reality (VR) and augmented reality (AR) platforms, and the potential role of LLMs in the transcription, translation, and summarization of feedback. Despite the promising opportunities presented by AI integration, several challenges must be addressed, including accuracy and reliability, ethical and privacy concerns, bias in AI models, integration with existing training systems, and training and adoption of AI-assisted tools. By proactively addressing these challenges and harnessing the potential of AI, the future of surgical training may be reshaped to provide a more comprehensive, safe, and effective learning experience for trainees, ultimately leading to better patient outcomes. .

Remote, asynchronous training and feedback enables development of neurodynamic skills in physiotherapy students

BACKGROUND

During the COVID-19 pandemic, face-to-face teaching and learning of physiotherapy practical skills was limited. Asynchronous, remote training has been effective in development of clinical skills in some health professions. This study aimed to determine the effect of remote, asynchronous training and feedback on development of neurodynamic skills in physiotherapy students.

METHODS

Longitudinal repeated measurements study, across four training sessions. Participants engaged in a remote training program for development of upper limb neurodynamic techniques. In this sequential training, participants viewed the online tutorial, practiced independently, and uploaded a video of their performance for formative assessment and feedback from a trained instructor via a checklist and rubric.

RESULTS

Intra-subject analyses of 60 third-year physiotherapy students showed that the target standard of performance, with no further significant change in scores, was attained following session 2 for the checklist and session 3 for the rubric. This shows that two sessions are required to learn the procedures, and three sessions yield further improvements in performance quality.

CONCLUSION

The remote, asynchronous training and feedback model proved to be an effective strategy for students' development of neurodynamic testing skills and forms a viable alternative to in-person training. This study contributes to the future of acquiring physiotherapy clinical competencies when distance or hybrid practice is required.