Effect of Continuous Motion Parameter Feedback on Laparoscopic Simulation Training: A Prospective Randomized Controlled Trial on Skill Acquisition and Retention

Simultaneous Remote Laparoscopic Training for Trainees Among Multiple Institutions: Can Remote Coaching Replace On-Site Coaching?

INTRODUCTION

Regional disparities in medical practice between urban and rural areas in Japan represent a critical issue, and extend to the field of surgical education. To address these disparities, we evaluated the effectiveness of simultaneous remote coaching across multiple facilities using a standardized laparoscopic training method.

METHODS

A total of 28 trainees from a university hospital and 3 rural hospitals were categorized into remote and on-site coaching groups. The training curriculum included lectures, practical training, and assessments, conducted for 1 h per week using three sessions. The primary endpoint of the study was the change in time for ligation of one suture between the on-site and remote coaching groups, expressed as the median of the reduction suture time rate (RTR). Secondary endpoints included the RTR categorized by years of graduation and the results of a questionnaire survey of participants.

RESULTS

Participants included 19 trainees in postgraduate year (PGY) 1-2 and 9 those in PGY 3-5. The median suture ligation time for the first attempt was 145 s (remote: 136 s vs. on-site: 160 s; p = 0.33) and that for the third attempt was 51 s (remote: 33 s vs. direct: 52 s; p = 0.91). The median RTR was 57%, with no significant difference observed between the remote and on-site coaching groups (43.2% vs. 71.2%, p = 0.26). The trainees' ratings for the training were generally favorable, with median ratings of 4 (range: 3-5) for the content of practical skills and 5 (4, 5) for the distance learning aspect, based on a 5-point Likert scale.

CONCLUSION

Simultaneous remote laparoscopic training could be effective in reducing disparities in surgical education.

Improvement of upper limb function in post-stroke patients with motion feedback training-based combination therapy: a retrospective analysis of muscle activation and recovery dynamics

OBJECTIVE

To evaluate the effectiveness of combination therapy based on motion feedback training in patients recovering from ischemic stroke.

METHODS

A retrospective analysis was conducted on 205 patients in the recovery phase of ischemic stroke admitted between June 2022 and June 2023. Patients were divided into two groups: the conventional treatment group (n=101), receiving standard care, and the combination therapy group (n=104), receiving additional motion feedback training for 30 days. Outcome measures included root mean square (RMS) and median frequency (MDF) of surface electromyography (sEMG) for upper limb muscles, biochemical indicators, active range of motion (AROM), Fugl-Meyer Assessment (FMA) scores, and Activities of Daily Living (ADL) scores.

RESULTS

Combination therapy significantly improved post-treatment RMS values in muscles such as the left Biceps brachii (BB) (P=0.008), right BB (P=0.003), and right Flexor pollicis brevis (FPB) (P=0.010). MDF values also improved significantly in the left BB (P=0.002) and left FPB (P=0.027). The combination therapy group showed higher post-treatment SOD levels compared to the conventional group (P=0.001). Significant improvements were observed in AROM (P<0.001), FMA (P<0.001), and ADL scores (P=0.010) in the combination therapy group. Logistic regression analysis revealed that combination therapy was associated with better outcomes (OR, 0.518; 95% CI, 0.291-0.923; P=0.026), while higher pre-treatment right FPB RMS values were linked to poorer prognosis (OR, 1.074; 95% CI, 1.004-1.149; P=0.039).

CONCLUSION

Motion feedback training-based combination therapy significantly enhances muscle activation, antioxidant biochemical pathways, functional recovery, and daily living activities in post-stroke patients compared to conventional treatment alone.

Change in economy of ultrasound probe motion among general medicine trainees

OBJECTIVES

To observe change in economy of 9 ultrasound probe movement metrics among internal medicine trainees during a 5-day training course in cardiac point of care ultrasound (POCUS).

METHODS

We used a novel probe tracking device to record nine features of ultrasound probe movement, while trainees and experts optimized ultrasound clips on the same volunteer patients. These features included translational movements, gyroscopic movements (titling, rocking, and rotation), smoothness, total path length, and scanning time. We determined the adjusted difference between each trainee's movements and the mean value of the experts' movements for each patient. We then used a mixed effects model to trend average the adjusted differences between trainees and experts throughout the 5 days of the course.

RESULTS

Fifteen trainees were enrolled. Three echocardiographer technicians and the course director served as experts. Across 16 unique patients, 294 ultrasound clips were acquired. For all 9 movements, the adjusted difference between trainees and experts narrowed day-to-day (p value < 0.05), suggesting ongoing improvement during training. By the last day of the course, there were no statistically significant differences between trainees and experts in translational movement, gyroscopic movement, smoothness, or total path length; yet on average trainees took 28 s (95% CI [14.7-40.3] seconds) more to acquire a clip.

CONCLUSIONS

We detected improved ultrasound probe motion economy among internal medicine trainees during a 5-day training course in cardiac POCUS using an inexpensive probe tracking device. Objectively quantifying probe motion economy may help assess a trainee's level of proficiency in this skill and individualize their POCUS training.

Exploring the activities and outcomes of digital teaching and learning of practical skills in higher education for the social and health care professions: a scoping review

Higher education for health care professionals faces numerous challenges. It is important to develop and apply methods supporting education, especially the practical skills. This scoping review aimed to explore the activities and learning outcomes of digital technology in practical skills teaching and learning in higher education for the social and health professions. Scoping review recommendations and the PRISMA-ScR checklist were applied. Randomized controlled trials published between 2016 and 2021 involving students in higher education who were taking courses in the social sciences and health care and reported interventions with digital technology activities and practices in practical teaching and learning were included. The CINAHL Plus, PubMed, Scopus, ERIC, and Sociological Abstracts/Social Services Abstracts databases were searched. Teaching methods were blended, e-learning or other online-based, and digital simulation-based activities. Teaching and learning environments, methods, resources, and activity characteristics varied, making a summary difficult. Interventions were developed in a face-to-face format prior to digitalization. The outcomes were measured at the knowledge level, not at the performance level. One-third of the studies showed a significant improvement in practical skills in the intervention group in comparison to the control conditions. The use of digital technology in the learning and teaching process have potential to develop of students' skills, knowledge, motivation, and attitudes. The pedagogy of technology use is decisive. The development of new digital methods for teaching and learning practical skills requires the engagement of students and teachers, in addition the researchers.

Using open surgery simulation kinematic data for tool and gesture recognition

PURPOSE

The use of motion sensors is emerging as a means for measuring surgical performance. Motion sensors are typically used for calculating performance metrics and assessing skill. The aim of this study was to identify surgical gestures and tools used during an open surgery suturing simulation based on motion sensor data.

METHODS

Twenty-five participants performed a suturing task on a variable tissue simulator. Electromagnetic motion sensors were used to measure their performance. The current study compares GRU and LSTM networks, which are known to perform well on other kinematic datasets, as well as MS-TCN++, which was developed for video data and was adapted in this work for motion sensors data. Finally, we extended all architectures for multi-tasking.

RESULTS

In the gesture recognition task the MS-TCN++ has the highest performance with accuracy of [Formula: see text] and F1-Macro of [Formula: see text], edit distance of [Formula: see text] and F1@10 of [Formula: see text] In the tool usage recognition task for the right hand, MS-TCN++ performs the best in most metrics with an accuracy score of [Formula: see text], F1-Macro of [Formula: see text], F1@10 of [Formula: see text], and F1@25 of [Formula: see text]. The multi-task GRU performs best in all metrics in the left-hand case, with an accuracy of [Formula: see text], edit distance of [Formula: see text], F1-Macro of [Formula: see text], F1@10 of [Formula: see text], and F1@25 of [Formula: see text].

CONCLUSION

In this study, using motion sensor data, we automatically identified the surgical gestures and the tools used during an open surgery suturing simulation. Our methods may be used for computing more detailed performance metrics and assisting in automatic workflow analysis. MS-TCN++ performed better in gesture recognition as well as right-hand tool recognition, while the multi-task GRU provided better results in the left-hand case. It should be noted that our multi-task GRU network is significantly smaller and has achieved competitive results in the rest of the tasks as well.

Artificial Intelligence Methods and Artificial Intelligence-Enabled Metrics for Surgical Education: A Multidisciplinary Consensus

BACKGROUND

Artificial intelligence (AI) methods and AI-enabled metrics hold tremendous potential to advance surgical education. Our objective was to generate consensus guidance on specific needs for AI methods and AI-enabled metrics for surgical education.

STUDY DESIGN

The study included a systematic literature search, a virtual conference, and a 3-round Delphi survey of 40 representative multidisciplinary stakeholders with domain expertise selected through purposeful sampling. The accelerated Delphi process was completed within 10 days. The survey covered overall utility, anticipated future (10-year time horizon), and applications for surgical training, assessment, and feedback. Consensus was agreement among 80% or more respondents. We coded survey questions into 11 themes and descriptively analyzed the responses.

RESULTS

The respondents included surgeons (40%), engineers (15%), affiliates of industry (27.5%), professional societies (7.5%), regulatory agencies (7.5%), and a lawyer (2.5%). The survey included 155 questions; consensus was achieved on 136 (87.7%). The panel listed 6 deliverables each for AI-enhanced learning curve analytics and surgical skill assessment. For feedback, the panel identified 10 priority deliverables spanning 2-year (n = 2), 5-year (n = 4), and 10-year (n = 4) timeframes. Within 2 years, the panel expects development of methods to recognize anatomy in images of the surgical field and to provide surgeons with performance feedback immediately after an operation. The panel also identified 5 essential that should be included in operative performance reports for surgeons.

CONCLUSIONS

The Delphi panel consensus provides a specific, bold, and forward-looking roadmap for AI methods and AI-enabled metrics for surgical education.

Linking Pain and Motor Control: Conceptualization of Movement Deficits in Patients With Painful Conditions

When people experience or expect pain, they move differently. Pain-altered movement strategies, collectively described here as pain-related movement dysfunction (PRMD), may persist well after pain resolves and, ultimately, may result in altered kinematics and kinetics, future reinjury, and disability. Although PRMD may manifest as abnormal movements that are often evident in clinical assessment, the underlying mechanisms are complex, engaging sensory-perceptual, cognitive, psychological, and motor processes. Motor control theories provide a conceptual framework to determine, assess, and target processes that contribute to normal and abnormal movement and thus are important for physical therapy and rehabilitation practice. Contemporary understanding of motor control has evolved from reflex-based understanding to a more complex task-dependent interaction between cognitive and motor systems, each with distinct neuroanatomic substrates. Though experts have recognized the importance of motor control in the management of painful conditions, there is no comprehensive framework that explicates the processes engaged in the control of goal-directed actions, particularly in the presence of pain. This Perspective outlines sensory-perceptual, cognitive, psychological, and motor processes in the contemporary model of motor control, describing the neural substrates underlying each process and highlighting how pain and anticipation of pain influence motor control processes and consequently contribute to PRMD. Finally, potential lines of future inquiry-grounded in the contemporary model of motor control-are outlined to advance understanding and improve the assessment and treatment of PRMD.

IMPACT

This Perspective proposes that approaching PRMD from a contemporary motor control perspective will uncover key mechanisms, identify treatment targets, inform assessments, and innovate treatments across sensory-perceptual, cognitive, and motor domains, all of which have the potential to improve movement and functional outcomes in patients with painful conditions.

Development of an innovative surgical navigation system for sacrospinous fixation in pelvic surgery

STUDY OBJECTIVE

To validate the use of an innovative navigation method for sacrospinous fixation in surgery-like conditions as a new teaching tool and surgical method.

DESIGN

2-month-experiment prospective pilot study between July and August 2021.

SETTING

Biomechanics laboratory academic research.

POPULATION

29 participants: 9 gynecological surgeons and 20 participants with no medical background.

MEASUREMENT AND MAIN RESULTS

The experiment was composed of two training phases dedicated to improve the hand-eye coordination and suture skills on a training mock-up, and of a suturing phase on a pelvic mock-up designed to recreate the surgery-like conditions of a sacrospinous fixation. The surgeons provided qualitative feedback on the bio-accuracy of the mock-ups and evaluated the ease-of-use of the navigation software. Non-surgeons were included to assess the progression of the suture performance between two experiments performed one week apart (Session 1 & 2). The main objective for participants was to reach a virtual target and to stitch sacrospinous ligaments. For Session 1, an overall comfort score of 7.2/10 was attributed to the tool; 14 (42%) surgeon suture attempts and 63 (65%) non-surgeon suture attempts were accurate (i.e. below the 5-mm threshold). 22 (67%) surgeon suture attempts and 28 (34%) non-surgeon suture attempts were fast (i.e. in the first two quantiles of the duration dataset). An improvement of the non-surgeon performance was observed between the two sessions in terms of duration (Session 1: 46±20 sec; Session 2: 37±18 sec; p=0.047) and distance (Session 1: 3.8±1.3 mm; Session 2: 3.2±1.4 mm; p=10^-5) for the last suturing exercise.

CONCLUSION

This new motion-capture-based navigation method for sacrospinous fixation tested under surgery-like conditions seemed to be accurate and effective. The next step will be to design a pelvis model more adapted to the constraints of a sacrospinous fixation and to validate the benefits of this method compared to current techniques.

Virtual Reality as an Affirmative Spin-Off to Laparoscopic Training: An Updated Review

Latest advancements in science lead to drastic improvements in patient health care. Techniques and technology evolved in surgery over the years have resulted in the improvement of patient outcomes by leaps and bounds. Open surgeries previously done for procedures like appendectomy and cholecystectomy evolved into laparoscopic minimally invasive procedures. Such procedures pose few challenges to the surgeons, like lack of tissue feedback and fulcrum effect of the abdominal wall. But training surgeons for such an advanced skill is still following conventional methods. These procedures can be effectively trained using Virtual Reality (VR), which can simulate operations outside the operating room (OR). To maximize the outcomes of VR training, knowledge on various strategies affecting the skills acquisition and retention in VR training is essential. This review collected information from PubMed, EMBASE, Cochrane Library (CENTRAL) databases. Data from the previous ten years are included in the review. This included documents, clinical trials, meta-analysis, randomized controlled trials, reviews, systematic reviews, letters to editors, and grey literature. After an advanced Medical Subject Headings (MeSH) search, we got 59,532 results, and after the application of filters, 189 results showed up. Out of these, studies that were not exclusively relevant to the use of VR in laparoscopic surgery were manually excluded, and a total of 35 articles were included in the study. VR is found to be an excellent training modality with promising outcomes. It helps the surgeons perform the surgery accurately at a faster pace and improves confidence and multitasking ability in OR. Instructor feedback from mentors and deliberate practice of trainees, and early introduction of haptics in VR resulted in the most effective outcomes of the VR training. Box trainers are also compared with VR trainers as they are the cheaper modalities of training. However, this area needs more research to conclude if box trainers can act as a cheaper alternative to VR training providing similar outcomes.

Microsurgical training course for clinicians and scientists: a 10-year experience at the Münster University Hospital

BACKGROUND

Microsurgical techniques are an important part of clinical and experimental research. Here we present our step-by-step microsurgery training course developed at the Münster University Hospital. The goal of this course was to create a short, modular curriculum with clearly described and easy to follow working steps in accordance with the Guidelines for Training in Surgical Research in Animals by the Academy of Surgical Research.

METHODS

Over the course of 10 years, we conducted an annual 2.5 day (20 h) microsurgical training course with a total of 120 participants.

RESULTS

Prior to the course, 90% of the participants reported to have never performed a microanastomosis before. During the 10 years a total of 84.2% of the participants performed microanastomoses without assistance, 15% required assistance and only 0.8% failed.

CONCLUSIONS

Our step-by-step microsurgery training course gives a brief overview of the didactic basics and the organization of a microsurgical training course and could serve as a guide for teaching microsurgical skills. During the 2.5-day curriculum, it was possible to teach, and for participants to subsequently perform a microsurgical anastomosis. The independent reproducibility of the learned material after the course is not yet known, therefore further investigations are necessary. With this step-by-step curriculum, we were able to conduct a successful training program, shown by the fact that each participant is able to perform microvascular anastomoses on a reproducible basis.

Remote training in laparoscopy: a randomized trial comparing home-based self-regulated training to centralized instructor-regulated training

Background

Simulation-based surgical training (SBST) is key to securing future surgical expertise. Proficiency-based training (PBT) in laparoscopy has shown promising results on skills transfer. However, time constraints and limited possibilities for distributed training constitute barriers to effective PBT. Home-based training may provide a solution to these barriers and may be a feasible alternative to centralized training in times of assembly constraints.

Methods

We randomly assigned first-year trainees in abdominal surgery, gynecology, and urology to either centralized instructor-regulated training (CIRT) or home-based self-regulated training (HSRT) in laparoscopy. All participants trained on portable box trainers providing feedback on metrics and possibility for video reviewing. Training in both groups was structured as PBT with graded proficiency exercises adopted from the Fundamentals of Laparoscopic Surgery (FLS). The HSRT group trained at home guided by online learning materials, while the CIRT group attended two training sessions in the simulation center with feedback from experienced instructors. Performance tests consisted of hand–eye and bimanual coordination, suture and knot-tying, and FLS exercises. We analyzed passing rates, training time and distribution, and test performances.

Results

Passing rates were 87% and 96% in the CIRT and HSRT group, respectively. HSRT facilitated distributed training and resulted in greater variation in training times. Task times for hand–eye and bimanual coordination were significantly reduced between pretest and posttest in both groups. Trainees maintained their posttest performances at the 6-month retention test. Our analyses revealed no significant inter-group differences in performances at pretest, posttest, or retention test. Performance improvements in the two groups followed similar patterns.

Conclusion

CIRT and HSRT in laparoscopy result in comparable performance improvements. HSRT in laparoscopy is a feasible and effective alternative to CIRT when offered inside a supportive instructional design. Further research is needed to clarify trainees’ preferences and explore facilitators and barriers to HSRT.

Automatic and Objective Assessment of Motor Skills Performance in Flexible Bronchoscopy

BACKGROUND

Motor skills have been identified as a useful measure to evaluate competency in bronchoscopy. However, no automatic assessment system of motor skills with a clear pass/fail criterion in flexible bronchoscopy exists.

OBJECTIVES

The objective of the study was to develop an objective and automatic measure of motor skills in bronchoscopy and set a pass/fail criterion.

METHODS

Participants conducted 3 bronchoscopies each in a simulated setting. They were equipped with a Myo Armband that measured lower arm movements through an inertial measurement unit, and hand and finger motions through electromyography sensors. These measures were composed into an objective and automatic composite score of motor skills, the motor bronchoscopy skills score (MoBSS).

RESULTS

Twelve novices, eleven intermediates, and ten expert bronchoscopy operators participated, resulting in 99 procedures available for assessment. MoBSS was correlated with a higher diagnostic completeness (Pearson's correlation, r = 0.43, p < 0.001) and a lower procedure time (Pearson's correlation, r = -0.90, p < 0.001). MoBSS was able to differentiate operator performance based on the experience level (one-way ANOVA, p < 0.001). Using the contrasting groups' method, a passing score of -0.08 MoBSS was defined that failed 30/36 (83%) novice, 5/33 (15%) intermediate, and 1/30 (3%) expert procedures.

CONCLUSIONS

MoBSS can be used as an automatic and unbiased assessment tool for motor skills performance in flexible bronchoscopy. MoBSS has the potential to generate automatic feedback to help guide trainees toward expert performance.

Analysis of Instrument Motion and the Impact of Residency Level and Concurrent Distraction on Laparoscopic Skills

OBJECTIVE

Using a laparoscopic box trainer fitted with motion analysis trackers and software, we aim to identify differences between junior and senior residents performing the peg transfer task, and the impact of a distracting secondary task on performance.

DESIGN

General surgery residents were asked to perform the laparoscopic peg transfer task on a trainer equipped with a motion tracker. They were also asked to perform the laparoscopic task while completing a secondary task. Extreme velocity and acceleration events of instrument movement in the 3 rotational degrees of freedom were measured during task completion. The number of extreme events, defined as velocity or acceleration exceeding 1 SD above or below their own mean, were tabulated. The performance of junior residents was compared to senior residents.

SETTING

Simulation learning institute, Beaumont Hospital, Royal Oak, Michigan.

PARTICIPANTS

Thirty-seven general surgery residents from Beaumont Hospital, Royal Oak.

RESULTS

When completing the primary task alone, senior residents executed significantly fewer extreme motion events specific to acceleration in pitch (16.63 vs. 20.69, p = 0.04), and executed more extreme motion events specific to velocity in roll (16.14 vs. 15.11, p = 0.038), when compared to junior residents. With addition of a secondary task, senior residents had fewer extreme acceleration events specific to pitch, (14.69 vs. 22.22, p < 0.001).

CONCLUSIONS

While junior and senior residents completed the peg transfer task with similar times, motion analysis identified differences in extreme motion events between the groups, even when a secondary task was added. Motion analysis may prove useful for real-time feedback during laparoscopic skill acquisition.

Performance assessment - The knowledge, skills and attitudes of surgical performance

Pediatric surgical education has traditionally focused on the hard cognitive and psychomotor (technical) skills. While more and more attention is being paid to softer skills such as communication, collaboration, leadership, health advocacy, professionalism and scholarship, the bulk of curricula remain focused on the hard skills. An intricate part of education is the assessment of performance. This article reviews the current literature on the assessment of cognitive and psychomotor skills, focusing particularly on the assessment of technical skills in the realm of simulation.

Refinement in the analysis of motion within low-cost laparoscopic simulators of differing size: Implications on assessing technical skills

BACKGROUND

Simulation is becoming more important in the teaching and assessment of technical skills. The purpose of this study was to refine the use of motion analysis parameters (MAPs) to assess performance of a defined task in low-cost pediatric laparoscopic simulators of differing size.

METHODS

105 participants performed a defined intracorporeal suturing task in large and small pediatric laparoscopic simulators. Outcomes included MAPs - path length, extreme velocity events, and extreme acceleration events in all available degrees of freedom for novices, intermediates, and experts. ANOVA p <0.05 was judged significant.

RESULTS

In the smaller simulator, all MAPs discriminated between expertise groups in all degrees of freedom. In the larger simulator, all but one MAP discriminated between expertise groups. Experts demonstrated the greatest variability in performance between the larger and smaller simulators.

CONCLUSION

Analysis of motion in the performance of a defined intracorporeal suturing task allowed discrimination between novices, intermediates, and experts in large and small low-cost pediatric laparoscopic simulators. Further refinement in MAPs will determine their role in surgical education.

LEVEL OF EVIDENCE

Not applicable.