FLS and FES: comprehensive models of training and assessment

Study on the application of progressive training method combined with imagery training method in laparoscopic suturing skills training for resident physicians

OBJECTIVE

This study aims to explore an efficient teaching method to improve laparoscopic suturing skills in resident physicians by combining the progressive training method with the imagery training method.

METHODS

This study used a randomized controlled trial methodology. The experimental group received training utilizing a combination of the progressive training method and the imagery training method In contrast, the control group followed the traditional teaching method of practicing continuous complete actions. Both groups were trained in intracorporeal suturing and knot-tying under laparoscopy. The training effects of the two groups were compared and analyzed before and after the training, including LS-CAT scores and suturing time.

RESULTS

In the second test, the experimental group had much higher LS-CAT scores than the control group, as well as a considerably lower number of operation errors. In the experimental group, 88.9% of the trainees were proficient, compared to only 28.6% in the control group. There was no significant difference in suturing time between the two groups. The results of the third test indicated that, although there were no significant differences in LS-CAT total scores or suturing time between the two groups, the experimental group demonstrated a significantly lower number of operational errors compared to the control group. Additionally, the LS-CAT scores for tissue handling in the experimental group were significantly better than those in the control group.

CONCLUSION

The combination of the progressive training method and the imagery training method significantly improved resident physicians' laparoscopic suturing skills. This method greatly enhanced the efficiency and quality of learning laparoscopic suturing and knot-tying skills among surgical and gynecological resident doctors.

Current status of resident simulation training curricula: pearls and pitfalls

BACKGROUND

Residency programs are required to incorporate simulation into their training program. Ideally, simulation provides a safe environment for a trainee to be exposed to both common and challenging clinical scenarios. The purpose of this review is to detail the current state of the most commonly used laparoscopic, endoscopic, and robotic surgery simulation programs in general surgery residency education, including resources required for successful implementation and benchmarks for evaluation.

MATERIALS AND METHODS

Members of the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) Resident and Fellow Task Force (RAFT) Committee performed a literature review using PubMed and training websites. Information regarding the components of the most commonly used laparoscopic, endoscopic, and/or robotic simulation curriculum, including both formal and informal benchmarks for evaluating training competence, were collected.

RESULTS

Laparoscopic simulation revolves around the Fundamentals of Laparoscopic Surgery (FLS). Proficiency-based as well as virtual simulation have been utilized for FLS training curricula. Challenges include less direct translation to the technical complexities that can arise in laparoscopic surgery. Endoscopic simulation focuses on the Fundamentals of Endoscopic Surgery. There are virtual reality simulation platforms that can be used for skills assessment and training. Challenges include simulator types and access, as well as structured mentoring and feedback. Robotic simulation training curricula have not been standardized. Simulation includes one primary technology, which can be prohibitive based on cost and requirements for onboarding.

CONCLUSIONS

While surgical simulation seems to be a fundamental and integrated part of surgical training, it requires a significant number of resources, which can be daunting for residency training programs. Regardless of the barriers outlined, the need for surgical simulation in laparoscopy, endoscopy, and robotics at surgical education training programs is clear.

SAGES White Paper on the importance of diversity in surgical leadership: creating the fundamentals of leadership development (FLD) curriculum

BACKGROUND

The Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) has long recognized and championed increasing diversity within the surgical workplace. SAGES initiated the Fundamentals of Leadership Development (FLD) Curriculum to address these needs and to provide surgeon leaders with the necessary tools and skills to promote diversity, equity, and inclusion (DEI) in surgical practice. In 2019, the American College of Surgeons issued a request for anti-racism initiatives which lead to the partnering of the two societies. The primary goal of FLD was to create the first surgeon-focused leadership curriculum dedicated to DEI. The rationale/development of this curriculum and its evaluation/feedback methods are detailed in this White Paper.

METHODS

The FLD curriculum was developed by a multidisciplinary task force that included surgeons, education experts, and diversity consultants. The curriculum development followed the Analysis, Design, Development, Implementation and Evaluation (ADDIE) instructional design model and utilized a problem-based learning approach. Competencies were identified, and specific learning objectives and assessments were developed. The implementation of the curriculum was designed to be completed in short intervals (virtual and in-person). Post-course surveys used the Kirkpatrick's model to evaluate the curriculum and provide valuable feedback.

RESULTS

The curriculum consisted of interactive online modules, an online discussion forum, and small group interactive sessions focused in three key areas: (1) increasing pipeline of underrepresented individuals in surgical leadership, (2) healthcare equity, and (3) conflict negotiation. By focusing on positive action items and utilizing a problem-solving approach, the curriculum aimed to provide a framework for surgical leaders to make meaningful changes in their institutions and organizations.

CONCLUSION

The FLD curriculum is a novel leadership curriculum that provided surgeon leaders with the knowledge and tools to improve diversity in three areas: pipeline improvement, healthcare equity, and conflict negotiation. Future directions include using pilot course feedback to enhance curricular effectiveness and delivery.

A review of minimal access surgery provision and training within the United Kingdom

When combined with healthcare pressures, the exponential growth of robotic-assisted surgery (RAS) has impacted UK-based training outcomes, including the learning curve to competency. Aim: To ascertain the current provision of RAS and investigate differences in access to minimal access surgical (MAS) facilities and training across the UK. A two-armed electronic survey was conducted. The first arm questioned clinical leads regarding robotic practice and future training provisions. The second investigated trainee and trainers' perceptions of MAS training and facilities. 64% (52/81) of responding trusts utilise a robotic system. The majority (68% [55/81]) have plans to expand or acquire a system within 3 years. 171 responses from 112 UK and Republic of Ireland hospitals were collected for Arm 2. Laparoscopic categories queried whether trainees had access to a formal curriculum, training days and sim-boxes. Most consultants (51.9%) and trainees (51.6%) reported that there was no formal local training curriculum for robotic surgery. Combined responses demonstrated 42.1% (n = 195/463) said "yes", 39.5% (n = 183) "no" and 18.4% (n = 85) "don't know". For combined robotic categories (simulation, training days and operative lists) 28.3% (n = 134/473) responded "yes", 51.6% (n = 244) said "no" and 20.1% (n = 95) said "don't know". This study provides insight into the current provision of robotic-assisted surgery at UK trusts and highlights the need to facilitate regular clinical training and equitable access to MAS simulation within a formal curriculum. This may aid regulation of training in parallel with the expansion of robotic practice and avoid a significant skill acquisition gap and risks to patient safety.

Experimental evaluation of accuracy and efficiency of two control strategies for a novel foot commanded robotic laparoscope holders with surgeons

The implementation of a laparoscope-holding robot in minimally invasive surgery enhances the efficiency and safety of the operation. However, the extra robot control task can increase the cognitive load on surgeons. A suitable interface may simplify the control task and reduce the surgeon load. Foot interfaces are commonly used for commanding laparoscope-holding robots, with two control strategies available: decoupled control permits only one Cartesian axis actuation, known as decoupled commands; hybrid control allows for both decoupled commands and multiple axes actuation, known as coupled commands. This paper aims to determine the optimal control strategy for foot interfaces by investigating two common assumptions in the literature: (1) Decoupled control is believed to result in better predictability of the final laparoscopic view orientation, and (2) Hybrid control has the efficiency advantage in laparoscope control. Our user study with 11 experienced and trainee surgeons shows that decoupled control has better predictability than hybrid control, while both approaches are equally efficient. In addition, using two surgery-like tasks in a simulator, users' choice of decoupled and coupled commands is analysed based on their level of surgical experience and the nature of the movement. Results show that trainee surgeons tend to issue more commands than the more experienced participants. Single decoupled commands were frequently used in small view adjustments, while a mixture of coupled and decoupled commands was preferred in larger view adjustments. A guideline for foot interface control strategy selection is provided.

Mixed reality based teleoperation and visualization of surgical robotics

Surgical robotics has revolutionized the field of surgery, facilitating complex procedures in operating rooms. However, the current teleoperation systems often rely on bulky consoles, which limit the mobility of surgeons. This restriction reduces surgeons' awareness of the patient during procedures and narrows the range of implementation scenarios. To address these challenges, an alternative solution is proposed: a mixed reality-based teleoperation system. This system leverages hand gestures, head motion tracking, and speech commands to enable the teleoperation of surgical robots. The implementation focuses on the da Vinci research kit (dVRK) and utilizes the capabilities of Microsoft HoloLens 2. The system's effectiveness is evaluated through camera navigation tasks and peg transfer tasks. The results indicate that, in comparison to manipulator-based teleoperation, the system demonstrates comparable viability in endoscope teleoperation. However, it falls short in instrument teleoperation, highlighting the need for further improvements in hand gesture recognition and video display quality.

Surgical tooltip motion metrics assessment using virtual marker: an objective approach to skill assessment for minimally invasive surgery

PURPOSE

Surgical skill assessment has primarily been performed using checklists or rating scales, which are prone to bias and subjectivity. To tackle this shortcoming, assessment of surgical tool motion can be implemented to objectively classify skill levels. Due to the challenges involved in motion tracking of surgical tooltips in minimally invasive surgeries, formerly used assessment approaches may not be feasible for real-world skill assessment. We proposed an assessment approach based on the virtual marker on surgical tooltips to derive the tooltip's 3D position and introduced a novel metric for surgical skill assessment.

METHODS

We obtained the 3D tooltip position based on markers placed on the tool handle. Then, we derived tooltip motion metrics to identify the metrics differentiating the skill levels for objective surgical skill assessment. We proposed a new tooltip motion metric, i.e., motion inconsistency, that can assess the skill level, and also can evaluate the stage of skill learning. In this study, peg transfer, dual transfer, and rubber band translocation tasks were included, and nine novices, five surgical residents and five attending general surgeons participated.

RESULTS

Our analyses showed that tooltip path length (p [Formula: see text] 0.007) and path length along the instrument axis (p [Formula: see text] 0.014) differed across the three skill levels in all the tasks and decreased by skill level. Tooltip motion inconsistency showed significant differences among the three skill levels in the dual transfer (p [Formula: see text] 0.025) and the rubber band translocation tasks (p [Formula: see text] 0.021). Lastly, bimanual dexterity differed across the three skill levels in all the tasks (p [Formula: see text] 0.012) and increased by skill level.

CONCLUSION

Depth perception ability (indicated by shorter tooltip path lengths along the instrument axis), bimanual dexterity, tooltip motion consistency, and economical tooltip movements (shorter tooltip path lengths) are related to surgical skill. Our findings can contribute to objective surgical skill assessment, reducing subjectivity, bias, and associated costs.

Perceptions of Competition-Based Learning After a Brief Experience at a National Surgical Meeting

BACKGROUND

Competition-based learning (CBL) facilitates learning through competitions. At the 2022 & 2023 Annual SAGES meetings, we evaluated a CBL experience (TOP GUN Shootout) developed from a modified version of the previously validated TOP GUN Laparoscopic Skills and Suturing Program. The project sought to evaluate the TOP GUN Shootout's (TGS) ability to enhance participant engagement in pursuit of laparoscopic surgical skills.

METHODS

Participants competed in the TGS. Their scores (time and errors) were recorded for: Fundamentals of Laparoscopic Surgery Peg Pass, Cup Drop Task, and Intracorporeal Suturing. All participants completed a 10-question satisfaction survey on a 7-point Likert scale, with questions assessing 3 domains: (1) capability/confidence in MIS skill performance prior to the competition; (2) applicability and satisfaction with TGS's capacity to develop MIS skills; and (3) interest in seeking additional MIS training and appropriateness of CBL in MIS training. Descriptive statistics were used to evaluate these areas.

RESULTS

Overall, 121 participants completed the TGS, of whom 84 (69%) completed the satisfaction survey. The average age was 32.9 years, 67% were males. On average (+/- SD), participant satisfaction was 5.04 (+/- 2.08) for Domain 1, 6.20 (+/- 1.28) for Domain 2, and 6.58 (+/- .95) for Domain 3.

CONCLUSION

Participants described an overall lack of confidence in their MIS skills prior to the 2022-2023 Annual SAGES conference. Participants felt that this brief CBL experience, aided in the development of their MIS skills. Furthermore, this brief CBL experience may inspire learners to seek out further training of their MIS skills.

Development of a continuously perfused ex vivo kidney training model for laparoscopic partial nephrectomy: validity and efficiency

BACKGROUND

Suture hemostasis is essential for laparoscopic partial nephrectomy (LPN). This study aimed to develop, validate, and test the efficacy of a continuously perfused training model (CPTM) in LPN with high-level simulated bleeding.

MATERIALS AND METHODS

The CPTM was constructed using fresh porcine kidneys with renal arteries continuously perfused with red-dyed liquid gelatin. Twenty-nine participants with expert, intermediate, or novice laparoscopic experience levels were recruited. The expert and intermediate participants evaluated the CPTM, and the novice participants were randomly assigned to one of two groups to complete training on a CPTM or dry box training model (DBTM). Messick's framework criteria were utilized to assess the validity and training efficacy of the model. The data were analyzed using the Mann-Whitney U , Kruskal-Wallis, and Friedman tests. A value of P< 0.05 was considered statistically significant.

RESULTS

Positive comments were provided by all experts and intermediates for the Content . The Relationships with other variables demonstrated significant differences among novices, intermediates, and experts in all metrics ( P< 0.05). The Consequences showed that the CPTM helped novices acquire LPN skills. The training efficacy was significantly better than that of the DBTM ( P< 0.05). There were no significant differences between the final performances of the novices and the initial performances of the experts ( P >0.05). Synthesizing all metrics, the LPN skills learned using CPTMs were significantly improved in the 12th round of training.

CONCLUSION

The CPTM offered a high-level simulation of bleeding with realistic tissue texture for acquiring LPN skills. Training of no fewer than 12 rounds is recommended for a novice's LPN training on the CPTM.

Optimal Timing of Fundamentals of Endoscopic Surgery (FES) Testing in General Surgery Residency: Early Is Better

BACKGROUND

Fundamentals of endoscopic surgery (FES) completion is mandatory for certification by the American Board of Surgery (ABS). As early simulation and competency assessment can bolster development of trainee proficiency, we sought to determine the optimal timing for FES examination by evaluating pass rates based on training level and previous endoscopic experience.

METHODS

PGY2-5 residents at a university-based medical center who were novice to FES were assigned to complete FES training and testing. Training year, prior endoscopic experience, and FES exam scores were recorded with pre- and post-test surveys.

RESULTS

Most residents in the program (88%) were able to complete FES training and testing within a single academic year. Most required only a single faculty-led session (88%) to feel confident to take the exam, augmented by varying numbers of independent practice sessions (50% 1-2, 19% 3-5, 27% > 5). After training, most (84%) felt confident that they would pass the exam, and 93% did so on their first attempt. While higher written exam scores were noted in the PGY5 group, there were no other statistically significant differences in overall pass rates or technical exam scores based on PGY level (p = 0.24). A number of previously completed endoscopic cases did not correlate with exam scores (p = 0.24 written, p = 0.91 technical).

CONCLUSION

Fundamentals of endoscopic surgery (FES) certification can be successfully completed by junior level general surgery residents regardless of previous endoscopic experience. Moving this exam to earlier training years can benefit resident development and preparedness in the clinical setting without negatively impacting pass rates.

Does practice make perfect? Laparoscopic training mainly improves motion efficiency: a prospective trial

Training improves skills in minimally invasive surgery. This study aimed to investigate the learning curves of complex motion parameters for both hands during a standardized training course using a novel measurement tool. An additional focus was placed on the parameters representing surgical safety and precision. Fifty-six laparoscopic novices participated in a training course on the basic skills of minimally invasive surgery based on a modified Fundamentals of Laparoscopic Surgery (FLS) curriculum. Before, twice during, and once after the practical lessons, all participants had to perform four laparoscopic tasks (peg transfer, precision cut, balloon resection, and laparoscopic suture and knot), which were recorded and analyzed using an instrument motion analysis system. Participants significantly improved the time per task for all four tasks (all p < 0.001). The individual instrument path length decreased significantly for the dominant and non-dominant hands in all four tasks. Similarly, both hands became significantly faster in all tasks, with the exception of the non-dominant hand in the precision cut task. In terms of relative idle time, only in the peg transfer task did both hands improve significantly, while in the precision cut task, only the dominant hand performed better. In contrast, the motion volume of both hands combined was reduced in only one task (precision cut, p = 0.01), whereas no significant improvement in the relative time of instruments being out of view was observed. FLS-based skills training increases motion efficiency primarily by increasing speed and reducing idle time and path length. Parameters relevant for surgical safety and precision (motion volume and relative time of instruments being out of view) are minimally affected by short-term training. Consequently, surgical training should also focus on safety and precision-related parameters, and assessment of these parameters should be incorporated into basic skill training accordingly.

An argument-based validation study of the fundamentals of laparoscopic surgery (FLS) program

BACKGROUND

The Fundamentals of Laparoscopy Surgery (FLS) program was launched over 15 years ago. Since then, there has been an exponential rise in advancements of laparoscopy and its uses. In response, we conducted an argument-based validation study of FLS. The purpose of this paper is to exemplify this approach to validation for surgical education researchers using FLS as an illustrative case.

METHODS

The argument-based approach to validation involves three key actions: (1) developing interpretation and use arguments; (2) research; and (3) building a validity argument. Drawing from the validation study of FLS each step is exemplified.

RESULTS

Qualitative and quantitative data sources from the FLS validity examination study provided evidence that both supported claims, but also generated backing for rebuttals. Some of the key findings were synthesized in a validity argument to illustrate its structure.

DISCUSSION

The argument-based validation approach described numerous advantages over other validation approaches: (1) it is endorsed by the foundational documents in assessment and evaluation research; (2) its specific language of claims, inferences, warrants, assumptions and rebuttals provides a systematic and unified way to communicate both the processes and outcomes of validation; and (3) the use of logic reasoning in building the validity document clearly delineates the relationship between evidence and the inferences made to support desired uses and interpretations from assessments.

The entrustable professional activities of laparoscopic surgery: moving toward an integrated training model

BACKGROUND

Entrustable Professional Activities (EPAs) provide the opportunity to integrate multiple competencies into meaningful units that facilitate curriculum development and assessment design. As part of the process of reviewing and enhancing the Fundamentals of Laparoscopic of Surgery (FLS) program, we used the concept of EPAs to create a framework of reference that articulates a contemporary definition of Laparoscopic Surgery (LS).

METHODS

The framework of reference of LS was created with data gathered from a literature review and during series of educational retreats with subject matter experts (SMEs). Various activities were implemented during these retreats to develop the LS EPAs, their constitutive competencies, and related observable behaviors.

RESULTS

Ten EPAs and associated competency descriptors (articulated as observable behaviors) specific to LS were identified. In addition, knowledge areas were associated to each EPA.

DISCUSSION

A comprehensive list of EPAs for LS were identified. These EPAs will be used in the development and update of the FLS program. Further, they can be used to guide the development of curriculum, clinical teaching, and assessment in any surgical program with a laparoscopic training component. They are applicable to any level of training by defining the expected observable behaviors associated with a given level of expertise. These fundamental aspects of LS provide a common framework of reference across different surgical specialties.

Motion Smoothness-Based Assessment of Surgical Expertise: The Importance of Selecting Proper Metrics

The smooth movement of hand/surgical instruments is considered an indicator of skilled, coordinated surgical performance. Jerky surgical instrument movements or hand tremors can cause unwanted damages to the surgical site. Different methods have been used in previous studies for assessing motion smoothness, causing conflicting results regarding the comparison among surgical skill levels. We recruited four attending surgeons, five surgical residents, and nine novices. The participants conducted three simulated laparoscopic tasks, including peg transfer, bimanual peg transfer, and rubber band translocation. Tooltip motion smoothness was computed using the mean tooltip motion jerk, logarithmic dimensionless tooltip motion jerk, and 95% tooltip motion frequency (originally proposed in this study) to evaluate their capability of surgical skill level differentiation. The results revealed that logarithmic dimensionless motion jerk and 95% motion frequency were capable of distinguishing skill levels, indicated by smoother tooltip movements observed in high compared to low skill levels. Contrarily, mean motion jerk was not able to distinguish the skill levels. Additionally, 95% motion frequency was less affected by the measurement noise since it did not require the calculation of motion jerk, and 95% motion frequency and logarithmic dimensionless motion jerk yielded a better motion smoothness assessment outcome in distinguishing skill levels than mean motion jerk.

Development and Validation of Task-Specific Metrics for the Assessment of Linear Stapler-Based Small Bowel Anastomosis

INTRODUCTION

Task-specific metrics facilitate the assessment of surgeon performance. This 3-phased study was designed to (1) develop task-specific metrics for stapled small bowel anastomosis, (2) obtain expert consensus on the appropriateness of the developed metrics, and (3) establish its discriminant validity.

METHODS

In Phase I, a hierarchical task analysis was used to develop the metrics. In Phase II, a survey of expert colorectal surgeons established the importance of the developed metrics. In Phase III, to establish discriminant validity, surgical trainees and surgeons, divided into novice and experienced groups, constructed a side-to-side anastomosis on porcine small bowel using a linear cutting stapler. The participants' performances were videotaped and rated by 2 independent observers. Partial least squares regression was used to compute the weights for the task-specific metrics to obtain weighted total score.

RESULTS

In Phase II, a total of 45 colorectal surgeons were surveyed: 28 with more than 15 years, 13 with 5 to 15 years, and 4 with less than 5 years of experience. The consensus was obtained on all the task-specific metrics in the more experienced groups. In Phase III, 20 subjects participated equally in both groups. The experienced group performed better than the novice group regardless of the rating scale used: global rating scale (p = 0.009) and the task-specific metrics (p = 0.012). After partial least squares regression, the weighted task-specific metric score continued to show that the experienced group performed better (p < 0.001).

CONCLUSION

Task-specific metric items were developed based on expert consensus and showed good discriminant validity compared with a global rating scale between experienced and novice operators. These items can be used for evaluating technical skills in a stapled small bowel anastomosis model.

Does caffeine consumption affect laparoscopic skills in a motion tracking analysis? A prospective, randomized, blinded crossover trial

BACKGROUND

Coffee can increase vigilance and performance, especially during sleep deprivation. The hypothetical downside of caffeine in the surgical field is the potential interaction with the ergonomics of movement and the central nervous system. The objective of this trial was to investigate the influence of caffeine on laparoscopic performance.

METHODS

Fifty laparoscopic novices participated in this prospective randomized, blinded crossover trial and were trained in a modified FLS curriculum until reaching a predefined proficiency. Subsequently, all participants performed four laparoscopic tasks twice, once after consumption of a placebo and once after a caffeinated (200 mg) beverage. Comparative analysis was performed between the cohorts. Primary endpoint analysis included task time, task errors, OSATS score and a performance analysis with an instrument motion analysis (IMA) system.

RESULTS

Fifty participants completed the study. Sixty-eight percent of participants drank coffee daily. The time to completion for each task was comparable between the caffeine and placebo cohorts for PEG transfer (119 s vs 121 s; p = 0.73), precise cutting (157 s vs 163 s; p = 0.74), gallbladder resection (190 s vs 173 s; p = 0.6) and surgical knot (171 s vs 189 s; p = 0.68). The instrument motion analysis showed no significant differences between the caffeine and placebo groups in any parameters: instrument volume, path length, idle, velocity, acceleration, and instrument out of view. Additionally, OSATS scores did not differ between groups, regardless of task. Major errors occurred similarly in both groups, except for one error criteria during the circle cutting task, which occurred significantly more often in the caffeine group (34% vs. 16%, p < 0.05).

CONCLUSION

The objective IMA and performance scores of laparoscopic skills revealed that caffeine consumption does not enhance or impair the overall laparoscopic performance of surgical novices. The occurrence of major errors is not conclusive but could be negatively influenced in part by caffeine intake.

Effectiveness of telesimulation for pediatric minimally invasive surgery essential skills training

BACKGROUND

In the context of the COVID-19 pandemic and social distancing rules, access to in-person training activities had temporarily been interrupted, speeding up the implementation of telesimulation for minimally invasive surgery (MIS) essential skills training (T-ESTM, Telesimulation - Essential Skills Training Module) in our center. The aim of this study was to explore the effectiveness of T-ESTM.

METHODS

T-ESTM was scheduled into 2 sessions of 3 h through the Zoom® virtual meeting platform. The academic lectures, the tutorials for box-trainer set-up and 7 performance tasks were accessed through an online campus previous to the remote encounter for personalized guidance and debriefing. Initial (pre-telementoring) and final (post 6-hour telementoring) assessment scoring as well as timing for Task 2 (circle-cutting pattern), 3 (extracorporeal Roeder knot) and 5 (intracorporeal Square knot) were registered.

RESULTS

61 participants were recruited. The mean age was 31±5 years. 65% were surgical residents. 48% performed low complexity procedures. 52% had previous experience with simulation training. In Task 2, there was a 21% improvement in the final score obtained, as well as a significant decrease in time of 33%; in Task 3, there was an increase of 39% in the scoring and a decrease of 49% in the timing; and in Task 5, participants improved their technique a 30% and decreased the performance time a 47%. All the differences were statistically significant.

DISCUSSION

Our data support T-ESTM as a reproducible and effective educational tool for remote MIS essential skills hands-on training.

LEVEL OF EVIDENCE

II.

Objective assessment of robotic surgical skills: review of literature and future directions

BACKGROUND

Evaluation of robotic surgical skill has become increasingly important as robotic approaches to common surgeries become more widely utilized. However, evaluation of these currently lacks standardization. In this paper, we aimed to review the literature on robotic surgical skill evaluation.

METHODS

A review of literature on robotic surgical skill evaluation was performed and representative literature presented over the past ten years.

RESULTS

The study of reliability and validity in robotic surgical evaluation shows two main assessment categories: manual and automatic. Manual assessments have been shown to be valid but typically are time consuming and costly. Automatic evaluation and simulation are similarly valid and simpler to implement. Initial reports on evaluation of skill using artificial intelligence platforms show validity. Few data on evaluation methods of surgical skill connect directly to patient outcomes.

CONCLUSION

As evaluation in surgery begins to incorporate robotic skills, a simultaneous shift from manual to automatic evaluation may occur given the ease of implementation of these technologies. Robotic platforms offer the unique benefit of providing more objective data streams including kinematic data which allows for precise instrument tracking in the operative field. Such data streams will likely incrementally be implemented in performance evaluations. Similarly, with advances in artificial intelligence, machine evaluation of human technical skill will likely form the next wave of surgical evaluation.

Meet EBE: The Development of an Evidence-Based Endoscopy Simulator

BACKGROUND AND AIMS

In the digital era of evidence-based medicine, there is a paucity of video endoscopy teaching platforms that use evidence-based medicine principles, or that allow for cognitive simulation of endoscopic management strategies. We created a guideline-based teaching platform for fellows that incorporates these features, and tested it.

METHODS

A pilot video module with embedded questions was drafted, and after incorporation of feedback from several attending gastroenterologists, an additional 2 modules were created. The embedded questions were designed to simulate cognitive management decisions as if the viewer were doing the endoscopy procedure in the video. A narrator explained the evidence behind the task being performed, and its certainty based on endoscopic guidelines. Quizzes and surveys were developed and administered to a sample of attendings and fellows who completed the video modules to test efficacy, usability, and likeability.

RESULTS

Three video modules, named evidence-based endoscopy (EBE), incorporating low fidelity simulation, and utilizing evidence-based medicine principles, were created. Eight fellows and 10 attendings completed the video modules and all quizzes and surveys. Mean test scores improved from before to after completing the video modules (56% to 92%; mean difference = -35%; 95% confidence interval, 27%-47%). Surveys indicated that the product was viewed favorably by participants, and that there is a strong desire for this type of educational product.

CONCLUSIONS

The EBE simulator is a unique, desirable, and effective educational platform based on evidence-based medicine principles that fills a gap in available tools for endoscopy education. Further studies are needed to assess whether EBE can aid in long-term knowledge retention and increase adherence to guideline recommendations.

¿Se deben confiar actividades profesionales en cirugía mínimamente invasiva al médico general? Una propuesta basada en el aprendizaje experiencial

Introducción. El entrenamiento en cirugía mínimamente invasiva y la definición de las actividades profesionales específicas, socialmente responsables y seguras para el paciente, son un desafío y un deber en la educación médica. Nuestro objetivo es argumentar a favor de esta intervención y describir las especificaciones, alcances y limitaciones de las actividades profesionales confiables a este nivel, así como su lugar en un modelo de aprendizaje experiencial en cirugía mínimamente invasiva para toda la vida. Métodos. Se evalúa el contexto de la actividad quirúrgica asistencial de los médicos generales, con relación a su participación en el equipo quirúrgico y la necesidad de incorporación en su perfil profesional de unas competencias propias de la cirugía mínimamente invasiva, acorde con su nivel y funciones. Mediante una postura académica y reflexiva, se identifican vacíos y oportunidades de avanzar en el tema. Resultados. El perfil profesional de un médico general debe contemplar la cirugía mínimamente invasiva como una competencia dentro de su formación, de manera análoga a las propias de la cirugía tradicional abierta. Para ello, se requiere afrontar coherentemente el cambio de teoría y educación quirúrgica, el cambio en la demanda de servicios quirúrgicos y procedimientos, así como fortalecer el rol activo del médico general en el equipo quirúrgico. Conclusiones. Es necesario modificar el paradigma educativo en cirugía, desde la formación médica en el pregrado. Se plantea un modelo de aprendizaje experiencial de cirugía mínimamente invasiva, y se establecen las competencias fundamentadas en actividades profesionales confiables, necesarias para el perfil profesional de un médico general del siglo XXI.

Effect of Genre and amplitude of music during laparoscopic surgery

PURPOSE

Music is often played in operating theaters. In the literature, the effects of music on surgeons are controversial. We aimed to investigate the effect of different music genres and amplitudes on laparoscopic performance.

METHODS

Novice surgeons underwent a proficiency-based laparoscopic training curriculum. Participants were required to perform these tasks under three conditions: no music, with music in medium volume (45-50 dB) and in high volume (65-70 dB). Soft rock by the Beatles and hard rock by AC/DC were played. Task performance was evaluated by analyzing speed and accuracy.

RESULTS

With soft rock in medium volume, participants were faster in peg transfer (60.3 vs. 56.7 s, P = 0.012) and more accurate in suture with intracorporeal knot (79.2 vs. 54.0, P = 0.011) compared to without music. The total score was improved (383.4 vs. 337.9, P = 0.0076) by enhancing accuracy (79.5 vs. 54.0, P = 0.011). This positive effect was lost if the soft rock was played in high volume. With hard rock in medium volume, participants were faster performing precision cutting (139.4 vs. 235.8, P = 0.0009) compared to without music. Both balloon preparation and precision cutting were performed more rapidly (227.3 vs. 181.4, P = 0.003, 139.4 vs. 114.0, P < 0.0001) and the accuracy was maintained. Hard rock in high volume also resulted in increased speed (366.7 vs. 295.5, P < 0.0001) compared to without music. Thereby, the total scores of participants were enhanced (516.5 vs. 437.1, P = 0.002).

CONCLUSION

Our data reveal that the effect of music on laparoscopic performance might depend on the combination of music genre and amplitude. A generally well-accepted music genre in the right volume could improve the performance of novice surgeons during laparoscopic surgeries.

TRIAL REGISTRATION

DRKS00026759, register date: 18.10.2021 (retrospectively registered).

The Fundamentals of Vaginal Surgery pilot study: developing, validating, and setting proficiency scores for a vaginal surgical skills simulation system

BACKGROUND

Surgical training in the simulation lab can develop basic skills that translate to the operating room. Standardized, basic skills programs that are supported by validated assessment measures exist for open, laparoscopic, and endoscopic surgery; however, there is yet to be a nationally recognized and widely implemented basic skills program specifically for vaginal surgery.

OBJECTIVE

Develop a vaginal surgical simulation system; evaluate robust validity evidence for the simulation system and its related performance measures; and establish a proficiency score that discriminates between novice and experienced vaginal surgeon performance.

STUDY DESIGN

In this 3-phased study, we developed the Fundamentals of Vaginal Surgery simulation system consisting of (1) the Fundamentals of Vaginal Surgery Trainer, a task trainer; (2) a validated regimen of tasks to be performed on the trainer; and (3) performance measures to determine proficiency. In Phase I, we developed the task trainer and selected surgical tasks by performing a needs assessment and hierarchical task analyses, with review and consensus from an expert panel. In Phase II, we conducted a national survey of vaginal surgeons to collect validity evidence regarding test content, response process, and internal structure relevant to the simulation system. In Phase III, we compared performance of novice (first and second year residents) and experienced (third and fourth year residents, fellows, and faculty) surgeons on the simulation system to evaluate relevant relationships to other variables and consequences. Performance measures were analyzed to set a proficiency score that would discriminate between novice and expert (faculty) vaginal surgical performance.

RESULTS

A novel task trainer and 6 basic vaginal surgical skills were developed in Phase I. In Phase II, the survey responses of 48 participants (27 faculty surgeons, 6 fellows, and 14 residents) were evaluated on the dimensions of test content, response process, and internal structure. To support evidence of test content, the participants deemed the task trainer and surgical tasks representative of intended surgical field and supportive of typical surgical actions (mean scores, 3.8-4.4/5). For response process, rater-data analysis revealed high rating variability regarding prototype color. This early evidence confirmed the value of a white prototype. For internal structure, there was high agreement among rater groups (obstetricians and gynecologists generalists vs Female Pelvic Medicine and Reconstructive Surgery specialists: interclass correlation coefficient range, 0.59-0.91; learners vs faculty interclass correlation coefficient range, 0.64-1.0). There were no differences in ratings across institution type, surgeon volume, expertise (P>.14). In Phase III, we analyzed performance from 23 participants (15 [65%] obstetricians and gynecologists residents, 3 [13%] fellows, and 5 [22%] Female Pelvic Medicine and Reconstructive Surgery faculty). Experienced surgeons scored significantly higher than novice surgeons (median, 467.5; interquartile range, [402.5-542.5] vs median, 261.5; interquartile range, [211.5-351.0]; P<.001). Based on these data, setting a proficiency score threshold at 400 results in 0% (0/6) novices attaining the score, with 100% (5/5) experts exceeding it.

CONCLUSION

We present validity evidence relevant to all 5 sources which supports the use of this novel simulation system for basic vaginal surgical skills. To complement the system, a proficiency score of 400 was established to discriminate between novices and experts.

Incorporating Cleft Lip Simulation Into a "Bootcamp-Style" Curriculum

INTRODUCTION

The traditions of surgical education have changed little over the years. However, the increasing focus on patient safety and duty hour restrictions mandates that residents start developing complex skill sets earlier to ensure they graduate with procedural competency. Surgical training is poised to exploit high-fidelity simulation technology to mitigate these pressures.

METHODS

By revisiting principles of adult learning theory, the authors created a "bootcamp-style" cleft lip curriculum that sought to (1) maximize educational impact and (2) pilot a high-fidelity procedural trainer permitting resident operative autonomy as part of that curriculum. Trainees participated in small group educational sessions comprised of a standard cleft didactic lecture, augmented by instructional video. Participants immediately processed knowledge from the lecture/video by "operating" on the simulator, allowing opportunities for questions and self-reflection, completing the learning cycle. A self-assessment survey was taken before and after each component of the session, including a self-confidence survey to conclude the session. Anthropometric measures of lip/nasal symmetry were assessed.

RESULTS

Sixteen trainees participated in the program. Little increase in self-assessed knowledge/skill was seen after the lecture, but significant increases in most aspects of cleft lip repair were seen after simulation. The greatest increase in self-assessment was seen for the program as a whole, with significant differences across all aspects of the self-assessment. Higher levels of training were associated with both higher self-assessment scores and better lip symmetry. Regardless of level of training, all participants strongly agreed that simulation helped them actively engage in learning and should be a required aspect of training, whereas 94% (n = 15) thought simulation was much more effective than standard preparation alone.

CONCLUSIONS

This pilot curriculum illustrates a mechanism to incorporate lessons from adult learning theory into plastic surgery training using a high-fidelity simulator for deliberate practice of cleft lip repair. Further evaluation is warranted to determine whether this didactic model can accelerate the acquisition of the complex skill set required for cleft lip repair and other surgical procedures.

Functional brain connectivity related to surgical skill dexterity in physical and virtual simulation environments

Significance: Surgical simulators, both virtual and physical, are increasingly used as training tools for teaching and assessing surgical technical skills. However, the metrics used for assessment in these simulation environments are often subjective and inconsistent. Aim: We propose functional activation metrics, derived from brain imaging measurements, to objectively assess the correspondence between brain activation with surgical motor skills for subjects with varying degrees of surgical skill. Approach: Cortical activation based on changes in the oxygenated hemoglobin (HbO) of 36 subjects was measured using functional near-infrared spectroscopy at the prefrontal cortex (PFC), primary motor cortex, and supplementary motor area (SMA) due to their association with motor skill learning. Inter-regional functional connectivity metrics, namely, wavelet coherence (WCO) and wavelet phase coherence were derived from HbO changes to correlate brain activity to surgical motor skill levels objectively. Results: One-way multivariate analysis of variance found a statistically significant difference in the inter-regional WCO metrics for physical simulator based on Wilk's Λ for expert versus novice, F ( 10,1 ) = 7495.5 , p < 0.01 . Partial eta squared effect size for the inter-regional WCO metrics was found to be highest between the central prefrontal cortex (CPFC) and SMA, CPFC-SMA ( η 2 = 0.257 ). Two-tailed Mann-Whitney U tests with a 95% confidence interval showed baseline equivalence and a statistically significant ( p < 0.001 ) difference in the CPFC-SMA WPCO metrics for the physical simulator training group ( 0.960 ± 0.045 ) versus the untrained control group ( 0.735 ± 0.177 ) following training for 10 consecutive days in addition to the pretest and posttest days. Conclusion: We show that brain functional connectivity WCO metric corresponds to surgical motor skills in the laparoscopic physical simulators. Functional connectivity between the CPFC and the SMA is lower for subjects that exhibit expert surgical motor skills than untrained subjects in laparoscopic physical simulators.

Análisis bibliométrico y de mapeo de la educación en cirugía laparoscópica y robótica en urología

Objetivo Se realizó un análisis bibliométrico para conocer la situación actual de la educación en cirugía laparoscópica y robótica en urología.

Métodos La búsqueda fue realizada en la base de datos MEDLINE y EMBASE en marzo de 2020, a través del facilitador de búsqueda: FABUMED y PUBMED-PUBREMINER, utilizando los siguientes criterios (Laparoscopy OR robotics) AND (education urology) AND (1988:2019[dp])) y establecer los artículos disponibles respecto a educación en cirugía laparoscópica en urología. Adicionalmente se realizó un análisis de mapeo bibliométrico así como mapas de redes de colaboración.

Resultados Se obtuvieron 1383 revisiones en la literatura publicadas en 172 revistas. Las revistas con más publicaciones fueron: Journal of Endourology (167) y factor de impacto (FI) 2.26, BJU International (101, FI 4.52) Urology (90, FI 1.86) y Journal of Urology (71, FI 5.6). La producción total se dio en 49 países, los países con mayor número de publicaciones fueron Estados Unidos con 362 (26.1%) y Reino Unido 152 (10.9%), Latinoamérica estuvo encabezada por Brasil con 17 publicaciones.

Conclusiones El mayor número de publicaciones se observó a partir del 2006 years durante la última década ha estado liderado por Estados Unidos. En Colombia la investigación de educación en cirugía laparoscópica y robótica es mínima, posiblemente por carecer de programas de entrenamiento en los programas de residencia. Este análisis bibliométrico permite mostrar que la producción bibliográfica en esta área puede depender de que existan programas formales de entrenamiento que a futuro beneficien a toda la comunidad urológica.

The Creation of a Novel Low-Cost Bench-Top Kidney Transplant Surgery Simulator and a Survey on Its Fidelity and Educational Utility

Introduction Resident inexperience during time-sensitive vascular anastomoses of a kidney transplant can negatively impact outcomes. In light of this, we created a low-cost bench-top kidney transplant surgery simulator to help residents practice vascular anastomoses. Methods We searched for inexpensive materials to design an iliac fossa and kidney allograft. Eighteen residents with real-life kidney transplant experience trialed the simulator and scored its fidelity and educational utility on a 0-100 visual analog scale (VAS) survey. Results A 35.9 x 19.4 x 12.4 cm plastic box mimicked the iliac fossa. Hooks attached to the box's sidewall held under tension 1.27 and 0.64 cm diameter Penrose drains to replicate the external iliac vein and artery. A modified kidney-shaped stress ball with 1.27 x 4, 0.64 x 4, and 0.64 x 15 cm Penrose drains replicated a kidney allograft with its vein, artery, and ureter, respectively. Residents performed and assisted in vascular anastomoses on the simulator. The iliac fossa and allograft cost $20.20 and each practice run cost $7.20. Residents thought that the simulator was less difficult than real-life procedure, had acceptable fidelity levels, and they highly rated its educational utility. Conclusion Our novel low-cost bench-top kidney transplant surgery simulator focusing on vascular anastomoses received positive educational feedback from residents.

The Hunger Games: Laparoscopic Performance in Novice Surgeons is Not Altered by Food Deprivation but Influenced by the Degree of Appetite - A Randomized Controlled Trial

OBJECTIVES

Food deprivation is a common condition for visceral surgeons and especially laparoscopic approaches require high levels of concentration. The current literature does not provide adequate answers whether intraoperative breaks, especially food intake, might influence the quality of the surgical skills. Thus, the primary aim of this trial was to analyze the influence of food deprivation on the laparoscopic performance.

DESIGN SETTING AND PARTICIPANTS

37 laparoscopic novices participated from 10/2017 to 04/2018 in this single center, prospective-randomized trial and were trained during laparoscopic training sessions until they reached a predefined level of proficiency. Subsequently, participants were randomized into 3 different groups: food deprivation of 8 hours, 4 hours, or carbohydrate loading directly prior to the laparoscopic exam. The exam comprised PEG-transfer, precise cutting, gallbladder resection and surgical knot.

MAIN FINDINGS

Completion time for PEG-transfer, precise cutting, gallbladder resection and surgical knot was 63s, 139s, 192s and 272s respectively. Participants starving for 8 hours performed 3 of 4 tasks more slowly whilst participants starving for 4 hours performed 3 of 4 tasks faster than the average. Analyzing self-reported level of appetite revealed: Students with an intermediate level were significantly faster (p <0.05) during complex procedures compared to participants that reported hunger prior to performing these tasks (192s vs. 307s). Additionally, hungry students had been more inaccurate during the surgical knot (p <0.05) whilst students with intermediate appetite level tend to be most accurate (p - value 0.012).

CONCLUSIONS

The subjective level of appetite rather than the absolute number of fasting hours influences the laparoscopic performance most. Thus, any extreme level of appetite may be avoided and surgeons may achieve the best performance when they have an intermediate level of appetite. In consequence, heavy meals may be omitted immediately prior to demanding laparoscopic procedures and surgeons may have access to mini-breaks and refreshers during major procedures.

Defining the key skills required to perform advanced laparoscopic procedures: a qualitative descriptive study

BACKGROUND

Simulation is widely used to teach and assess fundamental laparoscopic skills; however, program directors have reported that current simulation programs do not meet the needs for trainees and surgeons learning advanced laparoscopic procedures (ALP). The purpose of our study was to identify the key skills required to perform ALP, to serve as the basis to establish an advanced laparoscopic skills training program.

METHODS

Semi-structured interviews were conducted with attending surgeons, fellows, and senior residents in general surgery, gynaecology, and urology. The questions were developed through an iterative process using relevant literature, expert opinions, and in consultation with a qualitative researcher. Interviews were conducted in person, over the phone, or by videoconference, and inductive thematic analysis was performed.

RESULTS

25 interviews were conducted with 16 attending surgeons and 9 fellows/residents from 9 institutions in Canada and USA. Twenty-one skills were identified to be important when performing ALP. The skills most commonly described by faculty were the following : (a) suturing, (b) dissection, (c) procedural expertise, (d) retraction and exposure, and (e) familiarity with relevant anatomy as viewed through the laparoscope. The skills most commonly described by trainees were the following: (a) suturing, (b) dissection, (c) procedural expertise, (d) trocar positioning, and (e) patient factors. There was a large difference between the importance the faculty attributed to the 'Retraction and Exposure' skill compared to the trainees.

CONCLUSION

This study identified key skills that are important when performing ALP. In order to address the current needs of trainees/surgeons learning ALP, this work provides the building blocks for the development of an advanced laparoscopic surgery simulation program.

Learning Challenges, Teaching Strategies, and Cognitive Load: Insights From the Experience of Seasoned Endoscopy Teachers

PURPOSE

Learners of medical procedures must develop, refine, and apply schemas for both cognitive and psychomotor constructs, which may strain working memory capacity. Procedures with limitations in visual and tactile information may add risk of cognitive overload. The authors sought to elucidate how experienced procedural teachers perceived learners' challenges and their own teaching strategies in the exemplar setting of gastrointestinal endoscopy.

METHOD

The authors interviewed 22 experienced endoscopy teachers in the United States, Canada, and the Netherlands between May 2016 and March 2019 and performed thematic analysis using template analysis method. Interviews addressed learner challenges and teaching strategies from the teacher participants' perspectives. Cognitive load theory informed data interpretation and analysis.

RESULTS

Participants described taking steps to "diagnose" trainee ability and identify struggling trainees. They described learning challenges related to trainees (performance over mastery goal orientation, low self-efficacy, lack of awareness), tasks (psychomotor challenges, mental model development, tactile understanding), teachers (teacher-trainee relationship, inadequate teaching, teaching variability), and settings (internal/external distractions, systems issues). Participants described employing strategies that could match intrinsic load to learners' levels (teaching along developmental continuum, motor instruction, technical assistance/takeover), minimize extraneous load (optimize environment, systems solutions, emotional support, define expectations), and optimize germane load (promote mastery, teach schemas, stop and focus).

CONCLUSIONS

Participants provided insight into possible challenges while learning complex medical procedures with limitations in sensory channels, as well as teaching strategies that may address these challenges at individual and systems levels. Using cognitive load theory, the authors provide recommendations for procedural teachers.

Utilizing transcranial direct current stimulation to enhance laparoscopic technical skills training: A randomized controlled trial

BACKGROUND

Transcranial direct current stimulation (tDCS) is a non-invasive brain stimulation technique that delivers constant, low electrical current resulting in changes to cortical excitability. Prior work suggests it may enhance motor learning giving it the potential to augment surgical technical skill acquisition.

OBJECTIVES

The aim of this study was to test the efficacy of tDCS, coupled with motor skill training, to accelerate laparoscopic skill acquisition in a pre-registered (NCT03083483), double-blind and placebo-controlled study. We hypothesized that relative to sham tDCS, active tDCS would accelerate the development of laparoscopic technical skills, as measured by the Fundamentals of Laparoscopic Surgery (FLS) Peg Transfer task quantitative metrics.

METHODS

In this study, sixty subjects (mean age 22.7 years with 42 females) were randomized into sham or active tDCS in either bilateral primary motor cortex (bM1) or supplementary motor area (SMA) electrode configurations. All subjects practiced the FLS Peg Transfer Task during six 20-min training blocks, which were preceded and followed by a single trial pre-test and post-test. The primary outcome was changes in laparoscopic skill performance over time, quantified by group differences in completion time from pre-test to post-test and learning curves developed from a calculated score accounting for errors.

RESULTS

Learning curves calculated over the six 20-min training blocks showed significantly greater improvement in performance for the bM1 group than the sham group (t = 2.07, p = 0.039), with the bM1 group achieving approximately the same amount of improvement in 4 blocks compared to the 6 blocks required of the sham group. The SMA group also showed greater mean improvement than sham, but exhibited more variable learning performance and differences relative to sham were not significant (t = 0.85, p = 0.400). A significant main effect was present for pre-test versus post-test times (F = 133.2, p < 0.001), with lower completion times at post-test, however these did not significantly differ for the training groups.

CONCLUSION

Laparoscopic skill training with active bilateral tDCS exhibited significantly greater learning relative to sham. The potential for tDCS to enhance the training of surgical skills, therefore, merits further investigation to determine if these preliminary results may be replicated and extended.

A Novel University of North Carolina Laparoscopic Ventral Hernia Repair Simulator

Background: Simulation plays an important role in surgical training. We developed a simulator for laparoscopic ventral hernia repair (LVHR) surgery based on porcine tissue, characterized by low cost and high reality. Methods: Our LVHR model is based on porcine tissue mounted in a human mannequin. The anterior abdominal wall is constructed to allow laparoscopic training. Training sessions are conducted in a simulated operating room environment. Results: During preliminary tests, the LVHR simulator was found to be highly realistic in terms of tissue feedback, instrumentation usage, and performing the key steps of the LVHR procedure. The model was evaluated as a very useful tool for residents' training allowing to gain laparoscopic skills, learn the key steps of LVHR, and practice team work. Conclusions: Our simulator, based on porcine tissue mounted in a mannequin, offers a very realistic and cost-effective model for simulating LVHR surgery.

Characterizing the learning curve of a virtual intracorporeal suturing simulator VBLaST-SS©

BACKGROUND

The virtual basic laparoscopic skill trainer suturing simulator (VBLaST-SS©) was developed to simulate the intracorporeal suturing task in the FLS program. The purpose of this study was to evaluate the training effectiveness and participants' learning curves on the VBLaST-SS© and to assess whether the skills were retained after 2 weeks without training.

METHODS

Fourteen medical students participated in the study. Participants were randomly assigned to two training groups (7 per group): VBLaST-SS© or FLS, based on the modality of training. Participants practiced on their assigned system for one session (30 min or up to ten repetitions) a day, 5 days a week for three consecutive weeks. Their baseline, post-test, and retention (after 2 weeks) performance were also analyzed. Participants' performance scores were calculated based on the original FLS scoring system. The cumulative summation (CUSUM) method was used to evaluate learning. Two-way mixed factorial ANOVA was used to compare the effects of group, time point (baseline, post-test, and retention), and their interaction on performance.

RESULTS

Six out of seven participants in each group reached the predefined proficiency level after 7 days of training. Participants' performance improved significantly (p < 0.001) after training within their assigned group. The CUSUM learning curve shows that one participant in each group achieved 5% failure rate by the end of the training period. Twelve out of fourteen participants' CUSUM curves showed a negative trend toward achieving the 5% failure rate after further training.

CONCLUSION

The VBLaST-SS© is effective in training laparoscopic suturing skill. Participants' performance of intracorporeal suturing was significantly improved after training on both systems and was retained after 2 weeks of no training.

IMPACT OF A SIMULATED LAPAROSCOPIC TRAINING PROGRAM IN A THREE-YEAR GENERAL SURGERY RESIDENCY

Background:

A General Surgery Residency may last between 2-6 years, depending on the country. A shorter General Surgery Residency must optimize residents’ surgical exposure. Simulated surgical training is known to shorten the learning curves, but information related to how it affects a General Surgery Residency regarding clinical exposure is scarce.

Aim:

To analyze the effect of introducing a validated laparoscopic simulated training program in abdominal procedures performed by residents in a three-year General Surgery Residency program.

Methods:

A non-concurrent cohort study was designed. Four-generations (2012-2015) of graduated surgeons were included. Only abdominal procedures in which the graduated surgeons were the primary surgeon were described and analyzed. The control group was of graduated surgeons from 2012 without the laparoscopic simulated training program. Surgical procedures per program year, surgical technique, emergency/elective intervention and hospital-site (main/community hospitals) were described.

Results:

Interventions of 28 graduated surgeons were analyzed (control group=5; laparoscopic simulated training program=23). Graduated surgeons performed a mean of 372 abdominal procedures, with a higher mean number of medium-to-complex procedures in laparoscopic simulated training program group (48 vs. 30, p=0.02). Graduated surgeons trained with laparoscopic simulated training program performed a higher number of total abdominal procedures (384 vs. 319, p=0.04) and laparoscopic procedures (183 vs. 148, p<0.05).

Conclusions:

The introduction of laparoscopic simulated training program may increase the number and complexity of total and laparoscopic procedures in a three-year General Surgery Residency.

Training Effects of Visual Stroboscopic Impairment on Surgical Performance: A Randomized-Controlled Trial

OBJECTIVE

There have been numerous advances to accelerate and improve quality and dexterous proficiency of surgical training to meet the growing US demand of graduating surgeons. The authors aimed to investigate the learning effects of such limited visual input on the surgical proficiency in untrained novice surgeons.

DESIGN

A prospective randomized-controlled study was created with 11 participants in the study and 11 in the control group.

SETTING

An inanimate surgical simulation lab of a tertiary academic institution (Houston Methodist Hospital, Houston, Texas).

PARTICIPANTS

Adult medical students in the experimental group were wearing stroboscopic eyewear while performing the same tasks as students in the control group with normal vision. For 5 weeks, the subjects were scored during 3 standardized surgical tasks from the American College of Surgeons and the Association of Program Directors in Surgery Resident Skills Curriculum: knot tying, simple interrupted sutures, and a running stitch. Pretrial, we employed the State-Trait Anxiety Inventory and post-trial, the NASA Task Load Index.

RESULTS

The demographic characteristics of our study participants were uniformly distributed between the 2 cohorts: each group had 7 males and 4 females. Average ages were 23.6 and 24.2 years (p = 0.471). The anxiety was low during all 5 sessions and indifferent between both groups. At the end of the study, no changes were observed in the stroboscopic group for the knot-tying task (p = 0.619). However, for the simple interrupted and the running stitch, the students with stroboscopic glasses performed significantly better (p = 0.001 and p = 0.024, respectively). The stroboscopic students also had significantly lower NASA workload scores (p = 0.001).

CONCLUSIONS

Regular training with stroboscopic glasses that limit visual input has a significant positive effect on the technical skills of novice surgical trainees with regards to more complex tasks such as multiple simple interrupted suturing or running suture. Intermittently impaired vision is beneficial in the early education of students and surgical residents.

Effect of Short- Versus Long-Term Video Game Playing on Basic Laparoscopic Skills Acquisition of Veterinary Medicine Students

The objective of this study was to investigate the effect of playing video games on the performance of basic laparoscopic skills. The study was an experimental pre-test-post-test comparison group design. Fifty-two students (31 from the Western University of Health Sciences College of Veterinary Medicine and 21 from the Colorado State University College of Veterinary Medicine) completing their first or second year of the veterinary curriculum were randomized into two intervention groups. The intervention consisted of playing the video game Marble Mania on a Nintendo Wii. group L (long) played 18 hours over 6 weeks and group S (short) played 3 hours during the last week of the 6-week intervention period. Before and after the intervention, basic laparoscopic skills for both groups were assessed using a modified McGill Inanimate System for Training and Evaluation of Laparoscopic Skills (MISTELS) instrument. Participants performed two laparoscopic tasks. Results showed that the performance of students improved in both group S and L (p < .05) on both laparoscopic tasks. Both groups showed statistically significant improvement in their post-intervention scores (group L, N = 25, z = -3.711, p < .001, r = 0.742; group S, N = 27, z = -3.016, p < .003, r = 0.580). There was no significant difference in the degree of improvement between group S and group L. The results suggest that playing Marble Mania on a Wii for any time duration could be an effective method for veterinary medicine students to improve basic laparoscopic skills, and indicate the needs for additional studies.

Validation of the Omni: A Novel, Multimodality, and Longitudinal Surgical Skills Assessment

OBJECTIVE

The breadth of technical skills included in general surgery training continues to expand. The current competency-based training model requires assessment tools to measure acquisition, learning, and mastery of technical skill longitudinally in a reliable and valid manner. This study describes a novel skills assessment tool, the Omni, which evaluates performance in a broad range of skills over time.

DESIGN

The 5 Omni tasks, consisting of open bowel anastomosis, knot tying, laparoscopic clover pattern cut, robotic needle drive, and endoscopic bubble pop, were developed by general surgery faculty. Component performance metrics assessed speed, accuracy, and quality, which were scaled into an overall score ranging from 0 to 10 for each task. For each task, ANOVAs with Scheffé's post hoc comparisons and Pearson's chi-squared tests compared performance between 6 resident cohorts (clinical years (CY1-5) and research fellows (RF)). Paired samples t-tests evaluated changes in performance across academic years. Cronbach's alpha coefficient determined the internal consistency of the Omni as an overall assessment.

SETTING

The Omni was developed by the Department of Surgery at Duke University. Annual assessment and this research study took place in the Surgical Education and Activities Lab.

PARTICIPANTS

All active general surgery residents in 2 consecutive academic years spanning 2015 to 2017.

RESULTS

A total of 62 general surgery residents completed the Omni and 39 (67.2%) of those residents completed the assessment in 2 consecutive years. Based on data from all residents' first assessment, statistically significant differences (p < 0.05) were observed among CY cohorts for bowel anastomosis, robotic, and laparoscopic task metrics. By pair-wise comparisons, mean bowel anastomosis scores distinguished CY1 from CY3-5 and CY2 from CY5. Mean robotic scores distinguished CY1 from RF, and mean laparoscopic scores distinguished CY1 from RF, CY3, and CY5 in addition to CY2 from CY3. Mean scores in performance on the knot tying and endoscopic tasks were not significantly different. Statistically significant improvement in mean scores was observed for all tasks from year 1 to year 2 (all p < 0.02). The internal consistency analysis revealed an alpha coefficient of 0.656.

CONCLUSIONS

The Omni is a novel composite assessment tool for surgical technical skill that utilizes objective measures and scoring algorithms to evaluate performance. In this pilot study, 3 tasks demonstrated discriminative ability of performance by CY, and all 5 tasks demonstrated construct validity by showing longitudinal improvement in performance. Additionally, the Omni has adequate internal consistency for a formative assessment. These results suggest the Omni holds promise for the evaluation of resident technical skill and early identification of outliers requiring intervention.

Evaluating Surgery Resident Technical Skills: Intestinal Anastomosis in a Porcine Model

Because work hour restrictions and technological developments such as staplers change the surgical landscape, efficient resident training methods are necessary to ensure surgical quality. This study evaluates efficacy of a porcine skills laboratory for teaching surgery residents to perform handsewn intestinal anastomoses based on a validated subjective tool and novel objective measurements. We hypothesized that resident performance would improve postintervention; junior residents would improve more than the seniors would. This prospective study was completed over a period of four months in 2015. Participants performed standardized two-layer, handsewn, end-to-end small intestine anastomosis in a live porcine model before (pretest) and after (posttest) an educational intervention. The intervention consisted of an instructional module and skills laboratory teaching session by attending surgeons. Participants were evaluated based on objective measurements of the anastomosis and blinded video evaluations using objective structured assessment of technical skills. Twenty-eight residents in a six-year general surgery program started and completed the study. The objective structured assessment of technical skills ratings demonstrated that the whole resident cohort had statistically significant improvement in pre- to posttest scores, 11.16 to 24.59 ( P < 0.001). Junior and senior residents improved independently, 9.59 versus 22.53 ( P < 0.001) and 13.59 versus 27.77 ( P < 0.001), respectively. Finally, the cohort significantly improved in number of full-thickness Lembert sutures (2.36 vs 0.93, P = 0.001) and time to completion (31.28 vs 28.2 minutes, P = 0.046). Anastomotic leak pressure, anastomotic narrowing, and anastomotic tensile strength all trended toward improvement. A structured educational intervention, teaching intestinal anastomosis in a live porcine model produced significant improvement in residents’ technical skills.

Computerized feedback during colonoscopy training leads to improved performance: a randomized trial

BACKGROUND AND AIMS

Simulation-based training in colonoscopy is increasingly replacing the traditional apprenticeship method to avoid patient-related risk. Mentoring during simulation is necessary to provide feedback and to motivate, but expert supervisors are a scarce resource. We aimed to determine whether computerized feedback in simulated colonoscopy would improve performance, optimize time spent practicing, and optimize the pattern of training.

METHODS

Forty-four participants were recruited and randomized to either a feedback group (FG) or a control group (CG). Participants were allowed 2 hours of self-practice during which they could practice as they saw fit on 2 different cases: 1 easy and 1 difficult. The CG practiced without feedback, but the participants in the FG were given a score of progression every time they reached the cecum. All participants were tested on a different case after end of training. The primary outcome was the progression score in the final case, and secondary outcomes were time spent practicing and the training pattern.

RESULTS

Regression analysis adjusting for sex was done because of an uneven sex distribution between groups (P = .026) and significantly higher performance scores by men (37.6, standard deviation [SD] 25.9) compared with women (19.7, SD 18.7); P = .012. The FG outperformed the CG in the final case, FG scoring 14.4 points (95% confidence interval [CI], 1.2-27.6) more than the CG; P = .033, and they spent more time practicing, FG practicing 25.8 minutes (95% CI, 11.6-39.9) more than the CG; P = .001. The FG practiced more on the easy case and reached the cecum 3.2 times more (95% CI, 2-4.5) during practice (P < .001).

CONCLUSIONS

Our findings of this study revealed that an automatic, computerized score of progression during simulated colonoscopy motivates the novices to improve performance, optimizes time spent practicing, and optimizes their pattern of training. (Clinical trial registration number: NCT03248453.).