Proving the Effectiveness of the Fundamentals of Robotic Surgery (FRS) Skills Curriculum: A Single-blinded, Multispecialty, Multi-institutional Randomized Control Trial

Essential components and validation of multi-specialty robotic surgical training curricula: a systematic review

INTRODUCTION

The rapid adoption of robotic surgical systems has overtook the development of standardized training and competency assessment for surgeons, resulting in an unmet educational need in this field. This systematic review aims to identify the essential components and evaluate the validity of current robotic training curricula across all surgical specialties.

METHODS

A systematic search of MEDLINE, EMBASE, Emcare, and CINAHL databases was conducted to identify the studies reporting on multi-specialty or specialty-specific surgical robotic training curricula, between January 2000 and January 2024. We extracted the data according to Kirkpatrick's curriculum evaluation model and Messick's concept of validity. The quality of studies was assessed using the Medical Education Research Study Quality Instrument (MERSQI).

RESULTS

From the 3687 studies retrieved, 66 articles were included. The majority of studies were single-center ( n = 52, 78.8%) and observational ( n = 58, 87.9%) in nature. The most commonly reported curriculum components include didactic teaching ( n = 48, 72.7%), dry laboratory skills ( n = 46, 69.7%), and virtual reality (VR) simulation ( n = 44, 66.7%). Curriculum assessment methods varied, including direct observation ( n = 44, 66.7%), video assessment ( n = 26, 39.4%), and self-assessment (6.1%). Objective outcome measures were used in 44 studies (66.7%). None of the studies were fully evaluated according to Kirkpatrick's model, and five studies (7.6%) were fully evaluated according to Messick's framework. The studies were generally found to have moderate methodological quality with a median MERSQI of 11.

CONCLUSIONS

Essential components in robotic training curricula identified were didactic teaching, dry laboratory skills, and VR simulation. However, variability in assessment methods used and notable gaps in curricula validation remain evident. This highlights the need for standardized evidence-based development, evaluation, and reporting of robotic curricula to ensure the effective and safe adoption of robotic surgical systems.

Standardizing surgical training with objective performance indicators: a prospective cohort study

BACKGROUND

Multiple surgical virtual reality (VR) simulators are currently available; however, there is lack of comparison between performance after practice on these simulators compared to bench top models. Utilizing the Intuitive Data recorder (IDR) and Objective performance indicators (OPI), we aim to objectively assess robotic surgical skills using a dry lab model. We hypothesize that practicing surgical skills will improve OPIs and that those who practice on the dry lab model will have a greater improvement in their OPIs compared to those who practice with Fundamentals of Robotic Surgery (FRS) SimNow VR.

METHODS

The IDR was used to record kinematics as each participant went through five basic surgery tasks on a dry lab benchtop model to record baseline performance. Participants were then randomized to practice on the dry lab model or the corresponding SimNow Virtual reality (VR) tasks. The participants repeated the tasks again on the benchtop model. Statistical analysis was performed using paired samples t tests, independent samples t tests, and ANOVA tests.

RESULTS

Twenty-seven surgeons participated in our study ranging from interns to attendings. Randomization to VR vs benchtop practice resulted in 11 and 13 participants in each group. For the rollercoaster, backhand suturing, railroad, and knot tying tasks, a significant improvement in kinematic profiles was observed. Bimanual dexterity, angular motion, and smoothness metrics improved most consistently across the tasks after practice. Kinematic profiles between those practicing on VR versus benchtop had no significant differences.

CONCLUSIONS

This study shows that OPIs can be used to benchmark surgical trainees. VR appears to be non-inferior to dry lab model for practice for trainees. We identified patterns in OPI improvement that can be tailored to specific skills depending on the trainees needs. Our study is the first step in developing a standardized training and assessment tool to assess competency in robotic surgery training.

Surgical training simulation modalities in minimally invasive surgery: How to achieve evidence-based curricula by translational research

BACKGROUND

Surgery has evolved from a hands-on discipline where skills were acquired via the "learning by doing" principle to a surgical science with attention to patient safety, health care effectiveness and evidence-based research. A variety of simulation modalities have been developed to meet the need for effective resident training. So far, research regarding surgical training for minimally invasive surgery has been extensive but also heterogenous in grade of evidence.

METHODS

A literature search was conducted to summarize current knowledge about simulation training and to guide research towards evidence-based curricula with translational effects. This was conducted using a variety of terms in PubMed for English articles up to October 2024. Results are presented in a structured narrative review.

RESULTS

For virtual reality simulators, there is sound evidence for effective training outcomes. The required instruments for the development of minimally invasive surgery curricula combining different simulation modalities to create a clinical benefit are known and published.

CONCLUSION

Surgeons are the main creators for minimally invasive surgery training curricula and often follow a hands-on oriented approach that leaves out equally important aspects of assessment, evaluation, and feedback. Further high-quality research that includes available evidence in this field promises to improve patient safety in surgical disciplines.

The evolution of surgical skills simulation education: Robotic skills

Robotic surgery is now widely used after the introduction and increase in popularity of the da Vinci Xi Surgical System 25 years ago. Starting with urology, it has expanded into most major surgical specialties, with millions of robotic operations performed each year. With this growth comes the need to educate and train surgeons on its use. Robotic surgery introduces unique cognitive, psychomotor, and team-based skills not used in open and laparoscopic techniques. These demand creation of curricula on the basis of comprehensive and validated educational frameworks, similar to the Fundamentals of Endoscopic Surgery and Fundamentals of Laparoscopic Surgery programs, to train surgeons. Although programs like the Fundamentals of Robotic Surgery have been developed, they focus most on basic skills. Beyond curricula for these and more advanced skills, how performance is assessed is equally critical. Beginning to fill this gap are the Global Evaluative Assessment of Robotic Skills, Robotic Objective Structured Assessment of Technical Skills, and Robotic Ottawa Surgical Competency Operating Room Evaluation assessment tools. Continued development and improvement in curricula and assessment must persist, particularly as new technologies develop rapidly. Sophisticated features of newer robotic systems including objective performance indicators, augmented reality, virtual reality, artificial intelligence, and machine learning are gaining pace and are positioned to expand robotic surgery, and robotic surgical simulation education, even further over the next 25 years.

General surgery resident robotic training curriculum: evaluation six years after implementation

BACKGROUND

The surge of robotic surgery over the last decade emphasizes the need for a robotics curriculum during general surgery residency. We hypothesized that the implementation of a robotic surgery resident training curriculum would have a positive impact on the general surgery residency experience during and post-graduation.

MATERIALS/METHODS

Current post-graduate year 1 through 5 residents and previously graduated residents were surveyed regarding their robotic curriculum experience during residency and post-graduation. Additionally, ACGME operative case were analyzed to determine robotic case volume and to compare two different time periods of the robotics curriculum: July 2017-June 2020 (early) and January 2022-June 2023 (late).

RESULTS

Among current residents (n = 44), 19 (43%) responded to the survey regarding their robotic curriculum experience, and 17 (89%) were satisfied with the curriculum. Of the graduated residents (n = 33), 25 (75%) responded to the survey, of which 24 (96%) felt the curriculum prepared them for their future practice. Regarding ACGME case logs, 1,091 robotic cases were performed by current residents, compared to 352 cases between 2017 and 2020. The case averages by PGY-level significantly increased 3.1 times from the early (70.4 cases per PGY level) to the late time period (218.2 cases per PGY level) (p = 0.024).

CONCLUSIONS

Overall, our robotics curriculum has had a positive impact on resident training. Current and graduated residents are satisfied with the curriculum; there has also been significant growth in the operative case volume. This study suggests that a robotic training curriculum has value during residency and in clinical practice.

A pan-European survey of robotic training for gastrointestinal surgery: European Robotic Surgery Consensus (ERSC) initiative

BACKGROUND

There has been a recent rapid growth in the adoption of robotic systems across Europe. This study aimed to capture the current state of robotic training in gastrointestinal (GI) surgery and to identify potential challenges and barriers to training within Europe.

METHODS

A pan-European survey was designed to account for the opinion of the following GI surgery groups: (i) experts/independent practitioners; (ii) trainees with robotic access; (iii) trainees without robotic access; (iv) robotic industry representatives. The survey explored various aspects, including stakeholder opinions on bedside assisting, console operations, challenges faced and performance assessment. It was distributed through multiple European surgical societies and industry, in addition to social media and snowball sampling, between December 2023 and March 2024.

RESULTS

A total of 1360 participants responded, with valid/complete responses from 1045 participants across 38 European countries. Six hundred and ninety-five (68.0%) experts and trainees were not aware of a dedicated robotic training curriculum for trainees, with 13/23 (56.5%) industry representatives not incorporating training for trainees in their programme. Among trainees with access to robotic systems, 94/195 (48.2%) had not performed any robotic cases, citing challenges including a lack of certified robotic trainers and training lists. Both experts and trainees agreed that trainees should start bedside assisting and operating on the console earlier than they currently do. Assessment tools of trainee performance were not being used by 139/479 (29.0%) participants.

CONCLUSION

This pan-European survey highlights the need for a standardised robotic curriculum to address the gap in visceral training, assessment and certification. A greater emphasis may be required on implementing robotic training earlier through simulation training, dual console learning, bedside assisting, key clinical performance indicators, and assessment tools. The findings will guide the development of a pan-European consensus on the essential components of a comprehensive training programme for GI robotic surgery.

European expert consensus on a structured approach to circular stapling anastomosis in minimally invasive left-sided colorectal resection

AIM

The aim of this work is to develop and operationally define performance metrics that characterize a reference approach to circular stapling anastomosis during minimally invasive left-sided colorectal resection and to obtain face and content validity through a consensus meeting.

METHOD

Three expert colorectal surgeons with advanced experience with minimally invasive surgery, a senior behavioural scientist and a research fellow with experience in performance metrics development formed the Metrics Group. Technical support was provided by device engineers. Published guidelines, training materials, manufacturers' instructions for use and unedited videos of circular stapling anastomosis in minimally invasive left-sided colorectal resection were used to deconstruct the task into defined, observable performance units or metrics (i.e. procedural phases, steps, errors and critical errors). The performance metrics were then subjected to detailed review by 16 expert colorectal surgeons in a modified Delphi process.

RESULTS

Performance metrics for circular stapling anastomosis during minimally invasive left-sided colorectal resection had three procedural phases with 32 steps, 40 errors and 38 critical errors. After the modified Delphi process the agreed performance metrics consisted of three procedural phases, 36 steps, 42 errors and 39 critical errors. A group of expert colorectal surgeons from Europe verified the face and content of these metrics. After discussion, all procedural phases received unanimous consensus by the Delphi panel.

CONCLUSION

Circular stapling anastomosis during the minimally invasive approach to left-sided colorectal resection can be broken down into procedural phases and steps, with errors and critical errors known as performance metrics. We consider the metrics essential for the development of structured training in using circular stapling anastomosis in the minimally invasive approach to left-sided colorectal resection.

Ambiguity in robotic surgical instruction: lessons from remote and in-person simulation

The rise of robotic surgery has been accompanied by numerous educational challenges as surgeons and trainees learn skills unique to the robotic platform. Remote instruction is a solution to provide surgeons ongoing education when in-person teaching is not feasible. However, surgical instruction faces challenges from unclear communication. We aimed to describe, examine, and compare ambiguities in remote and in-person robotic instruction. We designed a simulation scenario in which a standardized learner performed tasks in robotic surgery while making pre-scripted errors. Instructors provided remote or in-person instruction to the standardized learner. We applied tools from discourse analysis to transcribe sessions, identify instructional instances, classify ambiguities, and select passages for further review. We used tests of proportions to compare ambiguities between the settings. We conducted four simulation sessions, including two remote and two in-person sessions, and identified 206 instructional instances. Within these, we found 964 occurrences of three common semantic ambiguities, or ambiguities arising from words alone. Instructors used visual tools - thus employing multimodality - to clarify semantic ambiguities in 32% of instructional instances. We identified a similar degree of referential ambiguity, or ambiguity for which context from multimodality did not provide clarifying information, during remote (60%) and in-person (48%) instructional instances (p = 0.08). We described, examined, and compared ambiguities in remote and in-person instruction for simulated robotic surgery. Based on the high prevalence of ambiguity in both settings, we recommend that robotic instructors decrease referential ambiguity. To do so, instructors can reduce semantic ambiguity, harness multimodality, or both.

Augmenting Robot-Assisted Pattern-Cutting With Periodic Perturbations: Can We Make Dry Lab Training More Realistic?

OBJECTIVE

Teleoperated robot-assisted minimally-invasive surgery (RAMIS) offers many advan tages over open surgery, but RAMIS training still requires optimization. Existing motor learning theories could improve RAMIS training. However, there is a gap between current knowledge based on simple movements and training approaches required for the more complicated work of RAMIS surgeons. Here, we studied how surgeons cope with time-dependent perturbations.

METHODS

We used the da Vinci Research Kit and investigated the effect of time-dependent force and motion perturbations on learning a circular pattern-cutting surgical task. Fifty-four participants were assigned to two experiments, with two groups for each: a control group trained without perturbations and an experimental group trained with 1 Hz perturbations. In the first experiment, force perturbations alternatingly pushed participants' hands inwards and outwards in the radial direction. In the second experiment, the perturbation constituted a periodic up-and-down motion of the task platform.

RESULTS

Participants trained with perturbations learned how to overcome them and improve their performances during training without impairing them after the perturbations were removed. Moreover, training with motion perturbations provided participants with an advantage when encountering the same or other perturbations after training, compared to training without perturbations.

CONCLUSION

Periodic perturbations can enhance RAMIS training without impeding the learning of the perturbed task.

SIGNIFICANCE

Our results demonstrate that using challenging training tasks that include perturbations can better prepare surgical trainees for the dynamic environment they will face with patients in the operating room.

Recommendations on Robotic Hepato-Pancreato-Biliary Surgery. The Paris Jury-Based Consensus Conference

OBJECTIVE

To establish the first consensus guidelines on the safety and indications of robotics in Hepato-Pancreatic-Biliary (HPB) surgery. The secondary aim was to identify priorities for future research.

BACKGROUND

HPB robotic surgery is reaching the IDEAL 2b exploration phase for innovative technology. An objective assessment endorsed by the HPB community is timely and needed.

METHODS

The ROBOT4HPB conference developed consensus guidelines using the Zurich-Danish model. An impartial and multidisciplinary jury produced unbiased guidelines based on the work of 10 expert panels answering predefined key questions and considering the best-quality evidence retrieved after a systematic review. The recommendations conformed with the GRADE and SIGN50 methodologies.

RESULTS

Sixty-four experts from 20 countries considered 285 studies, and the conference included an audience of 220 attendees. The jury (n=10) produced recommendations or statements covering 5 sections of robotic HPB surgery: technology, training and expertise, outcome assessment, and liver and pancreatic procedures. The recommendations supported the feasibility of robotics for most HPB procedures and its potential value in extending minimally invasive indications, emphasizing, however, the importance of expertise to ensure safety. The concept of expertise was defined broadly, encompassing requirements for credentialing HPB robotics at a given center. The jury prioritized relevant questions for future trials and emphasized the need for prospective registries, including validated outcome metrics for the forthcoming assessment of HPB robotics.

CONCLUSIONS

The ROBOT4HPB consensus represents a collaborative and multidisciplinary initiative, defining state-of-the-art expertise in HPB robotics procedures. It produced the first guidelines to encourage their safe use and promotion.

Guidelines for robotic credentialling in reconstructive and functional urology. Consensus study

Objectives

This study aims to define criteria for robotic reconstructive and functional urology credentialing using expert consensus. A recent narrative review identified a lack of standardised minimal requirements for performing robotic-assisted surgery procedures. The substantial variability or absence of a standardised curriculum and credentialing process within a highly specialised surgical field is often insufficient to guarantee surgeon proficiency and could potentially jeopardise patient safety.

Subjects and Methods

Thirty-five international robotic surgery experts in urology and urogynaecology, selected based on surgical and research expertise, were invited to participate as expert panellists. Using a modified Delphi process the experts were asked to indicate their agreement with the proposed list of recommendations that was identified from the literature and review of relevant international credentialing policies in three electronic survey rounds.

Results

Fourteen experts participated in round 1 of online surveys, 9 in round 2 and 13 in round 3. From 50 statements presented to the Delphi panel in round 1, a total of 39 recommendations (32 from round 1, 4 from round 2 and 3 from round 3) with median importance (MI) ≥ 7 and disagreement index (DI) < 1 were proposed for inclusion into the final draft set and were reviewed by the project team. Panellists agreed reconstructive and functional urology required its own specific modular training curriculum as the foundation for robotic training and a surgeon must have appropriate training i.e., fellowship or evidence of speciality training in functional urology.

Conclusions

This was the first study to develop preliminary guidelines on credentialing for robotic surgery in reconstructive and functional urology. A Delphi approach was employed to establish comprehensive credentialing criteria for robotic-assisted surgery. The consistent adoption of these criteria across institutions will foster the proficiency of robotic surgeons and has the potential to bring improvements in patient outcomes.

Skill progress during a dedicated societal robotic surgery training curriculum including several robotic surgery platforms

BACKGROUND

Robot-assisted procedures are increasingly common, and several systems are available for thoraco-abdominal surgery. Specific structured training is necessary, while access to these systems is still limited. This study aimed to assess surgeons' skill progress during consecutive training days of a curriculum with exposure to different robotic systems.

METHODS

This prospective observational study enrolled 47 surgeons with anonymized analysis of SimNow™ simulator performance scores and dedicated questionnaires after written consent. The primary outcome was the overall score, based on economy of motion, time to complete the exercise, and penalty for errors. Course participants in 2022-2023 had chosen 2 full hands-on days on Da Vinci® consoles with either virtual reality (VR) simulation training using the SimNow (n = 21, 44.7%) or digestive surgery procedures with a live animal model (n = 26, 55.3%). In all participants, training on Da Vinci® systems included console functions and principles of docking, camera, and instrument use for console and procedural training. They additionally had access to introductory dry-lab and VR simulator exercises on the Versius, HugoTMRAS, and Dexter systems and to VR exercises on the ROBOTiS simulator.

RESULTS

The participants (16F/31M, median age 40 years, range 29-58) from various surgical specialties (general/visceral/vascular) had no (n = 35, 74.5%) or little (n = 12, 25.5%) robotic experience including bedside assistance only and 20 (42.6%) had robotic simulator experience. The demographic variables fully completed by 44/47 participants (93.6%) and choice of module had no significant impact on the primary outcome. The considerable performance improvement from days 1 to 2 was exemplified by a significantly increased economy of motion and decreased amount of excessive force.

CONCLUSION

Robotic surgical training is increasingly complex with several systems on the market. Within a dedicated robotic surgery curriculum and based on integrated performance metrics, a significant improvement of skill levels was observed in a relatively short period of time.

Development and evaluation of a societal core robotic surgery accreditation curriculum for the UK

Standardised proficiency-based progression is the cornerstone of safe robotic skills acquisition, however, is currently lacking within surgical training curricula. Expert consensuses have defined a modular pathway to accredit surgeons. This study aimed to address the lack of a formal, pre-clinical core robotic skills, proficiency-based accreditation curriculum in the UK. Novice robotic participants underwent a four-day pre-clinical core robotic skills curriculum incorporating multimodal assessment. Modifiable-Global Evaluative Assessment of Robotic Skills (M-GEARS), VR-automated performance metrics (APMs) and Objective Clinical Human Reliability Analysis (OCHRA) error methodology assessed performance at the beginning and end of training. Messick's validity concept and a curriculum evaluation model were utilised. Feedback was collated. Proficiency-based progression, benchmarking, tool validity and reliability was assessed through comparative and correlational statistical methods. Forty-seven participants were recruited. Objective assessment of VR and dry models across M-GEARS, APMs and OCHRA demonstrated significant improvements in technical skill (p < 0.001). Concurrent validity between assessment tools demonstrated strong correlation in dry and VR tasks (r = 0.64-0.92, p < 0.001). OCHRA Inter-rater reliability was excellent (r = 0.93, p < 0.001 and 81% matched error events). A benchmark was established with M-GEARS and for the curriculum at 80%. Thirty (63.82%) participants passed. Feedback was 5/5 stars on average, with 100% recommendation. Curriculum evaluation fulfilled all five domains of Messick's validity. Core robotic surgical skills training can be objectively evaluated and benchmarked to provide accreditation in basic robotic skills. A strategy is necessary to enrol standardised curricula into national surgical training at an early stage to ensure patient safety.

Current Standards for Training in Robot-assisted Surgery and Endourology: A Systematic Review

BACKGROUND AND OBJECTIVE

Different training programs have been developed to improve trainee outcomes in urology. However, evidence on the optimal training methodology is sparse. Our aim was to provide a comprehensive description of the training programs available for urological robotic surgery and endourology, assess their validity, and highlight the fundamental elements of future training pathways.

METHODS

We systematically reviewed the literature using PubMed/Medline, Embase, and Web of Science databases. The validity of each training model was assessed. The methodological quality of studies on metrics and curricula was graded using the MERSQI scale. The level of evidence (LoE) and level of recommendation for surgical curricula were awarded using the educational Oxford Centre for Evidence-Based Medicine classification.

KEY FINDINGS AND LIMITATIONS

A total of 75 studies were identified. Many simulators have been developed to aid trainees in mastering skills required for both robotic and endourology procedures, but only four demonstrated predictive validity. For assessment of trainee proficiency, we identified 18 in robotics training and six in endourology training; however, the majority are Likert-type scales. Although proficiency-based progression (PBP) curricula demonstrated superior outcomes to traditional training in preclinical settings, only four of six (67%) in robotics and three of nine (33%) in endourology are PBP-based. Among these, the Fundamentals of Robotic Surgery and the SIMULATE curricula have the highest LoE (level 1b). The lack of a quantitative synthesis is the main limitation of our study.

CONCLUSIONS AND CLINICAL IMPLICATIONS

Training curricula that integrate simulators and PBP methodology have been introduced to standardize trainee outcomes in robotics and endourology. However, evidence regarding their educational impact remains restricted to preclinical studies. Efforts should be made to expand these training programs to different surgical procedures and assess their clinical impact.

European Robotic Surgery Consensus (ERSC): Protocol for the development of a consensus in robotic training for gastrointestinal surgery trainees

BACKGROUND

The rapid adoption of robotic surgical systems across Europe has led to a critical gap in training and credentialing for gastrointestinal (GI) surgeons. Currently, there is no existing standardised curriculum to guide robotic training, assessment and certification for GI trainees. This manuscript describes the protocol to achieve a pan-European consensus on the essential components of a comprehensive training programme for GI robotic surgery through a five-stage process.

METHODS AND ANALYSIS

In Stage 1, a Steering Committee, consisting of international experts, trainees and educationalists, has been established to lead and coordinate the consensus development process. In Stage 2, a systematic review of existing multi-specialty robotic training curricula will be performed to inform the formulation of key position statements. In Stage 3, a comprehensive survey will be disseminated across Europe to capture the current state of robotic training and identify potential challenges and opportunities for improvement. In Stage 4, an international panel of GI surgeons, trainees, and robotic theatre staff will participate in a three-round Delphi process, seeking ≥ 70% agreement on crucial aspects of the training curriculum. Industry and patient representatives will be involved as external advisors throughout this process. In Stage 5, the robotic training curriculum for GI trainees will be finalised in a dedicated consensus meeting, culminating in the production of an Explanation and Elaboration (E&E) document.

REGISTRATION DETAILS

The study protocol has been registered on the Open Science Framework (https://osf.io/br87d/).

A review of minimal access surgery provision and training within the United Kingdom

When combined with healthcare pressures, the exponential growth of robotic-assisted surgery (RAS) has impacted UK-based training outcomes, including the learning curve to competency. Aim: To ascertain the current provision of RAS and investigate differences in access to minimal access surgical (MAS) facilities and training across the UK. A two-armed electronic survey was conducted. The first arm questioned clinical leads regarding robotic practice and future training provisions. The second investigated trainee and trainers' perceptions of MAS training and facilities. 64% (52/81) of responding trusts utilise a robotic system. The majority (68% [55/81]) have plans to expand or acquire a system within 3 years. 171 responses from 112 UK and Republic of Ireland hospitals were collected for Arm 2. Laparoscopic categories queried whether trainees had access to a formal curriculum, training days and sim-boxes. Most consultants (51.9%) and trainees (51.6%) reported that there was no formal local training curriculum for robotic surgery. Combined responses demonstrated 42.1% (n = 195/463) said "yes", 39.5% (n = 183) "no" and 18.4% (n = 85) "don't know". For combined robotic categories (simulation, training days and operative lists) 28.3% (n = 134/473) responded "yes", 51.6% (n = 244) said "no" and 20.1% (n = 95) said "don't know". This study provides insight into the current provision of robotic-assisted surgery at UK trusts and highlights the need to facilitate regular clinical training and equitable access to MAS simulation within a formal curriculum. This may aid regulation of training in parallel with the expansion of robotic practice and avoid a significant skill acquisition gap and risks to patient safety.

How to integrate robotic training in surgical residency? An example of a 2-week robotic rotation

General surgery residents should be proficiently trained in robotic surgery. However, there is currently no standardized robotic training curriculum. We aimed to evaluate two approaches to a robotic curriculum and how implementing a virtual reality (VR) simulation curriculum improves trainee robotic performance. From 2019 to 2022, two models of a robotic training curriculum were examined: an in-unit rotation (IUR) and a 2-week curriculum (2WR). The VR curriculum was completed using the da Vinci® Skill Simulator. The curriculum used a pre/post-test design. Residents completed a pre-test that consisted of 4 VR exercises (graded 0-100%) and 3 inanimate box trainer exercises (graded using modified Objective Structured Assessment of Technical Skills). Then, residents completed a VR curriculum of 23 modules. Following the curriculum, residents were given a post-test with the same pre-test exercises. Time necessary to complete the curriculum and compliance were recorded. Of the 11 residents who participated in the IUR, 4 completed the VR curriculum. Comparatively, 100% (n = 23) of residents in the 2WR completed the curriculum. Average time to complete the VR curriculum was 3.8 h. After completion of the 2WR curriculum, resident performance improved from pre-test to post-test: VR test scores increased (160% vs 223%, p < 0.001), OSATS scores increased (15.0 vs 21.0, p < 0.001), and time to complete inanimate exercises decreased (1083 vs 756 s, p = 0.001). Residents who mastered all modules had higher post-test VR scores (241% vs 214%, p = 0.024). General surgery residents demonstrated improved compliance with the 2WR. The VR curriculum improved resident robotic performance in both virtual and inanimate domains.

The development of tissue handling skills is sufficient and comparable after training in virtual reality or on a surgical robotic system: a prospective randomized trial

BACKGROUND

Virtual reality is a frequently chosen method for learning the basics of robotic surgery. However, it is unclear whether tissue handling is adequately trained in VR training compared to training on a real robotic system.

METHODS

In this randomized controlled trial, participants were split into two groups for "Fundamentals of Robotic Surgery (FRS)" training on either a DaVinci VR simulator (VR group) or a DaVinci robotic system (Robot group). All participants completed four tasks on the DaVinci robotic system before training (Baseline test), after proficiency in three FRS tasks (Midterm test), and after proficiency in all FRS tasks (Final test). Primary endpoints were forces applied across tests.

RESULTS

This trial included 87 robotic novices, of which 43 and 44 participants received FRS training in VR group and Robot group, respectively. The Baseline test showed no significant differences in force application between the groups indicating a sufficient randomization. In the Midterm and Final test, the force application was not different between groups. Both groups displayed sufficient learning curves with significant improvement of force application. However, the Robot group needed significantly less repetitions in the three FRS tasks Ring tower (Robot: 2.48 vs. VR: 5.45; p < 0.001), Knot Tying (Robot: 5.34 vs. VR: 8.13; p = 0.006), and Vessel Energy Dissection (Robot: 2 vs. VR: 2.38; p = 0.001) until reaching proficiency.

CONCLUSION

Robotic tissue handling skills improve significantly and comparably after both VR training and training on a real robotic system, but training on a VR simulator might be less efficient.

Development and validation of metrics for a new RAPN training model

Robot-assisted partial nephrectomy (RAPN) is a complex and index procedure that urologists need to learn how to perform safely. No validated performance metrics specifically developed for a RAPN training model (TM) exist. A Core Metrics Group specifically adapted human RAPN metrics to be used in a newly developed RAPN TM, explicitly defining phases, steps, errors, and critical errors. A modified Delphi meeting concurred on the face and content validation of the new metrics. One hundred percent consensus was achieved by the Delphi panel on 8 Phases, 32 Steps, 136 Errors and 64 Critical Errors. Two trained assessors evaluated recorded video performances of novice and expert RAPN surgeons executing an emulated RAPN in the newly developed TM. There were no differences in procedure Steps completed by the two groups. Experienced RAPN surgeons made 34% fewer Total Errors than the Novice group. Performance score for both groups was divided at the median score using Total Error scores, into HiError and LoError subgroups. The LowErrs Expert RAPN surgeons group made 118% fewer Total Errors than the Novice HiErrs group. Furthermore, the LowErrs Expert RAPN surgeons made 77% fewer Total Errors than the HiErrs Expert RAPN surgeons. These results established construct and discriminative validity of the metrics. The authors described a novel RAPN TM and its associated performance metrics with evidence supporting their face, content, construct, and discriminative validation. This report and evidence support the implementation of a simulation-based proficiency-based progression (PBP) training program for RAPN.

Implementation and Validation of an Automated, Longitudinal Robotic Surgical Evaluation and Feedback Program at a High-volume Center and Impact on Training

Background

Surgical education lacks a standardized, proficiency-based approach to evaluation and feedback.

Objective

To assess the implementation and reception (ie, feasibility) of an automated, standardized, longitudinal surgical skill assessment and feedback system, and identify baseline trainee (resident and fellow) characteristics associated with achieving proficiency in robotic surgery while learning robotic-assisted laparoscopic prostatectomy.

Design setting and participants

A quality improvement study assessing a pilot of a surgical experience tracking program was conducted over 1 yr. Participants were six fellows, eight residents, and nine attending surgeons at a tertiary cancer center.

Intervention

Trainees underwent baseline self-assessment. After each surgery, an evaluation was completed independently by the trainee and attending surgeons. Performance was rated on a five-point anchored Likert scale (trainees were considered "proficient" when attending surgeons' rating was ≥4). Technical skills were assessed using the Global Evaluative Assessment of Robotic Skills (GEARS) and Prostatectomy Assessment and Competency Evaluation (PACE).

Outcome measurements and statistical analysis

Program success and utility were assessed by evaluating completion rates, evaluation completion times, and concordance rates between attending and trainee surgeons, and exit surveys. Baseline characteristics were assessed to determine associations with achieving proficiency.

Results and limitations

Completion rates for trainees and attending surgeons were 72% and 77%, respectively. Fellows performed more steps/cases than residents (median [interquartile range]: 5 [3-7] and 3 [2-4], respectively; p < 0.01). Prior completion of robotics or laparoscopic skill courses and surgical experience measures were associated with achieving proficiency in multiple surgical steps and GEARS domains. Interclass correlation coefficients on individual components were 0.27-0.47 on GEARS domains.

Conclusions

An automated surgical experience tracker with structured, longitudinal evaluation and feedback can be implemented with good participation and minimal participant time commitment, and can guide curricular development in a proficiency-based education program by identifying modifiable factors associated with proficiency, individualizing education, and identifying improvement areas within the education program.

Patient summary

An automated, standardized, longitudinal surgical skill assessment and feedback system can be implemented successfully in surgical education settings and used to inform education plans and predict trainee proficiency.

Validation of a Simulation Model for Robotic Myomectomy

STUDY OBJECTIVE

Several simulation models have been evaluated for gynecologic procedures such as hysterectomy, but there are limited published data for myomectomy. This study aimed to assess the validity of a low-cost robotic myomectomy model for surgical simulation training.

DESIGN

Prospective cohort simulation study.

SETTING

Surgical simulation laboratory.

PARTICIPANTS

Twelve obstetrics and gynecology residents and 4 fellowship-trained minimally invasive gynecologic surgeons were recruited for a 3:1 novice-to-expert ratio.

INTERVENTIONS

A robotic myomectomy simulation model was constructed using <$5 worth of materials: a foam cylinder, felt, a stress ball, bandage wrap, and multipurpose sealing wrap. Participants performed a simulation task involving 2 steps: fibroid enucleation and hysterotomy repair. Video-recorded performances were timed and scored by 2 blinded reviewers using the validated Global Evaluative Assessment of Robotic Skills (GEARS) scale (5-25 points) and a modified GEARS scale (5-40 points), which adds 3 novel domains specific to robotic myomectomy. Performance was also scored using predefined task errors. Participants completed a post-task questionnaire assessing the model's realism and utility.

MEASUREMENTS AND MAIN RESULTS

Median task completion time was shorter for experts than novices (9.7 vs 24.6 min, p = .001). Experts scored higher than novices on both the GEARS scale (median 23 vs 12, p = .004) and modified GEARS scale (36 vs 20, p = .004). Experts made fewer task errors than novices (median 15.5 vs 37.5, p = .034). For interrater reliability of scoring, the intraclass correlation coefficient was calculated to be 0.91 for the GEARS assessment, 0.93 for the modified GEARS assessment, and 0.60 for task errors. Using the contrasting groups method, the passing mark for the simulation task was set to a minimum modified GEARS score of 28 and a maximum of 28 errors. Most participants agreed that the model was realistic (62.5%) and useful for training (93.8%).

CONCLUSION

We have demonstrated evidence supporting the validity of a low-cost robotic myomectomy model. This simulation model and the performance assessments developed in this study provide further educational tools for robotic myomectomy training.

Optimizing laparoscopic and robotic skills through simulation in participants with limited or no prior experience: a systematic review and meta-analysis

BACKGROUND

Simulation is an innovative tool for developing complex skills required for surgical training. The objective of this study was to determine the advancement of laparoscopic and robotic skills through simulation in participants with limited or no previous experience.

METHODS

This is a systematic review and meta-analysis of randomized controlled trials (RCTs) in keeping with the Preferred Reporting Items for Systematic Reviews and Meta-analysis guidelines. We conducted searches using MEDLINE (PubMed), Web of Science, Google Scholar, and Cochrane Library. Variables analyzed were study characteristics, participant demographics, and characteristics of the learning program. Our main measures were effectiveness, surgical time, and errors. These were reported using standardized mean difference (SMD) with 95% CI (P < .05). Secondary measures included skill transfer and learning curve.

RESULTS

A total of 17 RCTs were included and comprised 619 participants: 354 participants (57%) were in the simulation group and 265 (43%) in the control group. Results indicated that laparoscopic simulation effectively enhanced surgical skills (SMD, 0.59 [0.18-1]; P = .004) and was significantly associated with shorter surgical duration (SMD, -1.08 [-1.57 to -0.59]; P < .0001) and a fewer errors made (SMD, -1.91 [-3.13 to -0.70]; P = .002). In the robotic simulation, there was no difference in effectiveness (SMD, 0.17 [-0.19 to 0.52]; P = .36) or surgical time (SMD, 0.27 [-0.86 to 1.39]; P = .64). Furthermore, skills were found to be transferable from simulation to a real-life operating room (P < .05).

CONCLUSION

Simulation is an effective tool for optimizing laparoscopic skills, even in participants with limited or no previous experience. This approach not only contributes to the reduction of surgical time and errors but also facilitates the transfer of skills to the surgical environment. In contrast, robotic simulation fails to maximize skill development, requiring previous experience in laparoscopy to achieve optimal levels of effectiveness.

Proficiency Levels and Validity Evidence for Scoring Metrics for a Virtual Reality and Inanimate Robotic Surgery Simulation Curriculum

OBJECTIVE

Our institution recently implemented a virtual reality (VR) skills curriculum for general surgery residents using the SimNow simulator. Based on a content alignment study, we revised the curriculum to include only 20 of 33 VR tasks and we added 3 previously validated inanimate tasks. The purpose of this study was to establish expert-derived proficiency levels for all tasks and to evaluate the validity of the scoring for the VR tasks.

DESIGN

Two expert robotic surgeons performed 5 repetitions of each VR and inanimate task. The trimmed mean (lowest scoring attempt and outliers [>2 standard deviations] were eliminated) was defined as the expert level for each task. For the VR tasks, expert levels were compared to resident performance to evaluate validity.

SETTING

This study was conducted at the University of Texas Southwestern Medical Center (Dallas, TX), a tertiary care academic teaching hospital.

PARTICIPANTS

Two expert robotic surgeons participated in this study. The data from 42 residents (PGY2-4) who completed the original curriculum was used to represent novice performance.

RESULTS

Comparison of expert levels and resident performance was statistically significant for 15 VR tasks (supporting validity) and approached significance (p = 0.06, 0.09) for 2 VR tasks; expert levels were designated as proficiency levels for these 17 tasks. Group comparisons were clearly not significant (p = 0.2-0.8) for 3 VR tasks; 2 of these 3 tasks were retained as introductory exercises (with 3 repetitions required) and 1 was excluded. For the 3 inanimate tasks, expert levels minus 2 standard deviations were designated as proficiency levels.

CONCLUSIONS

This analysis generated validity evidence for 15 VR tasks and established expert-derived proficiency levels for 17 VR tasks and 3 inanimate tasks. Our proposed curriculum now consists of 19 VR and 3 inanimate tasks using the selected proficiency levels. We anticipate that this design will maximize curriculum efficiency and effectiveness.

Artificial intelligence in pediatric surgery

Artificial intelligence (AI) is rapidly changing the landscape of medicine and is already being utilized in conjunction with medical diagnostics and imaging analysis. We hereby explore AI applications in surgery and examine its relevance to pediatric surgery, covering its evolution, current state, and promising future. The various fields of AI are explored including machine learning and applications to predictive analytics and decision support in surgery, computer vision and image analysis in preoperative planning, image segmentation, surgical navigation, and finally, natural language processing assist in expediting clinical documentation, identification of clinical indications, quality improvement, outcome research, and other types of automated data extraction. The purpose of this review is to familiarize the pediatric surgical community with the rise of AI and highlight the ongoing advancements and challenges in its adoption, including data privacy, regulatory considerations, and the imperative for interdisciplinary collaboration. We hope this review serves as a comprehensive guide to AI's transformative influence on surgery, demonstrating its potential to enhance pediatric surgical patient outcomes, improve precision, and usher in a new era of surgical excellence.

Conception and prospective multicentric validation of a Robotic Surgery Training Curriculum (RoSTraC) for surgical residents: from simulation via laboratory training to integration into the operation room

There is a lack of training curricula and educational concepts for robotic-assisted surgery (RAS). It remains unclear how surgical residents can be trained in this new technology and how robotics can be integrated into surgical residency training. The conception of a training curriculum for RAS addressing surgical residents resulted in a three-step training curriculum including multimodal learning contents: basics and simulation training of RAS (step 1), laboratory training on the institutional robotic system (step 2) and structured on-patient training in the operating room (step 3). For all three steps, learning content and video tutorials are provided via cloud-based access to allow self-contained training of the trainees. A prospective multicentric validation study was conducted including seven surgical residents. Transferability of acquired skills to a RAS procedure were analyzed using the GEARS score. All participants successfully completed RoSTraC within 1 year. Transferability of acquired RAS skills could be demonstrated using a RAS gastroenterostomy on a synthetic biological organ model. GEARS scores concerning this procedure improved significantly after completion of RoSTraC (17.1 (±5.8) vs. 23.1 (±4.9), p < 0.001). In step 3 of RoSTraC, all participants performed a median of 12 (range 5-21) RAS procedures on the console in the operation room. RoSTraC provides a highly standardized and comprehensive training curriculum for RAS for surgical residents. We could demonstrate that participating surgical residents acquired fundamental and advanced RAS skills. Finally, we could confirm that all surgical residents were successfully and safely embedded into the local RAS team.

Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review

BACKGROUND

There is a need to standardize training in robotic surgery, including objective assessment for accreditation. This systematic review aimed to identify objective tools for technical skills assessment, providing evaluation statuses to guide research and inform implementation into training curricula.

METHODS

A systematic literature search was conducted in accordance with the PRISMA guidelines. Ovid Embase/Medline, PubMed and Web of Science were searched. Inclusion criterion: robotic surgery technical skills tools. Exclusion criteria: non-technical, laparoscopy or open skills only. Manual tools and automated performance metrics (APMs) were analysed using Messick's concept of validity and the Oxford Centre of Evidence-Based Medicine (OCEBM) Levels of Evidence and Recommendation (LoR). A bespoke tool analysed artificial intelligence (AI) studies. The Modified Downs-Black checklist was used to assess risk of bias.

RESULTS

Two hundred and forty-seven studies were analysed, identifying: 8 global rating scales, 26 procedure-/task-specific tools, 3 main error-based methods, 10 simulators, 28 studies analysing APMs and 53 AI studies. Global Evaluative Assessment of Robotic Skills and the da Vinci Skills Simulator were the most evaluated tools at LoR 1 (OCEBM). Three procedure-specific tools, 3 error-based methods and 1 non-simulator APMs reached LoR 2. AI models estimated outcomes (skill or clinical), demonstrating superior accuracy rates in the laboratory with 60 per cent of methods reporting accuracies over 90 per cent, compared to real surgery ranging from 67 to 100 per cent.

CONCLUSIONS

Manual and automated assessment tools for robotic surgery are not well validated and require further evaluation before use in accreditation processes.PROSPERO: registration ID CRD42022304901.

Does Extended Reality Simulation Improve Surgical/Procedural Learning and Patient Outcomes When Compared With Standard Training Methods?: A Systematic Review

INTRODUCTION

The use of extended reality (XR) technologies, including virtual, augmented, and mixed reality, has increased within surgical and procedural training programs. Few studies have assessed experiential learning- and patient-based outcomes using XR compared with standard training methods.

METHODS

As a working group for the Society for Simulation in Healthcare, we used Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines and a PICO strategy to perform a systematic review of 4238 articles to assess the effectiveness of XR technologies compared with standard training methods. Outcomes were grouped into knowledge, time-to-completion, technical proficiency, reactions, and patient outcomes. Because of study heterogeneity, a meta-analysis was not feasible.

RESULTS

Thirty-two studies met eligibility criteria: 18 randomized controlled trials, 7 comparative studies, and 7 systematic reviews. Outcomes of most studies included Kirkpatrick levels of evidence I-III (reactions, knowledge, and behavior), while few reported level IV outcomes (patient). The overall risk of bias was low. With few exceptions, included studies showed XR technology to be more effective than standard training methods in improving objective skills and performance, shortening procedure time, and receiving more positive learner ratings. However, XR use did not show significant differences in gained knowledge.

CONCLUSIONS

Surgical or procedural XR training may improve technical skill development among trainees and is generally favored over standard training methods. However, there should be an additional focus on how skill development translates to clinically relevant outcomes. We recommend longitudinal studies to examine retention and transfer of training to clinical settings, methods to improve timely, adaptive feedback for deliberate practice, and cost analyses.

Effectiveness of a vision-based handle trajectory monitoring system in studying robotic suture operation

Data on surgical robots are not openly accessible, limiting further study of the operation trajectory of surgeons' hands. Therefore, a trajectory monitoring system should be developed to examine objective indicators reflecting the characteristic parameters of operations. 20 robotic experts and 20 first-year residents without robotic experience were included in this study. A dry-lab suture task was used to acquire relevant hand performance data. Novices completed training on the simulator and then performed the task, while the expert team completed the task after warm-up. Stitching errors were measured using a visual recognition method. Videos of operations were obtained using the camera array mounted on the robot, and the hand trajectory of the surgeons was reconstructed. The stitching accuracy, robotic control parameters, balance and dexterity parameters, and operation efficiency parameters were compared. Experts had smaller center distance (p < 0.001) and larger proximal distance between the hands (p < 0.001) compared with novices. The path and volume ratios between the left and right hands of novices were larger than those of experts (both p < 0.001) and the total volume of the operation range of experts was smaller (p < 0.001). The surgeon trajectory optical monitoring system is an effective and non-subjective method to distinguish skill differences. This demonstrates the potential of pan-platform use to evaluate task completion and help surgeons improve their robotic learning curve.

Is Robotic Console Time a Surrogate for Resident Operative Autonomy?

OBJECTIVE

Robotic-assisted surgery is an increasing part of general surgery training, but resident autonomy on the robotic platform can be hard to quantify. Robotic console time (RCT), the percentage of time the resident controls the console, may be an appropriate measure of resident operative autonomy. This study aims to characterize the correlation between objective resident RCT and subjectively scored operative autonomy.

METHODS

Using a validated resident performance evaluation instrument, we collected resident operative autonomy ratings from residents and attendings performing robotic cholecystectomy (RC) and robotic inguinal hernia repair (IH) at a university-based general surgery program between 9/2020-6/2021. We then extracted RCT data from the Intuitive surgical system. Descriptive statistics, t-tests and ANOVA were performed.

RESULTS

A total of 31 robotic operations (13 RC, 18 IH) performed by 4 attending surgeons and 8 residents (4 junior, 4 senior) were matched and included. 83.9% of cases were scored by both attending and resident. The average RCT per case was 35.6%(95% CI 13.0%,58.3%) for junior residents (PGY 2-3) and 59.7%(CI 51.1%,68.3%) for senior residents (PGY 4-5). The mean autonomy evaluated by residents was 3.29(CI 2.85,3.73) out of a maximum score of 5, while the mean autonomy evaluated by attendings was 4.12(CI 3.68,4.55). RCT significantly correlated with subjective evaluations of resident autonomy (r=0.61, p=0.0003). RCT also moderately correlated with resident training level (r=0.5306, p<0.0001). Neither attending robotic experience nor operation type significantly correlated with RCT or autonomy evaluation scores.

CONCLUSIONS

Our study suggests that resident console time is a valid surrogate for resident operative autonomy in robotic cholecystectomy and inguinal hernia repair. RCT may be a valuable measure in objective assessment of residents' operative autonomy and training efficiency. Future investigation into how RCT correlates with subjective and objective autonomy metrics such as verbal guidance or distinguishing critical operative steps is needed to validate the study findings further.

Robotic-Assisted Surgery Training (RAST): Assessment of Surgeon Console Ergonomic Skills

OBJECTIVE

The aim of this study was to evaluate the responsiveness of postgraduate year (PGY) general surgery residents (GSRs) to surgeon console ergonomics within the robotic-assisted surgery training (RAST) program.

DESIGN

This was a prospective educational study. GSRs were prepared with a pretraining educational video. Faculty provided one-on-one resident hands-on training and testing. Nine proficiency criteria (emergency stop & recover; left side pod adjustments; touchpad controls; footswitch panel; energy control pedals; camera control & focus; arm swap; master & finger clutch; dual console settings control) were assessed with a 5-point Likert-scale. Responsiveness was defined as change in performance over time. The robotic platform was Da Vinci Xi (Intuitive Surgical, Sunnyvale, CA). The Dundee ready educational environment measure (DREEM) inventory was used by GSRs to assess the educational environment.

SETTING

Tertiary care academic teaching institution.

PARTICIPANTS

A total of 22 GSRs: 4 PGY 1, 4 PGY 2, 4 PGY 3, 5 PGY 4, 5 PGY 5.

RESULTS

From June 2022 to March 2023 the hands-on console time decreased at testing when compared to baseline: median 39.0 (range 37-41) vs 20.1 (range 19-22) minutes, respectively. There was no difference in mean hands-on testing scores stratified by PGY: 4.85±0.4 PGY1; 4.98 ± 0.3 PGY2; 4.86 ± 0.4 PGY3, 4.88 ± 0.2 PGY4, and 4.91 ± 0.1 PGY5 (ANOVA test; p = 0.095). The overall DREEM score was 167.1 ± 16.9 with CAC = 0.908 (excellent internal consistency).

CONCLUSIONS

Training in ergonomics on the surgeon console impacted the responsiveness of the GSRs with 51% console time reduction. There were no differences in hands-on testing scores among PGYs. Perception of the educational environment by the GSRs was high.

Common Components of General Surgery Robotic Educational Programs

OBJECTIVE

Robotically assisted surgery has become more common in general surgery, but there is limited guidance from the Accreditation Council for Graduate Medical Education (ACGME) regarding this type of training. We sought to determine common elements and differences in the robotic educational curricula developed by general surgery residency programs.

DESIGN

Robotic educational curricula were obtained from the 7 individuals who presented at the workshop, "Robotic Education in General Surgery" at the 2023 Association of Program Directors in Surgery annual meeting.

RESULTS

All 7 general surgery programs had training beginning intern year, required online robotic modules, had at least 1 dedicated simulation training console not used for clinical purposes, and ran dry and wet (tissue) robotic labs at least annually. All programs had bedside and console surgeon case minimums and had administrative support to run the educational programs. Differences existed regarding how training intern year was executed, the simulations required, clinical practice minimum requirements, how progress was monitored over time, and how case numbers were tracked. Some programs had salary support for a director of robotic education.

CONCLUSIONS

There are several common elements to robotic educational curricula in general surgery, however significant variation does exist between programs. Given the frequency of robotic use in general surgery and current lack of standardization, formal guidance from the ACGME specifically regarding robotic education in general surgery residency is warranted.

Implementation of a structured robotic colorectal curriculum for general surgery residents

There is increasing demand for colorectal robotic training for general surgery residents. We implemented a robotic colorectal surgery curriculum expecting that it would increase resident exposure to the robotic platform and would increase the number of graduating general surgery residents obtaining a robotic equivalency certificate. The aim of this study is to describe the components of the curriculum and characterize the immediate impact of the implementation or residents. Our curriculum started in 2019 and consists of didactics, simulation, and clinical performance. Objectives are specified for both junior residents (post-graduate years [PGY]1-2) and senior residents (PGY3-5). The robotic colorectal surgical experience was characterized by comparing robotic to non-robotic operations, differences in robotic operations across post-graduate year, and percentage of graduates achieving an equivalency certificate. Robotic operations are tracked using case log annotation. From 2017 to 2021, 25 residents logged 681 major operations on the colorectal service (PGY1 mean = 7.6 ± 4.6, PGY4 mean = 29.7 ± 14.4, PGY5 mean = 29.8 ± 14.8). Robotic colorectal operations made up 24% of PGY1 (49% laparoscopic, 27% open), 35% of PGY4 (35% laparoscopic, 29% open), and 41% of PGY5 (44% laparoscopic, 15% open) major colorectal operations. Robotic bedside experience is primarily during PGY1 (PGY1 mean 2.0 ± 2.0 bedside operations vs 1.4 ± 1.6 and 0.2 ± 0.4 for PGY4 and 5, respectively). Most PGY4 and 5 robotic experience is on the console (PGY4 mean 9.1 ± 7.7 console operations, PGY5 mean 12.0 ± 4.8 console operations). Rates of robotic certification for graduating chief residents increased from 0% for E-2013 to 100% for E-2018. Our robotic colorectal curriculum for general surgery residents has facilitated earlier and increased robotic exposure for residents and increased robotic certification for our graduates.

The importance of robotic surgery training in HPB fellowship: a survey of the 2022 AHPBA fellows

BACKGROUND

The 2022 incoming fellows' expectations for their robotics training, as well as their perceptions of the utility of the surgical robot, are not well defined.

METHODS

Cross-sectional survey of 24 AHPBA fellows in 2022, analyzed with descriptive statistics and Spearman's rho.

RESULTS

Of 33 current AHPBA fellows, 22 completed the survey (66.7%). Study participants had limited-to-moderate experience with robotics prior to fellowship (mean 2.5 ± SD 1.1; range 1-4). Most participants agreed that robotics influenced their fellowship choice (mean 4.14 ± SD 0.87; range 1-5), would make then more marketable (mean 4.77 ± SD 0.52; range 1-5) and improve job prospects (mean 4.68 ± SD 0.87; range 1-5). Of the study participants, 55% responded that robotics training is "essential" in fellowship, while 64% responded that it is "essential" for their careers. Fellows were only slightly satisfied with overall robotics training within their respective programs (mean 3.44 ± SD 1.17; range 1-5) The majority (73.7%) expect that robotics will comprise <25% of their training. Notably, the majority (75%) have no formal robotics training curriculum.

DISCUSSION

This survey identifies potential gaps where robotics training could be improved for future incoming AHPBA fellows.

Current practises and the future of robotic surgical training

INTRODUCTION

This study reviews the current state of robotic surgery training for surgeons, including the various curricula, training methods, and tools available, as well as the challenges and limitations of these.

METHODS

The authors carried out a literature search across PubMed, MEDLINE, and Google Scholar using keywords related to 'robotic surgery', 'computer-assisted surgery', 'simulation', 'virtual reality', 'surgical training', and 'surgical education'. Full text analysis was performed on 112 articles.

TRAINING PROGRAMMES

The training program for robotic surgery should focus on proficiency, deliberation, and distribution principles. The curricula can be broadly split up into pre-console and console-side training. Pre-Console and Console-Side Training: Simulation training is an important aspect of robotic surgery training to improve technical skill acquisition and reduce mental workload, which helps prepare trainees for live procedures.

OPERATIVE PERFORMANCE ASSESSMENT

The study also discusses the various validated assessment tools used for operative performance assessments.

FUTURE ADVANCES

Finally, the authors propose potential future directions for robotic surgery training, including the use of emerging technologies such as AI and machine learning for real-time feedback, remote mentoring, and augmented reality platforms like Proximie to reduce costs and overcome geographic limitations.

CONCLUSION

Standardisation in trainee performance assessment is needed. Each of the robotic curricula and platforms has strengths and weaknesses. The ERUS Robotic Curriculum represents an evidence-based example of how to implement training from novice to expert. Remote mentoring and augmented reality platforms can overcome the challenges of high equipment costs and limited access to experts. Emerging technologies offer promising advancements for real-time feedback and immersive training environments, improving patient outcomes.

Intentional enterotomies: validation of a novel robotic surgery training exercise

While laparoscopic simulation-based training is a well-established component of general surgery training, no such requirement or standardized curriculum exists for robotic surgery. Furthermore, there is a lack of high-fidelity electrocautery simulation training exercises in the literature. Using Messick's validity framework, we sought to determine the content, response process, internal content and construct validity of a novel inanimate tissue model that utilizes electrocautery for potential incorporation in such curricula. A multi-institutional, prospective study involving medical students (MS) and general surgery residents (PGY1-3) was conducted. Participants performed an exercise using a biotissue bowel model on the da Vinci Xi robotic console during which they created an enterotomy using electrocautery, followed by approximation with interrupted sutures. Participant performance was recorded and then scored by crowd-sourced assessors of technical skill, along with three of the authors. Construct validity was determined via difference in Global Evaluative Assessment of Robotic Skills (GEARS) score, time to completion, and total number of errors between the two cohorts. Upon completion of the exercise, participants were surveyed on their perception of the exercise and its impact on their robotic training to determine content validity. 31 participants were enrolled and separated into two cohorts: MS + PGY1 vs. PGY2-3. Time spent on the robotic trainer (0.8 vs. 8.13 h, p = 0.002), number of bedside robotic assists (5.7 vs. 14.8, p < 0.001), and number of robotic cases as primary surgeon (0.3 vs. 13.1, p < 0.001) were statistically significant between the two groups. Differences in GEARS scores (18.5 vs. 19.9, p = 0.001), time to completion (26.1 vs. 14.4 min, p < 0.001), and total errors (21.5 vs. 11.9, p = 0.018) between the groups were statistically significant as well. Of the 23 participants that completed the post-exercise survey, 87% and 91.3% reported improvement in robotic surgical ability and confidence, respectively. On a 10-point Likert scale, respondents rated the realism of the exercise 7.5, educational benefit 9.1, and effectiveness in teaching robotic skills 8.7. Controlling for the upfront investment of certain training materials, each exercise iteration cost ~ $30. This study confirmed the content, response process, internal structure and construct validity of a novel, high-fidelity and cost-effective inanimate tissue exercise which successfully incorporates electrocautery. Consideration should be given to its addition to robotic surgery training programs.

Proctored adoption of robotic hiatus hernia surgery: outcomes and learning curves in a high-volume UK centre

BACKGROUND

The adoption of new surgical technologies is inevitably accompanied by a learning curve. With the increasing adoption of robotic techniques in benign foregut surgery, it is imperative to define optimal learning pathways, to ensure a clinically safe introduction of such a technique. The aim of this study was to assess the learning curve for robotic hiatal hernia repair with a pre-defined adoption process and proctoring.

METHODS

The learning curve was assessed in four surgeons in a high-volume tertiary referral centre, performing over a 100 hiatal hernia repairs annually. The robotic adoption process included simulation-based training and a multi-day wet lab-based course, followed by robotic operations proctored by robotic upper GI experts. CUSUM analysis was performed to assess changes in operating time in sequential cases.

RESULTS

Each surgeon (A, B, C and D) performed between 22 and 32 cases, including a total of 109 patients. Overall, 40 cases were identified as 'complex' (36.7%), including 16 revisional cases (16/109, 14.7%). With CUSUM analysis inflection points for operating time were seen after 7 (surgeon B) to 15 cases (surgeon B).

CONCLUSION

The learning curve for robotic laparoscopic fundoplication may be as little as 7-15 cases in the setting of a clearly organized learning pathway with proctoring. By integrating these organized learning pathways learning curves may be shortened, ensuring patient safety, preventing detrimental outcomes due to longer learning curves, and accelerating adoption and integration of novel surgical techniques.

A systematic review of general surgery robotic training curriculums

Background

As of the most recent surveys of resident programs in 2018, only slightly more than half of programs have formal robotic training curriculums implemented. Fewer programs have further assessed their own curriculum and its benefit.

Method

We conducted a PubMed/MEDLINE literature search for robotic surgery curriculums and those that had assessment of their programs.

Results

A total of 11 studies were reviewed. When reviewed in chronological order, there has been a progression towards more robotic specific objective data analysis as opposed to subjective surveying. There is a wide variation in curriculums, but simulation use is pervasive.

Conclusions

Our review makes evident two important concepts-there is great variety in training curriculums and there is great benefit in implementation. The importance is in establishment of what makes resident training effective and supports the adaptable and successful surgeon. This may come from an adaptable curriculum but a structured test-out assessment.

Discrimination, Reliability, Sensitivity, and Specificity of Robotic Surgical Proficiency Assessment With Global Evaluative Assessment of Robotic Skills and Binary Scoring Metrics: Results From a Randomized Controlled Trial

Objective

To compare binary metrics and Global Evaluative Assessment of Robotic Skills (GEARS) evaluations of training outcome assessments for reliability, sensitivity, and specificity.

Background

GEARS-Likert-scale skills assessment are a widely accepted tool for robotic surgical training outcome evaluations. Proficiency-based progression (PBP) training is another methodology but uses binary performance metrics for evaluations.

Methods

In a prospective, randomized, and blinded study, we compared conventional with PBP training for a robotic suturing, knot-tying anastomosis task. Thirty-six surgical residents from 16 Belgium residency programs were randomized. In the skills laboratory, the PBP group trained until they demonstrated a quantitatively defined proficiency benchmark. The conventional group were yoked to the same training time but without the proficiency requirement. The final trial was video recorded and assessed with binary metrics and GEARS by robotic surgeons blinded to individual, group, and residency program. Sensitivity and specificity of the two assessment methods were evaluated with area under the curve (AUC) and receiver operating characteristics (ROC) curves.

Results

The PBP group made 42% fewer objectively assessed performance errors than the conventional group (P < 0.001) and scored 15% better on the GEARS assessment (P = 0.033). The mean interrater reliability for binary metrics and GEARS was 0.87 and 0.38, respectively. Binary total error metrics AUC was 97% and for GEARS 85%. With a sensitivity threshold of 0.8, false positives rates were 3% and 25% for, respectively, the binary and GEARS assessments.

Conclusions

Binary metrics for scoring a robotic VUA task demonstrated better psychometric properties than the GEARS assessment.

A long distance telesurgical demonstration on robotic surgery phantoms over 5G

PURPOSE

Using robotic technology and communications infrastructure to remotely perform surgery has been a persistent goal in medical research in the past three decades. The recent deployment of the Fifth-Generation Wireless Networks has revitalized the research efforts in the telesurgery paradigm. Offering low latency and high bandwidth communication, they are well suited for applications that require real-time data transmission and can allow smoother communication between surgeon and patient, making it possible to remotely perform complex surgeries. In this paper, we investigate the effects of the 5 G network on surgical performance during a telesurgical demonstration where the surgeon and the robot are separated by nearly 300 km.

METHODS

The surgeon performed surgical exercises on a robotic surgery training phantom using a novel telesurgical platform. The master controllers were connected to the local site on a 5 G network, teleoperating the robot remotely in a hospital. A video feed of the remote site was also streamed. The surgeon performed various tasks on the phantom such as cutting, dissection, pick-and-place and ring tower transfer. To assess the usefulness, usability and image quality of the system, the surgeon was subsequently interviewed using three structured questionnaires.

RESULTS

All tasks were completed successfully. The low latency and high bandwidth of the network resulted into a latency of 18 ms for the motion commands while the video delay was about 350 ms. This enabled the surgeon to operate smoothly with a high-definition video from about 300 km away. The surgeon viewed the system's usability in a neutral to positive way while the video image was rated as of good quality.

CONCLUSION

5 G networks provide significant advancement in the field of telecommunications, offering faster speeds and lower latency than previous generations of wireless technology. They can serve as an enabling technology for telesurgery and further advance its application and adoption.

Robotic Plastic Surgery Education: Developing a Robotic Surgery Training Program Specific to Plastic Surgery Trainees

Over the past two decades, the surgical community has increasingly embraced robotic-assisted surgery (RAS) due to its potential to enhance accuracy and decrease surgical morbidity. Plastic surgery as a field has been historically slow to incorporate RAS, with lack of adequate training posing as one of the most commonly cited barriers. To date, robot technology has been utilized for various reconstructive procedures including flap elevation and inset, pedicle dissection, and microvascular anastomosis. As RAS continues to integrate within plastic surgery procedures, the need for a structured RAS curriculum designed for plastic surgery trainees is rising. This article delineates the essential components of a plastic surgery-specific RAS curriculum and outlines current training models and assessment tools utilized across surgical subspecialties to date.

Utilising an accelerated Delphi process to develop consensus on the requirement and components of a pre-procedural core robotic surgery curriculum

Robot-assisted surgery (RAS) continues to grow globally. Despite this, in the UK and Ireland, it is estimated that over 70% of surgical trainees across all specialities have no access to robot-assisted surgical training (RAST). This study aimed to provide educational stakeholders guidance on a pre-procedural core robotic surgery curriculum (PPCRC) from the perspective of the end user; the surgical trainee. The study was conducted in four Phases: P1: a steering group was formed to review current literature and summarise the evidence, P2: Pan-Specialty Trainee Panel Virtual Classroom Discussion, P3: Accelerated Delphi Process and P4: Formulation of Recommendations. Forty-three surgeons in training representing all surgical specialties and training levels contributed to the three round Delphi process. Additions to the second- and third-round surveys were formulated based on the answers and comments from previous rounds. Consensus opinion was defined as ≥ 80% agreement. There was 100% response from all three rounds. The resulting formulated guidance showed good internal consistency, with a Cronbach alpha of > 0.8. There was 97.7% agreement that a standardised PPCRC would be advantageous to training and that, independent of speciality, there should be a common approach (95.5% agreement). Consensus was reached in multiple areas: 1. Experience and Exposure, 2. Access and context, 3. Curriculum Components, 4 Target Groups and Delivery, 5. Objective Metrics, Benchmarking and Assessment. Using the Delphi methodology, we achieved multispecialty consensus among trainees to develop and reach content validation for the requirements and components of a PPCRC. This guidance will benefit from further validation following implementation.

[Evidence, Availability and Future Visions in Simulation in General and Visceral Surgery]

Practice makes perfect - a saying that everyone has certainly heard. Surgeons of all levels of training can demonstrably practice to some extent on simulators. This training outside the operating theatre and independent of patients makes sense, both ethically and financially. Although the effectiveness of simulation in surgery has been proven several times, simulation training is not a mandatory part of surgical specialist training in Germany. Simulation covers a very wide range in terms of application, effort and costs. This review is intended to give an overview of the systems and their areas of application and the target group. The focus lies on the commonly available systems and possible advantages and disadvantages. Practical skills are in the foreground and all three pillars of general and visceral surgery - conventional techniques, laparoscopy and robotics - are taken into account. However, simulators alone do not achieve cost-benefit effectiveness. The full potential of such an investment can only be exploited with a site-specific, structured training concept in which simulation training according to the post-graduate year and appropriate allocation to surgeries in the operating room are closely interlinked. It should always be possible to train basic skills on site. The significant additional costs for complex simulation systems are possible, depending on the financial resources, or should be purchased in a network or for national courses. The techniques of immersive virtual reality in combination with artificial intelligence and deformation algorithms will certainly play a decisive role for the future of simulation, whereby the use of the available systems must be a primary goal. The integration of simulation into specialist training should be striven for, not least in order to justify the costs.

Virtual classroom proficiency-based progression for robotic surgery training (VROBOT): a randomised, prospective, cross-over, effectiveness study

Robotic surgery training has lacked evidence-based standardisation. We aimed to determine the effectiveness of adjunctive interactive virtual classroom training (VCT) in concordance with the self-directed Fundamentals of Robotic Surgery (FRS) curriculum. The virtual classroom is comprised of a studio with multiple audio-visual inputs to which participants can connect remotely via the BARCO weConnect platform. Eleven novice surgical trainees were randomly allocated to two training groups (A and B). In week 1, both groups completed a robotic skills induction. In week 2, Group A received training with the FRS curriculum and adjunctive VCT; Group B only received access to the FRS curriculum. In week 3, the groups received the alternate intervention. The primary outcome was measured using the validated robotic-objective structured assessment of technical skills (R-OSAT) at the end of week 2 (time-point 1) and 3 (time-point 2). All participants completed the training curriculum and were included in the final analyses. At time-point 1, Group A achieved a statistically significant greater mean proficiency score compared to Group B (44.80 vs 35.33 points, p = 0.006). At time-point 2, there was no significant difference in mean proficiency score in Group A from time-point 1. In contrast, Group B, who received further adjunctive VCT showed significant improvement in mean proficiency by 9.67 points from time-point 1 (95% CI 5.18-14.15, p = 0.003). VCT is an effective, accessible training adjunct to self-directed robotic skills training. With the steep learning curve in robotic surgery training, VCT offers interactive, expert-led learning and can increase training effectiveness and accessibility.

Effects of automated skill assessment on robotic surgery training

BACKGROUND

Several automated skill-assessment approaches have been proposed for robotic surgery, but their utility is not well understood. This article investigates the effects of one machine-learning-based skill-assessment approach on psychomotor skill development in robotic surgery training.

METHODS

N = 29 trainees (medical students and residents) with no robotic surgery experience performed five trials of inanimate peg transfer with an Intuitive Surgical da Vinci Standard robot. Half of the participants received no post-trial feedback. The other half received automatically calculated scores from five Global Evaluative Assessment of Robotic Skill domains post-trial.

RESULTS

There were no significant differences between the groups regarding overall improvement or skill improvement rate. However, participants who received post-trial feedback rated their overall performance improvement significantly lower than participants who did not receive feedback.

CONCLUSIONS

These findings indicate that automated skill evaluation systems might improve trainee self-awareness but not accelerate early stage psychomotor skill development in robotic surgery training.

Gamification of robotic simulation to train general surgery residents

BACKGROUND

Gamification applies game design elements to non-game contexts in order to engage participation and increase learner motivation. Robotic surgery is gaining popularity in general surgery but requires specialized technical skills. We sought to determine whether gamification of robotic simulation training could increase robotic simulator utilization among general surgery residents.

METHODS

General surgery residents were recruited and sent weekly progress on simulator performance including leaderboards for 4 weeks during the intervention periods. There were also two control periods setup in an ABAB study design. Usage time and mean scores were compared between the control periods and intervention periods. A post-study qualitative assessment interview using semi-structured interviews determined barriers and motivational components of simulator usage.

RESULTS

Fifteen general surgery residents enrolled in the study (n = 15). Intervention increased total simulator usage time 9.7-fold from 153 to 1485 min. Total simulator days increased threefold from 9 to 27 days. Resident participation increased from 33 to 53%. Median average scores were higher during the intervention periods (58.8 and 81.9 vs 44.0). During the first intervention period, median individual-level simulator usage time increased 17 min (P = 0.03). However, there was no individual-level increase in median usage minutes or days during the second intervention period. Qualitative assessment determined barriers to be limited time due to clinical duties, and simulator availability while motivational factors included competitive factors such as leaderboards and gaming aspects. Potential improvements were increasing attending visibility of scores to increase recognition of progress by the residents and creating dedicated time for training.

CONCLUSION

Gamification of robotic simulation training increased general surgery resident participation, usage time and scores. Impact was not durable. Instituting dedicated practice time and more attending engagement may increase trainee motivation and performance.

Simulator Fidelity Does Not Affect Training for Robot-Assisted Minimally Invasive Surgery

This study was undertaken to compare performance using a surgical robot after training with one of three simulators of varying fidelity. Methods: Eight novice operators and eight expert surgeons were randomly assigned to one of three simulators. Each participant performed two exercises using a simulator and then using a surgical robot. The primary outcome of this study is performance assessed by time and GEARS score. Results: Participants were randomly assigned to one of three simulators. Time to perform the suturing exercise (novices vs. experts) was significantly different for all 3 simulators. Using the da Vinci robot, peg transfer showed no significant difference between novices and experts and all participants combined (mean time novice 2.00, expert 2.21, p = 0.920). The suture exercise had significant differences in each group and all participants combined (novice 3.54, expert 1.90, p = 0.001). ANOVA showed p-Values for suturing (novice 0.523, expert 0.123) and peg transfer (novice 0.742, expert 0.131) are not significantly different. GEARS scores were different (p < 0.05) for novices and experts. Conclusion: Training with simulators of varying fidelity result in similar performance using the da Vinci robot. A dry box simulator may be as effective as a virtual reality simulator for training. Further studies are needed to validate these results.

Developing a Robotic Surgery Curriculum: Selection of Virtual Reality Drills for Content Alignment

INTRODUCTION

Despite the importance of simulation-based training for robotic surgery, there is no consensus about its training curricula. Recently, a virtual reality (VR) platform (SimNow, Intuitive, Inc) was introduced with 33 VR drills but without evidence of their validity. As part of our creating a new robotic VR curriculum, we assessed the drills' validity through content mapping and the alignment between learning goals and drill content.

METHODS

Three robotically trained surgeons content-mapped all 33 drills for how well the drills incorporated 15 surgery skills and also rated the drills' difficulty, usefulness, relevance, and uniqueness. Drills were added to the new curriculum based on consensus about ratings and historic learner data. The drills were grouped according to similar skill sets and arranged in order of complexity.

RESULTS

The 33 drills were judged to have 12/15 surgery skills as primary goals and 13/15 as secondary goals. Twenty of the 33 drills were selected for inclusion in the new curriculum; these had 11/15 skills as primary goals and 11/15 as secondary goals. However, skills regarding energy sources, atraumatic handling, blunt dissection, fine dissection, and running suturing were poorly represented in the drills. Three previously validated inanimate drills were added to the curriculum to address lacking skill domains.

CONCLUSIONS

We identified 20 of the 33 SimNow drills as a foundation for a robotic surgery curriculum based on content-oriented evidence. We added 3 other drills to address identified gaps in drill content.

Development of an affordable, immersive model for robotic vaginal cuff closure: a randomized trial

Safe and secure closure of the vaginal cuff is a critical component of a robotic assisted hysterectomy procedure. Our aim in this study is to develop and validate a novel vaginal cuff closure model (VC) created from porcine heart that allows trainees to obtain competency in a low-risk environment. Ten expert and 20 novice robotic surgeons performed a cuff closure exercise on the VC model and on the dV-Trainer®, a virtual reality simulator (VR). Performances were timed, videotaped, and scored using the modified Global Evaluative Assessment of Robotic Skills (mGEARS) score. Expert robotic surgeons completed the task faster on both the VR (531 vs. 814 s, p = 0.03) and the VC platforms (311 vs. 631 s, p < 0.001) and achieved higher mGEAR scores (32.25 vs. 22.07, p < 0.0001). Knot quality and suturing accuracy were better in the VC than in the VR environment in both groups. In a post-completion survey, both expert and novice surgeons expressed strong preference towards the VC model. In this study, the novel VC model proved to be a reliable simulation tool with high face, content, and construct validity. Due to its simplicity and low cost, this high-yield simulation exercise can easily be incorporated into robotic training curricula of obstetrics and gynecology residents.

Safe implementation of robotic distal gastrectomy performed by non-endoscopic surgical skill qualification system-qualified surgeons

PURPOSE

Robotic gastrectomy (RG) for gastric cancer (GC) was approved for national medical insurance coverage in April, 2018, since when its use has increased dramatically throughout Japan. However, the safety of RG performed by surgeons who are not Endoscopic Surgical Skill Qualification System (ESSQS)-qualified has yet to be established. We conducted this study to verify the short-term outcomes of the initial series of RG procedures performed by non-ESSQS-qualified surgeons.

METHODS

Between January, 2020 and December, 2021, 30 patients with clinical Stage I and II GC underwent RG performed by four non-ESSQS-qualified surgeons according to the Japan Society for Endoscopic Surgery guideline. We evaluated, retrospectively, the morbidity rates according to Clavien-Dindo (CD) classification grade II or higher.

RESULTS

Each operating surgeon completed all procedures without any serious intraoperative adverse events. The median operative time, console time, and estimated blood loss were 413 (308-547) min, 361 (264-482) min, and 25.5 (4-167) mL, respectively. No patient required conversion to laparoscopic or open surgery. Three (10%) patients suffered CD grade II complications postoperatively. The median postoperative hospitalization was 11 (8-51) days.

CONCLUSION

Non-ESSQS-qualified surgeons trained by expert RG surgeons could perform robotic distal gastrectomy safely for initial cases.

Development and evaluation of a portable and soft 3D-printed cast for laparoscopic choledochojejunostomy model in surgical training

BACKGROUND

Laparoscopic choledochojejunostomy (LCJ) is an essential basic skill for biliary surgeons. Therefore, we established a convenient and effective LCJ 3D printing model to evaluate whether the model could simulate the actual operation situation and determine its effectiveness and validity in surgical training.

METHODS

A 3D printing dry laboratory model was established to simulate LCJ. The face and content validity of the model were evaluated by six experienced biliary surgeons based on 5-point Likert scale questionnaires. A total of 15 surgeons with different levels of experience performed LCJ on the model and evaluated the structural validity of the model using the objective structured assessment of technical skills (OSATS). Simultaneously, the operation time of each surgery was also recorded. A study was also performed to further evaluate the learning curve of residents.

RESULTS

The operating space score of the model was 4.83 ± 0.41 points. The impression score of bile duct and intestinal canal was 4.33 ± 0.52 and 4.17 ± 0.41 points, respectively. The tactile sensation score of bile duct suture and intestinal canal suture was 4.00 ± 0.63 and 3.83 ± 0.41points, respectively. The OSATS score for model operation in the attending group was 29.20 ± 0.45 points, which was significantly higher than that in the fellow group (26.80 ± 1.10, P = 0.007) and the resident group (19.80 ± 1.30, P < 0.001). In addition, there was a statistical difference in operation time among surgeons of different experience levels (P < 0.05). Residents could significantly improve the surgical score and shorten the time of LCJ through repeated training.

CONCLUSIONS

The 3D printing LCJ model can simulate the real operation scenes and distinguish surgeons with different levels of experience. The model is expected to be one of the training methods for biliary tract surgery in the future.