Best Practices for Robotic Surgery Training and Credentialing

Proficiency Levels and Validity Evidence for Scoring Metrics for a Virtual Reality and Inanimate Robotic Surgery Simulation Curriculum

OBJECTIVE

Our institution recently implemented a virtual reality (VR) skills curriculum for general surgery residents using the SimNow simulator. Based on a content alignment study, we revised the curriculum to include only 20 of 33 VR tasks and we added 3 previously validated inanimate tasks. The purpose of this study was to establish expert-derived proficiency levels for all tasks and to evaluate the validity of the scoring for the VR tasks.

DESIGN

Two expert robotic surgeons performed 5 repetitions of each VR and inanimate task. The trimmed mean (lowest scoring attempt and outliers [>2 standard deviations] were eliminated) was defined as the expert level for each task. For the VR tasks, expert levels were compared to resident performance to evaluate validity.

SETTING

This study was conducted at the University of Texas Southwestern Medical Center (Dallas, TX), a tertiary care academic teaching hospital.

PARTICIPANTS

Two expert robotic surgeons participated in this study. The data from 42 residents (PGY2-4) who completed the original curriculum was used to represent novice performance.

RESULTS

Comparison of expert levels and resident performance was statistically significant for 15 VR tasks (supporting validity) and approached significance (p = 0.06, 0.09) for 2 VR tasks; expert levels were designated as proficiency levels for these 17 tasks. Group comparisons were clearly not significant (p = 0.2-0.8) for 3 VR tasks; 2 of these 3 tasks were retained as introductory exercises (with 3 repetitions required) and 1 was excluded. For the 3 inanimate tasks, expert levels minus 2 standard deviations were designated as proficiency levels.

CONCLUSIONS

This analysis generated validity evidence for 15 VR tasks and established expert-derived proficiency levels for 17 VR tasks and 3 inanimate tasks. Our proposed curriculum now consists of 19 VR and 3 inanimate tasks using the selected proficiency levels. We anticipate that this design will maximize curriculum efficiency and effectiveness.

Robotic-Assisted Surgery Training (RAST): Assessment of Surgeon Console Ergonomic Skills

OBJECTIVE

The aim of this study was to evaluate the responsiveness of postgraduate year (PGY) general surgery residents (GSRs) to surgeon console ergonomics within the robotic-assisted surgery training (RAST) program.

DESIGN

This was a prospective educational study. GSRs were prepared with a pretraining educational video. Faculty provided one-on-one resident hands-on training and testing. Nine proficiency criteria (emergency stop & recover; left side pod adjustments; touchpad controls; footswitch panel; energy control pedals; camera control & focus; arm swap; master & finger clutch; dual console settings control) were assessed with a 5-point Likert-scale. Responsiveness was defined as change in performance over time. The robotic platform was Da Vinci Xi (Intuitive Surgical, Sunnyvale, CA). The Dundee ready educational environment measure (DREEM) inventory was used by GSRs to assess the educational environment.

SETTING

Tertiary care academic teaching institution.

PARTICIPANTS

A total of 22 GSRs: 4 PGY 1, 4 PGY 2, 4 PGY 3, 5 PGY 4, 5 PGY 5.

RESULTS

From June 2022 to March 2023 the hands-on console time decreased at testing when compared to baseline: median 39.0 (range 37-41) vs 20.1 (range 19-22) minutes, respectively. There was no difference in mean hands-on testing scores stratified by PGY: 4.85±0.4 PGY1; 4.98 ± 0.3 PGY2; 4.86 ± 0.4 PGY3, 4.88 ± 0.2 PGY4, and 4.91 ± 0.1 PGY5 (ANOVA test; p = 0.095). The overall DREEM score was 167.1 ± 16.9 with CAC = 0.908 (excellent internal consistency).

CONCLUSIONS

Training in ergonomics on the surgeon console impacted the responsiveness of the GSRs with 51% console time reduction. There were no differences in hands-on testing scores among PGYs. Perception of the educational environment by the GSRs was high.

Human visual explanations mitigate bias in AI-based assessment of surgeon skills

Artificial intelligence (AI) systems can now reliably assess surgeon skills through videos of intraoperative surgical activity. With such systems informing future high-stakes decisions such as whether to credential surgeons and grant them the privilege to operate on patients, it is critical that they treat all surgeons fairly. However, it remains an open question whether surgical AI systems exhibit bias against surgeon sub-cohorts, and, if so, whether such bias can be mitigated. Here, we examine and mitigate the bias exhibited by a family of surgical AI systems-SAIS-deployed on videos of robotic surgeries from three geographically-diverse hospitals (USA and EU). We show that SAIS exhibits an underskilling bias, erroneously downgrading surgical performance, and an overskilling bias, erroneously upgrading surgical performance, at different rates across surgeon sub-cohorts. To mitigate such bias, we leverage a strategy -TWIX-which teaches an AI system to provide a visual explanation for its skill assessment that otherwise would have been provided by human experts. We show that whereas baseline strategies inconsistently mitigate algorithmic bias, TWIX can effectively mitigate the underskilling and overskilling bias while simultaneously improving the performance of these AI systems across hospitals. We discovered that these findings carry over to the training environment where we assess medical students' skills today. Our study is a critical prerequisite to the eventual implementation of AI-augmented global surgeon credentialing programs, ensuring that all surgeons are treated fairly.

Robotic-assisted surgery training (RAST) program: module 1 of a three-module program. Assessment of patient cart docking skills and educational environment

There is currently no standardized robotic surgery training program in General Surgery Residency. RAST involves three modules: ergonomics, psychomotor, and procedural. This study aimed to report the results of module 1, which assessed the responsiveness of 27 PGY (postgraduate year) 1-5 general surgery residents (GSRs) to simulated patient cart docking, and to evaluate the residents' perception of the educational environment from 2021 to 2022. GSRs prepared with pre-training educational video and multiple-choice questions test (MCQs). Faculty provided one-on-one resident hands-on training and testing. Nine proficiency criteria (deploy cart; boom control; driving cart; docking camera port; targeting anatomy; flex joints; clearance joints; port nozzles; emergency undocking) were assessed with five-point Likert scale. A validated 50-item Dundee Ready Educational Environment Measure (DREEM) inventory was used by GSRs to assess the educational environment. Mean MCQ scores: (90.6 ± 16.1 PGY1), (80.2 ± 18.1PGY2), (91.7 ± 16.5 PGY3) and (PGY4, 86.8 ± 18.1 PGY5) (ANOVA test; p = 0.885). Hands-on docking time decreased at testing when compared to base line: median 17.5 (range 15-20) min vs. 9.5 (range 8-11). Mean hands-on testing score was 4.75 ± 0.29 PGY1; 5.0 ± 0 PGY2 and PGY3, 4.78 ± 0.13 PGY4, and 4.93 ± 0.1 PGY5 (ANOVA test; p = 0.095). No correlation was found between pre-course MCQ score and hands-on training score (Pearson correlation coefficient = - 0.359; p = 0.066). There was no difference in the hands-on scores stratified by PGY. The overall DREEM score was 167.1 ± 16.9 with CAC = 0.908 (excellent internal consistency). Patient cart training impacted the responsiveness of GSRs with 54% docking time reduction and no differences in hands-on testing scores among PGYs with a highly positive perception.

Establishment and Application of a Novel Difficulty Scoring System for da Vinci Robotic Pancreatoduodenectomy

Background

Robotic pancreatoduodenectomy (RPD) technology is developing rapidly, but there is still a lack of a specific and objective difficulty evaluation system in the field of application and training of RPD surgery.

Methods

The clinical data of patients who underwent RPD in our hospital from November 2014 to October 2020 were analyzed retrospectively. Univariate and multivariate logistic regression analyses were used to determine the predictors of operation difficulty and convert into a scoring system.

Results

A total of 72 patients were enrolled in the group. According to the operation time (25%), intraoperative blood loss (25%), conversion to laparotomy, and major complications, the difficulty of operation was divided into low difficulty (0–2 points) and high difficulty (3–4 points). The multivariate logistic regression model included the thickness of mesenteric tissue (P1) (P = 0.035), the thickness of the abdominal wall (B1) (P = 0.017), and the preoperative albumin (P = 0.032), and the nomogram was established. AUC = 0.773 (0.645–0.901).

Conclusions

The RPD difficulty evaluation system based on the specific anatomical relationship between da Vinci’s laparoscopic robotic arm and tissues/organs in the operation area can be used as a predictive tool to evaluate the surgical difficulty of patients before operation and guide clinical practice.

Assessment of the training program for Versius, a new innovative robotic system for use in minimal access surgery

Objectives

The Versius surgical system has been developed for use in robot-assisted minimal access surgery (MAS). This study aimed to evaluate the effectiveness of the Versius training program.

Design

A 3.5-day program following 10 hours of online didactic training. Participants were assessed during the technical training using the Global Evaluative Assessment of Robotic Skills (GEARS).

Setting

Dry box exercises were conducted in classrooms, and wet lab sessions simulated an operating room environment using cadaveric specimens.

Participants

Seventeen surgical teams participated; surgeons represented general, colorectal, obstetrics/gynecology, and urology specialties. All surgeons had previous laparoscopic MAS experience, while experience with robotics varied.

Main outcomes measures

Participants were scored on a five-point Likert Scale for each of six validated GEARS domains (depth perception, bimanual dexterity, efficiency, force sensitivity, autonomy, and robotic control). Additional metrics used to chart surgeon performance included: combined instrument path length; combined instrument angular path; and time taken to complete each task.

Results

Participants demonstrated an overall improvement in performance during the study, with a mean GEARS Score of 21.0 (SD: 1.9) in Assessment 1 increasing to 23.4 (SD: 2.9) in Validation. Greatest improvements were observed in the depth perception and robotic control domains. Greatest differences were observed when stratifying by robotic experience; those with extensive experience consistently scored higher than those with some or no experience.

Conclusions

The Versius training program is effective; participants were able to successfully operate the system by program completion, and more surgeons achieved intermediate-level and expert-level GEARS scores in Validation compared with Assessment 1.

Training and credentialing in Robotic Surgery in India: Current perspectives

Robotic surgery has changed the landscape of surgery and ushered in a new era of technology-assisted minimally invasive surgery. There is a paradigm shift from traditional open surgeries to minimal access surgery, with robotic surgery being the new standard of care in some surgical fields. This change comes with an unprecedented influx of innovations in technology related to minimal access surgery, robotics and artificial intelligence. Despite the exponential advances in technology, there is a lacuna in the training and credentialling of robotic surgeons. In India, no dedicated training curriculum exists for trainees in robotic surgery. Thus, as robotic surgery continues to develop in India, it is imperative that robust training and credentialing systems are in place to ensure that patient safety and surgical outcomes are not compromised.

Development and Validation of an Objective Scoring Tool for Robot-Assisted Partial Nephrectomy: Scoring for Partial Nephrectomy

Objective: To develop a structured and objective scoring tool for assessment of robot-assisted partial nephrectomy (RAPN): Scoring for Partial Nephrectomy (SPaN). Materials and Methods: Content development: RAPN was deconstructed into 6 domains by a multi-institutional panel of 10 expert robotic surgeons. Performance on each domain was represented on a Likert scale of 1 to 5, with specific descriptions of anchors 1, 3, and 5. Content validation: The Delphi methodology was utilized to achieve consensus about the description of each anchor for each domain in terms of appropriateness of the skill assessed, objectiveness, clarity, and unambiguous wording. The content validity index (CVI) of ≥0.75 was set as cutoff for consensus. Reliability: 15 de-identified videos of RAPN were utilized to determine the inter-rater reliability using linearly weighted percent agreement, and Construct validation of SPaN was described in terms of median scores and odds ratios. Results: The expert panel reached consensus (CVI ≥0.75) after 2 rounds. Consensus was achieved for 36 (67%) statements in the first round and 18 (33%) after the second round. The final six-domain SPaN included Exposure of the kidney; Identification and dissection of the ureter and gonadal vessels; Dissection of the hilum; Tumor localization and exposure; Clamping and tumor resection; and Renorrhaphy. The linearly weighted percent agreement was >0.75 for all domains. There was no difference between median scores for any domain between attendings and trainees. Conclusion: Despite the lack of significant construct validity, SPaN is a structured, reliable, and procedure-specific tool that can objectively assesses technical proficiency for RAPN.

Validity of robotic simulation for high-stakes examination: a pilot study

Simulation is increasingly being used to train surgeons and access technical competency in robotic skills. The construct validity of using simulation performance for high-stakes examinations such as credentialing has not been studied appropriately. There are data on how simulation exercises can differentiate between novice and expert surgeons, but there are limited data to support their use for distinguishing intermediate from competent surgeons. Senior cardiothoracic trainees with limited robotic but significant laparoscopic experience ("intermediate surgeons", IS) and practicing robotic thoracic surgeons ("competent surgeons", CS) participating in a thoracic cadaver robotic course were evaluated on three Da Vinci (Xi) simulations. Scores were separately recorded into components and analyzed by t-test for significant differences between groups. 21 competent and 17 intermediate surgeons participated. Overall scores did not have a statistically significant difference in any exercise between groups. Simulation exercises do not appear to distinguish intermediate from competent surgeon performance of robotic skills. Without better validity data, the use of simulation for credentialing should be thoughtfully considered.

Teaching and learning robotic surgery at the dual console: a video-based qualitative analysis

Robotic-assisted surgery (RAS) involves training processes and challenges that differ from open or laparoscopic surgery, particularly regarding the possibilities of observation and embodied guidance. The video recording and the dual-console system creates a potential opportunity for participation. Our research, conducted within the department of visceral surgery of a big Swiss, public, academic hospital, uses a methodology based on the co-analysis of video recordings with surgeons in self-confrontation interviews, to investigate the teaching activity of the lead surgeon supervising a surgeon in training at the dual console. Three short sequences have been selected for the paper. Our analysis highlights the skills-in-construction of the surgeon in training regarding communication with the operating team, fluency of working with three hands, and awareness of the whole operating site. It also shows the divergent necessities of enabling verbalization for professional training, while ensuring a quiet and efficient environment for medical performance. To balance these requirements, we argue that dedicated briefing and debriefing sessions may be particularly effective; we also suggest that the self-confrontation video technique may be valuable to support the verbalization on both the mentor’s and the trainee’s side during such debriefing, and to enhance the mentor’s reflexivity regarding didactic choices.

A National Survey of Robotic Surgery Training Among Otolaryngology-Head and Neck Surgery Residents

OBJECTIVE

The aim of this study is to describe the current state of robotic surgery training among Otolaryngology-Head and Neck Surgery (OHNS) residency programs in the United States.

METHODS

This is a national survey study among OHNS residents. All OHNS residency programs were identified via the Accreditation Council for Graduate Medical Education website. A total of 64/127 (50.3%) of OHNS programs were selected based on a random number generator. The main outcome measure was the number of OHNS residents with access to robotic surgery training and assessment of operative experience in robotic surgery among those residents.

RESULTS

A total of 140 OHNS residents participated in the survey, of which 59.3% (n = 83) were male. Response rate was 40.2%. Respondents came from middle 50.0% (n = 70), southern 17.8% (n = 25), western 17.8% (n = 25), and eastern sections 14.3% (n = 20). Most respondents (94.3%, n = 132) reported that their institution utilized a robot for head and neck surgery. Resident experience at the bedside increased in the junior years of training and console experience increased across the years particularly for more senior residents. However, 63.4% of residents reported no operative experience at the console. Only 11.4% of programs have a structured robotics training program.

CONCLUSION

This survey indicated that nearly all OHNS residencies utilize robotic surgery in their clinical practice with residents receiving little formal education in robotics or experience at the console. OHNS residencies should aim to increase access to training opportunities in order to increase resident competency.

LEVEL OF EVIDENCE

IV.

European Society of Coloproctology Colorectal Robotic Surgery Training for the Trainers Course - the first pilot experience

AIM

Currently, there is no established colorectal specific robotic surgery Train the Trainer (TTT) course. The aim was to develop and evaluate such a course which can then be further developed to be incorporated within the planned European Society of Coloproctology (ESCP)/European School of Coloproctology (ESC) robotic colorectal surgery training curriculum.

METHOD

After identifying the need for such a course within a training programme, the course was developed by a subgroup of the ESCP/ESC. A scoping literature review was performed and the content and materials for the course were developed by a team consisting of two gastroenterologists with a combined experience of 30 years of facilitating TTT courses, a robotic surgeon and proctor with laparoscopic TTT faculty experience and experienced robotic and laparoscopic colorectal trainers. The course was evaluated by asking delegates to complete pre- and post-course questionnaires.

RESULTS

There were eight delegates on the course from across Europe. Delegates increased their knowledge of each of the course learning objectives and identified learning points in order to change practice. The feedback from the delegates of the course was positive across several areas and all felt that they had achieved their own personal objectives in attending the course.

CONCLUSION

This pilot robotic colorectal TTT course has achieved its aim and demonstrated many positives. There is a need for such a course and the evaluation processes have provided opportunities for reflection, which will allow the development/tailoring of future robotic colorectal TTT courses to help develop robotic training further.

Training novice robot surgeons: Proctoring provides same results as simulator-generated guidance

To understand the influence of proctored guidance versus simulator generated guidance (SGG) on the acquisition dexterity skills in novice surgeons learning RAS (robot assisted surgery). Prospective non-blinded 3-arm randomised controlled trial (RTC). Exclusion criteria: previous experience in RAS or robotic surgery simulation. The participants were assigned to three different intervention groups and received a different form of guidance: (1) proctored guidance, (2) simulator generated guidance, (3) no guidance, during training on virtual reality (VR) simulator. All participants were asked to complete multiple questionnaires. The training was the same in all groups with the exception of the intervention part. Catharina Hospital Eindhoven, The Netherlands. A total of 70 Dutch medical students, PhD-students, and surgical residents were included in the study. The participants were randomly assigned to one of the three groups. Overall, all the participants showed a significant improvement in their dexterity skills after the training. There was no significant difference in the improvement of surgical skills between the three different intervention groups. The proctored guidance group reported a higher participant satisfaction compared to the simulator-generated guidance group, which could indicate a higher motivation to continue the training. This study showed that novice surgeons. Significantly increase their dexterity skills in RAS after a short time of practicing on simulator. The lack of difference in results between the intervention groups could indicate there is a limited impact of "human proctoring" on dexterity skills during surgical simulation training. Since there is no difference between the intervention groups the exposure alone of novice surgeons to the robotic surgery simulator could possibly be sufficient to achieve a significant improvement of dexterity skills during the initial steps of RAS learning.

A Comparative Human-Centric Analysis of Virtual Reality and Dry Lab Training Tasks on the da Vinci Surgical Platform

There is a growing, widespread trend of adopting robot-assisted minimally invasive surgery (RMIS) in clinical care. Dry lab robot training and virtual reality simulation are commonly used to train surgical residents; however, it is unclear whether both types of training are equivalent or can be interchangeable and still achieve the same results in terms of training outcomes. In this paper, we take the first step in comparing the effects of physical and simulated surgical training tasks on human operator kinematics and physiological response to provide a richer understanding of exactly how the user interacts with the actual or simulated surgical robot. Four subjects, with expertise levels ranging from novice to expert surgeon, were recruited to perform three surgical tasks — Continuous Suture, Pick and Place, Tubes, with three repetitions — on two training platforms: (1) the da Vinci Si Skills Simulator and (2) da Vinci S robot, in a randomized order. We collected physiological response and kinematic movement data through body-worn sensors for a total of 72 individual experimental trials. A range of expertise was chosen for this experiment to wash out inherent differences based on expertise and only focus on inherent differences between the virtual reality and dry lab platforms. Our results show significant differences ([Formula: see text]-[Formula: see text]) between tasks done on the simulator and surgical robot. Specifically, robotic tasks resulted in significantly higher muscle activation and path length, and significantly lower economy of volume. The individual tasks also had significant differences in various kinematic and physiological metrics, leading to significant interaction effects between the task type and training platform. These results indicate that the presence of the robotic system may make surgical training tasks more difficult for the human operator. Thus, the potentially detrimental effects of virtual reality training alone are an important topic for future investigation.

Are current credentialing requirements for robotic surgery adequate to ensure surgeon proficiency?

BACKGROUND

Robotic surgery has seen unprecedented growth, requiring hospitals to establish or update credentialing policies regarding this technology. Concerns about verification of robotic surgeon proficiency and the adequacy of current credentialing criteria to maintain patient safety have arisen. The aim of this project was to examine existing institutional credentialing requirements for robotic surgery and evaluate their adequacy in ensuring surgeon proficiency.

METHODS

Robotic credentialing policies for community and academic surgery programs were acquired and reviewed. Common criteria across institutions related to credentialing and recredentialing were identified and the average, standard deviation, and range of numeric requirements, if defined, was calculated. Criteria for proctors and assistants were also analyzed.

RESULTS

Policies from 42 geographically dispersed US hospitals were reviewed. The majority of policies relied on a defined number of proctored cases as a surrogate for proficiency with an average of 3.24 ± 1.69 and a range of 1-10 cases required for initial credentialing. While 34 policies (81%) addressed maintenance of privileges requirements, there was wide variability in the average number of required robotic cases (7.19 ± 3.28 per year) and range (1-15 cases per year). Only 11 policies (26%) addressed the maximum allowable time gap between robotic cases.

CONCLUSION

Significant variability in credentialing policies exists in a representative sample of US hospitals. Most policies require completion of a robotic surgery training course and a small number of proctored cases; however, ongoing objective performance assessments and patient outcome monitoring was rarely described. Existing credentialing policies are likely inadequate to ensure surgeon proficiency; therefore, development and wide implementation of robust credentialing guidelines is recommended to optimize patient safety and outcomes.

Educational note: teaching and training in robotic surgery. An opinion of the Minimally Invasive and Robotic Surgery Committee of the Brazilian College of Surgeons

ABSTRACT With the expansion of robotic surgical procedures, the acquisition of specific knowledge and skills for surgeons to reach proficiency seems essential before performing surgical procedures on humans. In this sense, the authors present a proposal to establish a certification based on objective and validated criteria for carrying out robotic procedures. A study was carried out by the Committee on Minimally Invasive and Robotic Surgery of the Brazilian College of Surgeons based on a reviewing strategy of the scientific literature. The study serves as a reference for the creation of a standard for the qualification and certification in robotic surgery according to a statement of the Brazilian Medical Association (AMB) announced on December 17, 2019. The standard proposes a minimum curriculum, integrating training and performance evaluation. The initial (pre-clinical) stage aims at knowledge and adaptation to a specific robotic platform and the development of psychomotor skills based on surgical simulation. Afterwards, the surgeon must accompany in person at least five surgeries in the specialty, participate as a bedside assistant in at least 10 cases and perform 10 surgeries under the supervision of a preceptor surgeon. The surgeon who completes all the steps will be considered qualified in robotic surgery in his specialty. The final certification must be issued by the specialty societies affiliated to AMB. The authors conclude that the creation of a norm for habilitation in robotic surgery should encourage Brazilian hospitals to apply objective qualification criteria for this type of procedure to qualify assistance.

Impact of Urology Resident Involvement on intraoperative, Long-Term Oncologic and Functional Outcomes of Robotic Assisted Laparoscopic Radical Prostatectomy

OBJECTIVE

To evaluate the impact of resident involvement in robot assisted laparoscopic prostatectomy on oncologic, functional, and intraoperative outcomes, both short and long term.

METHODS

We queried our prospectively maintained database of prostate cancer patients who underwent robotic-assisted laparoscopic prostatectomy from November 20, 2007 to December 27, 2016. We analyzed cases performed by 1 surgeon on a specific day of the week when the morning case involved at least 1 resident (R) and the afternoon case involved the attending physician only (nonresident [NR]). We compared R versus NR on a number of clinical, perioperative, and oncological outcomes.

RESULTS

A total of 230 NR and 230 R cases met inclusion criteria and were included in the analysis. Over one third (36.7%) of the NR group was Gleason 4+3 (Grade Group 3) or higher, relative to 25.9% of the R group, P = .015. Median operative time (OT) was significantly longer for R versus NR (200 minutes versus 156 minutes, P<.001) as was robotic time (161 minutes versus119 minutes, P<.001). No significant differences were noted for any other measure. Median follow-up for oncological outcomes was 30 and 33.5 months for NR and R, respectively (P= .3). Median OT and median estimated blood loss were both significantly greater in later years relative to the earlier years for R (2012-2016 versus 2007-2011; P< .001 for OT; P= .041 for median estimated blood loss) but not for NR.

CONCLUSION

Neither safety nor quality is diminished by R involvement in robot assisted laparoscopic prostatectomy.

Utilising the Delphi Process to Develop a Proficiency-based Progression Train-the-trainer Course for Robotic Surgery Training

CONTEXT

As the role of robot-assisted surgery continues to expand, development of standardised and validated training programmes is becoming increasingly important.

OBJECTIVE

To provide guidance on an optimised "train-the-trainer" (TTT) structured educational programme for surgical trainers, in which delegates learn a standardised approach to training candidates in skill acquisition. We aim to describe a TTT course for robotic surgery based on the current published literature and to define the key elements within a TTT course by seeking consensus from an expert committee formed of key opinion leaders in training.

EVIDENCE ACQUISITION

The project was carried out in phases: a systematic review of the current evidence was conducted, a face-to-face meeting was held in Philadelphia, and then an initial survey was created based on the current literature and expert opinion and sent to the committee. Thirty-two experts in training, including clinicians, academics, and industry, contributed to the Delphi process. The Delphi process underwent three rounds of survey in total. Additions to the second- and third-round surveys were formulated based on the answers and comments from the previous rounds. Consensus opinion was defined as ≥80% agreement.

EVIDENCE SYNTHESIS

There was 100% consensus that there was a need for a standardized TTT course in robotic surgery. A consensus was reached in multiple areas, including the following: (1) definitions and terminologies, (2) qualifications to attend, (3) course objectives, (4) precourse considerations, (5) requirement of e-learning, (6) theory and course content, and (7) measurement of outcomes and performance level verification. The resulting formulated curriculum showed good internal consistency among experts, with a Cronbach alpha of 0.90.

CONCLUSIONS

Using the Delphi methodology, we achieved an international consensus among experts to develop and reach content validation for a standardised TTT curriculum for robotic surgery training. This defined content lays the foundation for developing a proficiency-based progression model for trainers in robotic surgery. This TTT curriculum will require further validation.

PATIENT SUMMARY

As the role of robot-assisted surgery continues to expand, development of standardised and validated training programmes is becoming increasingly important. There is currently a lack of high-level evidence on how best to train trainers in robot-assisted surgery. We report a consensus view on a standardised "train-the trainer" curriculum focused on robotic surgery. It was formulated by training experts from the USA and Europe, combining current evidence for training with experts' knowledge of surgical training.

Understanding and Assessing Nontechnical Skills in Robotic Urological Surgery: A Systematic Review and Synthesis of the Validity Evidence

OBJECTIVE

Robotic urological surgery (RUS) has seen widespread adoption across institutions in the last decade. To match this rapid growth, it is imperative to develop a structured RUS curriculum that addresses both technical and nontechnical competencies. Emerging evidence has shown that nontechnical skills form a critical component of RUS training. The purpose of this review is to examine the validity evidence of available nontechnical skills assessment tools in RUS.

METHODS

A literature search of MEDLINE, EMBASE, and PsycINFO was conducted to identify primary articles using nontechnical skills assessment tools in RUS. Messick's validity framework and the Medical Education Research Study Quality Instrument were utilized to evaluate the quality of the validity evidence of the abstracted articles.

RESULTS

Of the 566 articles identified, 12 used nontechnical skills assessment tools in RUS. The metrics used ranged from self-assessment using global rating scales, to objective measures such as electroencephalography. The setting of these evaluations ranged from immersive and virtual reality-based simulators to live surgery.

CONCLUSIONS

Limited effort has been made to develop nontechnical skills assessment tools in RUS. Recently, there has been a shift from subjective to objective measures of nontechnical performance, as well as the development of assessments specific to RUS. However, the validity evidence supporting these nontechnical assessments is limited at this time, including their relationship to technical skills, and their impact on surgical outcomes.

Comparison of effective teaching methods to achieve skill acquisition using a robotic virtual reality simulator: Expert proctoring versus an educational video versus independent training

BACKGROUND

To compare the superiority of teaching methods for acquiring a proficient level of surgical skill in a robotic surgery-naïve individual using a robotic virtual reality simulator.

METHODS

This study employed a prospective, randomized study design to assess student's learning curve. We divided 45 subjects into 3 groups: those with expert proctoring (group I), those who watched only an educational video (group II), and those with independent training (group III; n = 15 per group). The task used in this study was the Tube 2 and it imitates a vesicourethral anastomosis in robotic prostatectomy. The effects were analyzed by the time to end the task after overcoming the learning curve which is determined by several performance parameters.

RESULTS

The number of task repetitions required to reach the learning curve plateau was 45, 42, and 37 repetitions in groups I, II, and III, which means that there was continuous improvement in performing the task after 40 repetitions only in groups I and II. The mean time for completing the task during the stabilization period was significantly different between group I and group III and group II and group III, which means that the independent training method was inferior to the other methods (group I vs. group II vs. group III: 187.38 vs. 187.07 vs. 253.47 seconds, P < .001).

CONCLUSIONS

This study's findings showed that an educational video can be as beneficial as expert proctoring, which implies that the development of a standardized educational video would be worthwhile.

Initial and Long-term Retention of Robotic Technical Skills in an Otolaryngology Residency Program

OBJECTIVES/HYPOTHESIS

To objectively assess the initial and long-term retention of robotic surgical skills of otolaryngology residents.

STUDY DESIGN

This study was performed in an academic otolaryngology residency training program. Between October 2015 and November 2016, residents were invited to complete a prospective, multiphase robotic surgical skills training course: 1) online da Vinci Surgical System Assessment and didactic, 2) faculty-supervised robotic simulator training, 3) robotic docking and draping training, 4) robotic dry-lab exercises. To optimize surgical skill retention, the training laboratory was repeated 2 weeks after the initial training session.

METHODS

Twenty otolaryngology residents were included. Primary outcome was measured as robotic skill assessment scores on three tasks: camera targeting, peg board, and needle targeting. Skill assessments were completed prior to training, between the two training sessions, and at 1 month and 6 months after training. Residents were also asked to complete a self-assessment questionnaire.

RESULTS

Camera targeting scores were improved at midtraining (P < .001) and 1-month posttraining (P = .010). Peg board scores were improved at 1 month training (P = .043). Needle targeting scores were improved at midtraining (P = .002), 1 month (P = .002), and 6 months posttraining (P < .001). Resident self-assessment scores demonstrating comfort with using the robotic console (P < .01) and docking/draping (P < .01) improved significantly following the training.

CONCLUSIONS

Following a multiphase robotic training program, otolaryngology residents demonstrated significant, objective skill acquisition and retention at 1 month and 6 months follow-up. Although the proposed training strategy may be considered an important step in otolaryngology residency training, additional innovations are being designed toward a formal robotic training curriculum.

LEVEL OF EVIDENCE

NA Laryngoscope, 129:1380-1385, 2019.

Evolution and literature review of robotic general surgery resident training 2002-2018

The University of Illinois purchased their first da Vinci System in September of 2002. Within the first calendar year, their program began orienting trainees to the da Vinci Standard System to make its inclusion in their clinical training run more smoothly. During the ensuring 16 years, their program has evolved into more frequent resident orientations, lectures, and courses. The program has grown over the course of different versions of the da Vinci System. Currently, their program houses three Xi and two Si systems. Led by Dr. Crawford and Mr. Dwyer they have formalized their curriculum using a systematic progression of skill acquisition. The lecture will detail the program's organic development over the last 16 years. It will also explain the scientific measurement tools recently applied to the curriculum.

Use of Robotic Anastomosis Competency Evaluation (RACE) for assessment of surgical competency during urethrovesical anastomosis

INTRODUCTION

We sought to evaluate the Robotic Anastomosis Competency Evaluation (RACE), a validated tool that objectively quantifies surgical skills specifically for urethrovesical anastomosis (UVA), as a tool to track progress of trainees, and to determine the predictive value of RACE.

METHODS

UVAs performed by trainees at our institution were evaluated using RACE over a period of two years. Trainees were supervised by an experienced robotic surgeon. Outcomes included trainee-related variables (RACE score, proportion of UVA performed by trainee, and suturing speed), and clinical outcomes (total UVA duration, postoperative urinary continence, and UVA-related complications). Significance was determined using linear regression analysis.

RESULTS

A total of 51 UVAs performed by six trainees were evaluated. Trainee RACE scores (19.8 to 22.3; p=0.01) and trainee proportion of UVA (67% to 80%; p=0.003) improved significantly over time. Trainee suture speed was significantly associated with RACE score (mean speed range 0.54-0.74 sutures/minute; p=0.03). Neither urinary continence at six weeks nor six months was significantly associated with RACE score (p=0.17 and p=0.15, respectively), and only one UVA-related postoperative complication was reported.

CONCLUSIONS

Trainee RACE scores improved and proportion of UVA performed by trainees increased over time. RACE can be used as an objective measure of surgical performance during training. Strict mentor supervision allowed safe training without compromising patient outcomes.

Residency Training in Robotic General Surgery: A Survey of Program Directors

Objective

Robotic surgery continues to expand in minimally invasive surgery; however, the literature is insufficient to understand the current training process for general surgery residents. Therefore, the objectives of this study were to identify the current approach to and perspectives on robotic surgery training.

Methods

An electronic survey was distributed to general surgery program directors identified by the Accreditation Council for Graduate Medical Education website. Multiple choice and open-ended questions regarding current practices and opinions on robotic surgery training in general surgery residency programs were used.

Results

20 program directors were surveyed, a majority being from medium-sized programs (4–7 graduating residents per year). Most respondents (73.68%) had a formal robotic surgery curriculum at their institution, with 63.16% incorporating simulation training. Approximately half of the respondents believe that more time should be dedicated to robotic surgery training (52.63%), with simulation training prior to console use (84.21%). About two-thirds of the respondents (63.16%) believe that a formal robotic surgery curriculum should be established as a part of general surgery residency, with more than half believing that exposure should occur in postgraduate year one (55%).

Conclusion

A formal robotics curriculum with simulation training and early surgical exposure for general surgery residents should be given consideration in surgical residency training.

Postgraduate course in minimally invasive urological surgery

Background

Minimally invasive surgeries are increasingly common as the first option for most urological diseases. However, laparoscopic techniques are difficult to master, especially for surgeons who were not trained during their residency programs. Therefore, postgraduate courses are important for such matters. This study aims to evaluate the results of postgraduate courses in minimally invasive urological surgery.

Methods

A specific questionnaire was used to evaluate the impact of the course on urologists' professional activities. The questionnaire also evaluated demographic data and previous surgical experience. The postgraduate course was divided into 10 monthly modules, each one with 36 hours of activities, from March to December. All students of the laparoscopic postgraduate course from the last five years were enrolled in the study.

Results

Forty-one students were included in the study. Thirty-nine students were male (95.1%), and the mean age was 39.5 years (range, 30-60 years). Students from all regions of the country were enrolled. Thirty (73.2%) students had minor laparoscopic experience. All students improved their laparoscopic skills and were able to include new procedures in their daily surgical practice. Eleven students (26.8%) had no laparoscopic experience, and all of them started to perform laparoscopic procedures. The median level of impact on professional life was 75 points (range, 0-100 points).

Conclusions

The postgraduate course is an appropriate way to acquire urological laparoscopic skills. The annual course allowed improvement and initiation of laparoscopic procedures, which significantly impacted urologists' daily activities.

Implementing assessments of robot-assisted technical skill in urological education: a systematic review and synthesis of the validity evidence

OBJECTIVES

To systematically review and synthesise the validity evidence supporting intraoperative and simulation-based assessments of technical skill in urological robot-assisted surgery (RAS), and make evidence-based recommendations for the implementation of these assessments in urological training.

MATERIALS AND METHODS

A literature search of the Medline, PsycINFO and Embase databases was performed. Articles using technical skill and simulation-based assessments in RAS were abstracted. Only studies involving urology trainees or faculty were included in the final analysis.

RESULTS

Multiple tools for the assessment of technical robotic skill have been published, with mixed sources of validity evidence to support their use. These evaluations have been used in both the ex vivo and in vivo settings. Performance evaluations range from global rating scales to psychometrics, and assessments are carried out through automation, expert analysts, and crowdsourcing.

CONCLUSION

There have been rapid expansions in approaches to RAS technical skills assessment, both in simulated and clinical settings. Alternative approaches to assessment in RAS, such as crowdsourcing and psychometrics, remain under investigation. Evidence to support the use of these metrics in high-stakes decisions is likely insufficient at present.

Development and validation of surgical training tool: cystectomy assessment and surgical evaluation (CASE) for robot-assisted radical cystectomy for men

BACKGROUND

We aimed to develop a structured scoring tool: cystectomy assessment and surgical evaluation (CASE) that objectively measures and quantifies performance during robot-assisted radical cystectomy (RARC) for men.

METHODS

A multinational 10-surgeon expert panel collaborated towards development and validation of CASE. The critical steps of RARC in men were deconstructed into nine key domains, each assessed by five anchors. Content validation was done utilizing the Delphi methodology. Each anchor was assessed in terms of context, score concordance, and clarity. The content validity index (CVI) was calculated for each aspect. A CVI ≥ 0.75 represented consensus, and this statement was removed from the next round. This process was repeated until consensus was achieved for all statements. CASE was used to assess de-identified videos of RARC to determine reliability and construct validity. Linearly weighted percent agreement was used to assess inter-rater reliability (IRR). A logit model for odds ratio (OR) was used to assess construct validation.

RESULTS

The expert panel reached consensus on CASE after four rounds. The final eight domains of the CASE included: pelvic lymph node dissection, development of the peri-ureteral space, lateral pelvic space, anterior rectal space, control of the vascular pedicle, anterior vesical space, control of the dorsal venous complex, and apical dissection. IRR > 0.6 was achieved for all eight domains. Experts outperformed trainees across all domains.

CONCLUSION

We developed and validated a reliable structured, procedure-specific tool for objective evaluation of surgical performance during RARC. CASE may help differentiate novice from expert performances.

Functional Brain States Measure Mentor-Trainee Trust during Robot-Assisted Surgery

Mutual trust is important in surgical teams, especially in robot-assisted surgery (RAS) where interaction with robot-assisted interface increases the complexity of relationships within the surgical team. However, evaluation of trust between surgeons is challenging and generally based on subjective measures. Mentor-Trainee trust was defined as assessment of mentor on trainee's performance quality and approving trainee's ability to continue performing the surgery. Here, we proposed a novel method of objectively assessing mentor-trainee trust during RAS based on patterns of brain activity of surgical mentor observing trainees. We monitored the EEG activity of a mentor surgeon while he observed procedures performed by surgical trainees and quantified the mentor's brain activity using functional and cognitive brain state features. We used methods from machine learning classification to identity key features that distinguish trustworthiness from concerning performances. Results showed that during simple surgical task, functional brain features are sufficient to classify trust. While, during more complex tasks, the addition of cognitive features could provide additional accuracy, but functional brain state features drive classification performance. These results indicate that functional brain network interactions hold information that may help objective trainee specific mentorship and aid in laying the foundation of automation in the human-robot shared control environment during RAS.

Towards development and validation of an intraoperative assessment tool for robot-assisted radical prostatectomy training: results of a Delphi study

Introduction

As urology training shifts toward competency-based frameworks, the need for tools for high stakes assessment of trainees is crucial. Validated assessment metrics are lacking for many robot-assisted radical prostatectomy (RARP). As it is quickly becoming the gold standard for treatment of localized prostate cancer, the development and validation of a RARP assessment tool for training is timely.

Materials and methods

We recruited 13 expert RARP surgeons from the United States and Canada to serve as our Delphi panel. Using an initial inventory developed via a modified Delphi process with urology residents, fellows, and staff at our institution, panelists iteratively rated each step and sub-step on a 5-point Likert scale of agreement for inclusion in the final assessment tool. Qualitative feedback was elicited for each item to determine proper step placement, wording, and suggestions.

Results

Panelist’s responses were compiled and the inventory was edited through three iterations, after which 100% consensus was achieved. The initial inventory steps were decreased by 13% and a skip pattern was incorporated. The final RARP stepwise inventory was comprised of 13 critical steps with 52 sub-steps. There was no attrition throughout the Delphi process.

Conclusions

Our Delphi study resulted in a comprehensive inventory of intraoperative RARP steps with excellent consensus. This final inventory will be used to develop a valid and psychometrically sound intraoperative assessment tool for use during RARP training and evaluation, with the aim of increasing competency of all trainees.

Positive surgical margin rates during the robot-assisted laparoscopic radical prostatectomy learning curve of an experienced laparoscopic surgeon

INTRODUCTION

Since its introduction, robot-assisted laparoscopic radical prostatectomy (RARP) has gained widespread popularity, but is associated with a variable learning curve. Herein, we report the positive surgical margin (PSM) rates during the RARP learning curve of a single surgeon with significant previous laparoscopic radical prostatectomy (LRP) experience.

METHODS

We performed a prospective cohort study of the first 400 men with prostate cancer treated with RARP by a single surgeon (BS) with significant LRP experience. Our primary outcome was the impact of case timing in the learning curve on margin status. Our analysis was conducted by dividing the case numbers into quartiles (Q1-Q4) and determining if a case falling into an earlier quartile had an impact on margin status relative to the most recent quartile (Q4).

RESULTS

The Q1 cases had an odds ratio for margin positivity of 1.74 compared to Q4 (p=0.1). Multivariate logistic regression did not demonstrate case number to be a significant predictor of PSM. The mean Q1 operative time was 207.4 minutes, decreasing to 179.2 by Q4 (p<0.0001). The mean Q1 estimated blood loss was 255.1 ml, decreasing to 213.6 by Q4 (p=0.0064). There was no change in length of hospitalization within the study period.

CONCLUSIONS

Even when controlling for copredictors, a statistically significant learning curve for PSM rate of a surgeon with significant previous LRP experience was not detected during the first 400 RARP cases. We hypothesize that previous LRP experience may reduce the RARP PSM learning curve.

Design and Implementation of a Robotic Surgery Training Experience Logging System

PURPOSE

Residents currently log robotic cases in the ACGME system as a "surgeon" if they performed any critical step of the procedure on the surgeon console. There is no standardization as to which steps or how much of the procedure should be performed by the resident. It was our objective to establish a tool for logging the true operative experience in robotic surgery to aid in assessing surgical competency as well as curriculum development.

MATERIALS AND METHODS

We propose a tool to log surgical skill progression, experience, and feedback for robotic cases. A web-based robotic experience logging system (RoboLog) was developed with procedures deconstructed to their major steps. Trainees may request the supervising attending review their performance. RoboLog provides automated summary reports to both residents and attendings.

RESULTS

RoboLog was successfully developed and piloted with a total of 310 cases logged over 1 year. A reporting structure was developed where residents could view statistics on several data points such as step-specific involvement and feedback from attending staff. Detailed data on resident experience were obtained. For instance, 82% of the 151 robotic prostatectomies were logged as "surgeon", yet urethral transection had <35% resident involvement.

CONCLUSIONS

Our current system for logging robotic experience is lacking given the fact that resident involvement on the surgical console is variable. Widespread usage of a logging system with more insight into step-specific involvement is needed. RoboLog fills this need and can be used to track robotic training progress and aid in development of a standardized curriculum.

From dV-Trainer to Real Robotic Console: The Limitations of Robotic Skill Training

OBJECTIVES

To investigate operators' performance quality, mental stress, and ergonomic habits through a training curriculum on robotic simulators.

DESIGN

Forty volunteers without robotic surgery experience were recruited to practice 2 exercises on a dV-Trainer (dVT) for 14 hours. The simulator software (M-score^a) provided an automatic evaluation of the overall score for the surgeons' performance. Each participant provided a subjective difficulty score (validity to be proven) for each exercise. Their ergonomic habits were evaluated based on the workspace range and armrest load-validated criteria for evaluating the proficiency of using the armrest. They then repeated the same tasks on a da Vinci Surgical Skill Simulator for a final-level test. Their final scores were compared with their initial scores and the scores of 5 experts on the da Vinci Surgical Skill Simulator.

RESULTS

A total of 14 hours of training on the dVT significantly improved the surgeons' performance scores to the expert level with a significantly reduced workload, but their ergonomic score was still far from the expert level.

CONCLUSION

Sufficient training on the dVT improves novices' performance, reduces psychological stress, and inculcates better ergonomic habits. Among the evaluated criteria, novices had the most difficulty in achieving expert levels of ergonomic skills. The training benefits of robotic surgery simulators should be determined with quantified variables. The detection of the limitations during robotic training curricula could guide the targeted training and improve the training effect.

Performances on simulator and da Vinci robot on subjects with and without surgical background

Objective: To assess whether previous training in surgery influences performance on da Vinci Skills Simulator and da Vinci robot. Material and methods: In this prospective study, thirty-seven participants (11 medical students, 17 residents, and 9 attending surgeons) without previous experience in laparoscopy and robotic surgery performed 26 exercises at da Vinci Skills Simulator. Thirty-five then executed a suture using a da Vinci robot. Results: The overall scores on the exercises at the da Vinci Skills Simulator show a similar performance among the groups with no statistically significant pair-wise differences (p < .05). The quality of the suturing based on the unedited videos of the test run was similar for the intermediate (7 (4, 10)) and expert group (6.5 (4.5, 10)), and poor for the untrained groups (5 (3.5, 9)), without statistically significant difference (p < .05). Conclusion: This study showed, for subjects new to laparoscopy and robotic surgery, insignificant differences in the scores at the da Vinci Skills Simulator and at the da Vinci robot on inanimate models.

Model of a training program in robotic surgery and its initial results

Objective:

to describe the implementation of a training program in robotic surgery and to point the General Surgery procedures that can be performed with advantages using the robotic platform.

Methods:

we conducted a retrospective analysis of data collected prospectively from the robotic surgery group in General and Colo-Retal Surgery at the Samaritan Hospital (Rio de Janeiro, Brazil), from October 2012 to December 2015. We describe the training stages and particularities.

Results:

two hundred and ninety three robotic operations were performed in general surgery: 108 procedures for morbid obesity, 59 colorectal surgeries, 55 procedures in the esophago-gastric transition area, 16 cholecystectomies, 27 abdominal wall hernioplasties, 13 inguinal hernioplasties, two gastrectomies with D2 lymphadenectomy, one vagotomy, two diaphragmatic hernioplasties, four liver surgeries, two adrenalectomies, two splenectomies, one pancreatectomy and one bilio-digestive anastomosis. The complication rate was 2.4%, with no major complications.

Conclusion:

the robotic surgery program of the Samaritan Hospital was safely implemented and with initial results better than the ones described in the current literature. There seems to be benefits in using the robotic platform in super-obese patients, re-operations of obesity surgery and hiatus hernias, giant and paraesophageal hiatus hernias, ventral hernias with multiple defects and rectal resections.

Surgeon Performance Predicts Early Continence After Robot-Assisted Radical Prostatectomy

INTRODUCTION

There is limited, yet compelling evidence supporting the role of surgeon technical performance in influencing patient outcomes. To date, this concept has been underexplored in endourologic procedures. We hypothesized that a surgeon's technical performance plays a role in predicting an early return to continence after robot-assisted radical prostatectomy (RARP).

MATERIALS AND METHODS

We conducted a retrospective, matched case-control analysis of prospectively collected unedited RARP endoscopic videos performed by a single surgeon. A blinded observer with expertise in intraoperative video analysis evaluated clinically relevant steps of RARP using the global evaluative assessment of robotic skill (GEARS) and the generic error rating tool (GERT). The primary outcome was continence status at 3 months postoperatively, defined as patient use of less than or equal to a single precautionary pad. Mann-Whitney U tests examined differences in predictor variables between cases and controls, and multivariate analysis was conducted using binary logistic regression models.

RESULTS

Twenty-four incontinent patients were matched for age, body mass index, preoperative International Prostate Symptoms Score, use of posterior/anterior hitch, prostate weight, and learning curve position. No statistically significant difference in errors between groups was observed using the GERT. On multivariate analysis, overall case GEARS score was independently predictive of 3-month continence status (odds ratios [OR] = 0.55, 95% confidence interval [CI] 0.33-0.91), as were urethrovesical anastomosis (OR = 0.70, 95% CI 0.50-0.97) and bladder neck GEARS scores (OR = 0.69, 95% CI 0.51-0.94).

CONCLUSIONS

Our study generates the hypothesis that there may be a link between surgeon technical performance and functional outcomes in RARP. This relationship may have implications for the accreditation and training of future urologists and warrants further investigation.

Can teenage novel users perform as well as General Surgery residents upon initial exposure to a robotic surgical system simulator?

New techniques in minimally invasive and robotic surgical platforms require staged curricula to insure proficiency. Scant literature exists as to how much simulation should play a role in training those who have skills in advanced surgical technology. The abilities of novel users may help discriminate if surgically experienced users should start at a higher simulation level or if the tasks are too rudimentary. The study's purpose is to explore the ability of General Surgery residents to gain proficiency on the dVSS as compared to novel users. The hypothesis is that Surgery residents will have increased proficiency in skills acquisition as compared to naive users. Six General Surgery residents at a single institution were compared with six teenagers using metrics measured by the dVSS. Participants were given two 1-h sessions to achieve an MScoreTM in the 90th percentile on each of the five simulations. MScoreTM software compiles a variety of metrics including total time, number of attempts, and high score. Statistical analysis was run using Student's t test. Significance was set at p value <0.05. Total time, attempts, and high score were compared between the two groups. The General Surgery residents took significantly less Total Time to complete Pegboard 1 (PB1) (p = 0.043). No significant difference was evident between the two groups in the other four simulations across the same MScoreTM metrics. A focused look at the energy dissection task revealed that overall score might not be discriminant enough. Our findings indicate that prior medical knowledge or surgical experience does not significantly impact one's ability to acquire new skills on the dVSS. It is recommended that residency-training programs begin to include exposure to robotic technology.

Modular Training for Robot-Assisted Radical Prostatectomy: Where to Begin?

OBJECTIVE

Effective training is paramount for patient safety. Modular training entails advancing through surgical steps of increasing difficulty. This study aimed to construct a modular training pathway for use in robot-assisted radical prostatectomy (RARP). It aims to identify the sequence of procedural steps that are learnt before surgeons are able to perform a full procedure without an intervention from mentor.

DESIGN

This is a multi-institutional, prospective, observational, longitudinal study. We used a validated training tool (RARP Score). Data regarding surgeons' stage of training and progress were collected for analysis. A modular training pathway was constructed with consensus on the level of difficulty and evaluation of individual steps. We identified and recorded the sequence of steps performed by fellows during their learning curves.

SETTING AND PARTICIPANTS

We included 15 urology fellows from UK, Europe, and Australia.

RESULTS

A total of 15 surgeons were assessed by mentors in 425 RARP cases over 8 months (range: 7-79) across 15 international centers. There were substantial differences in the sequence of RARP steps according to the chronology of the procedure, difficulty level, and the order in which surgeons actually learned steps. Steps were not attempted in chronological order. The greater the difficulty, the later the cohort first undertook the step (p = 0.021). The cohort undertook steps of difficulty level I at median case number 1. Steps of difficulty levels II, III, and IV showed more variation in median case number of the first attempt. We recommend that, in the operating theater, steps be learned in order of increasing difficulty. A new modular training route has been designed. This incorporates the steps of RARP with the following order of priority: difficulty level > median case number of first attempt > most frequently undertaken in surgical training.

CONCLUSIONS

An evidence-based modular training pathway has been developed that facilitates a safe introduction to RARP for novice surgeons.

Milestone assessment of minimally invasive surgery in Pediatric Urology fellowship programs

INTRODUCTION

Minimally invasive surgery has become an important aspect of Pediatric Urology fellowship training. In 2014, the Accreditation Council for Graduate Medical Education published the Pediatric Urology Milestone Project as a metric of fellow proficiency in multiple facets of training, including laparoscopic/robotic procedures.

OBJECTIVE

The present study assessed trends in minimally invasive surgery training and utilization of the Milestones among recent Pediatric Urology fellows.

STUDY DESIGN

Using an electronic survey instrument, Pediatric Urology fellowship program directors and fellows who completed their clinical year in 2015 were surveyed. Participants were queried regarding familiarity with the Milestone Project, utilization of the Milestones, robotic/laparoscopic case volume and training experience, and perceived competency with robotic/laparoscopic surgery at the start and end of the fellowship clinical year according to Milestone criteria. Responses were accepted between August and November 2015.

RESULTS

Surveys were distributed via e-mail to 35 fellows and 30 program directors. Sixteen fellows (46%) and 14 (47%) program directors responded. All fellows reported some robotic experience prior to fellowship, and 69% performed >50 robotic/laparoscopic surgeries during residency. Fellow robotic/laparoscopic case volume varied: three had 1-10 cases (19%), four had 11-20 cases (25%), and nine had >20 cases (56%). Supplementary or robotic training modalities included simulation (9), animal models (6), surgical videos (7), and courses (2). Comparison of beginning and end of fellowship robotic/laparoscopic Milestone assessment (Summary Fig.) revealed scores of <3 in (10) 62% of fellow self-assessments and 10 (75%) of program director assessments. End of training Milestone scores >4 were seen in 12 (75%) of fellow self-assessment and eight (57%) of program director assessments.

DISCUSSION

An improvement in robotic/laparoscopic Milestone scores by both fellow self-assessment and program director assessment was observed during the course of training; however, 43% of program directors rated their fellow below the graduation target of a Milestone score of 4.

CONCLUSION

The best ways to teach minimally invasive surgery in fellowship training must be critically considered.

Robotically Assisted Thoracic Surgery: Proposed Guidelines for Privileging and Credentialing

Objective

Increased use of robotically assisted thoracic surgery (RATS) necessitates effective credentialing guidelines to ensure safe outcomes. We provide a stepwise algorithm for granting privileges and credentials in RATS. This algorithm reflects graduated responsibility and complexity of the surgical procedures performed. Furthermore, it takes into account volume, outcomes, surgeon's competency, and appropriateness of robot usage.

Methods

We performed a literature review for available strategies to grant privileges and credentials for implementing robotic surgery. The following terms were queried: robot, robotic, surgery, and credentialing. We provide this algorithm on the basis of review of the literature, our institutional experience, and the experience of other medical centers around the United States.

Results

Currently, two pathways for robotic training exist: residency and nonresidency-trained. In the United Sates, Joint Commission: Accreditation, Health Care, Certification requires hospitals to credential and privilege physicians on their medical staff. In the proposed algorithm, a credentialing designee oversees and reviews all requests. Residency-trained surgeons must fulfill 20 cases with program directors’ attestation to obtain full privileges. Nonresidency-trained surgeons are required to fulfill simulation, didactics including online modules, wet laboratories (cadaver or animal), and observation of at least two cases before provisional privileges can be granted. A minimum number of cases (10 per year) are required to maintain privileges. All procedures are monitored via departmental QA/QI committee review. Investigational uses of the robot require institutional review board approval, and complex operations may require additional proctoring and QA/QI review.

Conclusions

Safety concerns with the introduction of novel and complex technologies such as RATS must be paramount. Our algorithm takes into consideration appropriate use and serves as a basic guideline for institutions that wish to implement a RATS program.

Proctors exploit three-dimensional ghost tools during clinical-like training scenarios: a preliminary study

Purpose

In this study, we examine three-dimensional (3D) proctoring tools (i.e., semitransparent ghost tools overlaid on the surgeon’s field of view) on realistic surgical tasks. Additionally, we develop novel, quantitative measures of whether proctors exploit the additional capabilities offered by ghost tools.

Methods

Seven proctor–trainee pairs completed realistic surgical tasks such as tissue dissection and suturing in a live porcine model using 3D ghost tools on the da Vinci Xi Surgical System. The usability and effectiveness of 3D ghost tools were evaluated using objective measures of proctor performance based on proctor hand movements and button presses, as well as post-study questionnaires.

Results

Proctors exploited the capabilities of ghost tools, such as 3D hand movement (p < 0.001), wristedness (p < 0.001), finger pinch gestures (p < 0.001), and bimanual hand motions (p < 0.001). The median ghost tool excursion distances across proctors in the x-, y-, and z-directions were 57.6, 31.9, and 50.7, respectively. Proctors and trainees consistently evaluated the ghost tools as effective across multiple categories of mentoring. Trainees found ghost tools more helpful than proctors across all categories (p < 0.05).

Conclusions

Proctors exploit the augmented capabilities of 3D ghost tools during clinical-like training scenarios. Additionally, both proctors and trainees evaluated ghost tools as effective mentoring tools, thereby confirming previous studies on simple, inanimate tasks. Based on this preliminary work, advanced mentoring technologies, such as 3D ghost tools, stand to improve current telementoring and training technologies in robot-assisted minimally invasive surgery.

Electronic supplementary material

The online version of this article (doi:10.1007/s00345-016-1944-x) contains supplementary material, which is available to authorized users.

Robotics in otolaryngology and head and neck surgery: Recommendations for training and credentialing: A report of the 2015 AHNS education committee, AAO-HNS robotic task force and AAO-HNS sleep disorders committee

Training and credentialing for robotic surgery in otolaryngology - head and neck surgery is currently not standardized, but rather relies heavily on industry guidance. This manuscript represents a comprehensive review of this increasingly important topic and outlines clear recommendations to better standardize the practice. The recommendations provided can be used as a reference by individuals and institutions alike, and are expected to evolve over time. © 2016 Wiley Periodicals, Inc. Head Neck 38: E151-E158.

Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery

Experienced surgeons commonly mentor trainees as they move through their initial learning curves. During robot-assisted minimally invasive surgery, several tools exist to facilitate proctored cases, such as two-dimensional telestration and a dual surgeon console. The purpose of this study was to evaluate the utility and efficiency of three, novel proctoring tools for robot-assisted minimally invasive surgery, and to compare them to existing proctoring tools. Twenty-six proctor-trainee pairs completed validated, dry-lab training exercises using standard two-dimensional telestration and three, new three-dimensional proctoring tools called ghost tools. During each exercise, proctors mentored trainees by correcting trainee technical errors. Proctors and trainees completed post-study questionnaires to compare the effectiveness of the proctoring tools. Proctors and trainees consistently rated the ghost tools as effective proctoring tools. Both proctors and trainees preferred 3DInstruments and 3DHands over standard two-dimensional telestration (proctors p < 0.001 and p = 0.03, respectively, and trainees p < 0.001 and p = 0.002, respectively). In addition, proctors preferred three-dimensional vision of the operative field (used with ghost tools) over two-dimensional vision (p < 0.001). Total mentoring time and number of instructions provided by the proctor were comparable between all proctoring tools (p > 0.05). In summary, ghost tools and three-dimensional vision were preferred over standard two-dimensional telestration and two-dimensional vision, respectively, by both proctors and trainees. Proctoring tools—such as ghost tools—have the potential to improve surgeon training by enabling new interactions between a proctor and trainee.

Design and evaluation of a trilateral shared-control architecture for teleoperated training robots

Multilateral teleoperated robots can be used to train humans to perform complex tasks that require collaborative interaction and expert supervision, such as laparoscopic surgical procedures. In this paper, we explain the design and performance evaluation of a shared-control architecture that can be used in trilateral teleoperated training robots. The architecture includes dominance and observation factors inspired by the determinants of motor learning in humans, including observational practice, focus of attention, feedback and augmented feedback, and self-controlled practice. Toward the validation of such an architecture, we (1) verify the stability of a trilateral system by applying Llewellyn's criterion on a two-port equivalent architecture, and (2) demonstrate that system transparency remains generally invariant across relevant observation factors and movement frequencies. In a preliminary experimental study, a dyad of two human users (one novice, one expert) collaborated on the control of a robot to follow a trajectory. The experiment showed that the framework can be used to modulate the efforts of the users and adjust the source and level of haptic feedback to the novice user.