Objective assessment in residency-based training for transoral robotic surgery

Image-based and textbook-based virtual reality training on operational skills among junior residents: a proof of concept study

BACKGROUND

Operational training is a key component of resident education. Recently, innovative virtual reality (VR) training methods have been introduced to enhance training efficiency. Image-based VR (IBVR), which incorporates cognitive load, is theorized to improve task performance. However, the impact of IBVR on learning outcomes requires further investigation. This study aims to assess the efficacy of IBVR compared to textbook-based VR (TBVR) in teaching operational skills to junior residents.

METHODS

In a prospective cross-over pilot study, ten volunteers were randomly assigned to either the IBVR-TBVR or TBVR-IBVR group. Participants engaged in four learning sessions using either IBVR or TBVR modules during the first phase. Performance was assessed using quizzes, and Milestone/Direct Observation of Procedural Skills (DOPS) ratings on real patients. After one month, participants switched to the alternate VR module for further training. Cognitive load and stress were assessed during each session through questionnaires and heart rate variability (HRV). At the end of the study, learning satisfaction, experience, and overall effectiveness were evaluated using a global satisfaction scale, the AttrakDiff2 questionnaire, and group interviews. Qualitative data were analyzed using a thematic analysis framework.

RESULTS

The IBVR module yielded significantly better Milestone (p = 0.04), and DOPS (p < 0.01) scores compared to TBVR. There were no significant differences in knowledge gain, cognitive load, or HRV between the two modules. TBVR was favored in terms of global satisfaction (p = 0.03), hedonic stimulation (p = 0.01), and hedonic identification (p = 0.03), whereas IBVR was perceived as a more immersive and enriching experience. The majority (70%) of participants reported a positive experience with IBVR, while 50% expressed positive feedback regarding TBVR. Thematic analysis identified two key themes: usability of instructional content and ease of engagement.

CONCLUSION

Although TBVR yielded higher learner satisfaction and hedonic appeal, IBVR resulted in greater improvements in operational performance and was positively received by most participants. This proof-of-concept study highlights the complementary strengths of both VR approaches and calls for further research to validate these preliminary findings and inform the design of effective VR-based surgical education strategies.

TRIAL REGISTRATION

Clinicaltrials.gov NCT03501641; https://clinicaltrials.gov/ct2/show/NCT03501641 ; date of registration: April 18, 2018.

Training in robotic-assisted surgery: a systematic review of training modalities and objective and subjective assessment methods

INTRODUCTION

The variety of robotic surgery systems, training modalities, and assessment tools within robotic surgery training is extensive. This systematic review aimed to comprehensively overview different training modalities and assessment methods for teaching and assessing surgical skills in robotic surgery, with a specific focus on comparing objective and subjective assessment methods.

METHODS

A systematic review was conducted following the PRISMA guidelines. The electronic databases Pubmed, EMBASE, and Cochrane were searched from inception until February 1, 2022. Included studies consisted of robotic-assisted surgery training (e.g., box training, virtual reality training, cadaver training and animal tissue training) with an assessment method (objective or subjective), such as assessment forms, virtual reality scores, peer-to-peer feedback or time recording.

RESULTS

The search identified 1591 studies. After abstract screening and full-texts examination, 209 studies were identified that focused on robotic surgery training and included an assessment tool. The majority of the studies utilized the da Vinci Surgical System, with dry lab training being the most common approach, followed by the da Vinci Surgical Skills Simulator. The most frequently used assessment methods included simulator scoring system (e.g., dVSS score), and assessment forms (e.g., GEARS and OSATS).

CONCLUSION

This systematic review provides an overview of training modalities and assessment methods in robotic-assisted surgery. Dry lab training on the da Vinci Surgical System and training on the da Vinci Skills Simulator are the predominant approaches. However, focused training on tissue handling, manipulation, and force interaction is lacking, despite the absence of haptic feedback. Future research should focus on developing universal objective assessment and feedback methods to address these limitations as the field continues to evolve.

Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review

BACKGROUND

There is a need to standardize training in robotic surgery, including objective assessment for accreditation. This systematic review aimed to identify objective tools for technical skills assessment, providing evaluation statuses to guide research and inform implementation into training curricula.

METHODS

A systematic literature search was conducted in accordance with the PRISMA guidelines. Ovid Embase/Medline, PubMed and Web of Science were searched. Inclusion criterion: robotic surgery technical skills tools. Exclusion criteria: non-technical, laparoscopy or open skills only. Manual tools and automated performance metrics (APMs) were analysed using Messick's concept of validity and the Oxford Centre of Evidence-Based Medicine (OCEBM) Levels of Evidence and Recommendation (LoR). A bespoke tool analysed artificial intelligence (AI) studies. The Modified Downs-Black checklist was used to assess risk of bias.

RESULTS

Two hundred and forty-seven studies were analysed, identifying: 8 global rating scales, 26 procedure-/task-specific tools, 3 main error-based methods, 10 simulators, 28 studies analysing APMs and 53 AI studies. Global Evaluative Assessment of Robotic Skills and the da Vinci Skills Simulator were the most evaluated tools at LoR 1 (OCEBM). Three procedure-specific tools, 3 error-based methods and 1 non-simulator APMs reached LoR 2. AI models estimated outcomes (skill or clinical), demonstrating superior accuracy rates in the laboratory with 60 per cent of methods reporting accuracies over 90 per cent, compared to real surgery ranging from 67 to 100 per cent.

CONCLUSIONS

Manual and automated assessment tools for robotic surgery are not well validated and require further evaluation before use in accreditation processes.PROSPERO: registration ID CRD42022304901.

The application of objective clinical human reliability analysis (OCHRA) in the assessment of basic robotic surgical skills

BACKGROUND

Using a validated, objective, and standardised assessment tool to assess progression and competency is essential for basic robotic surgical training programmes. Objective clinical human reliability analysis (OCHRA) is an error-based assessment tool that provides in-depth analysis of individual technical errors. We conducted a feasibility study to assess the concurrent validity and reliability of OCHRA when applied to basic, generic robotic technical skills assessment.

METHODS

Selected basic robotic surgical skill tasks, in virtual reality (VR) and dry lab equivalent, were performed by novice robotic surgeons during an intensive 5-day robotic surgical skills course on da Vinci® X and Xi surgical systems. For each task, we described a hierarchical task analysis. Our developed robotic surgical-specific OCHRA methodology was applied to error events in recorded videos with a standardised definition. Statistical analysis to assess concurrent validity with existing tools and inter-rater reliability were performed.

RESULTS

OCHRA methodology was applied to 272 basic robotic surgical skills tasks performed by 20 novice robotic surgeons. Performance scores improved from the start of the course to the end using all three assessment tools; Global Evaluative Assessment of Robotic Skills (GEARS) [VR: t(19) = - 9.33, p < 0.001] [dry lab: t(19) = - 10.17, p < 0.001], OCHRA [VR: t(19) = 6.33, p < 0.001] [dry lab: t(19) = 10.69, p < 0.001] and automated VR [VR: t(19) = - 8.26, p < 0.001]. Correlation analysis, for OCHRA compared to GEARS and automated VR scores, shows a significant and strong inverse correlation in every VR and dry lab task; OCHRA vs GEARS [VR: mean r = - 0.78, p < 0.001] [dry lab: mean r = - 0.82, p < 0.001] and OCHRA vs automated VR [VR: mean r = - 0.77, p < 0.001]. There is very strong and significant inter-rater reliability between two independent reviewers (r = 0.926, p < 0.001).

CONCLUSION

OCHRA methodology provides a detailed error analysis tool in basic robotic surgical skills with high reliability and concurrent validity with existing tools. OCHRA requires further evaluation in more advanced robotic surgical procedures.

Artificial intelligence in clinical endoscopy: Insights in the field of videomics

Artificial intelligence is being increasingly seen as a useful tool in medicine. Specifically, these technologies have the objective to extract insights from complex datasets that cannot easily be analyzed by conventional statistical methods. While promising results have been obtained for various -omics datasets, radiological images, and histopathologic slides, analysis of videoendoscopic frames still represents a major challenge. In this context, videomics represents a burgeoning field wherein several methods of computer vision are systematically used to organize unstructured data from frames obtained during diagnostic videoendoscopy. Recent studies have focused on five broad tasks with increasing complexity: quality assessment of endoscopic images, classification of pathologic and nonpathologic frames, detection of lesions inside frames, segmentation of pathologic lesions, and in-depth characterization of neoplastic lesions. Herein, we present a broad overview of the field, with a focus on conceptual key points and future perspectives.

A Probabilistic Approach To Surgical Tasks and Skill Metrics

Identifying and quantifying the activities that compose surgery is essential for effective interventions, computer-aided analyses and the advancement of surgical data science. For example, recent studies have shown that objective metrics (referred to as objective performance indicators, OPIs) computed during key surgical tasks correlate with surgeon skill and clinical outcomes. Unambiguous identification of these surgical tasks can be particularly challenging for both human annotators and algorithms. Each surgical procedure has multiple approaches, each surgeon has their own level of skill, and the initiation and termination of surgical tasks can be subject to interpretation. As such, human annotators and machine learning models face the same basic problem, accurately identifying the boundaries of surgical tasks despite variable and unstructured information. For use in surgeon feedback, OPIs should also be robust to the variability and diversity in this data. To mitigate this difficulty, we propose a probabilistic approach to surgical task identification and calculation of OPIs. Rather than relying on tasks that are identified by hard temporal boundaries, we demonstrate an approach that relies on distributions of start and stop times, for a probabilistic interpretation of when the task was performed. We first use hypothetical data to outline how this approach is superior to other conventional approaches. Then we present similar analyses on surgical data. We find that when surgical tasks are identified by their individual probabilities, the resulting OPIs are less sensitive to noise in the identification of the start and stop times. These results suggest that this probabilistic approach holds promise for the future of surgical data science.

Evaluation of a 3D-Printed Transoral Robotic Surgery Simulator Utilizing Artificial Tissue

OBJECTIVES/HYPOTHESIS

Transoral robotic surgery (TORS) poses challenges for operators in training, with limited robot access on a platform requiring distinct surgical skills. Few simulators exist, and current virtual reality training modules exclude head and neck simulations. This study evaluates the construct validity for a novel low-cost TORS simulator.

STUDY DESIGN

Single institution prospective observational study.

METHODS

Using 3D-printed oral cavity structures and replaceable artificial tissue components, a modular TORS simulator was constructed for short-duration hands-on simulations with the da Vinci SI robot. Sixteen surgeons of differing robotic skill levels, no experience (novice), prior experience, and formal robot training, participated in simulated tonsil and tongue base tumor resections. Video recordings of each participant were graded by a blinded robotically trained surgeon using a 35-point Global Evaluative Assessment of Robotic Surgery (GEARS) criterion adapted for the TORS simulator.

RESULTS

Operators reporting formal robotic training or prior robot experience achieved significantly higher mean total GEARS scores compared to novice operators (32 vs. 20.5; P < .001). Overall, mean total GEARS scores correlated with reported experience level; novice operators scored 54% of total points at 19 (4.5), operators with prior experience scored 82.3% of total points at 28.8 (2.6), and robotically trained operators scored 97.1% of total points at 34 (1.7).

CONCLUSION

With a GEARS criterion, our simulator successfully differentiated novice from experienced and robotically trained operators of the da Vinci SI robot during simulated tonsillectomy and base of tongue resections. These findings support the construct validity of this prototype simulator and offer a foundation for further testing of predictive validity.

LEVEL OF EVIDENCE

2 Laryngoscope, 2021.

Adaptive Surgical Robotic Training Using Real-Time Stylistic Behavior Feedback Through Haptic Cues

Surgical skill directly affects surgical procedure outcomes; thus, effective training is needed to ensure satisfactory results. Many objective assessment metrics have been developed that provide the trainee with descriptive feedback about their performance however, often lack feedback on how to improve performance. The most effective training method is one that is intuitive, easy to understand, personalized to the user,and provided in a timely manner. We propose a framework to enable user-adaptive training using near real-time detection of performance, based on intuitive styles of surgical movements, and design a haptic feedback framework to assist with correcting styles of movement. We evaluate the ability of three types of force feedback (spring, damping, and spring plus damping feedback), computed based on prior user positions, to improve different stylistic behaviors of the user during kinematically constrained reaching movement tasks. The results indicate that five out of six styles studied here were improved using at least one of the three types of force feedback. Task performance metrics were compared in the presence of the three types of feedback. Task time was statistically significantly lower when applying spring feedback, compared to the other two types of feedback. Path straightness and targeting error were statistically significantly improved when using spring-damping feedback compared to the other two types of feedback. This study presents a groundwork for adaptive training in robotic surgery based on near real-time human-centric models of surgical behavior.

A National Survey of Robotic Surgery Training Among Otolaryngology-Head and Neck Surgery Residents

OBJECTIVE

The aim of this study is to describe the current state of robotic surgery training among Otolaryngology-Head and Neck Surgery (OHNS) residency programs in the United States.

METHODS

This is a national survey study among OHNS residents. All OHNS residency programs were identified via the Accreditation Council for Graduate Medical Education website. A total of 64/127 (50.3%) of OHNS programs were selected based on a random number generator. The main outcome measure was the number of OHNS residents with access to robotic surgery training and assessment of operative experience in robotic surgery among those residents.

RESULTS

A total of 140 OHNS residents participated in the survey, of which 59.3% (n = 83) were male. Response rate was 40.2%. Respondents came from middle 50.0% (n = 70), southern 17.8% (n = 25), western 17.8% (n = 25), and eastern sections 14.3% (n = 20). Most respondents (94.3%, n = 132) reported that their institution utilized a robot for head and neck surgery. Resident experience at the bedside increased in the junior years of training and console experience increased across the years particularly for more senior residents. However, 63.4% of residents reported no operative experience at the console. Only 11.4% of programs have a structured robotics training program.

CONCLUSION

This survey indicated that nearly all OHNS residencies utilize robotic surgery in their clinical practice with residents receiving little formal education in robotics or experience at the console. OHNS residencies should aim to increase access to training opportunities in order to increase resident competency.

LEVEL OF EVIDENCE

IV.

How to Bring Surgery to the Next Level: Interpretable Skills Assessment in Robotic-Assisted Surgery

Introduction

A surgeon's technical skills are an important factor in delivering optimal patient care. Most existing methods to estimate technical skills remain subjective and resource intensive. Robotic-assisted surgery (RAS) provides a unique opportunity to develop objective metrics using key elements of intraoperative surgeon behavior which can be captured unobtrusively, such as instrument positions and button presses. Recent studies have shown that objective metrics based on these data (referred to as objective performance indicators [OPIs]) correlate to select clinical outcomes during robotic-assisted radical prostatectomy. However, the current OPIs remain difficult to interpret directly and, therefore, to use within structured feedback to improve surgical efficiencies.

Methods

We analyzed kinematic and event data from da Vinci surgical systems (Intuitive Surgical, Inc., Sunnyvale, CA, USA) to calculate values that can summarize the use of robotic instruments, referred to as OPIs. These indicators were mapped to broader technical skill categories of established training protocols. A data-driven approach was then applied to further sub-select OPIs that distinguish skill for each technical skill category within each training task. This subset of OPIs was used to build a set of logistic regression classifiers that predict the probability of expertise in that skill to identify targeted improvement and practice. The final, proposed feedback using OPIs was based on the coefficients of the logistic regression model to highlight specific actions that can be taken to improve.

Results

We determine that for the majority of skills, only a small subset of OPIs (2-10) are required to achieve the highest model accuracies (80-95%) for estimating technical skills within clinical-like tasks on a porcine model. The majority of the skill models have similar accuracy as models predicting overall expertise for a task (80-98%). Skill models can divide a prediction into interpretable categories for simpler, targeted feedback.

Conclusion

We define and validate a methodology to create interpretable metrics for key technical skills during clinical-like tasks when performing RAS. Using this framework for evaluating technical skills, we believe that surgical trainees can better understand both what can be improved and how to improve.

Transoral Robotic Surgical Proficiency Via Real-Time Tactile Collision Awareness System

OBJECTIVES

In 2009, the Food and Drug Administration approved the use of the surgical robotic system for removal of benign and malignant conditions of the upper aerodigestive tract. This novel application of robotic-assisted surgery, termed transoral robotic surgery (TORS), places robotic instruments and camera system through the mouth to reach recessed areas of the pharynx and larynx. Over the successive decade, there was a rapid adoption of TORS with a surgical growth rate that continues to increase. Despite the rapid clinical acceptance, the field of TORS has not yet seen substantive changes or advances in the technical shortcomings, the lack of which has restricted objective TORS-specific surgical skills assessment as well as subsequent skills improvement efforts. One of the primary technical challenges of TORS is operating in a confined space, where the robotic system is maneuvered within the restrictive boundaries of the mouth and throat. Due to these confined boundaries of the pharynx, instruments can frequently collide with anatomic structures such as teeth and bone, producing anatomic collisions. Therefore, we hypothesized that anatomic collisions negatively impact TORS surgical performance. Secondarily, we hypothesized that avoidance of unwanted anatomic collisions could improve TORS surgical proficiency.

METHODS

Design and fidelity testing for a custom TORS training platform with an integrated anatomic collision-sensing system providing real-time tactile feedback is described. Following successful platform assembly and testing, validation study using the platform was carried through prospective surgical training with trial randomization. Twenty otolaryngology-head and neck surgery residents, each trainee performing three discrete mock surgical trials (n = 60), performed the initial system validation. Ten of the 20 residents were randomized to perform the surgical trials utilizing the real-time feedback system. The remaining 10 residents were randomized to perform the surgical trials without the feedback system, although the system still could record collision data. Surgical proficiency was measured by Global Evaluative Assessment of Robotic Skills (GEARS) score, time to completion, and tumor resection scores (categorical scale ranging 0-3, describing the adequacy of resection).

RESULTS

Major anatomic collisions (greater than 5N of force) negatively affected GEARS robotic skills. A mixed model analysis demonstrated that for every additional occurrence of a major collision, GEARS robotic skills assessment score would decrease by 0.29 points (P = .04). Real-time collision awareness created significantly fewer major (> 5 N) anatomic collisions with the tactile feedback system active (n = 30, mean collisions = 2.9 ± 4.2) as compared with trials without tactile feedback (n = 30, mean collisions = 12.53 ± 23.23) (P < .001). The second assessment measure of time to completion was unaffected by the presence of collisions or by the use of tactile feedback system. The third proficiency assessment was measured with tumor resection grading. Tumor resection scores was significantly (P = .02) improved with collision awareness system activated than trials without collision awareness.

CONCLUSION

In order to test our primary hypothesis, a novel TORS training platform was successfully developed that provides collision force measurements including frequency, severity, and duration of anatomic collisions. Additionally, the platform was modulated to provide real-time tactile feedback of the occurrence of out-of-field collisions. Utilizing this custom platform, our hypothesis that anatomic collisions during TORS diminishes surgical performance was supported. Additionally, our secondary hypothesis that subsequent reduction of anatomic collisions improves TORS proficiency was supported by the surgical trial. Dedicated investigation to characterize the effect size and clinical impact is required in order to translate this finding into training curriculums and into clinical utilization.

LEVEL OF EVIDENCE

II (Randomized trial) Laryngoscope, 130:S1-S17, 2020.

Enhancing Operative Feedback: A Descriptive Trajectory for Surgical Development in Otolaryngology

OBJECTIVE

Developmental frameworks are narrative descriptions of learner performance that may be useful to provide operative feedback tools in surgical education. The authors previously proposed the Technician, Anatomist, Anticipator, Strategist, Executive (TAASE) framework utilizing data collected from general surgeons and conjectured its applicability in other surgical specialties. Here, we construct a developmental framework in otolaryngology using similar techniques, then compare the results to TAASE.

DESIGN

Ten otolaryngology educators participated in semi-structured, audio-recorded interviews, to explore how otolaryngology faculty characterize surgical learning at different levels of training. Researchers analyzed the transcripts using a thematic analysis approach to build a developmental framework. Results were then qualitatively compared to the TAASE trajectory.

SETTING

Single tertiary academic medical center.

PARTICIPANTS

Faculty within the Department of Otolaryngology-Head and Neck Surgery.

RESULTS

Otolaryngology faculty characterized surgical development as an integrated trajectory of technical and cognitive skills progressing from specific operative tasks to a global understanding of patients and procedures largely consistent with stages outlined in the Technician, Anatomist, Anticipator, Strategist, and Executive model. A new theme identified was learner emotions, which may impact learning and hinder or enhance progression along the trajectory.

CONCLUSIONS

Otolaryngology and general surgeons agree upon a common arc to operative maturity reflected by the TAASE trajectory. The TAASE framework may be useful as a tool for intraoperative assessment in otolaryngology to help promote quality feedback. Further research is needed to understand how emotions may influence operative skill development.

Technical Performance as a Predictor of Clinical Outcomes in Laparoscopic Gastric Cancer Surgery

OBJECTIVE

The purpose of this study was to evaluate the relationship between technical performance and patient outcomes in laparoscopic gastric cancer surgery.

BACKGROUND

Laparoscopic gastrectomy for cancer is an advanced procedure with high rate of postoperative morbidity and mortality. Many variables including patient, disease, and perioperative management factors have been shown to impact postoperative outcomes; however, the role of surgical performance is insufficiently investigated.

METHODS

A retrospective review was performed for all patients who had undergone laparoscopic gastrectomy for cancer at 3 teaching institutions between 2009 and 2015. Patients with available, unedited video-recording of their procedure were included in the study. Video files were rated for technical performance, using Objective Structured Assessments of Technical Skills (OSATS) and Generic Error Rating Tool instruments. The main outcome variable was major short-term complications. The effect of technical performance on patient outcomes was assessed using logistic regression analysis with backward selection strategy.

RESULTS

Sixty-one patients with available video recordings were included in the study. The overall complication rate was 29.5%. The mean Charlson comorbidity index, type of procedure, and the global OSATS score were included in the final predictive model. Lower performance score (OSATS ≤29) remained an independent predictor for major short-term outcomes (odds ratio 6.49), while adjusting for comorbidities and type of procedure.

CONCLUSIONS

Intraoperative technical performance predicts major short-term outcomes in laparoscopic gastrectomy for cancer. Ongoing assessment and enhancement of surgical skills using modern, evidence-based strategies might improve short-term patient outcomes. Future work should focus on developing and studying the effectiveness of such interventions in laparoscopic gastric cancer surgery.

A Robotic Recording and Playback Platform for Training Surgeons and Learning Autonomous Behaviors Using the da Vinci Surgical System

This paper describes a recording and playback system developed using a da Vinci Standard Surgical System and research kit. The system records stereo laparoscopic videos, robot arm joint angles, and surgeon–console interactions in a synchronized manner. A user can then, on-demand and at adjustable speeds, watch stereo videos and feel recorded movements on the hand controllers of entire procedures or sub procedures. Currently, there is no reported comprehensive ability to capture expert surgeon movements and insights and reproduce them on hardware directly. This system has important applications in several areas: (1) training of surgeons, (2) collection of learning data for the development of advanced control algorithms and intelligent autonomous behaviors, and (3) use as a “black box” for retrospective error analysis. We show a prototype of such an immersive system on a clinically-relevant platform along with its recording and playback fidelity. Lastly, we convey possible research avenues to create better systems for training and assisting robotic surgeons.

Where am I? Transnasal esophagoscopy outside the normal esophagus

Medical malpractice is costly and disruptive, and it is important to prevent. We conducted a study with the objective to look at medical malpractice in robotic surgery overall, to evaluate reasons for litigation, and to comment on possible strategies to avoid litigation with transoral robotic surgery. We used the Westlaw computerized database to identify all state and federal verdict summaries in medical malpractice cases. We found 17 cases alleging malpractice that involved the use of robotic surgery. In all, the plaintiffs in 6 cases (35%) contended that an open rather than a robotic approach should have been used, 5 (29%) alleged negligent credentialing, 4 (24%) alleged training deficiencies, 2 (12%) alleged manufacturing problems, and 1 (6%) charged that robotic surgery should have been performed instead of open surgery (1 case involved two of these allegations). In 11 cases (65%), plaintiffs charged that robotic surgery contributed to an undesirable outcome, and in 6 cases (35%) they raised concerns about informed consent. In all, only 5 of the 17 lawsuits (29%) resulted in plaintiff verdicts or settlements; damages ranged from $95,000 to $7.5 million. We believe the courts should not play a major role in establishing safety guidelines for the introduction of new technology such as robotic surgery. Instead, training and credentialing guidelines should be established by appropriate national associations and societies to assist hospitals in doing so.

The interplay of IMRT and transoral surgery in HPV-mediated oropharyngeal cancer: Getting the balance right

Transoral surgery (TOS) and IMRT represent two primary local ablative treatment modalities for oropharyngeal cancer (OPC). The choice of one over the other represents an interplay between the chance of cure vs risk of late sequelae. HPV-mediated (HPV+) OPC patients generally have excellent outcomes, especially in TNM-8 stage I disease. Controversies exist over which treatment has a more favorable toxicity profile and equal efficacy in the management of this population. Non-randomized retrospective data show comparable oncological and functional outcomes between TOS-based vs IMRT-based treatment for this disease. Several de-intensification concepts have been explored in this subset in both primary surgery-based vs primary radiotherapy-based trials. However, no robust mature trial data are available to convincingly guide treatment selection. TOS is often presented as one of the de-intensification options although the majority of series also describe the use of adjuvant treatments which inevitably result in non-negligible toxicities. Patient selection and surgeons' training are paramount. Understanding tumor biology and the prognostic value of traditional 'adverse' features will further guide trial design for refinement of risk tailored approach. In conclusion, comparative data suggests TOS and IMRT are both effective treatment for TNM-8 stage I HPV+ OPC with similar oncological and functional outcomes. TOS as a single modality has potential advantages in mitigating radiation included toxicities. TOS should be avoided in the presence of clinically overt extranodal extension or when negative margins are unlikely to be achieved. TOS is also less ideal for cases with radiological features predicting a high risk of distant metastasis.

Advanced head and neck surgical techniques: A survey of US otolaryngology resident perspectives

OBJECTIVES

To assess the perspectives of OHNS residents with regards to their training in the following advanced head and neck surgery techniques: transoral robotic surgery (TORS), transoral laser microsurgery (TLM), sialendoscopy, and surgeon-performed ultrasound (SP-US) for possible curricula development.

METHODS

Cross-sectional survey. A 20-item questionnaire was electronically distributed to OHNS residency programs assessing volume of cases, training barriers, satisfaction, additional training preferences, and pertinence to future practice.

RESULTS

One hundred thirty-one residents completed the questionnaire. Trainee satisfaction with advanced techniques did not vary significantly with level of training (PGY) or intent to pursue fellowship. Residents who participated in more TLM, sialendoscopy, and SP-US cases were significantly more likely to be satisfied with their training (all p<0.05). The most frequently reported limitation to training was low home institution procedure volume. Seventy-eight of 123 respondents (63.4%) indicated insufficient opportunity to participate in TORS, with most residents reporting that TORS was preferentially performed by attendings (59/78, 75.6%). Forty-five of 126 (35.7%) reported having adequate access to skills training in TORS, compared to 43.6%, 48.4%, and 54.8% for sialendoscopy, TLM, and SP-US, respectively. A vast majority expressed interest in home institution-sponsored training courses in SP-US (120/127, 94.5%) and sialendoscopy (105/129, 81.4%). Many anticipated using SP-US (63.3%) and sialendoscopy (49.6%) in their future practices.

CONCLUSION

Greater resident participation in advanced head and neck surgical procedures is associated with higher trainee satisfaction. There is a possible need for additional home institution-sponsored training courses, especially in sialendoscopy and SP-US.

LEVEL OF EVIDENCE

N/A.

Initial and Long-term Retention of Robotic Technical Skills in an Otolaryngology Residency Program

OBJECTIVES/HYPOTHESIS

To objectively assess the initial and long-term retention of robotic surgical skills of otolaryngology residents.

STUDY DESIGN

This study was performed in an academic otolaryngology residency training program. Between October 2015 and November 2016, residents were invited to complete a prospective, multiphase robotic surgical skills training course: 1) online da Vinci Surgical System Assessment and didactic, 2) faculty-supervised robotic simulator training, 3) robotic docking and draping training, 4) robotic dry-lab exercises. To optimize surgical skill retention, the training laboratory was repeated 2 weeks after the initial training session.

METHODS

Twenty otolaryngology residents were included. Primary outcome was measured as robotic skill assessment scores on three tasks: camera targeting, peg board, and needle targeting. Skill assessments were completed prior to training, between the two training sessions, and at 1 month and 6 months after training. Residents were also asked to complete a self-assessment questionnaire.

RESULTS

Camera targeting scores were improved at midtraining (P < .001) and 1-month posttraining (P = .010). Peg board scores were improved at 1 month training (P = .043). Needle targeting scores were improved at midtraining (P = .002), 1 month (P = .002), and 6 months posttraining (P < .001). Resident self-assessment scores demonstrating comfort with using the robotic console (P < .01) and docking/draping (P < .01) improved significantly following the training.

CONCLUSIONS

Following a multiphase robotic training program, otolaryngology residents demonstrated significant, objective skill acquisition and retention at 1 month and 6 months follow-up. Although the proposed training strategy may be considered an important step in otolaryngology residency training, additional innovations are being designed toward a formal robotic training curriculum.

LEVEL OF EVIDENCE

NA Laryngoscope, 129:1380-1385, 2019.

Initiating a Robotic Thyroidectomy Program in India

Robotic surgery has been successfully used for many surgical indications in head and neck surgery. Robotic thyroidectomy is getting accepted worldwide, but the majority of the literature is from South Korea. The purpose of the paper is to review and give a personal perspective on how a robotic thyroidectomy program was initiated in a tertiary care academic medical institution in India. Advantages of robotic approaches are the three-dimensional visualization, precision, dexterity, and surgeon ergonomics. Cost is an important concern. Training includes basic robotics skill training, cadaveric training, observership, and hands-on training. Sufficient preclinical and clinical training is essential before embarking onto the newer surgical modality. Surgeon credentialing, though institution dependent, has specific guidelines. Case selection is the key, especially in the initial learning curve. The authors prefer the retroauricular approach for robotic thyroidectomy, and our initial experience in the first ten cases of total thyroidectomy was encouraging.

Toward Intraoperative Image-Guided Transoral Robotic Surgery

This paper presents the development and evaluation of video augmentation on the stereoscopic da Vinci S system with intraoperative image guidance for base of tongue tumor resection in transoral robotic surgery (TORS). Proposed workflow for image-guided TORS begins by identifying and segmenting critical oropharyngeal structures (e.g., the tumor and adjacent arteries and nerves) from preoperative computed tomography (CT) and/or magnetic resonance (MR) imaging. These preoperative planned data can be deformably registered to the intraoperative endoscopic view using mobile C-arm cone-beam computed tomography (CBCT) [1, 2]. Augmentation of TORS endoscopic video defining surgical targets and critical structures has the potential to improve navigation, spatial orientation, and confidence in tumor resection. Experiments in animal specimens achieved statistically significant improvement in target localization error when comparing the proposed image guidance system to simulated current practice.

The Generic Error Rating Tool: A Novel Approach to Assessment of Performance and Surgical Education in Gynecologic Laparoscopy

OBJECTIVE

Global rating scales are commonly used to rate surgeons' skill level. However, these tools lack granularity required for specific skill feedback. Recently, an alternative framework has been developed that is designed to measure technical errors during laparoscopy. The purpose of the present study was to gather validity evidence for the Generic Error Rating Tool (GERT) in gynecologic laparoscopy.

DESIGN

Video recordings of total laparoscopic hysterectomies were analyzed by 2 blinded reviewers using the GERT and the Objective Structured Assessment of Technical Skills (OSATS) scale. Several sources of validity were examined according to the unitary framework of validity. Main outcomes were interrater and intrarater reliability regarding total number of errors and events. Further, surgeons were grouped according to OSATS scores (OSATS ≥ 28 = high performers and OSATS < 28 = low performers), and the number of errors and events was compared between groups. Correlation analysis between GERT and OSATS scores was performed. Lastly, error distribution within procedure steps was explored and compared between high- and low-performing surgeons.

SETTING

University teaching hospital.

PARTICIPANTS

A total of 20 anonymized video recordings of total laparoscopic hysterectomies.

RESULTS

Interrater and intrarater reliability was high (intraclass correlation coefficient >0.95) for total number of errors and events. Low performers made significantly more errors than high performers did (median = 49.5 [interquartile range: 34.5-66] vs median = 31 [interquartile range: 16.75-35.25], p = 0.002). There was a significant negative correlation between individual OSATS scores and total number of errors (Spearman ρ = -0.76, p < 0.001, and ρ = -0.88, p < 0.001, for raters 1 and 2, respectively). Error distribution varied between operative steps, and low performers made more errors in some steps, but not in others.

CONCLUSION

GERT allows for objective and reproducible assessment of technical errors during gynecologic laparoscopy and could be used for performance analysis and personalized surgical education and training.

Current status and effectiveness of mentorship programmes in urology: a systematic review

The objectives of this review were to identify and evaluate the efficacy of mentorship programmes for minimally invasive procedures in urology and give recommendations on how to improve mentorship. A systematic literature search of the PubMed/Medline databases was carried out according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. In all, 21 articles were included in the review and divided into four categories: fellowships, mini-fellowships, mentored skills courses and novel mentorship programmes. Various structures of mentorship programme were identified and in general, mentorship programmes were found to be feasible, having content validity and educational impact. Perioperative data showed equally good outcomes when comparing trainees and specialists. Mentorship programmes are effective and represent one of the best current methods of training in urology. However, participation in such programmes is not widespread. The structure of mentorship programmes is highly variable, with no clearly defined 'best approach' for postgraduate training. This review offers recommendations as to how this 'best approach' can be established.

Assessing resident surgical competency in urology using a global rating scale

OBJECTIVE

Training programs must ensure residents are competent to practice independently. For surgical fields, this is generally done by the faculty who graduate the residents, but there has been no accepted methodology for this process.

DESIGN

As part of a generalized survey, attending physicians performing an operation were asked to assess resident competency to perform the operation independently in an average patient, using a single global question. Residents, in a blinded manner, were asked to answer the same question.

SETTING

Urology Residency Program, Albany Medical College, Albany, NY.

PARTICIPANTS

Participants included 12 resident physicians and 10 attending physicians.

RESULTS

There is a large variation in attending physician assessment of resident surgical competency, and the assessment varies by attending physician and by resident. Generally, attending physicians rated residents lower than the residents rated themselves. The discrepancy was largest for residents early in training and lessened as resident experience increased. Assessments also tended to converge toward the attending physician assessment as competency increased. Assessments had less variability when involving a single, high-volume procedure for a single resident.

CONCLUSIONS

Assessing resident surgical competency with a standardized global question is feasible, but complex. Attending physicians and residents differ significantly in their assessment of resident competence. The trend of residents׳ perceptions approaching attending physician estimates as training and competence increases supports the current concept that program directors should use attending physician assessments as the primary measure.

Using virtual reality to maintain surgical skills during periods of robotic surgery inactivity

Periodic practice is needed for newly trained robotic surgeons to maintain skills during periods of robotic inactivity. The current study was performed to determine whether virtual robotic skill maintenance can serve as an adequate substitute for practice on a surgical robot. Eleven surgical residents with no prior robotic training were trained to a level of robotic proficiency with inanimate models, including a needle driving pad, a running suture pad, and ring placement on a rocking peg board. After reaching proficiency, each resident was tested on a complex tissue closure task. For the next 8 weeks, the only robotic activity was biweekly virtual robotic skills maintenance. After 8 weeks, the residents performed the tissue closure task twice with the robot, followed by evaluation on the inanimate models used to reach proficiency. Repeated-measures statistical analyses were used to compare between the three tissue closure trials and between the final test at week 0 and the evaluation at week 8 for the other inanimate models. Time to complete the tissue closure task was more than 20 % lower for the second evaluation at 8 weeks than for the other two trials (p < 0.05). Residents maintained their skills for needle driving, but times for suture running and rocking peg board increased by more than 20 % at 8 weeks (p < 0.01). Virtual practice shows promise for maintaining robotic skills. Following a warm-up period, some skills may actually improve with biweekly virtual practice, but skill retention is selective, so further improvements are needed.

Surgery in the HPV era: the role of robotics and microsurgical techniques

Retrospective studies suggested that head and neck cancers associated with human papilloma virus (HPV) are more frequently cured than those caused by substance use. The Eastern Cooperative Oncology Group (ECOG) subsequently confirmed the observation in a prospective trial. Most HPV-initiated cancers arise in the oropharynx. Survival differences between patients with cancers caused by HPV and those caused by alcohol and tobacco use persist despite modern treatment. The impression that treatment intensification has resulted in improved survivorship may well be attributable to an increasing proportion of patients with cancers caused by HPV infection. Unsatisfactory results for cancers attributable to substance use and encouraging improvements in tumor control for patients with HPV-initiated cancers have led to dissatisfaction with the current nonsurgical management paradigm. Ongoing advances in surgical techniques permit transoral resection of oropharyngeal cancers, thus limiting exposure-related morbidity and permitting ready recovery in terms of speech and swallowing. Transoral laser microsurgery (TLM) is increasingly employed and transoral robotic surgery (TORS) has dramatically popularized surgical treatment of oropharyngeal cancers. Resection affords the opportunity to increase local control at the primary site and surgical management of neck allows risk-based stratification of postoperative radiation therapy. Case series from several institutions show encouraging results. Transoral surgical resection is safe, can be undertaken with acceptable morbidity, and provides comparable locoregional control to that achieved with chemoradiation. Prospective trials for patients with HPV-initiated cancers, as well as those referable to substance use, are underway.

Training to maintain surgical skills during periods of robotic surgery inactivity

BACKGROUND

The study was performed to establish a level of practice needed for newly-trained residents to maintain robotic surgical skills during periods of robotic inactivity.

METHODS

Ten surgical residents were trained to a standardized level of robotic surgery proficiency with inanimate models. At the end of two, four and six weeks, the residents practiced with the models for a total of one hour. Each resident performed a timed tissue closure task immediately after reaching the proficiency standards and twice in succession at eight weeks. Time to completion was compared between the three trials with a repeated measures ANOVA and a post-hoc test.

RESULTS

Average time to complete the tissue closure task decreased by more than 25% over the period between reaching the proficiency standards and the trials at eight weeks, with the difference significant (P < 0.004).

CONCLUSIONS

Biweekly practice for one hour was sufficient to maintain robotic surgical skills.

Error rating tool to identify and analyse technical errors and events in laparoscopic surgery

Background

Surgical error analysis is essential for investigating mechanisms of errors, events and adverse outcomes. Furthermore, it provides valuable information for formative feedback and quality control. The aim of the present study was to design and validate a technical error rating tool in laparoscopic surgery.

Methods

The framework consisted of nine task groups and four error modes. Unedited videos of laparoscopic Roux-en-Y gastric bypass procedures were rated and analysed. The Objective Structured Assessment of Technical Skill (OSATS) global rating scale was used to assess technical skills. The incidence of errors and of injuries (events) were the main outcome measures, and were used to calculate the reliability, and construct and concurrent validity of the instrument.

Results

Two observers analysed 25 procedures. Inter-rater reliability was high regarding total number of errors (intraclass correlation coefficient (ICC) 0·90) and events (ICC 0·85). The median (interquartile range) error rate was 35 (26–44) and the event rate 3 (2–3) per procedure. Error frequencies and OSATS scores correlated significantly in all operative steps (rs = − 0·75 to −0·40, P = &lt;0·001–0·046). Surgeons demonstrating high OSATS scores had lower median (i.q.r.) error rates than surgeons with low scores in three of four steps: measuring bowel (4 (2–7) versus 10 (9–11); P = 0·004), jejunojejunostomy formation (5 (2–6) versus 10 (9–11); P = 0·001) and pouch formation (4 (3–6) versus 9 (5–12); P = 0·004).

Conclusion

The proposed error rating tool allows an objective and reliable assessment of operative performance in laparoscopic gastric bypass procedures.