Implementation of a comprehensive competency-based transoral robotic surgery training curriculum with ex vivo dissection models

Perception of Young European Otolaryngologists toward Transoral Robotic Surgery in Head and Neck Oncology and Surgery

Background: To investigate the perception of young European otolaryngologists (OTOs), i.e., head and neck surgeons, toward transoral robotic surgery (TORS). Methods: Members of the Young Confederation of European Otorhinolaryngology-Head and Neck Surgery and Young Otolaryngologists of International Federation of Otorhinolaryngological Societies were surveyed about TORS perception and practice. Results: The survey was completed by 120 young OTOS (26%). The most important barriers to TORS were robot availability (73%), cost (69%), and lack of training (37%). The participants believed that the main benefits include better surgical filed view (64%), shorter hospital stay (62%), and better postoperative outcomes (61%) than the conventional approach. Head and neck surgeons considered cT1-T2 oropharyngeal cancers (94%), resection of base of tongue for sleep apnea (86%), or primary unknown cancer (76%) as the most appropriate indications. A total of 67% of TORS surgeons assessed themselves as adequately trained in TORS. Conclusions: Young European OTOs report positive perception, adoption, and knowledge of TORS. The cost-related unavailability and the lack of training or access are reported to be the most important barriers for the spread of TORS.

Development and validation of a cadaveric porcine Pseudotumor model for Oral Cancer biopsy and resection training

OBJECTIVE

The gold standard of oral cancer (OC) treatment is diagnostic confirmation by biopsy followed by surgical treatment. However, studies have shown that dentists have difficulty performing biopsies, dental students lack knowledge about OC, and surgeons do not always maintain a safe margin during tumor resection. To address this, biopsies and resections could be trained under realistic conditions outside the patient. The aim of this study was to develop and to validate a porcine pseudotumor model of the tongue.

METHODS

An interdisciplinary team reflecting various specialties involved in the oncological treatment of head and neck oncology developed a porcine pseudotumor model of the tongue in which biopsies and resections can be practiced. The refined model was validated in a final trial of 10 participants who each resected four pseudotumors on a tongue, resulting in a total of 40 resected pseudotumors. The participants (7 residents and 3 specialists) had an experience in OC treatment ranging from 0.5 to 27 years. Resection margins (minimum and maximum) were assessed macroscopically and compared beside self-assessed margins and resection time between residents and specialists. Furthermore, the model was evaluated using Likert-type questions on haptic and radiological fidelity, its usefulness as a training model, as well as its imageability using CT and ultrasound.

RESULTS

The model haptically resembles OC (3.0 ± 0.5; 4-point Likert scale), can be visualized with medical imaging and macroscopically evaluated immediately after resection providing feedback. Although, participants (3.2 ± 0.4) tended to agree that they had resected the pseudotumor with an ideal safety margin (10 mm), the mean minimum resection margin was insufficient at 4.2 ± 1.2 mm (mean ± SD), comparable to reported margins in literature. Simultaneously, a maximum resection margin of 18.4 ± 6.1 mm was measured, indicating partial over-resection. Although specialists were faster at resection (p < 0.001), this had no effect on margins (p = 0.114). Overall, the model was well received by the participants, and they could see it being implemented in training (3.7 ± 0.5).

CONCLUSION

The model, which is cost-effective, cryopreservable, and provides a risk-free training environment, is ideal for training in OC biopsy and resection and could be incorporated into dental, medical, or oncologic surgery curricula. Future studies should evaluate the long-term training effects using this model and its potential impact on improving patient outcomes.

Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review

BACKGROUND

There is a need to standardize training in robotic surgery, including objective assessment for accreditation. This systematic review aimed to identify objective tools for technical skills assessment, providing evaluation statuses to guide research and inform implementation into training curricula.

METHODS

A systematic literature search was conducted in accordance with the PRISMA guidelines. Ovid Embase/Medline, PubMed and Web of Science were searched. Inclusion criterion: robotic surgery technical skills tools. Exclusion criteria: non-technical, laparoscopy or open skills only. Manual tools and automated performance metrics (APMs) were analysed using Messick's concept of validity and the Oxford Centre of Evidence-Based Medicine (OCEBM) Levels of Evidence and Recommendation (LoR). A bespoke tool analysed artificial intelligence (AI) studies. The Modified Downs-Black checklist was used to assess risk of bias.

RESULTS

Two hundred and forty-seven studies were analysed, identifying: 8 global rating scales, 26 procedure-/task-specific tools, 3 main error-based methods, 10 simulators, 28 studies analysing APMs and 53 AI studies. Global Evaluative Assessment of Robotic Skills and the da Vinci Skills Simulator were the most evaluated tools at LoR 1 (OCEBM). Three procedure-specific tools, 3 error-based methods and 1 non-simulator APMs reached LoR 2. AI models estimated outcomes (skill or clinical), demonstrating superior accuracy rates in the laboratory with 60 per cent of methods reporting accuracies over 90 per cent, compared to real surgery ranging from 67 to 100 per cent.

CONCLUSIONS

Manual and automated assessment tools for robotic surgery are not well validated and require further evaluation before use in accreditation processes.PROSPERO: registration ID CRD42022304901.

Influence of Otolaryngological Subspecialties on Perception of Transoral Robotic Surgery: An International YO-IFOS Survey

BACKGROUND

To investigate perception, adoption, and awareness on the part of otolaryngology and head and neck surgeons (OTO-HNS) of transoral robotic surgery (TORS).

METHODS

Several items assessed: awareness/perception; access to TORS; training; indications and advantages/hurdles to TORS practice. A subanalysis was performed to assess differences according to the identified otolaryngological subspecialties.

RESULTS

A total of 359 people completed the survey. Among subspecialties, while for otolaryngologists 30/359 (8.4%) and H&N surgeons 100/359 (27.9%) TORS plays an effective role in hospital stay, laryngologists frequently disagreed (54.3%). There was a lower incidence among rhinologists and otologists (1.9%). Pediatric surgeons (0.8%) reported a positive response regarding the adoption of robotic surgery, and head and neck specialists expressed an even greater response (14.2%). Low adherence was related to perceived cost-prohibitive TORS, by 50% of H&N surgeons.

CONCLUSIONS

Perception, adoption, and knowledge about TORS play a key role in the application of the robotic system, significantly varying across subspecialties.

Adoption of otolaryngologist-head neck surgeons toward transoral robotic surgery: An international survey

OBJECTIVE

To investigate perception, adoption and awareness of otolaryngologist-head neck surgeons (OTO-HNS) toward transoral robotic surgery (TORS).

METHODS

An online survey was sent to 1383 OTO-HNS on the perception, adoption and awareness about TORS to members of many otolaryngological societies. The following aspects were assessed: TORS access; training; awareness/perception; indications and advantages/barriers to TORS practice. The responses were presented for the entire cohort and regarding the TORS experience of OTO-HNS.

RESULTS

A total of 359 completed the survey (26%); including 115 TORS surgeons. TORS-surgeons carry out a mean number of 34.4 annual TORS procedures. The primary barriers to TORS were the cost of the robot (74%) and disposable accessories (69%), and the lack of training opportunity (38%). The 3D view of the surgical field (66%), the postoperative quality of life outcomes (63%) and the shorter hospital stay (56%) were the most important benefits of TORS. TORS-surgeons believed more frequently that TORS is indicated for cT1-T2 oropharyngeal and supraglottic cancers than non-TORS surgeons (p < .005). Participants believed that the priorities for the future consisted of the reduction of the robot arm size and the incorporation of flexible instruments (28%); the integration of laser (25%) or GPS tracking based on imaging (18%), all of them to improve accesses to hypopharynx (24%), supraglottic larynx (23%) and vocal folds (22%).

CONCLUSIONS

The perception, adoption and knowledges toward TORS depend on the access to robot. The findings of this survey may help guide decisions on how improve the dissemination of TORS interest and awareness.

Evaluation of a 3D-Printed Transoral Robotic Surgery Simulator Utilizing Artificial Tissue

OBJECTIVES/HYPOTHESIS

Transoral robotic surgery (TORS) poses challenges for operators in training, with limited robot access on a platform requiring distinct surgical skills. Few simulators exist, and current virtual reality training modules exclude head and neck simulations. This study evaluates the construct validity for a novel low-cost TORS simulator.

STUDY DESIGN

Single institution prospective observational study.

METHODS

Using 3D-printed oral cavity structures and replaceable artificial tissue components, a modular TORS simulator was constructed for short-duration hands-on simulations with the da Vinci SI robot. Sixteen surgeons of differing robotic skill levels, no experience (novice), prior experience, and formal robot training, participated in simulated tonsil and tongue base tumor resections. Video recordings of each participant were graded by a blinded robotically trained surgeon using a 35-point Global Evaluative Assessment of Robotic Surgery (GEARS) criterion adapted for the TORS simulator.

RESULTS

Operators reporting formal robotic training or prior robot experience achieved significantly higher mean total GEARS scores compared to novice operators (32 vs. 20.5; P < .001). Overall, mean total GEARS scores correlated with reported experience level; novice operators scored 54% of total points at 19 (4.5), operators with prior experience scored 82.3% of total points at 28.8 (2.6), and robotically trained operators scored 97.1% of total points at 34 (1.7).

CONCLUSION

With a GEARS criterion, our simulator successfully differentiated novice from experienced and robotically trained operators of the da Vinci SI robot during simulated tonsillectomy and base of tongue resections. These findings support the construct validity of this prototype simulator and offer a foundation for further testing of predictive validity.

LEVEL OF EVIDENCE

2 Laryngoscope, 2021.

A review of robotic surgical training: establishing a curriculum and credentialing process in ophthalmology

Ophthalmic surgery requires a highly dexterous and precise surgical approach to work within the small confines of the eye, and the use of robotics offers numerous potential advantages to current surgical techniques. However, there is a lag in the development of a comprehensive training and credentialing system for robotic eye surgery, and certification of robotic skills proficiency relies heavily on industry leadership. We conducted a literature review on the curricular elements of established robotics training programs as well as privileging guidelines from various institutions to outline key components in training and credentialing robotic surgeons for ophthalmic surgeries. Based on our literature review and informal discussions between the authors and other robotic ophthalmic experts, we recommend that the overall training framework for robotic ophthalmic trainees proceeds in a stepwise, competency-based manner from didactic learning, to simulation exercises, to finally operative experiences. Nontechnical skills such as device troubleshooting and interprofessional teamwork should also be formally taught and evaluated. In addition, we have developed an assessment tool based on validated global rating scales for surgical skills that may be used to monitor the progress of trainees. Finally, we propose a graduating model for granting privileges to robotic surgeons. Further work will need to be undertaken to assess the feasibility, efficacy and integrity of the training curriculum and credentialing practices for robotic ophthalmic surgery.

Development of an International Standardized Curriculum for Laparoscopic Sleeve Gastrectomy Teaching Utilizing Modified Delphi Methodology

BACKGROUND

The performance of laparoscopic sleeve gastrectomy has increased markedly to become the single-most performed bariatric surgical procedure globally. To date, a means of standardized trainee teaching has not been developed. The aim of this study was to design a laparoscopic curriculum for trainees of bariatric surgery utilizing modified Delphi consensus methodology.

METHODS

A panel of surgeons was assembled to devise an academic framework of technical, non-technical and cognitive skills utilized in the performance of laparoscopic sleeve gastrectomy. The panel invited 18 bariatric surgeons experienced in laparoscopic gastrectomy from 11 countries to rate the items for inclusion in the curriculum to a predefined level of agreement.

RESULTS

A consensus of experts was achieved for 24 of the 30 proposed elements for inclusion within the first round of the curriculum Delphi panel. All components pertaining to anatomical knowledge, peri-operative considerations and non-technical items were accepted. A second round further examined six statements, of which three were accepted. Agreement of the panel was reached for 27 of the cognitive, technical and non-technical components after two rounds. Three statements found no consensus.

CONCLUSIONS

Utilizing modified Delphi methodology, a curriculum outlining the most important components of teaching the procedure of laparoscopic sleeve gastrectomy, has been determined by a consensus of international experts in bariatric surgery. The curriculum is suggested as a standard in proficiency-based training of this procedure. It forms a generic template which facilitates individual jurisdictions to perform content validation, adapting the curriculum to local requirements in teaching the next generation of bariatric surgeons.

A National Survey of Robotic Surgery Training Among Otolaryngology-Head and Neck Surgery Residents

OBJECTIVE

The aim of this study is to describe the current state of robotic surgery training among Otolaryngology-Head and Neck Surgery (OHNS) residency programs in the United States.

METHODS

This is a national survey study among OHNS residents. All OHNS residency programs were identified via the Accreditation Council for Graduate Medical Education website. A total of 64/127 (50.3%) of OHNS programs were selected based on a random number generator. The main outcome measure was the number of OHNS residents with access to robotic surgery training and assessment of operative experience in robotic surgery among those residents.

RESULTS

A total of 140 OHNS residents participated in the survey, of which 59.3% (n = 83) were male. Response rate was 40.2%. Respondents came from middle 50.0% (n = 70), southern 17.8% (n = 25), western 17.8% (n = 25), and eastern sections 14.3% (n = 20). Most respondents (94.3%, n = 132) reported that their institution utilized a robot for head and neck surgery. Resident experience at the bedside increased in the junior years of training and console experience increased across the years particularly for more senior residents. However, 63.4% of residents reported no operative experience at the console. Only 11.4% of programs have a structured robotics training program.

CONCLUSION

This survey indicated that nearly all OHNS residencies utilize robotic surgery in their clinical practice with residents receiving little formal education in robotics or experience at the console. OHNS residencies should aim to increase access to training opportunities in order to increase resident competency.

LEVEL OF EVIDENCE

IV.

Transoral Robotic Surgical Proficiency Via Real-Time Tactile Collision Awareness System

OBJECTIVES

In 2009, the Food and Drug Administration approved the use of the surgical robotic system for removal of benign and malignant conditions of the upper aerodigestive tract. This novel application of robotic-assisted surgery, termed transoral robotic surgery (TORS), places robotic instruments and camera system through the mouth to reach recessed areas of the pharynx and larynx. Over the successive decade, there was a rapid adoption of TORS with a surgical growth rate that continues to increase. Despite the rapid clinical acceptance, the field of TORS has not yet seen substantive changes or advances in the technical shortcomings, the lack of which has restricted objective TORS-specific surgical skills assessment as well as subsequent skills improvement efforts. One of the primary technical challenges of TORS is operating in a confined space, where the robotic system is maneuvered within the restrictive boundaries of the mouth and throat. Due to these confined boundaries of the pharynx, instruments can frequently collide with anatomic structures such as teeth and bone, producing anatomic collisions. Therefore, we hypothesized that anatomic collisions negatively impact TORS surgical performance. Secondarily, we hypothesized that avoidance of unwanted anatomic collisions could improve TORS surgical proficiency.

METHODS

Design and fidelity testing for a custom TORS training platform with an integrated anatomic collision-sensing system providing real-time tactile feedback is described. Following successful platform assembly and testing, validation study using the platform was carried through prospective surgical training with trial randomization. Twenty otolaryngology-head and neck surgery residents, each trainee performing three discrete mock surgical trials (n = 60), performed the initial system validation. Ten of the 20 residents were randomized to perform the surgical trials utilizing the real-time feedback system. The remaining 10 residents were randomized to perform the surgical trials without the feedback system, although the system still could record collision data. Surgical proficiency was measured by Global Evaluative Assessment of Robotic Skills (GEARS) score, time to completion, and tumor resection scores (categorical scale ranging 0-3, describing the adequacy of resection).

RESULTS

Major anatomic collisions (greater than 5N of force) negatively affected GEARS robotic skills. A mixed model analysis demonstrated that for every additional occurrence of a major collision, GEARS robotic skills assessment score would decrease by 0.29 points (P = .04). Real-time collision awareness created significantly fewer major (> 5 N) anatomic collisions with the tactile feedback system active (n = 30, mean collisions = 2.9 ± 4.2) as compared with trials without tactile feedback (n = 30, mean collisions = 12.53 ± 23.23) (P < .001). The second assessment measure of time to completion was unaffected by the presence of collisions or by the use of tactile feedback system. The third proficiency assessment was measured with tumor resection grading. Tumor resection scores was significantly (P = .02) improved with collision awareness system activated than trials without collision awareness.

CONCLUSION

In order to test our primary hypothesis, a novel TORS training platform was successfully developed that provides collision force measurements including frequency, severity, and duration of anatomic collisions. Additionally, the platform was modulated to provide real-time tactile feedback of the occurrence of out-of-field collisions. Utilizing this custom platform, our hypothesis that anatomic collisions during TORS diminishes surgical performance was supported. Additionally, our secondary hypothesis that subsequent reduction of anatomic collisions improves TORS proficiency was supported by the surgical trial. Dedicated investigation to characterize the effect size and clinical impact is required in order to translate this finding into training curriculums and into clinical utilization.

LEVEL OF EVIDENCE

II (Randomized trial) Laryngoscope, 130:S1-S17, 2020.

Tumor phantom for training and research in transoral surgery

OBJECTIVE

With the paradigm shift towards minimally invasive surgical techniques such as transoral laser microsurgery and transoral robotic surgery for resection of head and neck malignancies, there is a need to enhance the surgical training of these techniques as well as provide a platform for testing new approaches and technologies. The steeper learning curve associated with minimally invasive surgical techniques may be mitigated with the use of tumor phantoms (TP) placed in cadaver models.

METHODS

An injectable TP was developed using an agar-gelatin base, unsalted chicken stock, deionized water, food coloring for visual mimicry, and iohexol for radiographic mimicry. Four percentage glutaraldehyde was used as a cross-linking agent for solidification of the TP. The TP was then injected in various mucosal anatomic sites in four unfixed cadaver heads. Visual, radiographic, and tactile mimicry was assessed via endoscopy, CT scan, and tumor dissection and palpation, respectively.

RESULTS

Tumor phantom injection was successfully achieved in all four cadaver heads. Visually and tactilely, the TP demonstrated similar color change, induration, and firmness of a typical squamous cell carcinoma (SCCa). However, ulceration that is often seen with SCCa could not be replicated. CT mimicry was compared with nine patients with known SCCa. Tumor radiodensity in the nine patients was between 77 and 110 HU (mean 86.3 HU) whereas TP radiodensity was 59 and 127 HU (mean 93.7 HU), with no significant difference between groups (P = .21).

CONCLUSION

This inexpensive, easy to apply, and unique tumor phantom could be used both to train transoral techniques and as a tool to further investigate new approaches and technologies for transoral surgery.

LEVEL OF EVIDENCE

NA.

Validation of an Objective Assessment Tool for Tonsillectomy in Otolaryngology Resident Training

OBJECTIVE

Create and validate an objective structured assessment of technical skills (OSATS) for otolaryngology residents learning how to perform a tonsillectomy.

STUDY DESIGN

Multicenter prospective longitudinal validation study.

METHODS

A multi-institutional study at six tertiary academic otolaryngology residency programs from July 2009 to May 2012. Using the modified Delphi technique, a panel of pediatric otolaryngologists created a tonsillectomy task-based checklist (TBC) for a tonsil OSATS using a 5-point Likert-type scale. Residents were assessed by pediatric otolaryngology staff at the time of surgery with the TBC and a global rating scale. Procedure time, patient age, number of previously performed tonsillectomies, and surgical technique were also collected.

RESULTS

One hundred sixty-seven tonsil OSATS were completed for 38 residents, and competency was recorded for 99 (59.2%). Residents scored as competent had performed significantly more previous tonsillectomies than those deemed noncompetent, 44.4 ± 35.6 and 13.5 ± 11.6, respectively (P < .001). The mean overall score on the tonsil TBC was 4.0 ± 0.8 and 2.6 ± 1.0 for competent and noncompetent, respectively (P < .001). Higher number of tonsillectomies performed and mean tonsil TBC score significantly increased the likelihood of competency (P < .001). Each additional tonsillectomy performed increased the likelihood of achieving competency by 6.3% (P = .006, 95% confidence interval (CI): 1.330-1.110), and each 1.0 point increase in mean tonsil TBC score increased the likelihood of competency by a factor of 2.71 (P = .006, 95% CI:1.330-5.513). There is a 95% likelihood of competency at 48 tonsillectomies or a tonsil TBC score of 4.91.

CONCLUSION

The tonsil OSATS is a valid and feasible instrument to assess resident competency with tonsillectomy and provides timely objective feedback.

LEVEL OF EVIDENCE

4. Laryngoscope, 131:E359-E366, 2021.

Advanced head and neck surgical techniques: A survey of US otolaryngology resident perspectives

OBJECTIVES

To assess the perspectives of OHNS residents with regards to their training in the following advanced head and neck surgery techniques: transoral robotic surgery (TORS), transoral laser microsurgery (TLM), sialendoscopy, and surgeon-performed ultrasound (SP-US) for possible curricula development.

METHODS

Cross-sectional survey. A 20-item questionnaire was electronically distributed to OHNS residency programs assessing volume of cases, training barriers, satisfaction, additional training preferences, and pertinence to future practice.

RESULTS

One hundred thirty-one residents completed the questionnaire. Trainee satisfaction with advanced techniques did not vary significantly with level of training (PGY) or intent to pursue fellowship. Residents who participated in more TLM, sialendoscopy, and SP-US cases were significantly more likely to be satisfied with their training (all p<0.05). The most frequently reported limitation to training was low home institution procedure volume. Seventy-eight of 123 respondents (63.4%) indicated insufficient opportunity to participate in TORS, with most residents reporting that TORS was preferentially performed by attendings (59/78, 75.6%). Forty-five of 126 (35.7%) reported having adequate access to skills training in TORS, compared to 43.6%, 48.4%, and 54.8% for sialendoscopy, TLM, and SP-US, respectively. A vast majority expressed interest in home institution-sponsored training courses in SP-US (120/127, 94.5%) and sialendoscopy (105/129, 81.4%). Many anticipated using SP-US (63.3%) and sialendoscopy (49.6%) in their future practices.

CONCLUSION

Greater resident participation in advanced head and neck surgical procedures is associated with higher trainee satisfaction. There is a possible need for additional home institution-sponsored training courses, especially in sialendoscopy and SP-US.

LEVEL OF EVIDENCE

N/A.

Initial and Long-term Retention of Robotic Technical Skills in an Otolaryngology Residency Program

OBJECTIVES/HYPOTHESIS

To objectively assess the initial and long-term retention of robotic surgical skills of otolaryngology residents.

STUDY DESIGN

This study was performed in an academic otolaryngology residency training program. Between October 2015 and November 2016, residents were invited to complete a prospective, multiphase robotic surgical skills training course: 1) online da Vinci Surgical System Assessment and didactic, 2) faculty-supervised robotic simulator training, 3) robotic docking and draping training, 4) robotic dry-lab exercises. To optimize surgical skill retention, the training laboratory was repeated 2 weeks after the initial training session.

METHODS

Twenty otolaryngology residents were included. Primary outcome was measured as robotic skill assessment scores on three tasks: camera targeting, peg board, and needle targeting. Skill assessments were completed prior to training, between the two training sessions, and at 1 month and 6 months after training. Residents were also asked to complete a self-assessment questionnaire.

RESULTS

Camera targeting scores were improved at midtraining (P < .001) and 1-month posttraining (P = .010). Peg board scores were improved at 1 month training (P = .043). Needle targeting scores were improved at midtraining (P = .002), 1 month (P = .002), and 6 months posttraining (P < .001). Resident self-assessment scores demonstrating comfort with using the robotic console (P < .01) and docking/draping (P < .01) improved significantly following the training.

CONCLUSIONS

Following a multiphase robotic training program, otolaryngology residents demonstrated significant, objective skill acquisition and retention at 1 month and 6 months follow-up. Although the proposed training strategy may be considered an important step in otolaryngology residency training, additional innovations are being designed toward a formal robotic training curriculum.

LEVEL OF EVIDENCE

NA Laryngoscope, 129:1380-1385, 2019.