Initial and Long-term Retention of Robotic Technical Skills in an Otolaryngology Residency Program

The Otolaryngology boot camp: a scoping review evaluating commonalities and appraisal for curriculum design and delivery

OBJECTIVE

Surgical boot camps are becoming increasingly popular in Otolaryngology-Head and Neck Surgery (OHNS) residency programs. Despite pioneering virtual reality and simulation-based surgical education, these boot camps have lacked critical appraisal. The objective of this article was to examine the adoption and utility of surgical boot camps in OHNS residency training programs around the world.

DATA SOURCES

Ovid Medline and PubMed databases were systematically searched in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines for scoping reviews. Additionally, a grey literature search was performed.

REVIEW METHODS

Inclusion criteria were peer-reviewed publications and grey literature sources that reported on OHNS boot camps for the novice learner. The search was restricted to human studies published in English. Studies were excluded if they were not examining junior trainees.

RESULTS

A total of 551 articles were identified. Following removal of duplicates, screening, and full text review, 16 articles were included for analysis. Seven major boot camps were identified across various academic sites in the world. Most boot camps were one-day intensive camps incorporating a mixture of didactic, skill specific, and simulation sessions using an array of task trainers and high-fidelity simulators focusing on OHNS emergencies. Studies measuring trainee outcomes demonstrated improvement in trainee confidence, immediate knowledge, and skill acquisition.

CONCLUSION

Surgical boot camps appear to be an effective tool for short term knowledge and skill acquisition. Further studies should examine retention of skill and maintenance of confidence over longer intervals, as little is known about these lasting effects.

Safe implementation of hand held steerable laparoscopic instruments: a survey among EAES surgeons

The complexity of handheld steerable laparoscopic instruments (SLI) may impair the learning curve compared to conventional instruments when first utilized. This study aimed to provide the current state of interest in the use of SLI, the current use of these in daily practice and the type of training which is conducted before using SLI in the operating room (OR) on real patients. An online survey was distributed by European Association of Endoscopic Surgery (EAES) Executive Office to all active members, between January 4th and February 3rd, 2020. The survey consisted of 14 questions regarding the usage and training of steerable laparoscopic instruments. A total of 83 members responded, coming from 33 different countries. Twenty three percent of the respondents using SLI, were using the instruments routinely and of these 21% had not received any formal training in advance of using the instruments in real patients. Of all responding EAES members, 41% considered the instruments to potentially compromise patient safety due to their complexity, learning curve and the inexperience of the surgeons. The respondents reported the three most important aspects of a possible steerable laparoscopic instruments training curriculum to be: hands-on training, safe tissue handling and suturing practice. Finally, a major part of the respondents consider force/pressure feedback data to be of significant importance for implementation of training and assessment of safe laparoscopic and robotic surgery. Training and assessment of skills regarding safe implementation of steerable laparoscopic instruments is lacking. The respondents stressed the need for specific hands-on training during which feedback and assessment of skills should be guaranteed before operating on real patients.

Validation of a Cost-effective Cast Saw Simulation-based Educational Module to Improve Cast Removal Safety

BACKGROUND

Inexperience in cast removal in the pediatric population can lead to a range of cast saw-related injuries. The purpose of this study is to validate a simple simulation-based wax model that is both reproducible and economical while providing a valuable tool that can be used to grade cast saw use performance in trainees.

METHODS

Cylindrical wax models were used as an analog for a pediatric upper extremity. The wax models were casted in a proscribed reproducible fashion for consistency. Two groups, the first consisting of 15 experienced cast saw users and the second consisting of 15 inexperienced individuals, completed 4 sequential longitudinal cuts in the casted wax models. After removal of the cast material, marks left by the cast saw in the wax were counted and measured. Indentation length, maximum depth, and maximum width were measured on each wax model. The total length of the cast saw indentations per cast saw user was also calculated.

RESULTS

For the inexperienced cast saw users, the average total length of the cast saw indentations was 526.56 mm, average maximum depth was 1.91 mm, and average maximum width was 3.24 mm. For experienced cast saw users, the average total length of the cast saw indentations was 156.57 mm with an average maximum depth of 1.06 mm and average maximum width of 2.19 mm. Receiver operating characteristic curves of the total number of errors, total error length, maximum error depth, and maximum error width show effective discrimination of experienced from inexperienced trainees.

CONCLUSIONS

This study provides valid evidence supporting a cost-effective, time-efficient, and easily reproducible educational simulation module that can objectively measure cast saw the performance in trainees. This model demonstrates construct validity and can distinguish novice from experienced cast saw users. It is sensitive enough to identify mistakes even in the most experienced cast saw users, creating a platform that can provide performance-based feedback to cast saw users of all experience levels.

LEVEL OF EVIDENCE

Level III-diagnostic test.

A review of robotic surgical training: establishing a curriculum and credentialing process in ophthalmology

Ophthalmic surgery requires a highly dexterous and precise surgical approach to work within the small confines of the eye, and the use of robotics offers numerous potential advantages to current surgical techniques. However, there is a lag in the development of a comprehensive training and credentialing system for robotic eye surgery, and certification of robotic skills proficiency relies heavily on industry leadership. We conducted a literature review on the curricular elements of established robotics training programs as well as privileging guidelines from various institutions to outline key components in training and credentialing robotic surgeons for ophthalmic surgeries. Based on our literature review and informal discussions between the authors and other robotic ophthalmic experts, we recommend that the overall training framework for robotic ophthalmic trainees proceeds in a stepwise, competency-based manner from didactic learning, to simulation exercises, to finally operative experiences. Nontechnical skills such as device troubleshooting and interprofessional teamwork should also be formally taught and evaluated. In addition, we have developed an assessment tool based on validated global rating scales for surgical skills that may be used to monitor the progress of trainees. Finally, we propose a graduating model for granting privileges to robotic surgeons. Further work will need to be undertaken to assess the feasibility, efficacy and integrity of the training curriculum and credentialing practices for robotic ophthalmic surgery.

A National Survey of Robotic Surgery Training Among Otolaryngology-Head and Neck Surgery Residents

OBJECTIVE

The aim of this study is to describe the current state of robotic surgery training among Otolaryngology-Head and Neck Surgery (OHNS) residency programs in the United States.

METHODS

This is a national survey study among OHNS residents. All OHNS residency programs were identified via the Accreditation Council for Graduate Medical Education website. A total of 64/127 (50.3%) of OHNS programs were selected based on a random number generator. The main outcome measure was the number of OHNS residents with access to robotic surgery training and assessment of operative experience in robotic surgery among those residents.

RESULTS

A total of 140 OHNS residents participated in the survey, of which 59.3% (n = 83) were male. Response rate was 40.2%. Respondents came from middle 50.0% (n = 70), southern 17.8% (n = 25), western 17.8% (n = 25), and eastern sections 14.3% (n = 20). Most respondents (94.3%, n = 132) reported that their institution utilized a robot for head and neck surgery. Resident experience at the bedside increased in the junior years of training and console experience increased across the years particularly for more senior residents. However, 63.4% of residents reported no operative experience at the console. Only 11.4% of programs have a structured robotics training program.

CONCLUSION

This survey indicated that nearly all OHNS residencies utilize robotic surgery in their clinical practice with residents receiving little formal education in robotics or experience at the console. OHNS residencies should aim to increase access to training opportunities in order to increase resident competency.

LEVEL OF EVIDENCE

IV.

The future surgical training paradigm: Virtual reality and machine learning in surgical education

Surgical training has undergone substantial change in the last few decades. As technology and patient complexity continues to increase, demands for novel approaches to ensure competency have arisen. Virtual reality systems augmented with machine learning represents one such approach. The ability to offer on-demand training, integrate checklists, and provide personalized, surgeon-specific feedback is paving the way to a new era of surgical training. Machine learning algorithms that improve over time as they acquire more data will continue to refine the education they provide. Further, fully immersive simulated environments coupled with machine learning analytics provide real-world training opportunities in a safe atmosphere away from the potential to harm patients. Careful implementation of these technologies has the potential to increase access and improve quality of surgical training and patient care and are poised to change the landscape of current surgical training. Herein, we describe the current state of virtual reality coupled with machine learning for surgical training, future directions, and existing limitations of this technology.

Transoral Robotic Surgical Proficiency Via Real-Time Tactile Collision Awareness System

OBJECTIVES

In 2009, the Food and Drug Administration approved the use of the surgical robotic system for removal of benign and malignant conditions of the upper aerodigestive tract. This novel application of robotic-assisted surgery, termed transoral robotic surgery (TORS), places robotic instruments and camera system through the mouth to reach recessed areas of the pharynx and larynx. Over the successive decade, there was a rapid adoption of TORS with a surgical growth rate that continues to increase. Despite the rapid clinical acceptance, the field of TORS has not yet seen substantive changes or advances in the technical shortcomings, the lack of which has restricted objective TORS-specific surgical skills assessment as well as subsequent skills improvement efforts. One of the primary technical challenges of TORS is operating in a confined space, where the robotic system is maneuvered within the restrictive boundaries of the mouth and throat. Due to these confined boundaries of the pharynx, instruments can frequently collide with anatomic structures such as teeth and bone, producing anatomic collisions. Therefore, we hypothesized that anatomic collisions negatively impact TORS surgical performance. Secondarily, we hypothesized that avoidance of unwanted anatomic collisions could improve TORS surgical proficiency.

METHODS

Design and fidelity testing for a custom TORS training platform with an integrated anatomic collision-sensing system providing real-time tactile feedback is described. Following successful platform assembly and testing, validation study using the platform was carried through prospective surgical training with trial randomization. Twenty otolaryngology-head and neck surgery residents, each trainee performing three discrete mock surgical trials (n = 60), performed the initial system validation. Ten of the 20 residents were randomized to perform the surgical trials utilizing the real-time feedback system. The remaining 10 residents were randomized to perform the surgical trials without the feedback system, although the system still could record collision data. Surgical proficiency was measured by Global Evaluative Assessment of Robotic Skills (GEARS) score, time to completion, and tumor resection scores (categorical scale ranging 0-3, describing the adequacy of resection).

RESULTS

Major anatomic collisions (greater than 5N of force) negatively affected GEARS robotic skills. A mixed model analysis demonstrated that for every additional occurrence of a major collision, GEARS robotic skills assessment score would decrease by 0.29 points (P = .04). Real-time collision awareness created significantly fewer major (> 5 N) anatomic collisions with the tactile feedback system active (n = 30, mean collisions = 2.9 ± 4.2) as compared with trials without tactile feedback (n = 30, mean collisions = 12.53 ± 23.23) (P < .001). The second assessment measure of time to completion was unaffected by the presence of collisions or by the use of tactile feedback system. The third proficiency assessment was measured with tumor resection grading. Tumor resection scores was significantly (P = .02) improved with collision awareness system activated than trials without collision awareness.

CONCLUSION

In order to test our primary hypothesis, a novel TORS training platform was successfully developed that provides collision force measurements including frequency, severity, and duration of anatomic collisions. Additionally, the platform was modulated to provide real-time tactile feedback of the occurrence of out-of-field collisions. Utilizing this custom platform, our hypothesis that anatomic collisions during TORS diminishes surgical performance was supported. Additionally, our secondary hypothesis that subsequent reduction of anatomic collisions improves TORS proficiency was supported by the surgical trial. Dedicated investigation to characterize the effect size and clinical impact is required in order to translate this finding into training curriculums and into clinical utilization.

LEVEL OF EVIDENCE

II (Randomized trial) Laryngoscope, 130:S1-S17, 2020.