Comparative performance of high-fidelity training models for flexible ureteroscopy: Are all models effective?

Endoflex - the first portable virtual simulator for flexible ureterorenoscopy (fURS): pilot study

Introduction

The market for virtual reality simulators designed to simulate retrograde intrarenal kidney stone (RIRS) surgery, utilising flexible ureteroscopes, is highly limited and dominated by a handful of simulators. The objective of our research is to carry out a pilot study and to provide a description of Endoflex, a transportable virtual flexible ureterorenoscopy simulator for kidney stone treatment.

Material and methods

Seventeen novices were recruited, and each performed a virtual ureterorenoscopy with lithotripsy and lithoextraction. The cavity and location of the stone were determined randomly using the random.org portal. The same scenario was used after an educational week, to define changes in metrics. The time taken for the entire simulation, lasing time, fluoroscopic time, stone-free rate, novices' opinions regarding the usefulness of such a simulator in their training, and its impact on their motivation to continue learning endourological skills were evaluated. Three experienced endourologists were asked about the face and content validity.

Results

There was a significant decrease in simulation time, activated laser time, and fluoroscopy time. The number of novices who fully cleared the pelvicalyceal system increased from 11 to 15 (out of 17). All participants found the Endoflex simulator to be useful for their education. The face and content validity estimated was 4 each for face and content validity.

Conclusions

Endoflex is a promising VR-simulator that can be implemented in urological simulation-based training. However, further improvements are necessary for its full-fledged training of RIRS.

Role of virtual reality in improving the spatial perception of the kidney during flexible ureteroscopy: A feasibility study using virtual reality simulators and 3D models

Background

The aims were to describe a software-based reconstruction of the patient-specific kidney cavity intraluminal appearance via a head-mounted device and to estimate its feasibility for training novices.

Materials and methods

In total, 15 novices were recruited. Each novice was shown a three-dimensional reconstruction of a patient's computed tomography scan, whose kidney was printed. They then joined the surgeon in the operating room and assisted them in detecting the stone during flexible ureteroscopy on the printed model. Then, each participant did a 7-day virtual reality (VR) study followed by virtual navigation of the printed kidney model and came to the operating room to help the surgeon with ureteroscope navigation. The length of the procedure and the number of attempts to find the targeted calyx were compared.

Results

With VR training, the length of the procedure (p = 0.0001) and the number of small calyces that were incorrectly identified as containing stones were significantly reduced (p = 0.0001). All the novices become highly motivated to improve their endourological skills further. Participants noticed minimal values for nausea and for disorientation. However, oculomotor-related side effects were defined as significant. Five specialists noticed a good similarity between the VR kidney cavity representation and the real picture, strengthening the potential for the novice's education via VR training.

Conclusions

Virtual reality simulation allowed for improved spatial orientation within the kidney cavity by the novices and could be a valuable option for future endourological training and curricula.

Development and validation of a novel home-made bench-top training model for retrograde intrarenal surgery

PURPOSE

To develop and validate a low-cost homemade bench-top training model to facilitate retrograde intrarenal surgery (RIRS) training.

METHODS

The RIRS training model (G-Model) was developed using a surgical glove and a recycled ureter access sheath. Fifteen participants including 10 residents and 5 urologists were enrolled. Designed training curriculum for residents was carried out. Face validity, content validity, construct validity and criterion validity evaluation of the G-Model were carried out.

RESULTS

The global score of face and content validity was 4.15 ± 0.53 and 4.65 ± 0.29, respectively. For construct validity, the overall modified global rating scale (mGRS) score was significantly improved [12.5 (5.25) vs. 24.0 (5.25), p = 0.004], and the total task time was significantly shortened (39.5 ± 4.48 min vs. 24.1 ± 3.81 min, p < 0.001) within residents after G-Model training. The baseline mGRS score and total task time of residents were poorer than those of urologists [12.5 (5.25) vs. 32.0 (1.00), p < 0.001; 39.5 ± 4.48 min vs. 16.0 ± 1.58 min, p < 0.001]. Spearman correlation analysis revealed strong correlations between residents' G-Model and real patient performance.

CONCLUSION

The current study presented a valid low-cost easily accessible RIRS bench-top training model which could facilitate skill acquisition and translate to real-life scenario.

[Impact of simulation-based training in endourology: A systematic review of the literature]

INTRODUCTION

The impact of simulation on the acquisition of surgical skills as well as their transfer to the operating room is still debated. The objective was to assess these two specific points, focusing on the field of endourology.

METHODS

A systematic review of the literature, following the PRIMA statement, was performed using Medline database through September 2021 without time limit. Studies focusing on the impact of simulators on the acquisition of surgical technical skills as well as their transfer to the operating room in the field of endourology were included. The endourological procedures were: cystoscopy, ureteroscopy, percutaneous nephrolithotomy, endoscopic treatment of benign prostatic hyperplasia, endoscopic bladder resection.

RESULTS

Among the 11,442 publications identified, fifty-two studies were included in the analysis. The majority reported an improvement in procedure time of the requested tasks and dexterity of participants, regardless of the type of simulator and procedure. The level of evidence of included studies was often low. Few studies evaluated the transfer of acquired skills from the simulator to the operating room.

CONCLUSION

This review showed the positive impact of simulation on the acquisition of technical skills in endourology. However, in order to include proficiency-based progression in the curriculum of trainees, some parameters such as the choice of reference simulators, choice of tasks, and method of validation of acquired skills must be validated in a consensual manner to offer a quality training.

Training surgical skills on hip arthroscopy by simulation: a survey on surgeon's perspectives

Purpose

The purpose of this study is to investigate the importance of general and specific surgical skills for hip arthroscopy from the perspective of surgeons in China. Concurrently, we intend to identify the preferred type of simulation that would facilitate competency of surgical trainees in performing arthroscopy and reinforce their preparation for carrying out the actual surgical procedure.

Methods

An online survey comprising 42 questions was developed by experts in hip arthroscopy and sent to 3 online communities whose members are arthroscopic surgeons in China. The responses collected were based on a 5-point Likert scale, with an open-ended comment section. Data were analyzed using one-way AVOVA and post hoc Tukey’s test.

Results

A total of 159 valid responses from 66 junior specialist surgeons, 68 consultant surgeons, and 25 senior consultant surgeons (from 130 institutions in 27 out of 34 provincial administrative districts in China) were collected. Cognitive ability was identified as the overall most important attribute for hip arthroscopic trainees to possess, while skills relevant to the treatment of femoroacetabular impingement (FAI) were considered as the most important specific skills by the surgeons surveyed. In addition, simulation using cadaveric specimens was considered the most favorable method for surgeons to practice their surgical skills.

Conclusion

In designing a training program for hip arthroscopy, it is essential to incorporate features that evaluate cognitive skills. It would be helpful for trainees to specifically practice skills that are often used in the treatment of some very common diseases of the hip joint, such as FAI. Using high-fidelity physical models for simulation to train skills of hip arthroscopy could be an ideal alternative and effective way to overcome problems arising from the lack of accessibility to cadaveric specimens.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11548-022-02708-x.

3D printed model for flexible ureteroscopy training, a low-cost option for surgical training

INTRODUCTION

Training in experimental models is a valid option that improves the outcomes and shortens surgical learning curves. Our objective was to develop a 3D printed plastic model for teaching, training and education in flexible ureteroscopy, analyzing costs and suitability for the practice of this surgical technique.

METHODS

A 3D printed model was developed based on a CT scan from a real-life patient's upper urinary tract. Horos™ software was used for segmentation and an FDM-Ultimaker for 3D printing. Renal calyces were numbered to be identified, as in the European Association of Urology Endoscopic Stone Treatment training curriculum, Task 4. The following were used: Innovex single-use flexible ureteroscope (Palex) and nitinol baskets (Coloplast).

RESULTS

Printing time was 19 h, with a total cost of €8.77. The three-dimensional model allowed the insertion of the flexible ureteroscope and the exploration of the renal calyces by urologists in training as well as in current practice of the specialty without difficulty. The model also allowed the use of baskets and the mobilization and removal of previously placed stones.

CONCLUSION

We unveil a valid three-dimensional model for flexible ureteroscopy training exercises with reasonable costs, which will allow acquiring the necessary skills and confidence to initiate the procedure in a real-life scenario.

Simulation-Based Training Models for Urolithiasis: A Systematic Review

Objectives: Urolithiasis is one of the most common presentations in urological practice and it is becoming increasingly important to provide structured, simulation-based training using validated training models. This systematic review aims to identify current simulation-based training models and to evaluate their validity and effectiveness. Methods: Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, a comprehensive search was performed on the Medline and EMBASE databases for English language articles published between 2000 and 2018 describing and/or assessing validity of simulation models for urolithiasis procedures. Studies were qualitatively assessed for validity using the Messick validity framework and models were assigned levels of recommendation using the McGaghie model of translational outcomes. Results: A total of 98 studies were included in this study assessing 51 models, with 28 studies concerning models for urethrocystoscopy, 46 studies for ureterorenoscopy, and 39 studies for percutaneous access and/or nephrolithotomy. Only four models demonstrated a level of recommendation of 4. The most validated models were the URO/PERC-Mentor (Simbionix, Lod, Israel) with multiple studies for each across various procedural skills. Conclusion: There is a wide spectrum of simulation-based models currently available for urolithiasis procedures, mostly with limited validity evidence from small studies. Further research is required with higher levels of evidence including randomized controlled trials. In addition, long-term transfer of skills to the operating room should be assessed to establish whether there is genuine skill development and retention using simulation models and whether this helps to reduce surgical complications.

Current Status of Simulation Training in Urology: A Non-Systematic Review

Simulation has emerged as an effective solution to increasing modern constraints in surgical training. It is recognized that a larger proportion of surgical complications occur during the surgeon's initial learning curve. The simulation takes the learning curve out of the operating theatre and facilitates training in a safe and pressure-free environment whilst focusing on patient safety. The cost of simulation is not insignificant and requires commitment in funding, human resources and logistics. It is therefore important for trainers to have evidence when selecting various simulators or devices. Our non-systematic review aims to provide a comprehensive up-to-date picture on urology simulators and the evidence for their validity. It also discusses emerging technologies and future directions. Urologists should embed evidence-based simulation in training programs to shorten learning curves while maintaining patient safety and work should be directed toward a validated and agreed curriculum.

Validation of laparoscopy and flexible ureteroscopy tasks in inanimate simulation training models at a large-scale conference setting

Objective

Simulation based training with training models is being increasingly used as a tool to help trainees mount the learning curve. However, validation studies of surgical simulators are often limited by small numbers. We aim to evaluate the feasibility of validating simulation-training tasks in laparoscopy and flexible ureteroscopy (FURS) rapidly at a large-scale conference setting for residents.

Methods

Seventy-six urology residents from various Asian countries were assessed on their laparoscopic and FURS skills during the 14th Urological Association of Asia Congress 2016. Residents performed the peg transfer task from the fundamentals of laparoscopic surgery (FLS) and completed inspection of calyces and stone retrieval using a flexible ureteroscope in an endourological model. Each participant's experience (no experience, 1–30 or >30 procedures) in laparoscopy, rigid ureteroscopy (RURS) and FURS was self-reported.

Results

Median time taken to complete the laparoscopic task decreased with increasing laparoscopic experience (209 s vs. 177 s vs. 145 s, p=0.008) whereas median time taken to complete the FURS tasks reduced with increasing FURS experience (405 s vs. 250 s vs. 163 s, p=0.003) but not with RURS experience (400.5 s vs. 397 s vs. 331 s, p=0.143), demonstrating construct validity. Positive educational impact of both tasks was high, with mean ratings of 4.16/5 and 4.10/5 respectively, demonstrating face validity.

Conclusion

Our study demonstrates construct and face validities of laparoscopy and FURS simulation tasks among residents at a conference setting. Validation studies at a conference setting can be an effective avenue for evaluating simulation models and curriculum in the future.

Evaluation of the Endo-Uro trainer for semi-rigid ureteroscopy training

Background:

The aim of this study was to evaluate the validity of evidence of the Endo-Uro Trainer (SAMED, Dresden, Germany) for semi-rigid ureteroscopy.

Methods:

Novice (n = 29), intermediate-level (n = 25), and expert (n = 24) urological surgeons were recruited to participate in the study. Novices were allocated randomly to Groups A and B, where A performed two set procedures using the already validated Uro-Scopic Trainer (Limbs and Things, Bristol, UK), and Group B used the Endo-Uro trainer. Subsequently they were crossed over to perform the same two procedures using the other model. Intermediate and expert groups performed the same procedure on the Endo-Uro trainer only. Objective Structured Assessment of Technical Skills (OSATS) and the procedural times were collected and analyzed. All participants were invited to complete a final evaluation survey.

Results:

The evaluation survey revealed a realism rating in all aspects, with a mean Likert rating of 4.04/5. Significant differences were observed in performance time between novices and experts (p = 0.0014), and between intermediates and experts (p = 0.0113). OSATS scores differed significantly between all groups (p < 0.0001). Group B novices showed statistically significant improvement in performance time (p = 0.0012) and OSATS scores (p = 0.0439) after the crossover. Significant differences in performance time (p = 0.0025) between groups A and B were also observed post-crossover.

Conclusions:

This study demonstrated content validity for the Endo-Uro Trainer model. In addition, the model was shown to be capable of differentiating levels of experience, which contributes to the acceptance of the validity hypothesis. Improvement in performance using the model demonstrates its effectiveness for training.

Simulation-based flexible ureteroscopy training using a novel ureteroscopy part-task trainer

INTRODUCTION

Simulation-based training (SBT) is being increasingly used for novice trainees as a means of overcoming the early learning curve associated with new surgical skills. We designed a SBT flexible ureteroscopy (fURS) course using a novel inanimate training model (Cook Medical, Bloomington, IN; URS model). We evaluated the course and validated this Cook URS model.

METHODS

A 2-week SBT fURS course was designed for junior level urology trainees at 2 Canadian universities. The curriculum included didactic lectures, hands-on training, independent training sessions with expert feedback, and use of the Cook URS part-task model. Baseline and post-course assessments of trainee fURS skills were conducted using a standardized test task (fURS with basket manipulation of a calyceal stone). Performances were video-recorded and reviewed by 2 blinded experts using a validated assessment device.

RESULTS

Fifteen residents (postgraduate years [PGY] 0-3) participated in the course. Of the participants, 80% rated the Cook URS model as realistic (mean = 4.2/5) and 5 endourology experts rated it as useful as a training device (mean = 4.9/5), providing both face and content validity. The mean overall performance scores, task completion times, and passing ratings correlated with trainee clinical fURS experience - demonstrating construct validity for the Cook URS model. The mean post-course task completion times (15.76 vs. 9.37 minutes, p = 0.001) and overall performance scores (19.20 vs. 25.25, p = 0.007) were significantly better than at baseline. Post-course performance was better in all domains assessed by the validated assessment device.

CONCLUSIONS

This study demonstrates that a SBT curriculum for fURS can lead to improved short-term technical skills among junior level urology residents. The Cook URS model demonstrated good face, content and construct validity.

A novel cadaveric simulation program in urology

OBJECTIVE

To evaluate the urology human cadaver training program developed by the British Association of Urological Surgeons.

DESIGN

This prospective, observational comparative study recruited urology residents, with different levels of experience, in 2 sessions of a 3-day modular cadaveric operative urology training. Participants performed various procedures on fresh-frozen cadaveric specimens, as per module, supervised by certified urological surgeons. At the conclusion of each module, all residents and faculty were invited to complete an evaluation survey.

SETTING

The training days were hosted by the British Association of Urological Surgeons at the University of Manchester Surgical Skills and Simulation Centre.

PARTICIPANTS

A total of 81 urology residents were recruited, with a maximum of 14 participants attending each module, over 2 sessions. We allocated 2 participants to each cadaver with access to all necessary equipment and guidance.

RESULTS

A total of 102 evaluation surveys were received from the trainees and faculty; a response rate of 94%. All procedures scored a mean of 3 on 5 for face validity, which is higher than the acceptability range. Regarding content validity, participants and faculty rated all aspects ≥3 on 5. Respondents held a positive view of the cadaver sessions and believed them to be useful for learning anatomy and steps of an operation (mean = 4.54) and as a confidence booster for performing a procedure (mean = 4.33). Furthermore, it was thought that the training program significantly improved skills (mean = 4.11), gave transferrable skills for the operating room (mean = 4.21), and was feasible to be incorporated into training programs (mean = 4.29). Human cadaveric simulation was rated as the best mode of simulation-based training for all the procedures in the curriculum.

CONCLUSIONS

This study on cadaveric simulation training demonstrated face and content validities. It also showed feasibility, acceptability, a high value for educational influence and cost-effectiveness for cadaveric simulation. A simulation-based training pathway has been proposed for effective procedural training in urology.

Simulation-based ureteroscopy training: a systematic review

OBJECTIVE

Simulation is a common adjunct to operative training and various modalities exist for ureteroscopy. This systematic review aims the following: (1) to identify available ureteroscopy simulators, (2) to explore evidence for their effectiveness using characteristic criterion, and (3) to provide recommendations for simulation-based ureteroscopy training.

DESIGN

The preferred reporting items for systematic reviews and meta-analysis statement guidelines were used. A literature search was performed using the PubMed, EMBASE, and Cochrane Library databases.

RESULTS

In total, 20 articles concerning ureteroscopy simulators were included. Overall, 3 high-fidelity bench models are available. The Uro-Scopic Trainer has demonstrated face, construct, and concurrent validity, whereas the Scope Trainer has undergone content, construct, and predictive validation. The adult ureteroscopy trainer has demonstrated face, content, and construct validity. The URO Mentor is the only available ureteroscopy virtual-reality system; 10 studies were identified demonstrating its face, content, construct, concurrent, and predictive validity. The Uro-Scopic Trainer, the Scope Trainer, and the URO Mentor have demonstrated high educational impact. A noncommercially available, low-fidelity model has demonstrated effectiveness comparable to its high-fidelity counterpart at 185 times lesser than the price of the Uro-Scopic Trainer. The use of porcine models has also been described in 3 studies but require further study.

CONCLUSIONS

Valid models are available for simulation-based ureteroscopy training. However, there is a lack of many high-level studies conducted, and further investigation is required in this area. Furthermore, current research focuses on the technical skills acquisition with little research conducted on nontechnical skills acquisition within ureteroscopy. The next step for ureteroscopy training is a formalized and validated curriculum, incorporating simulation, training models, development of nontechnical skills, and real-life practice.