Systematic review of augmented reality in urological interventions: the evidences of an impact on surgical outcomes are yet to come

Dual-camera laparoscopic imaging with super-resolution reconstruction for intraoperative hyperspectral image guidance

Laparoscopic and robotic surgery, as one type of minimally invasive surgery (MIS), has gained popularity due to the improved surgeon ergonomics, instrument precision, operative time, and postoperative recovery. Hyperspectral imaging (HSI) is an emerging medical imaging modality, which has proved useful for intraoperative image guidance. Snapshot hyperspectral cameras are ideal for intraoperative laparoscopic imaging because of their compact size and light weight, but low spatial resolution can be a limitation. In this work, we developed a dual-camera laparoscopic imaging system that consists of a high-resolution color camera and a snapshot hyperspectral camera, and we employed super-resolution reconstruction to fuse the images from both cameras to generate high-resolution hyperspectral images. The experimental results show that our method can significantly improve the resolution of hyperspectral images without compromising the image quality or spectral signatures. The proposed super-resolution reconstruction method is promising to promote the employment of high-speed hyperspectral imaging in laparoscopic surgery.

3D-Image guided robotic-assisted partial nephrectomy: a multi-institutional propensity score-matched analysis (UroCCR study 51)

PURPOSE

Robot-assisted partial nephrectomy (RAPN) is a difficult procedure with risk of significant perioperative complications. The objective was to evaluate the impact of preoperative planning and intraoperative guidance with 3D model reconstructions on perioperative outcomes of RAPN.

METHODS

We conducted a retrospective analysis of all patients who underwent RAPN for kidney tumor by three high-volume expert surgeons from academic centers. Clinical data were collected prospectively after written consent into the French kidney cancer network database UroCCR (CNIL-DR 2013-206; NCT03293563). Our cohort was divided into two groups: 3D-Image guided RAPN group (3D-IGRAPN) and control group. A propensity score according to age, pre-operative renal function and RENAL tumor complexity score was used. Both surgical techniques were compared in terms of perioperative outcomes.

RESULTS

The initial study cohort included 230 3D-IGRAPN and 415 control RAPN. Before propensity-score matching, patients in the 3D-IGRAPN group had a larger tumor (4.3 cm vs. 3.5 cm, P < 0.001) and higher RENAL complexity score (9 vs. 8, P < 0.001). Following propensity-score matching, there were 157 patients in both groups. The rate of major complications was lower for patients in the 3D-IGRAPN group (3.8% vs. 9.5%, P = 0.04). The median percentage of eGFR variation recorded at first follow-up was lower in the 3D-IGRAPN group (- 5.6% vs. - 10.5%, P = 0.002). The trifecta achievement rate was higher in the 3D-IGRAPN group (55.7% vs. 45.1%; P = 0.005).

CONCLUSION

Three-dimensional kidney reconstructions use for pre-operative planning and intraoperative surgical guidance lowers the risk of complications and improve perioperative clinical outcomes of RAPN.

Clinical Applications of Machine Learning for Urolithiasis and Benign Prostatic Hyperplasia: A Systematic Review

INTRODUCTION

Previous systematic reviews related to machine learning (ML) in urology often overlooked the literature related to endourology. Therefore, we aim to conduct a more focused systematic review examining the use of ML algorithms for benign prostatic hyperplasia (BPH) or urolithiasis. In addition, we are the first group to evaluate these articles using the STREAM-URO framework.

METHODS

Searches of MEDLINE, Embase, and the Cochrane CENTRAL databases were conducted from inception through July 12, 2021. Keywords included those related to ML, endourology, urolithiasis, and BPH. Two reviewers screened the citations that were eligible for title, abstract and full-text screening, with conflicts resolved by a third reviewer. Two reviewers extracted information from the studies, with discrepancies resolved by a third reviewer. The data collected was then qualitatively synthesized by consensus. Two reviewers evaluated each article according to the STREAM-URO checklist with discrepancies resolved by a third reviewer.

RESULTS

After identifying 459 unique citations, 63 articles were retained for data extraction. Most articles consisted of tabular (n=32) and computer vision (n=23) tasks. The two most common problem types were classification (n=40) and regression (n=12). In general, most studies utilized neural networks as their ML algorithm (n=36). Among the 63 studies retrieved, 58 were related to urolithiasis and five focused on BPH. The urolithiasis studies were designed for outcome prediction (n=20), stone classification (n=18), diagnostics (n=17), and therapeutics (n=3). The BPH studies were designed for outcome prediction (n=2), diagnostics (n=2), and therapeutics (n=1). On average, the urolithiasis and BPH articles met 13.8 (SD 2.6), and 13.4 (4.1) of the 26 STREAM-URO framework criteria, respectively.

CONCLUSIONS

The majority of the retrieved studies successfully helped with outcome prediction, diagnostics, and therapeutics for both urolithiasis and BPH. While ML shows great promise in improving patient care, it is important to adhere to the recently developed STREAM-URO framework to ensure the development of high-quality ML studies.

Mixed Reality in der Gefäßchirurgie – ein Scoping Review

Hintergrund „Mixed Reality“ (MR) erlaubt die Projektion von virtuellen Objekten in das Sichtfeld des Anwenders durch ein Head-mounted Display (HMD). Im gefäßchirurgischen Behandlungsspektrum könnten MR-Anwendungen in Zukunft einen Nutzen darstellen. Im folgenden Scoping Review soll eine Orientierung über die aktuelle Anwendung der genannten Technologien im Bereich der Gefäßchirurgie gegeben und Forschungsziele für die Zukunft definiert werden. Material und Methoden Es erfolgte eine systematische Literaturrecherche in PubMed (MEDLINE) mit den Suchbegriffen „aorta“, „intervention“, „endovsacular intervention“, „vascular surgery“, „aneurysm“, „endovascular“, „vascular access“ jeweils in Kombination mit „mixed reality“ oder „augmented reality“. Die Suche erfolgte nach PRISMA-Leitlinie (Preferred Reporting Items for Systematic reviews and Meta-Analyses) für Scoping Reviews. Ergebnisse Aus 547 Literaturstellen konnten 8 relevante Studien identifiziert werden. Die Suchergebnisse konnten in 2 Anwendungskategorien eingeteilt werden: (1) MR mit dem Ziel des Informationsmanagements und zur Verbesserung der periprozeduralen Ergonomie gefäßchirurgischer Eingriffe (n = 3) sowie (2) MR mit dem Ziel der intraoperativen Navigation bei gefäßchirurgischen Eingriffen (n = 5). Die Registrierung des physischen Patienten mit dem virtuellen Objekt und das Tracking von Instrumenten in der MR-Umgebung zur intraoperativen Navigation ist dabei im Fokus des wissenschaftlichen Interesses und konnte technisch erfolgreich am Phantom- und Tiermodell gezeigt werden. Die bisher vorgestellten Methoden sind jedoch mit hohem infrastrukturellem Aufwand und relevanten Limitationen verbunden. Schlussfolgerung Der Einsatz von MR im Bereich der Gefäßchirurgie ist grundsätzlich vielversprechend. Für die Zukunft sollten alternative, pragmatische Registrierungsmethoden mit entsprechender Quantifizierung des Positionierungsfehlers angestrebt werden. Die entwickelten Soft- und Hardwarelösungen sollten auf das Anforderungsprofil der Gefäßchirurgie angepasst werden. Das elektromagnetische Instrumenten-Tracking erscheint als sinnvolle, komplementäre Technologie zur Umsetzung der MR-assistierten Navigation.

Fluorescence-Guided Surgery and Novel Innovative Technologies for Improved Visualization in Pediatric Urology

Fluorescence-guided surgery (FGS), three-dimensional (3D) imaging technologies, and other innovative devices are rapidly revolutionizing the field of urology, providing surgeons with powerful tools for a more complete understanding of patient-specific anatomy. Today, several new intraoperative imaging technologies and cutting-edge devices are available in adult urology to assist surgeons in delivering personalized interventions. Their applications are also gradually growing in general pediatric surgery, where the detailed visualization of normal and pathological structures has the potential to significantly minimize perioperative complications and improve surgical outcomes. In the field of pediatric urology, FGS, 3D reconstructions and printing technologies, augmented reality (AR) devices, contrast-enhanced ultrasound (CEUS), and intraoperative magnetic resonance imaging (iMRI) have been increasingly adopted for a more realistic understanding of the normal and abnormal anatomy, providing a valuable insight to deliver customized treatments in real time. This narrative review aims to illustrate the main applications of these new technologies and imaging devices in the clinical setting of pediatric urology by selecting, with a strict methodology, the most promising articles published in the international scientific literature on this topic. The purpose is to favor early adoption and stimulate more research on this topic for the benefit of children.

Stone disease in low-middle income countries. Could augmented reality have a role in its management?

Urolithiasis is a global phenomenon. Cystolithiasis is common in parts of Africa due to low protein intake and dehydration from endemic diarrhoeal illnesses. Nephrolithiasis is less prevalent than in high income countries, probably due to a variety of lifestyle issues, such as a more elemental diet, higher physical activity and less obesity. Although renal stones are less common in low-middle income countries (LMICs), the social and economic impacts of nephrolithiasis are still considerable; many stones present late or with complications such as upper urinary tract obstruction or urosepsis. These may lead to the development of chronic kidney disease, or end-stage renal failure in a small proportion of cases, conditions for which there is very poor provision in most LMICs. Early treatment of nephrolithiasis by the least invasive method possible can, however, reduce the functional consequences of urinary stone disease. Although ESWL is uncommon, and endoscopic interventions for stone are not widespread in most of Africa, percutaneous nephrolithomy and ureteroscopic renal surgery are viable techniques in those regional centres with infrastructure to support them. Longitudinal mentoring has been shown to be a key step in the adoption of these minimally invasive procedures by local surgeons, something that has been difficult during the COVID-19 pandemic due to travel restriction. Augmented reality (AR) technology is an alternative means of providing remote mentoring, something that has been trialled by Urolink, the MediTech Trust and other global non-governmental organisations during this period. Our preliminary experience suggests that this is a viable technique for promulgating skills in LMICs where appropriate connectivity exists to support remote communication. AR may also have long term promise for decreasing the reliance upon short-term surgical visits to consolidate competence, thereby reducing the carbon footprint of global surgical education.

Assessment of a novel smartglass-based point-of-care fusion approach for mixed reality-assisted targeted prostate biopsy: A pilot proof-of-concept study

Purpose

While several biopsy techniques and platforms for magnetic resonance imaging (MRI)-guided targeted biopsy of the prostate have been established, none of them has proven definite superiority. Augmented and virtual reality (mixed reality) smartglasses have emerged as an innovative technology to support image-guidance and optimize accuracy during medical interventions. We aimed to investigate the benefits of smartglasses for MRI-guided mixed reality-assisted cognitive targeted biopsy of the prostate.

Methods

For prospectively collected patients with suspect prostate PIRADS lesions, multiparametric MRI was uploaded to a smartglass (Microsoft® Hololens I), and smartglass-assisted targeted biopsy (SMART TB) of the prostate was executed by generation of a cognitive fusion technology at the point-of-care. Detection rates of prostate cancer (PCA) were compared between SMART TB and 12-core systematic biopsy. Assessment of SMART-TB was executed by the two performing surgeons based on 10 domains on a 10-point scale ranging from bad (1) to excellent (10).

Results

SMART TB and systematic biopsy of the prostate were performed for 10 patients with a total of 17 suspect PIRADS lesions (PIRADS 3, n = 6; PIRADS 4, n = 6; PIRADS 5, n = 5). PCA detection rate per core was significant (p < 0.05) higher for SMART TB (47%) than for systematic biopsy (19%). Likelihood for PCA according to each core of a PIRADS lesion (17%, PIRADS 3; 58%, PIRADS 4; 67%, PIRADS 5) demonstrated convenient accuracy. Feasibility scores for SMART TB were high for practicality (10), multitasking (10), execution speed (9), comfort (8), improvement of surgery (8) and image quality (8), medium for physical stress (6) and device handling (6) and low for device weight (5) and battery autonomy (4).

Conclusion

SMART TB has the potential to increase accuracy for PCA detection and might enhance cognitive MRI-guided targeted prostate biopsy in the future.

Smartglass augmented reality-assisted targeted prostate biopsy using cognitive point-of-care fusion technology

INTRODUCTION

MRI-guided targeted biopsy has become standard of care for diagnosis of prostate cancer, with establishment of several biopsy techniques and platforms. Augmented reality smart glasses have emerged as novel technology to support image-guided interventions. We aimed to investigate its usage while prostate biopsy.

METHODS

MRI with PIRADS-lesions ≥3 was uploaded to smart glasses (Vuzix Blade^R ) and augmented reality smart glasses-assisted targeted biopsy (SMART-TB) of the prostate was performed using cognitive fusion technology at the point of care. Detection rates were compared to systematic biopsy. Feasibility for SMART-TB was assessed (10 domains from bad [1] to excellent [10]).

RESULTS

SMART-TB was performed for four patients. Prostate cancer detection was more likely for SMART-TB (46%; 13/28) than for systematic biopsy (27%; 13/48). Feasibility scores were high [8-10] for practicality, multitasking, execution speed, comfort and device weight and low [1-4] for handling, battery and image quality. Median execution time: 28 min; Investment cost smart glass: 1017 USD.

CONCLUSION

First description of SMART-TB demonstrated convenient feasibility. This novel technology might enhance diagnosis of prostate cancer in future.

"Augmented reality" applications in urology: a systematic review

INTRODUCTION

Augmented reality (AR) applied to surgical procedures refers to the superimposition of preoperative or intra-operative images onto the operative field. Augmented reality has been increasingly used in myriad surgical specialties including Urology. The following study reviews advances in the use of AR for improvements in urologic outcomes.

EVIDENCE ACQUISITION

We identified all descriptive, validity, prospective randomized/nonrandomized trials and retrospective comparative/noncomparative studies about the use of AR in Urology up until March 2021. The MEDLINE, Scopus, and Web of Science databases were used for literature search. We conducted the study selection according to the PRISMA (Preferred Reporting Items for Systematic Reviews and meta-analysis statement) guidelines. We limited included studies to only those using AR, excluding all that used virtual reality technology.

EVIDENCE SYNTHESIS

A total of 60 studies were identified and included in the present analysis. Overall, 19 studies were descriptive/validity/phantom studies for specific AR methodologies, 4 studies were case reports, and 37 studies included clinical prospective/retrospective comparative studies.

CONCLUSIONS

Advances in AR have led to increasing registration accuracy as well as increased ability to identify anatomic landmarks and improve outcomes during Urologic procedures such as RARP and robot-assisted partial nephrectomy.

The current and possible future role of 3D modelling within oesophagogastric surgery: a scoping review

BACKGROUND

3D reconstruction technology could revolutionise medicine. Within surgery, 3D reconstruction has a growing role in operative planning and procedures, surgical education and training as well as patient engagement. Whilst virtual and 3D printed models are already used in many surgical specialities, oesophagogastric surgery has been slow in their adoption. Therefore, the authors undertook a scoping review to clarify the current and future roles of 3D modelling in oesophagogastric surgery, highlighting gaps in the literature and implications for future research.

METHODS

A scoping review protocol was developed using a comprehensive search strategy based on internationally accepted guidelines and tailored for key databases (MEDLINE, Embase, Elsevier Scopus and ISI Web of Science). This is available through the Open Science Framework (osf.io/ta789) and was published in a peer-reviewed journal. Included studies underwent screening and full text review before inclusion. A thematic analysis was performed using pre-determined overarching themes: (i) surgical training and education, (ii) patient education and engagement, and (iii) operative planning and surgical practice. Where applicable, subthemes were generated.

RESULTS

A total of 56 papers were included. Most research was low-grade with 88% (n = 49) of publications at or below level III evidence. No randomised control trials or systematic reviews were found. Most literature (86%, n = 48) explored 3D reconstruction within operative planning. These were divided into subthemes of pre-operative (77%, n = 43) and intra-operative guidance (9%, n = 5). Few papers reported on surgical training and education (14%, n = 8), and were evenly subcategorised into virtual reality simulation (7%, n = 4) and anatomical teaching (7%, n = 4). No studies utilising 3D modelling for patient engagement and education were found.

CONCLUSION

The use of 3D reconstruction is in its infancy in oesophagogastric surgery. The quality of evidence is low and key themes, such as patient engagement and education, remain unexplored. Without high quality research evaluating the application and benefits of 3D modelling, oesophagogastric surgery may be left behind.

Technology Behavior Model—Beyond Your Sight with Extended Reality in Surgery

Extended Reality Smart Glasses is a new pattern that uses extended reality technology to present a visual environment that combines the physical and virtual worlds. However, the surgical technique using Smart Glasses implementation is still unknown, to the infancy in clinical surgery, derived to the limits of existing technology. This study researched the acceptability and possibility of XRSG for medical experts. It combines human seen behavioral control with information technology research to construct a new “Extended Reality Technology Behavior Model” using method Technology Acceptance Model and Theory of Planned Behavior. To improve the accuracy of the study, statistical analysis, exploratory analysis, and cross-sectional research triangulation were used to collect data in five hospitals in Malaysia using a convenience sampling method and a questionnaire on behavioral influences. From the collected data, PLS-SEM analysis was used to reflect the relationship between variables. The strong positive results suggest that using XRSG by medical experts helps to improve the composition, interactivity, standardization, and clarity of medical images, resulting in increased efficiency and reduced procedure time and felt the usefulness and ease of use of XRSG through their behavior, providing a basis for technology acceptance in surgery.

Methods and Applications of 3D Patient-Specific Virtual Reconstructions in Surgery

3D modelling has been highlighted as one of the key digital technologies likely to impact surgical practice in the next decade. 3D virtual models are reconstructed using traditional 2D imaging data through either direct volume or indirect surface rendering. One of the principal benefits of 3D visualisation in surgery relates to improved anatomical understanding-particularly in cases involving highly variable complex structures or where precision is required.Workflows begin with imaging segmentation which is a key step in 3D reconstruction and is defined as the process of identifying and delineating structures of interest. Fully automated segmentation will be essential if 3D visualisation is to be feasibly incorporated into routine clinical workflows; however, most algorithmic solutions remain incomplete. 3D models must undergo a range of processing steps prior to visualisation, which typically include smoothing, decimation and colourization. Models used for illustrative purposes may undergo more advanced processing such as UV unwrapping, retopology and PBR texture mapping.Clinical applications are wide ranging and vary significantly between specialities. Beyond pure anatomical visualisation, 3D modelling offers new methods of interacting with imaging data; enabling patient-specific simulations/rehearsal, Computer-Aided Design (CAD) of custom implants/cutting guides and serves as the substrate for augmented reality (AR) enhanced navigation.3D may enable faster, safer surgery with reduced errors and complications, ultimately resulting in improved patient outcomes. However, the relative effectiveness of 3D visualisation remains poorly understood. Future research is needed to not only define the ideal application, specific user and optimal interface/platform for interacting with models but also identify means by which we can systematically evaluate the efficacy of 3D modelling in surgery.

[Virtual and augmented reality in urology]

Zwar haben jeher technologische Weiterentwicklungen die medizinische Versorgung in deren stetigem Wandel optimiert, so waren diese jedoch immer noch für den Anwender weitestgehend fassbar. Getrieben durch immense finanzielle Anstrengungen sind innovative Produkte und technische Lösungen entstanden, die den medizinischen Alltag transformieren und diesen in Zukunft um eine Dimension erweitern werden: die Virtual und Augmented Reality. Dieser Übersichtsartikel fasst die aktuellen wissenschaftlichen Projekte und den zukünftigen Nutzen von Virtual und Augmented Reality im Fachgebiet der Urologie zusammen.

Three-dimensional Model Reconstruction: The Need for Standardization to Drive Tailored Surgery

The clinical utility of three-dimensional virtual models has been widely explored for preoperative planning, patient counseling, surgical training, and intraoperative navigation. There is now a need for standardized methodology for construction of these models so that their utility can be realized in routine practice to achieve the goal of individualized treatment for patients.

SERV-CT: A disparity dataset from cone-beam CT for validation of endoscopic 3D reconstruction

•

Full torso porcine CT model for stereo-endoscopic reconstruction validation

•

CT of endoscope and anatomy with constrained manual alignment provides a reference

•

Accuracy analysis of repeated alignments and performance of existing algorithms presented

•

Open sourced dataset for stereo reconstruction validation

In computer vision, reference datasets from simulation and real outdoor scenes have been highly successful in promoting algorithmic development in stereo reconstruction. Endoscopic stereo reconstruction for surgical scenes gives rise to specific problems, including the lack of clear corner features, highly specular surface properties and the presence of blood and smoke. These issues present difficulties for both stereo reconstruction itself and also for standardised dataset production. Previous datasets have been produced using computed tomography (CT) or structured light reconstruction on phantom or ex vivo models. We present a stereo-endoscopic reconstruction validation dataset based on cone-beam CT (SERV-CT). Two ex vivo small porcine full torso cadavers were placed within the view of the endoscope with both the endoscope and target anatomy visible in the CT scan. Subsequent orientation of the endoscope was manually aligned to match the stereoscopic view and benchmark disparities, depths and occlusions are calculated. The requirement of a CT scan limited the number of stereo pairs to 8 from each ex vivo sample. For the second sample an RGB surface was acquired to aid alignment of smooth, featureless surfaces. Repeated manual alignments showed an RMS disparity accuracy of around 2 pixels and a depth accuracy of about 2 mm. A simplified reference dataset is provided consisting of endoscope image pairs with corresponding calibration, disparities, depths and occlusions covering the majority of the endoscopic image and a range of tissue types, including smooth specular surfaces, as well as significant variation of depth. We assessed the performance of various stereo algorithms from online available repositories. There is a significant variation between algorithms, highlighting some of the challenges of surgical endoscopic images. The SERV-CT dataset provides an easy to use stereoscopic validation for surgical applications with smooth reference disparities and depths covering the majority of the endoscopic image. This complements existing resources well and we hope will aid the development of surgical endoscopic anatomical reconstruction algorithms.

Laparoscopic augmented reality registration for oncological resection site repair

PURPOSE

Resection site repair during laparoscopic oncological surgery (e.g. laparoscopic partial nephrectomy) poses some unique challenges and opportunities for augmented reality (AR) navigation support. This work introduces an AR registration workflow that addresses the time pressure that is present during resection site repair.

METHODS

We propose a two-step registration process: the AR content is registered as accurately as possible prior to the tumour resection (the primary registration). This accurate registration is used to apply artificial fiducials to the physical organ and the virtual model. After the resection, these fiducials can be used for rapid re-registration (the secondary registration). We tested this pipeline in a simulated-use study with [Formula: see text] participants. We compared the registration accuracy and speed for our method and for landmark-based registration as a reference.

RESULTS

Acquisition of and, thereby, registration with the artificial fiducials were significantly faster than the initial use of anatomical landmarks. Our method also had a trend to be more accurate in cases in which the primary registration was successful. The accuracy loss between the elaborate primary registration and the rapid secondary registration could be quantified with a mean target registration error increase of 2.35 mm.

CONCLUSION

This work introduces a registration pipeline for AR navigation support during laparoscopic resection site repair and provides a successful proof-of-concept evaluation thereof. Our results indicate that the concept is better suited than landmark-based registration during this phase, but further work is required to demonstrate clinical suitability and applicability.

Effectiveness of the Use of Augmented Reality in Teaching the Management of Anaphylactic Shock at the Primary Care Level: Protocol for a Randomized Controlled Trial

BACKGROUND

Augmented reality (AR) has benefits and feasibility in emergency medicine, especially in the clinical care of patients, in operating rooms and inpatient facilities, and in the education and training of emergency care providers, but current research on this topic is sparse.

OBJECTIVE

The primary objective is to evaluate the short-term and long-term effectiveness of the use of AR in the treatment of patients with anaphylactic shock. The secondary objectives are to evaluate the safety in the treatment of patients with anaphylactic shock, evaluate the short-term and long-term effectiveness of stress management in this process, and determine the experiences and attitudes towards the use of AR in education.

METHODS

The study will be conducted in 3 phases. In the first phase, we will develop and test the scenario for simulation of anaphylactic shock and the evaluation scale for assessing the effect of the intervention. In the second phase, a single-blinded, randomized controlled trial will be conducted. In the third phase, the use of AR in teaching the management of anaphylactic shock using focus groups will be evaluated qualitatively. All participants will participate in a 1-day training program consisting of a lecture on emergency care and anaphylactic shock as well as exercises in manual dexterity (aspiration, airway management, alternative airway management, artificial respiration, chest compressions, safe defibrillation, oxygen application, use of medication during emergency care). The test group will also focus on education about anaphylactic shock in AR (the intervention). The main outcome will be the evaluation of the participants' performance in coping with a simulated scenario of anaphylactic shock using a high-fidelity simulator (simulator with high levels of realism) and a standardized patient in an educational and clinical environment. The study will be conducted with primary care physicians.

RESULTS

A scenario for the simulation with a high-fidelity simulator and standardized patient has already been developed. For the time being, we are developing an evaluation scale and starting to recruit participants. We plan to complete the recruitment of participants by the end of December 2020, start the randomized controlled trial in January 2021, and finish 1 year later. The first results are expected to be submitted for publication in 2021.

CONCLUSIONS

This will be the first study to evaluate the effectiveness of the use of AR in medical teaching. Specifically, it will be based on a clinical case of anaphylactic shock at the primary care level. With our study, we also want to evaluate the translation of these educational results into clinical practice and assess their long-term impact.

TRIAL REGISTRATION

ISRCTN Registry ISRCTN58047410; http://www.isrctn.com/ISRCTN58047410.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/22460.

Real-time Augmented Reality Three-dimensional Guided Robotic Radical Prostatectomy: Preliminary Experience and Evaluation of the Impact on Surgical Planning

BACKGROUND

Augmented reality (AR) is a novel technology adopted in prostatic surgery.

OBJECTIVE

To evaluate the impact of a 3D model with AR (AR-3D model), to guide nerve sparing (NS) during robot-assisted radical prostatectomy (RARP), on surgical planning.

DESIGN, SETTING, AND PARTICIPANTS

Twenty-six consecutive patients with diagnosis of prostate cancer (PCa) and multiparametric magnetic resonance imaging (mpMRI) results available were scheduled for AR-3D NS RARP.

INTERVENTION

Segmentation of mpMRI and creation of 3D virtual models were achieved. To develop AR guidance, the surgical DaVinci video stream was sent to an AR-dedicated personal computer, and the 3D virtual model was superimposed and manipulated in real time on the robotic console.

OUTCOME MEASUREMENTS AND STATISTICAL ANALYSIS

The concordance of localisation of the index lesion between the 3D model and the pathological specimen was evaluated using a prostate map of 32 specific areas. A preliminary surgical plan to determinate the extent of the NS approach was recorded based on mpMRI. The final surgical plan was reassessed during surgery by implementation of the AR-3D model guidance.

RESULTS AND LIMITATIONS

The positive surgical margin (PSM) rate was 15.4% in the overall patient population; three patients (11.5%) had PSMs at the level of the index lesion. AR-3D technology changed the NS surgical plan in 38.5% of men on patient-based and in 34.6% of sides on side-based analysis, resulting in overall appropriateness of 94.4%. The 3D model revealed 70%, 100%, and 92% of sensitivity, specificity, and accuracy, respectively, at the 32-area map analysis.

CONCLUSIONS

AR-3D guided surgery is useful for improving the real-time identification of the index lesion and allows changing of the NS approach in approximately one out of three cases, with overall appropriateness of 94.4%.

PATIENT SUMMARY

Augmented reality three-dimensional guided robot-assisted radical prostatectomy allows identification of the index prostate cancer during surgery, to tailor the surgical dissection to the index lesion and to change the extent of nerve-sparing dissection.

Current Status of Simulation Training in Urology: A Non-Systematic Review

Simulation has emerged as an effective solution to increasing modern constraints in surgical training. It is recognized that a larger proportion of surgical complications occur during the surgeon's initial learning curve. The simulation takes the learning curve out of the operating theatre and facilitates training in a safe and pressure-free environment whilst focusing on patient safety. The cost of simulation is not insignificant and requires commitment in funding, human resources and logistics. It is therefore important for trainers to have evidence when selecting various simulators or devices. Our non-systematic review aims to provide a comprehensive up-to-date picture on urology simulators and the evidence for their validity. It also discusses emerging technologies and future directions. Urologists should embed evidence-based simulation in training programs to shorten learning curves while maintaining patient safety and work should be directed toward a validated and agreed curriculum.

Clinical predictors and significance of adherent perinephric fat assessed with Mayo Adhesive Probability (MAP) score and perinephric fat surface density (PnFSD) at the time of partial nephrectomy for localized renal mass. A single high-volume referral center experience

BACKGROUND

Adherent perinephric fat (APF) could negatively influence surgical outcomes of partial nephrectomy (PN). Novel radiological scores have been introduced to preoperatively detect APF, i.e. Mayo Adhesive Probability (MAP) score and perinephric fat surface density (PnFSD). We aimed to evaluate clinical predictors of APF and the association of MAP and PnFSD with perioperative outcomes after PN.

METHODS

Clinical and radiological data of patients undergoing open or robotic PN were prospectively gathered. Perinephric fat was retrospectively measured by a single expert uro-radiologist. Patients were divided into MAP 0-3 vs. MAP 4-5 and high vs. low PnFSD. Multivariable analysis was performed to seek for clinical predictors of APF.

RESULTS

Overall, 175 patients were entered. Patients with vs. without APF were significantly different regarding age, gender, ASA score, Charlson Comorbidity Index, Body Mass Index, waist circumference, HDL status and metabolic syndrome. Conversely, tumor-related characteristics were not significantly different between the groups. At multivariable analysis, metabolic syndrome was confirmed as the only independent predictor of APF (OR: 24.9; P<0.001). Notably, APF assessed by MAP score or PnFSD was not associated with perioperative outcomes after PN.

CONCLUSIONS

In experienced hands, APF did not impact on intra- or perioperative outcomes after PN. Metabolic syndrome was the only significant predictor of APF in our series.

Optimization of virtual and real registration technology based on augmented reality in a surgical navigation system

Background

The traditional navigation interface was intended only for two-dimensional observation by doctors; thus, this interface does not display the total spatial information for the lesion area. Surgical navigation systems have become essential tools that enable for doctors to accurately and safely perform complex operations. The image navigation interface is separated from the operating area, and the doctor needs to switch the field of vision between the screen and the patient’s lesion area. In this paper, augmented reality (AR) technology was applied to spinal surgery to provide more intuitive information to surgeons. The accuracy of virtual and real registration was improved via research on AR technology. During the operation, the doctor could observe the AR image and the true shape of the internal spine through the skin.

Methods

To improve the accuracy of virtual and real registration, a virtual and real registration technique based on an improved identification method and robot-assisted method was proposed. The experimental method was optimized by using the improved identification method. X-ray images were used to verify the effectiveness of the puncture performed by the robot.

Results

The final experimental results show that the average accuracy of the virtual and real registration based on the general identification method was 9.73 ± 0.46 mm (range 8.90–10.23 mm). The average accuracy of the virtual and real registration based on the improved identification method was 3.54 ± 0.13 mm (range 3.36–3.73 mm). Compared with the virtual and real registration based on the general identification method, the accuracy was improved by approximately 65%. The highest accuracy of the virtual and real registration based on the robot-assisted method was 2.39 mm. The accuracy was improved by approximately 28.5% based on the improved identification method.

Conclusion

The experimental results show that the two optimized methods are highly very effective. The proposed AR navigation system has high accuracy and stability. This system may have value in future spinal surgeries.

Image Overlay Surgery Based on Augmented Reality: A Systematic Review

Augmented Reality (AR) applied to surgical guidance is gaining relevance in clinical practice. AR-based image overlay surgery (i.e. the accurate overlay of patient-specific virtual images onto the body surface) helps surgeons to transfer image data produced during the planning of the surgery (e.g. the correct resection margins of tissue flaps) to the operating room, thus increasing accuracy and reducing surgery times. We systematically reviewed 76 studies published between 2004 and August 2018 to explore which existing tracking and registration methods and technologies allow healthcare professionals and researchers to develop and implement these systems in-house. Most studies used non-invasive markers to automatically track a patient's position, as well as customised algorithms, tracking libraries or software development kits (SDKs) to compute the registration between patient-specific 3D models and the patient's body surface. Few studies combined the use of holographic headsets, SDKs and user-friendly game engines, and described portable and wearable systems that combine tracking, registration, hands-free navigation and direct visibility of the surgical site. Most accuracy tests included a low number of subjects and/or measurements and did not normally explore how these systems affect surgery times and success rates. We highlight the need for more procedure-specific experiments with a sufficient number of subjects and measurements and including data about surgical outcomes and patients' recovery. Validation of systems combining the use of holographic headsets, SDKs and game engines is especially interesting as this approach facilitates an easy development of mobile AR applications and thus the implementation of AR-based image overlay surgery in clinical practice.

Novel Education and Simulation Tools in Urologic Training

PURPOSE OF REVIEW

Postgraduate medical training has evolved considerably from an emphasis on hands-on, autonomous learning to a paradigm where simulation technologies are used to introduce and augment certain skill sets. This review is intended to provide an update on surgical simulators and tools for urological trainee education.

RECENT FINDINGS

We provide an overview of simulation platforms for robotics, endoscopy, and laparoscopic practice and training. In general, these simulators provide face, content, and construct validity. Various educational and evaluation tools have been adopted. Simulation platforms have been developed for technical and non-technical surgical skills, educational bootcamps, and tools for evaluation and feedback. While trainees find the opportunity to practice their skills beneficial, there may be difficulty with access due to cost and availability. Additionally, there is a need for more objective metrics demonstrating improvement in skill or patient outcome.

Artificial intelligence and robotics: a combination that is changing the operating room

PURPOSE

The aim of the current narrative review was to summarize the available evidence in the literature on artificial intelligence (AI) methods that have been applied during robotic surgery.

METHODS

A narrative review of the literature was performed on MEDLINE/Pubmed and Scopus database on the topics of artificial intelligence, autonomous surgery, machine learning, robotic surgery, and surgical navigation, focusing on articles published between January 2015 and June 2019. All available evidences were analyzed and summarized herein after an interactive peer-review process of the panel.

LITERATURE REVIEW

The preliminary results of the implementation of AI in clinical setting are encouraging. By providing a readout of the full telemetry and a sophisticated viewing console, robot-assisted surgery can be used to study and refine the application of AI in surgical practice. Machine learning approaches strengthen the feedback regarding surgical skills acquisition, efficiency of the surgical process, surgical guidance and prediction of postoperative outcomes. Tension-sensors on the robotic arms and the integration of augmented reality methods can help enhance the surgical experience and monitor organ movements.

CONCLUSIONS

The use of AI in robotic surgery is expected to have a significant impact on future surgical training as well as enhance the surgical experience during a procedure. Both aim to realize precision surgery and thus to increase the quality of the surgical care. Implementation of AI in master-slave robotic surgery may allow for the careful, step-by-step consideration of autonomous robotic surgery.

Review of the effect of 3D medical printing and virtual reality on urology training with ‘MedTRain3DModsim’ Erasmus + European Union Project

Background/aim

It is necessary to incorporate novel training modalities in medical education, especially in surgical fields, because of the limitations of cadaveric training. Traditional medical education has many drawbacks, such as residency working hour restrictions, patient safety conflicts with the learning needs, and the lack of hands-on workshops. The MedTRain3DModsim Project aimed to produce 3-dimensional (3D) medical printed models, simulations, and innovative applications for every level of medical training using novel worldwide technologies. It was aimed herein to improve the interdisciplinary and transnational approaches, and accumulate existing experience for medical education, postgraduate studies, and specialty training.

Materials and methods

This project focused on models of solid organs and the urinary system, including the kidney, prostate, ureter, and liver. With 3D medical printing, it is possible to produce a body part from inert materials in just a few hours with the standardization of medical 3D modeling.

Results

The target groups of this project included medical students and residents, graduate students from engineering departments who needed medical education and surgical training, and medical researchers interested in health technology or clinical and surgical an atomy.

Conclusion

It was also intended to develop a novel imaging platform for education and training by reevaluating the existing data using new software and 3D modalities. Therefore, it was believed that our methodology could be implemented in all related medical fields.