Three-dimensional automatic artificial intelligence driven augmented-reality selective biopsy during nerve-sparing robot-assisted radical prostatectomy: A feasibility and accuracy study

Visual extended reality tools in image-guided surgery in urology: a systematic review

PURPOSE

The aim of this systematic review is to assess the clinical implications of employing various Extended Reality (XR) tools for image guidance in urological surgery.

METHODS

In June 2023, a systematic electronic literature search was conducted using the Medline database (via PubMed), Embase (via Ovid), Scopus, and Web of Science. The search strategy was designed based on the PICO (Patients, Intervention, Comparison, Outcome) criteria. Study protocol was registered on PROSPERO (registry number CRD42023449025). We incorporated retrospective and prospective comparative studies, along with single-arm studies, which provided information on the use of XR, Mixed Reality (MR), Augmented Reality (AR), and Virtual Reality (VR) in urological surgical procedures. Studies that were not written in English, non-original investigations, and those involving experimental research on animals or cadavers were excluded from our analysis. The quality assessment of comparative and cohort studies was conducted utilizing the Newcastle-Ottawa scale, whilst for randomized controlled trials (RCTs), the Jadad scale was adopted. The level of evidence for each study was determined based on the guidelines provided by the Oxford Centre for Evidence-Based Medicine.

RESULTS

The initial electronic search yielded 1,803 papers after removing duplicates. Among these, 58 publications underwent a comprehensive review, leading to the inclusion of 40 studies that met the specified criteria for analysis. 11, 20 and 9 studies tested XR on prostate cancer, kidney cancer and miscellaneous, including bladder cancer and lithiasis surgeries, respectively. Focusing on the different technologies 20, 15 and 5 explored the potential of VR, AR and MR. The majority of the included studies (i.e., 22) were prospective non-randomized, whilst 7 and 11 were RCT and retrospective studies respectively. The included studies that revealed how these new tools can be useful both in preoperative and intraoperative setting for a tailored surgical approach.

CONCLUSIONS

AR, VR and MR techniques have emerged as highly effective new tools for image-guided surgery, especially for urologic oncology. Nevertheless, the complete clinical advantages of these innovations are still in the process of evaluation.

Automatic 3D Augmented-Reality Robot-Assisted Partial Nephrectomy Using Machine Learning: Our Pioneer Experience

The aim of "Precision Surgery" is to reduce the impact of surgeries on patients' global health. In this context, over the last years, the use of three-dimensional virtual models (3DVMs) of organs has allowed for intraoperative guidance, showing hidden anatomical targets, thus limiting healthy-tissue dissections and subsequent damage during an operation. In order to provide an automatic 3DVM overlapping in the surgical field, we developed and tested a new software, called "ikidney", based on convolutional neural networks (CNNs). From January 2022 to April 2023, patients affected by organ-confined renal masses amenable to RAPN were enrolled. A bioengineer, a software developer, and a surgeon collaborated to create hyper-accurate 3D models for automatic 3D AR-guided RAPN, using CNNs. For each patient, demographic and clinical data were collected. A total of 13 patients were included in the present study. The average anchoring time was 11 (6-13) s. Unintended 3D-model automatic co-registration temporary failures happened in a static setting in one patient, while this happened in one patient in a dynamic setting. There was one failure; in this single case, an ultrasound drop-in probe was used to detect the neoplasm, and the surgery was performed under ultrasound guidance instead of AR guidance. No major intraoperative nor postoperative complications (i.e., Clavien Dindo > 2) were recorded. The employment of AI has unveiled several new scenarios in clinical practice, thanks to its ability to perform specific tasks autonomously. We employed CNNs for an automatic 3DVM overlapping during RAPN, thus improving the accuracy of the superimposition process.