Renal biopsy under augmented reality guidance

Integrated Needle Guide on Smartphone for Percutaneous Interventions Using Augmented Reality

PURPOSE

This study aimed to describe the workflow and evaluate the accuracy of a novel smartphone augmented reality (AR) application that includes an integrated needle guide, in a phantom.

MATERIALS AND METHODS

A smartphone cover with an integrated needle guide was designed and 3D-printed. An AR application for percutaneous application was developed, which integrated a projected needle path based on the rigid needle guide. After planning the needle path using this novel tool, the operator could place the needle through the guide to reach the target. Six lesions with out-of-plane entry points were targeted on an abdominal phantom. Timing and accuracy of needle placements were measured on post-procedural CT both using smartphone AR guidance and with a freehand approach. Results were compared using Wilcoxon rank sum and Pearson's chi-squared tests.

RESULTS

A total of 108 needle placements were performed by 9 physicians with widely varying experience. The median accuracy was 4 mm (IQR 3-6 mm) using the smartphone versus 18 mm (IQR 9-27 mm) for freehand (P < 0.001). Using the smartphone AR application, planning time was 91 s (IQR 71-151 s), and puncture time was 68 s (IQR 57-77 s). There was no difference in accuracy, planning, or puncture times according to experience level when using the AR tool.

CONCLUSION

This smartphone application with an integrated needle guide allows path planning and accurate needle placement on phantoms with real-time angular feedback in less than 3 min. This technology could promote standardization, reduce experience requirements, or provide accurate low-cost guidance in environments without procedural imaging for percutaneous interventions.

Acceptance and feasibility of an augmented reality-based navigation system with optical tracking for percutaneous procedures in interventional radiology - a simulation-based phantom study

Augmented reality (AR) projects additional information into the user's field of view during interventions. The aim was to evaluate the acceptance and clinical feasibility of an AR system and to compare users with different levels of experience. A system was examined that projects a CT-generated 3D model of a phantom into the field of view using a HoloLens 2, whereby the tracked needle is displayed and navigated live. A projected ultrasound image is used for live control of the needle positioning. This should minimize radiation exposure and improve orientation.The acceptance and usability of the AR navigation system was evaluated by 10 physicians and medical students with different levels of experience by performing punctures with the system in a phantom. The required time was then compared and a questionnaire was completed to assess clinical acceptance and feasibility. For statistical analysis, frequencies for qualitative characteristics, location and dispersion measures for quantitative characteristics and Spearman rank correlations for correlations were calculated.9 out of 10 subjects hit all 5 target regions in the first attempt, taking an average of 29:39 minutes for all punctures. There was a significant correlation between previous experience in interventional radiology, years in the profession, and the time required. Overall, the time varied from an average of 43:00 min. for medical students to 15:00 min. for chief physicians. All test subjects showed high acceptance of the system and rated especially the potential clinical feasibility, the simplification of the puncture, and the image quality positively. However, the majority require further training for sufficient safety in use.The system offers distinct advantages for navigation and orientation, facilitates percutaneous interventions during training and enables professionally experienced physicians to achieve short intervention times. In addition, the system improves ergonomics during the procedure by making important information always directly available in the field of view and has the potential to reduce the radiation exposure of staff in particular by combining AR and sonography and thus shortening CT-fluoroscopy times. · AR navigation offers advantages for orientation during percutaneous radiological interventions.. · The subjects would like to use the AR system in everyday clinical practice on patients.. · AR improves ergonomics by making important information directly available in the field of view.. · The combination of AR and sonography can significantly reduce radiation exposure for staff.. · Rohmer K, Becker M, Georgiades M et al. Acceptance and feasibility of an augmented reality-based navigation system with optical tracking for percutaneous procedures in interventional radiology - a simulation-based phantom study. Fortschr Röntgenstr 2024; DOI 10.1055/a-2416-1080.

Performance Comparison of Augmented Reality Versus Ultrasound Guidance for Puncture: A Phantom Study

PURPOSE

Augmented reality (AR) is an innovative approach that could assist percutaneous procedures; by directly seeing "through" a phantom, targeting a lesion might be more intuitive than using ultrasound (US). The objective of this study was to compare the performance of experienced interventional radiologists and operators untrained in soft tissue lesion puncture using AR guidance and standard US guidance.

MATERIAL AND METHODS

Three trained interventional radiologists with 5-10 years of experience and three untrained operators performed punctures of five targets in an abdominal phantom, with US guidance and AR guidance. Correct targeting, accuracy (defined as the Euclidean distance between the tip and the center of the target), planning time, and puncture time were documented.

RESULTS

Accuracy was higher for the trained group than the untrained group using US guidance (1 mm versus 4 mm, p = 0.001), but not when using AR guidance (4 mm vs. 4 mm, p = 0.76). All operators combined, no significant difference was found concerning accuracy between US and AR guidance (2 mm vs. 4 mm, p = 0.09), but planning time and puncture time were significantly shorter using AR (respectively, 15.1 s vs. 74 s, p < 0.001; 16.1 s vs. 59 s; p < 0.001).

CONCLUSION

Untrained and trained operators obtained comparable accuracy in percutaneous punctures when using AR guidance whereas US performance was better in the experienced group. All operators together, accuracy was similar between US and AR guidance, but shorter planning time, puncture time were found for AR guidance.

Augmented Reality (AR) for Surgical Robotic and Autonomous Systems: State of the Art, Challenges, and Solutions

Despite the substantial progress achieved in the development and integration of augmented reality (AR) in surgical robotic and autonomous systems (RAS), the center of focus in most devices remains on improving end-effector dexterity and precision, as well as improved access to minimally invasive surgeries. This paper aims to provide a systematic review of different types of state-of-the-art surgical robotic platforms while identifying areas for technological improvement. We associate specific control features, such as haptic feedback, sensory stimuli, and human-robot collaboration, with AR technology to perform complex surgical interventions for increased user perception of the augmented world. Current researchers in the field have, for long, faced innumerable issues with low accuracy in tool placement around complex trajectories, pose estimation, and difficulty in depth perception during two-dimensional medical imaging. A number of robots described in this review, such as Novarad and SpineAssist, are analyzed in terms of their hardware features, computer vision systems (such as deep learning algorithms), and the clinical relevance of the literature. We attempt to outline the shortcomings in current optimization algorithms for surgical robots (such as YOLO and LTSM) whilst providing mitigating solutions to internal tool-to-organ collision detection and image reconstruction. The accuracy of results in robot end-effector collisions and reduced occlusion remain promising within the scope of our research, validating the propositions made for the surgical clearance of ever-expanding AR technology in the future.

Advances and Innovations in Ablative Head and Neck Oncologic Surgery Using Mixed Reality Technologies in Personalized Medicine

The benefit of computer-assisted planning in head and neck ablative and reconstructive surgery has been extensively documented over the last decade. This approach has been proven to offer a more secure surgical procedure. In the treatment of cancer of the head and neck, computer-assisted surgery can be used to visualize and estimate the location and extent of the tumor mass. Nowadays, some software tools even allow the visualization of the structures of interest in a mixed reality environment. However, the precise integration of mixed reality systems into a daily clinical routine is still a challenge. To date, this technology is not yet fully integrated into clinical settings such as the tumor board, surgical planning for head and neck tumors, or medical and surgical education. As a consequence, the handling of these systems is still of an experimental nature, and decision-making based on the presented data is not yet widely used. The aim of this paper is to present a novel, user-friendly 3D planning and mixed reality software and its potential application for ablative and reconstructive head and neck surgery.

Snake Robots for Surgical Applications: A Review

Although substantial advancements have been achieved in robot-assisted surgery, the blueprint to existing snake robotics predominantly focuses on the preliminary structural design, control, and human–robot interfaces, with features which have not been particularly explored in the literature. This paper aims to conduct a review of planning and operation concepts of hyper-redundant serpentine robots for surgical use, as well as any future challenges and solutions for better manipulation. Current researchers in the field of the manufacture and navigation of snake robots have faced issues, such as a low dexterity of the end-effectors around delicate organs, state estimation and the lack of depth perception on two-dimensional screens. A wide range of robots have been analysed, such as the i²Snake robot, inspiring the use of force and position feedback, visual servoing and augmented reality (AR). We present the types of actuation methods, robot kinematics, dynamics, sensing, and prospects of AR integration in snake robots, whilst addressing their shortcomings to facilitate the surgeon’s task. For a smoother gait control, validation and optimization algorithms such as deep learning databases are examined to mitigate redundancy in module linkage backlash and accidental self-collision. In essence, we aim to provide an outlook on robot configurations during motion by enhancing their material compositions within anatomical biocompatibility standards.

Automatically Addressing System for Ultrasound-Guided Renal Biopsy Training Based on Augmented Reality

Chronic kidney disease has become one of the diseases with the highest morbidity and mortality in kidney diseases, and there are still some problems in surgery. During the operation, the surgeon can only operate on two-dimensional ultrasound images and cannot determine the spatial position relationship between the lesion and the medical puncture needle in real-time. The average number of punctures per patient will reach 3 to 4, Increasing the incidence of complications after a puncture. This article starts with ultrasound-guided renal biopsy navigation training, optimizes puncture path planning, and puncture training assistance. The augmented reality technology, combined with renal puncture surgery training was studied. This paper develops a prototype ultrasound-guided renal biopsy surgery training system, which improves the accuracy and reliability of the system training. The system is compared with the VR training system. The results show that the augmented reality training platform is more suitable as a surgical training platform. Because it takes a short time and has a good training effect.