Performance Evaluation of Mixed Reality Display for Guidance During Transcatheter Cardiac Mapping and Ablation

Augmented Reality in Dentistry: Enhancing Precision in Clinical Procedures-A Systematic Review

Background: Augmented reality (AR) enhances sensory perception by adding extra information, improving anatomical localization and simplifying treatment views. In dentistry, digital planning on bidimensional screens lacks real-time feedback, leading to potential errors. However, it is not clear if AR can improve the clinical treatment precision. The aim of this research is to evaluate if the use of AR-based instruments could improve dental procedure precision. Methods: This review covered studies from January 2018 to June 2023, focusing on AR in dentistry. The PICO question was "Does AR increase the precision of dental interventions compared to non-AR techniques?". The systematic review was carried out on electronic databases, including Ovid MEDLINE, PubMed, and the Web of Science, with the following inclusion criteria: studies comparing the variation in the precision of interventions carried out with AR instruments and non-AR techniques. Results: Thirteen studies were included. Conclusions: The results of this systematic review demonstrate that AR enhances the precision of various dental procedures. The authors advise clinicians to use AR-based tools in order to improve the precision of their therapies.

Advancements and applications of artificial intelligence in cardiovascular imaging: a comprehensive review

Artificial intelligence (AI) is transforming cardiovascular imaging by offering advancements across multiple modalities, including echocardiography, cardiac computed tomography (CCT), cardiovascular magnetic resonance (CMR), interventional cardiology, nuclear medicine, and electrophysiology. This review explores the clinical applications of AI within each of these areas, highlighting its ability to improve patient selection, reduce image acquisition time, enhance image optimization, facilitate the integration of data from different imaging modality and clinical sources, improve diagnosis and risk stratification. Moreover, we illustrate both the advantages and the limitations of AI across these modalities, acknowledging that while AI can significantly aid in diagnosis, risk stratification, and workflow efficiency, it cannot replace the expertise of cardiologists. Instead, AI serves as a powerful tool to streamline routine tasks, allowing clinicians to focus on complex cases where human judgement remains essential. By accelerating image interpretation and improving diagnostic accuracy, AI holds great potential to improve patient care and clinical decision-making in cardiovascular imaging.

Application of Mixed/Augmented Reality in Interventional Cardiology

This review explores the transformative applications of augmented reality (AR) and mixed reality (MR) technologies in interventional cardiology. The integration of these cutting-edge systems offers unprecedented potential to enhance visualization, guidance, and outcomes during complex cardiac interventional procedures. This review examines four key domains: (1) medical AR/MR systems and technological foundations; (2) clinical applications across procedures like TAVI, PCI, and electrophysiology mapping; (3) ongoing technology development and validation efforts; and (4) educational and training applications for fostering essential skills. By providing an in-depth analysis of the benefits, challenges, and future directions, this work elucidates the paradigm shift catalyzed by AR and MR in advancing interventional cardiology practices. Through meticulous exploration of technological, clinical, and educational implications, this review underscores the pivotal role of these innovative technologies in optimizing procedural guidance, improving patient outcomes, and driving innovation in cardiovascular care.

Artificial Intelligence for Cardiovascular Care-Part 1: Advances: JACC Review Topic of the Week

Recent artificial intelligence (AI) advancements in cardiovascular care offer potential enhancements in diagnosis, treatment, and outcomes. Innovations to date focus on automating measurements, enhancing image quality, and detecting diseases using novel methods. Applications span wearables, electrocardiograms, echocardiography, angiography, genetics, and more. AI models detect diseases from electrocardiograms at accuracy not previously achieved by technology or human experts, including reduced ejection fraction, valvular heart disease, and other cardiomyopathies. However, AI's unique characteristics necessitate rigorous validation by addressing training methods, real-world efficacy, equity concerns, and long-term reliability. Despite an exponentially growing number of studies in cardiovascular AI, trials showing improvement in outcomes remain lacking. A number are currently underway. Embracing this rapidly evolving technology while setting a high evaluation benchmark will be crucial for cardiology to leverage AI to enhance patient care and the provider experience.

Merging virtual and physical experiences: extended realities in cardiovascular medicine

Technological advancement and the COVID-19 pandemic have brought virtual learning and working into our daily lives. Extended realities (XR), an umbrella term for all the immersive technologies that merge virtual and physical experiences, will undoubtedly be an indispensable part of future clinical practice. The intuitive and three-dimensional nature of XR has great potential to benefit healthcare providers and empower patients and physicians. In the past decade, the implementation of XR into cardiovascular medicine has flourished such that it is now integrated into medical training, patient education, pre-procedural planning, intra-procedural visualization, and post-procedural care. This review article discussed how XR could provide innovative care and complement traditional practice, as well as addressing its limitations and considering its future perspectives.

The HoloLens in medicine: A systematic review and taxonomy

The HoloLens (Microsoft Corp., Redmond, WA), a head-worn, optically see-through augmented reality (AR) display, is the main player in the recent boost in medical AR research. In this systematic review, we provide a comprehensive overview of the usage of the first-generation HoloLens within the medical domain, from its release in March 2016, until the year of 2021. We identified 217 relevant publications through a systematic search of the PubMed, Scopus, IEEE Xplore and SpringerLink databases. We propose a new taxonomy including use case, technical methodology for registration and tracking, data sources, visualization as well as validation and evaluation, and analyze the retrieved publications accordingly. We find that the bulk of research focuses on supporting physicians during interventions, where the HoloLens is promising for procedures usually performed without image guidance. However, the consensus is that accuracy and reliability are still too low to replace conventional guidance systems. Medical students are the second most common target group, where AR-enhanced medical simulators emerge as a promising technology. While concerns about human-computer interactions, usability and perception are frequently mentioned, hardly any concepts to overcome these issues have been proposed. Instead, registration and tracking lie at the core of most reviewed publications, nevertheless only few of them propose innovative concepts in this direction. Finally, we find that the validation of HoloLens applications suffers from a lack of standardized and rigorous evaluation protocols. We hope that this review can advance medical AR research by identifying gaps in the current literature, to pave the way for novel, innovative directions and translation into the medical routine.

Extended reality for biomedicine

Extended reality (XR) refers to an umbrella of methods that allows users to be immersed in a three-dimensional (3D) or a 4D (spatial + temporal) virtual environment to different extents, including virtual reality (VR), augmented reality (AR), and mixed reality (MR). While VR allows a user to be fully immersed in a virtual environment, AR and MR overlay virtual objects over the real physical world. The immersion and interaction of XR provide unparalleled opportunities to extend our world beyond conventional lifestyles. While XR has extensive applications in fields such as entertainment and education, its numerous applications in biomedicine create transformative opportunities in both fundamental research and healthcare. This Primer outlines XR technology from instrumentation to software computation methods, delineating the biomedical applications that have been advanced by state-of-the-art techniques. We further describe the technical advances overcoming current limitations in XR and its applications, providing an entry point for professionals and trainees to thrive in this emerging field.

Early preclinical experience of a mixed reality ultrasound system with active GUIDance for NEedle-based interventions: The GUIDE study

Background

Use of ultrasound (US) to facilitate vascular access has increased compared to landmark-based procedures despite ergonomic challenges and need for extrapolation of 2-dimensional images to understand needle position. The MantUS™ system (Sentiar, Inc.,) uses a mixed reality (MxR) interface to display US images and integrate real-time needle tracking.

Objective

The purpose of this prospective preclinical study was to evaluate the feasibility and usability of MantUS in a simulated environment.

Methods

Participants were recruited from pediatric cardiology and critical care. Access was obtained in 2 vascular access training models: a femoral access model and a head and neck model for a total of 4 vascular access sites under 2 conditions—conventional US and MantUS. Participants were randomized for order of completion. Videos were obtained, and quality of access including time required, repositions, number of attempts, and angle of approach were quantified.

Results

Use of MantUS resulted in an overall reduction in number of needle repositions (P = .03) and improvement in quality of access as measured by distance (P <.0001) and angle of elevation (P = .006). These findings were even more evident in the right femoral vein (RFV) access site, which was a simulated anatomic variant with a deeper more oblique vascular course. Use of MantUS resulted in faster time to access (P = .04), fewer number of both access attempts (P = .02), and number of needle repositions (P <.0001) compared to conventional US. Postparticipant survey showed high levels of usability (87%) and a belief that MantUS may decrease adverse outcomes (73%) and failed access attempts (83%).

Conclusion

Use of MantUS improved vascular access among all comers, including the quality of access. This improvement was even more notable in the vascular variant (RFV). MantUS readily benefited users by providing improved spatial understanding. Further development of MantUS will focus on improving user interface and experience, with larger clinical usage and in-human studies.

Evaluation Challenges for the Application of Extended Reality Devices in Medicine

Augmented and virtual reality devices are being actively investigated and implemented for a wide range of medical uses. However, significant gaps in the evaluation of these medical devices and applications hinder their regulatory evaluation. Addressing these gaps is critical to demonstrating the devices' safety and effectiveness. We outline the key technical and clinical evaluation challenges discussed during the US Food and Drug Administration's public workshop, "Medical Extended Reality: Toward Best Evaluation Practices for Virtual and Augmented Reality in Medicine" and future directions for evaluation method development. Evaluation challenges were categorized into several key technical and clinical areas. Finally, we highlight current efforts in the standards communities and illustrate connections between the evaluation challenges and the intended uses of the medical extended reality (MXR) devices. Participants concluded that additional research is needed to assess the safety and effectiveness of MXR devices across the use cases.

Artificial Intelligence and Machine Learning in Cardiac Electrophysiology

Cardiac electrophysiology requires the processing of several patient-specific data points in real time to provide an accurate diagnosis and determine an optimal therapy. Expanding beyond the traditional tools that have been used to extract information from patient-specific data, machine learning offers a new set of advanced tools capable of revealing previously unknown data patterns and features. This new tool set can substantially improve the speed and level of confidence with which electrophysiologists can determine patient-specific diagnoses and therapies. The ability to process substantial amounts of data in real time also paves the way to novel techniques for data collection and visualization. Extended realities such as virtual and augmented reality can now enable the real-time visualization of 3-dimensional images in space. This enables improved preprocedural planning and intraprocedural interventions. Machine learning supplemented with novel visualization technologies could substantially improve patient care and outcomes by helping physicians to make more informed patient-specific decisions. This article presents current applications of machine learning and their use in cardiac electrophysiology.

Virtual and Augmented Reality in Cardiovascular Care: State-of-the-Art and Future Perspectives

Applications of virtual reality (VR) and augmented reality (AR) assist both health care providers and patients in cardiovascular education, complementing traditional learning methods. Interventionalists have successfully used VR to plan difficult procedures and AR to facilitate complex interventions. VR/AR has already been used to treat patients, during interventions in rehabilitation programs and in immobilized intensive care patients. There are numerous additional potential applications in the catheterization laboratory. By using AR, interventionalists could combine visual fluoroscopy information projected and registered on the patient body with data derived from preprocedural imaging and live fusion of different imaging modalities such as fluoroscopy with echocardiography. Persistent technical challenges to overcome include the integration of different imaging modalities into VR/AR and the harmonization of data flow and interfaces. Cybersickness might exclude some patients and users from the potential benefits of VR/AR. Critical ethical considerations arise in the application of VR/AR in vulnerable patients. In addition, digital applications must not distract physicians from the patient. It is our duty as physicians to participate in the development of these innovations to ensure a virtual health reality benefit for our patients in a real-world setting. The purpose of this review is to summarize the current and future role of VR and AR in different fields within cardiology, its challenges, and perspectives.

Design Considerations for Interacting and Navigating with 2 Dimensional and 3 Dimensional Medical Images in Virtual, Augmented and Mixed Reality Medical Applications

The extended realities, including virtual, augmented, and mixed realities (VAMR) have recently experienced significant hardware improvement resulting in an expansion in medical applications. These applications can be classified by the target end user (for instance, classifying applications as patient-centric, physician-centric, or both) or by use case (for instance educational, diagnostic tools, therapeutic tools, or some combination). When developing medical applications in VAMR, careful consideration of both the target end user and use case must heavily influence design considerations, particularly methods and tools for interaction and navigation. Medical imaging consists of both 2-dimensional and 3-dimensional medical imaging which impacts design, interaction, and navigation. Additionally, medical applications need to comply with regulatory considerations which will also influence interaction and design considerations. In this manuscript, the authors explore these considerations using three VAMR tools being developed for cardiac electrophysiology procedures.

Impact of augmented-reality improvement in ablation catheter navigation as assessed by virtual-heart simulations of ventricular tachycardia ablation

BACKGROUND

Recently, an augmented reality (AR) solution allows the physician to place the ablation catheter at the designated lesion site more accurately during cardiac electrophysiology studies. The improvement in navigation accuracy may positively affect ventricular tachycardia (VT) ablation termination, however assessment of this in the clinic would be difficult. Novel personalized virtual heart technology enables non-invasive identification of optimal lesion targets for infarct-related VT. This study aims to evaluate the potential impact of such catheter navigation accuracy improvement in virtual VT ablations.

METHODS

2 MRI-based virtual hearts with 2 in silico induced VTs (VT 1, VT 2) were included. VTs were terminated with virtual "ground truth" endocardial ablation lesions. 106 navigation error values that were previously assessed in a clinical study evaluating the improvement of ablation catheter navigation accuracy guided with AR (53 with, 53 without) were used to displace the "ground truth" ablation targets. The corresponding ablations were simulated based on these errors and VT termination for each simulation was assessed.

RESULTS

In 54 VT 1 ablation simulations, smaller error with AR significantly resulted in more VT termination (25) compared to the error without AR (16) (P < 0.01). In 52 VT 2 ablation simulations, no significant difference was observed from error with (11) and without AR (13) (P = 0.58). The substrate characteristic may impact the effect of improved accuracy to an improved VT termination.

CONCLUSION

Virtual heart shows that the increased catheter navigation accuracy provided by AR guidance can affect the VT termination.

Registration Techniques for Clinical Applications of Three-Dimensional Augmented Reality Devices

Many clinical procedures would benefit from direct and intuitive real-time visualization of anatomy, surgical plans, or other information crucial to the procedure. Three-dimensional augmented reality (3D-AR) is an emerging technology that has the potential to assist physicians with spatial reasoning during clinical interventions. The most intriguing applications of 3D-AR involve visualizations of anatomy or surgical plans that appear directly on the patient. However, commercially available 3D-AR devices have spatial localization errors that are too large for many clinical procedures. For this reason, a variety of approaches for improving 3D-AR registration accuracy have been explored. The focus of this review is on the methods, accuracy, and clinical applications of registering 3D-AR devices with the clinical environment. The works cited represent a variety of approaches for registering holograms to patients, including manual registration, computer vision-based registration, and registrations that incorporate external tracking systems. Evaluations of user accuracy when performing clinically relevant tasks suggest that accuracies of approximately 2 mm are feasible. 3D-AR device limitations due to the vergence-accommodation conflict or other factors attributable to the headset hardware add on the order of 1.5 mm of error compared to conventional guidance. Continued improvements to 3D-AR hardware will decrease these sources of error.