A System for Real-Time, Online Mixed-Reality Visualization of Cardiac Magnetic Resonance Images

Use of Virtual Reality and 3D Models in Contemporary Practice of Cardiology

PURPOSE OF REVIEW

To provide an overview of the impact of virtual and augmented reality in contemporary cardiovascular medical practice.

RECENT FINDINGS

The utilization of virtual and augmented reality has emerged as an innovative technique in various cardiovascular subspecialties, including interventional adult, pediatric, and adult congenital as well as structural heart disease and heart failure. In particular, electrophysiology has proven valuable for both diagnostic and therapeutic procedures. The incorporation of 3D reconstruction modeling has significantly enhanced our understanding of patient anatomy and morphology, thereby improving diagnostic accuracy and patient outcomes. The interactive modeling of cardiac structure and function within the virtual realm plays a pivotal role in comprehending complex congenital, structural, and coronary pathology. This, in turn, contributes to safer interventions and surgical procedures. Noteworthy applications include septal defect device closure, transcatheter valvular interventions, and left atrial occlusion device implantation. The implementation of virtual reality has been shown to yield cost savings in healthcare, reduce procedure time, minimize radiation exposure, lower intravenous contrast usage, and decrease the extent of anesthesia required. These benefits collectively result in a more efficient and effective approach to patient care.

Assessment of deep learning segmentation for real-time free-breathing cardiac magnetic resonance imaging at rest and under exercise stress

In recent years, a variety of deep learning networks for cardiac MRI (CMR) segmentation have been developed and analyzed. However, nearly all of them are focused on cine CMR under breathold. In this work, accuracy of deep learning methods is assessed for volumetric analysis (via segmentation) of the left ventricle in real-time free-breathing CMR at rest and under exercise stress. Data from healthy volunteers (n = 15) for cine and real-time free-breathing CMR at rest and under exercise stress were analyzed retrospectively. Exercise stress was performed using an ergometer in the supine position. Segmentations of two deep learning methods, a commercially available technique (comDL) and an openly available network (nnU-Net), were compared to a reference model created via the manual correction of segmentations obtained with comDL. Segmentations of left ventricular endocardium (LV), left ventricular myocardium (MYO), and right ventricle (RV) are compared for both end-systolic and end-diastolic phases and analyzed with Dice's coefficient. The volumetric analysis includes the cardiac function parameters LV end-diastolic volume (EDV), LV end-systolic volume (ESV), and LV ejection fraction (EF), evaluated with respect to both absolute and relative differences. For cine CMR, nnU-Net and comDL achieve Dice's coefficients above 0.95 for LV and 0.9 for MYO, and RV. For real-time CMR, the accuracy of nnU-Net exceeds that of comDL overall. For real-time CMR at rest, nnU-Net achieves Dice's coefficients of 0.94 for LV, 0.89 for MYO, and 0.90 for RV and the mean absolute differences between nnU-Net and the reference are 2.9 mL for EDV, 3.5 mL for ESV, and 2.6% for EF. For real-time CMR under exercise stress, nnU-Net achieves Dice's coefficients of 0.92 for LV, 0.85 for MYO, and 0.83 for RV and the mean absolute differences between nnU-Net and reference are 11.4 mL for EDV, 2.9 mL for ESV, and 3.6% for EF. Deep learning methods designed or trained for cine CMR segmentation can perform well on real-time CMR. For real-time free-breathing CMR at rest, the performance of deep learning methods is comparable to inter-observer variability in cine CMR and is usable for fully automatic segmentation. For real-time CMR under exercise stress, the performance of nnU-Net could promise a higher degree of automation in the future.

MRI Distortion Correction and Robot-to-MRI Scanner Registration for an MRI-Guided Robotic System

Magnetic resonance imaging (MRI) guided robotic procedures require safe robotic instrument navigation and precise target localization. This depends on reliable tracking of the instrument from MR images, which requires accurate registration of the robot to the scanner. A novel differential image based robot-to-MRI scanner registration approach is proposed that utilizes a set of active fiducial coils, where background subtraction method is employed for coil detection. In order to use the presented preoperative registration approach jointly with the real-time high speed MRI image acquisition and reconstruction methods in real-time interventional procedures, the effects of the geometric MRI distortion in robot to scanner registration is analyzed using a custom distortion mapping algorithm. The proposed approach is validated by a set of target coils placed within the workspace, employing multi-planar capabilities of the scanner. Registration and validation errors are respectively 2.05 mm and 2.63 mm after the distortion correction showing an improvement of respectively 1.08 mm and 0.14 mm compared to the results without distortion correction.

Optimization of through-time radial GRAPPA with coil compression and weight sharing

PURPOSE

This work proposes principal component analysis (PCA) coil compression and weight sharing to reduce acquisition and reconstruction time of through-time radial GRAPPA.

METHODS

Through-time radial GRAPPA enables ungated free-breathing motion-resolved cardiac imaging but requires a long calibration acquisition and GRAPPA weight calculation time. PCA coil compression reduces calibration data requirements and associated acquisition time, and weight sharing reduces the number of unique GRAPPA weight sets and associated weight computation time. In vivo cardiac data reconstructed with coil compression and weight sharing are compared to a gold standard to demonstrate improvement in calibration acquisition and reconstruction performance with minimal loss of image quality.

RESULTS

Coil compression from 30 physical to 12 virtual coils (90% of signal variance) decreases requisite calibration data by 60%, reducing calibration acquisition time to 6.7 s/slice from 31.5 s/slice reported in original through-time radial GRAPPA work. Resulting images have small increase in RMS error (RMSE). Reconstruction with a weight sharing factor of 8 results in eight-fold reduction in GRAPPA weight calculation time with a comparable RMSE to reconstructions with no weight sharing. Optimized parameters for coil compression and weight sharing applied to reconstructions enables images to be collected with a temporal resolution of 66 ms/frame and spatial resolution of 2.34 × 2.34 mm while reducing calibration acquisition time from 34 to 6.7 s, weight calculation time from 200 to 3 s, and weight application time 18 to 5 s.

CONCLUSION

Coil compression and weight sharing applied to through-time radial GRAPPA enables fast free-breathing ungated cardiac cine without compromising image quality.