Fully automatic segmentation and objective assessment of atrial scars for long-standing persistent atrial fibrillation patients using late gadolinium-enhanced MRI

Automated T1 and T2 mapping segmentation on cardiovascular magnetic resonance imaging using deep learning

Introduction

Structural and functional heart abnormalities can be examined non-invasively with cardiac magnetic resonance imaging (CMR). Thanks to the development of MR devices, diagnostic scans can capture more and more relevant information about possible heart diseases. T1 and T2 mapping are such novel technology, providing tissue specific information even without the administration of contrast material. Artificial intelligence solutions based on deep learning have demonstrated state-of-the-art results in many application areas, including medical imaging. More specifically, automated tools applied at cine sequences have revolutionized volumetric CMR reporting in the past five years. Applying deep learning models to T1 and T2 mapping images can similarly improve the efficiency of post-processing pipelines and consequently facilitate diagnostic processes.

Methods

In this paper, we introduce a deep learning model for myocardium segmentation trained on over 7,000 raw CMR images from 262 subjects of heterogeneous disease etiology. The data were labeled by three experts. As part of the evaluation, Dice score and Hausdorff distance among experts is calculated, and the expert consensus is compared with the model's predictions.

Results

Our deep learning method achieves 86% mean Dice score, while contours provided by three experts on the same data show 90% mean Dice score. The method's accuracy is consistent across epicardial and endocardial contours, and on basal, midventricular slices, with only 5% lower results on apical slices, which are often challenging even for experts.

Conclusions

We trained and evaluated a deep learning based segmentation model on 262 heterogeneous CMR cases. Applying deep neural networks to T1 and T2 mapping could similarly improve diagnostic practices. Using the fine details of T1 and T2 mapping images and high-quality labels, the objective of this research is to approach human segmentation accuracy with deep learning.

Artificial intelligence in cardiovascular imaging: enhancing image analysis and risk stratification

In this review, we summarize state-of-the-art artificial intelligence applications for non-invasive cardiovascular imaging modalities including CT, MRI, echocardiography, and nuclear myocardial perfusion imaging.

The Applications of Artificial Intelligence in Cardiovascular Magnetic Resonance-A Comprehensive Review

Cardiovascular disease remains an integral field on which new research in both the biomedical and technological fields is based, as it remains the leading cause of mortality and morbidity worldwide. However, despite the progress of cardiac imaging techniques, the heart remains a challenging organ to study. Artificial intelligence (AI) has emerged as one of the major innovations in the field of diagnostic imaging, with a dramatic impact on cardiovascular magnetic resonance imaging (CMR). AI will be increasingly present in the medical world, with strong potential for greater diagnostic efficiency and accuracy. Regarding the use of AI in image acquisition and reconstruction, the main role was to reduce the time of image acquisition and analysis, one of the biggest challenges concerning magnetic resonance; moreover, it has been seen to play a role in the automatic correction of artifacts. The use of these techniques in image segmentation has allowed automatic and accurate quantification of the volumes and masses of the left and right ventricles, with occasional need for manual correction. Furthermore, AI can be a useful tool to directly help the clinician in the diagnosis and derivation of prognostic information of cardiovascular diseases. This review addresses the applications and future prospects of AI in CMR imaging, from image acquisition and reconstruction to image segmentation, tissue characterization, diagnostic evaluation, and prognostication.

Uncertainty-guided symmetric multi-level supervision network for 3D left atrium segmentation in late gadolinium-enhanced MRI

PURPOSE

Atrial fibrillation is a common arrhythmia and requires volumetric imaging to guide the therapy procedure. Late gadolinium-enhanced magnetic resonance imaging (LGE MRI) is an efficient non-invasive technology for imaging the diseased heart. Three-dimensional segmentation of the left atrium (LA) in LGE MRI is a fundamental step for guiding the therapy of patients with atrial fibrillation. However, the low contrast and fuzzy surface of the LA in LGE MRI make accurate and objective LA segmentation challenge. The purpose of this study is to propose an automatic and efficient LA segmentation model based on a convolutional neural network to obtain a more accurate predicted surface and improve the LA segmentation results.

METHODS

In this study, we proposed an uncertainty-guided symmetric multi-level supervision network for 3D LA segmentation in LGE MRI. Firstly, we constructed a symmetric multi-level supervision structure to combine the corresponding features from the encoding and decoding stages to learn the multi-scale representation of LA. Secondly, we formulated the discrepancy of predictions of our model as model uncertainty. Then we proposed an uncertainty-guided objective function to further increase the segmentation accuracy on the surface.

RESULTS

We evaluated our proposed model on the public LA segmentation database using four universal metrics. The proposed model achieved Hausdorff Distance of 11.68 mm, average symmetric surface distance of 0.92 mm, Dice score of 0.92, and Jaccard of 0.85. Compared with state-of-the-art models, our model achieved the best Hausdorff Distance that is sensitive to surface accuracy. For the other three metrics, our model also achieved better or comparable performance.

CONCLUSIONS

We proposed an efficient automatic LA segmentation model that consisted of a symmetric multi-level supervision structure and an uncertainty-guided objective function. Compared to other models, we designed an additional supervision branch in the encoding stage to learn more detailed representations of LA while learning global context information through the multi-level structure of each supervision branch. To address the fuzzy surface challenge of LA segmentation in LGE MRI, we leveraged the model uncertainty to enhance the distinguishing ability of the model on the surface, thereby the predicted accuracy of the LA surface can be further increased. We conducted extensive ablation and comparative experiments with state-of-the-art models. The experiment results demonstrated that our proposed model could handle the complex structure of LA and had superior advantages in improving the segmentation performance on the surface. This article is protected by copyright. All rights reserved.

Medical image analysis on left atrial LGE MRI for atrial fibrillation studies: A review

Late gadolinium enhancement magnetic resonance imaging (LGE MRI) is commonly used to visualize and quantify left atrial (LA) scars. The position and extent of LA scars provide important information on the pathophysiology and progression of atrial fibrillation (AF). Hence, LA LGE MRI computing and analysis are essential for computer-assisted diagnosis and treatment stratification of AF patients. Since manual delineations can be time-consuming and subject to intra- and inter-expert variability, automating this computing is highly desired, which nevertheless is still challenging and under-researched. This paper aims to provide a systematic review on computing methods for LA cavity, wall, scar, and ablation gap segmentation and quantification from LGE MRI, and the related literature for AF studies. Specifically, we first summarize AF-related imaging techniques, particularly LGE MRI. Then, we review the methodologies of the four computing tasks in detail and summarize the validation strategies applied in each task as well as state-of-the-art results on public datasets. Finally, the possible future developments are outlined, with a brief survey on the potential clinical applications of the aforementioned methods. The review indicates that the research into this topic is still in the early stages. Although several methods have been proposed, especially for the LA cavity segmentation, there is still a large scope for further algorithmic developments due to performance issues related to the high variability of enhancement appearance and differences in image acquisition.

TAUNet: a triple-attention-based multi-modality MRI fusion U-Net for cardiac pathology segmentation

Automated segmentation of cardiac pathology in MRI plays a significant role for diagnosis and treatment of some cardiac disease. In clinical practice, multi-modality MRI is widely used to improve the cardiac pathology segmentation, because it can provide multiple or complementary information. Recently, deep learning methods have presented implausible performance in multi-modality medical image segmentation. However, how to fuse the underlying multi-modality information effectively to segment the pathology with irregular shapes and small region at random locations, is still a challenge task. In this paper, a triple-attention-based multi-modality MRI fusion U-Net was proposed to learn complex relationship between different modalities and pay more attention on shape information, thus to achieve improved pathology segmentation. First, three independent encoders and one fusion encoder were applied to extract specific and multiple modality features. Secondly, we concatenate the modality feature maps and use the channel attention to fuse specific modal information at every stage of the three dedicate independent encoders, then the three single modality feature maps and channel attention feature maps are together concatenated to the decoder path. Spatial attention was adopted in decoder path to capture the correlation of various positions. Once more, we employ shape attention to focus shape-dependent information. Lastly, the training approach is made efficient by introducing deep supervision mechanism with object contextual representations block to ensure precisely boundary prediction. Our proposed network was evaluated on the public MICCAI 2020 Myocardial pathology segmentation dataset which involves patients suffering from myocardial infarction. Experiments on the dataset with three modalities demonstrate the effectiveness of fusion mode of our model, and attention mechanism can integrate various modality information well. We demonstrated that such a deep learning approach could better fuse complementary information to improve the segmentation performance of cardiac pathology.

AtrialJSQnet: A New framework for joint segmentation and quantification of left atrium and scars incorporating spatial and shape information

Left atrial (LA) and atrial scar segmentation from late gadolinium enhanced magnetic resonance imaging (LGE MRI) is an important task in clinical practice. The automatic segmentation is however still challenging due to the poor image quality, the various LA shapes, the thin wall, and the surrounding enhanced regions. Previous methods normally solved the two tasks independently and ignored the intrinsic spatial relationship between LA and scars. In this work, we develop a new framework, namely AtrialJSQnet, where LA segmentation, scar projection onto the LA surface, and scar quantification are performed simultaneously in an end-to-end style. We propose a mechanism of shape attention (SA) via an implicit surface projection to utilize the inherent correlation between LA cavity and scars. In specific, the SA scheme is embedded into a multi-task architecture to perform joint LA segmentation and scar quantification. Besides, a spatial encoding (SE) loss is introduced to incorporate continuous spatial information of the target in order to reduce noisy patches in the predicted segmentation. We evaluated the proposed framework on 60 post-ablation LGE MRIs from the MICCAI2018 Atrial Segmentation Challenge. Moreover, we explored the domain generalization ability of the proposed AtrialJSQnet on 40 pre-ablation LGE MRIs from this challenge and 30 post-ablation multi-center LGE MRIs from another challenge (ISBI2012 Left Atrium Fibrosis and Scar Segmentation Challenge). Extensive experiments on public datasets demonstrated the effect of the proposed AtrialJSQnet, which achieved competitive performance over the state-of-the-art. The relatedness between LA segmentation and scar quantification was explicitly explored and has shown significant performance improvements for both tasks. The code has been released via https://zmiclab.github.io/projects.html.

Edge-enhanced dual discriminator generative adversarial network for fast MRI with parallel imaging using multi-view information

In clinical medicine, magnetic resonance imaging (MRI) is one of the most important tools for diagnosis, triage, prognosis, and treatment planning. However, MRI suffers from an inherent slow data acquisition process because data is collected sequentially in k-space. In recent years, most MRI reconstruction methods proposed in the literature focus on holistic image reconstruction rather than enhancing the edge information. This work steps aside this general trend by elaborating on the enhancement of edge information. Specifically, we introduce a novel parallel imaging coupled dual discriminator generative adversarial network (PIDD-GAN) for fast multi-channel MRI reconstruction by incorporating multi-view information. The dual discriminator design aims to improve the edge information in MRI reconstruction. One discriminator is used for holistic image reconstruction, whereas the other one is responsible for enhancing edge information. An improved U-Net with local and global residual learning is proposed for the generator. Frequency channel attention blocks (FCA Blocks) are embedded in the generator for incorporating attention mechanisms. Content loss is introduced to train the generator for better reconstruction quality. We performed comprehensive experiments on Calgary-Campinas public brain MR dataset and compared our method with state-of-the-art MRI reconstruction methods. Ablation studies of residual learning were conducted on the MICCAI13 dataset to validate the proposed modules. Results show that our PIDD-GAN provides high-quality reconstructed MR images, with well-preserved edge information. The time of single-image reconstruction is below 5ms, which meets the demand of faster processing.

JAS-GAN: Generative Adversarial Network Based Joint Atrium and Scar Segmentations on Unbalanced Atrial Targets

Automated and accurate segmentations of left atrium (LA) and atrial scars from late gadolinium-enhanced cardiac magnetic resonance (LGE CMR) images are in high demand for quantifying atrial scars. The previous quantification of atrial scars relies on a two-phase segmentation for LA and atrial scars due to their large volume difference (unbalanced atrial targets). In this paper, we propose an inter-cascade generative adversarial network, namely JAS-GAN, to segment the unbalanced atrial targets from LGE CMR images automatically and accurately in an end-to-end way. Firstly, JAS-GAN investigates an adaptive attention cascade to automatically correlate the segmentation tasks of the unbalanced atrial targets. The adaptive attention cascade mainly models the inclusion relationship of the two unbalanced atrial targets, where the estimated LA acts as the attention map to adaptively focus on the small atrial scars roughly. Then, an adversarial regularization is applied to the segmentation tasks of the unbalanced atrial targets for making a consistent optimization. It mainly forces the estimated joint distribution of LA and atrial scars to match the real ones. We evaluated the performance of our JAS-GAN on a 3D LGE CMR dataset with 192 scans. Compared with the state-of-the-art methods, our proposed approach yielded better segmentation performance (Average Dice Similarity Coefficient (DSC) values of 0.946 and 0.821 for LA and atrial scars, respectively), which indicated the effectiveness of our proposed approach for segmenting unbalanced atrial targets.

Left atrial evaluation by cardiovascular magnetic resonance: sensitive and unique biomarkers

Left atrial (LA) imaging is still not routinely used for diagnosis and risk stratification, although recent studies have emphasized its importance as an imaging biomarker. Cardiovascular magnetic resonance is able to evaluate LA structure and function, metrics that serve as early indicators of disease, and provide prognostic information, e.g. regarding diastolic dysfunction, and atrial fibrillation (AF). MR angiography defines atrial anatomy, useful for planning ablation procedures, and also for characterizing atrial shapes and sizes that might predict cardiovascular events, e.g. stroke. Long-axis cine images can be evaluated to define minimum, maximum, and pre-atrial contraction LA volumes, and ejection fractions (EFs). More modern feature tracking of these cine images provides longitudinal LA strain through the cardiac cycle, and strain rates. Strain may be a more sensitive marker than EF and can predict post-operative AF, AF recurrence after ablation, outcomes in hypertrophic cardiomyopathy, stratification of diastolic dysfunction, and strain correlates with atrial fibrosis. Using high-resolution late gadolinium enhancement (LGE), the extent of fibrosis in the LA can be estimated and post-ablation scar can be evaluated. The LA LGE method is widely available, its reproducibility is good, and validations with voltage-mapping exist, although further scan-rescan studies are needed, and consensus regarding atrial segmentation is lacking. Using LGE, scar patterns after ablation in AF subjects can be reproducibly defined. Evaluation of 'pre-existent' atrial fibrosis may have roles in predicting AF recurrence after ablation, predicting new-onset AF and diastolic dysfunction in patients without AF. LA imaging biomarkers are ready to enter into diagnostic clinical practice.

Recent Advances in Fibrosis and Scar Segmentation From Cardiac MRI: A State-of-the-Art Review and Future Perspectives

Segmentation of cardiac fibrosis and scars is essential for clinical diagnosis and can provide invaluable guidance for the treatment of cardiac diseases. Late Gadolinium enhancement (LGE) cardiovascular magnetic resonance (CMR) has been successful in guiding the clinical diagnosis and treatment reliably. For LGE CMR, many methods have demonstrated success in accurately segmenting scarring regions. Co-registration with other non-contrast-agent (non-CA) modalities [e.g., balanced steady-state free precession (bSSFP) cine magnetic resonance imaging (MRI)] can further enhance the efficacy of automated segmentation of cardiac anatomies. Many conventional methods have been proposed to provide automated or semi-automated segmentation of scars. With the development of deep learning in recent years, we can also see more advanced methods that are more efficient in providing more accurate segmentations. This paper conducts a state-of-the-art review of conventional and current state-of-the-art approaches utilizing different modalities for accurate cardiac fibrosis and scar segmentation.

Myocardial Infarction Quantification from Late Gadolinium Enhancement MRI Using Top-Hat Transforms and Neural Networks

Late gadolinium enhancement (LGE) MRI is the gold standard technique for myocardial viability assessment. Although the technique accurately reflects the damaged tissue, there is no clinical standard to quantify myocardial infarction (MI). Moreover, commercial software used in clinical practice are mostly semi-automatic, and hence require direct intervention of experts. In this work, a new automatic method for MI quantification from LGE-MRI is proposed. Our novel segmentation approach is devised for accurately detecting not only hyper-enhanced lesions, but also microvascular obstruction areas. Moreover, it includes a myocardial disease detection step which extends the algorithm for working under healthy scans. The method is based on a cascade approach where firstly, diseased slices are identified by a convolutional neural network (CNN). Secondly, by means of morphological operations a fast coarse scar segmentation is obtained. Thirdly, the segmentation is refined by a boundary-voxel reclassification strategy using an ensemble of very light CNNs. We tested the method on a LGE-MRI database with healthy (n = 20) and diseased (n = 80) cases following a 5-fold cross-validation scheme. Our approach segmented myocardial scars with an average Dice coefficient of 77.22 ± 14.3% and with a volumetric error of 1.0 ± 6.9 cm3. In a comparison against nine reference algorithms, the proposed method achieved the highest agreement in volumetric scar quantification with the expert delineations (p< 0.001 when compared to the other approaches). Moreover, it was able to reproduce the scar segmentation intra- and inter-rater variability. Our approach was shown to be a good first attempt towards automatic and accurate myocardial scar segmentation, although validation over larger LGE-MRI databases is needed.

How to do left atrial late gadolinium enhancement: a review

BACKGROUND

Quantification of left atrial late gadolinium enhancement is a powerful clinical and research tool. Fibrosis burden has been shown to predict the success of pulmonary vein isolation, post-ablation reoccurrence, and major adverse cardiovascular events such as stroke.

OVERVIEW

The standardized cardiovascular magnetic resonance imaging protocols 2020 update describes the key components of the examination. This review is a more in-depth guide, geared toward building left atrial late gadolinium enhancement imaging from the ground up. The standard protocol consists of the following: localization, pulmonary vein magnetic resonance angiography, cardiac cines, left ventricular, and atrial late gadolinium enhancement. We also review typical segmentation and post-processing techniques, as well as discuss pitfalls, limitations, and potential future innovations in this area.

CONCLUSIONS

With sufficient experience and optimized protocols, left atrial late gadolinium enhancement imaging is a strong addition to the cardiac magnetic resonance imaging repertoire.

Machine Learning-Derived Fractal Features of Shape and Texture of the Left Atrium and Pulmonary Veins From Cardiac Computed Tomography Scans Are Associated With Risk of Recurrence of Atrial Fibrillation Postablation

[Figure: see text].

PWD-3DNet: A Deep Learning-Based Fully-Automated Segmentation of Multiple Structures on Temporal Bone CT Scans

The temporal bone is a part of the lateral skull surface that contains organs responsible for hearing and balance. Mastering surgery of the temporal bone is challenging because of this complex and microscopic three-dimensional anatomy. Segmentation of intra-temporal anatomy based on computed tomography (CT) images is necessary for applications such as surgical training and rehearsal, amongst others. However, temporal bone segmentation is challenging due to the similar intensities and complicated anatomical relationships among critical structures, undetectable small structures on standard clinical CT, and the amount of time required for manual segmentation. This paper describes a single multi-class deep learning-based pipeline as the first fully automated algorithm for segmenting multiple temporal bone structures from CT volumes, including the sigmoid sinus, facial nerve, inner ear, malleus, incus, stapes, internal carotid artery and internal auditory canal. The proposed fully convolutional network, PWD-3DNet, is a patch-wise densely connected (PWD) three-dimensional (3D) network. The accuracy and speed of the proposed algorithm was shown to surpass current manual and semi-automated segmentation techniques. The experimental results yielded significantly high Dice similarity scores and low Hausdorff distances for all temporal bone structures with an average of 86% and 0.755 millimeter (mm), respectively. We illustrated that overlapping in the inference sub-volumes improves the segmentation performance. Moreover, we proposed augmentation layers by using samples with various transformations and image artefacts to increase the robustness of PWD-3DNet against image acquisition protocols, such as smoothing caused by soft tissue scanner settings and larger voxel sizes used for radiation reduction. The proposed algorithm was tested on low-resolution CTs acquired by another center with different scanner parameters than the ones used to create the algorithm and shows potential for application beyond the particular training data used in the study.

A fully automated left atrium segmentation approach from late gadolinium enhanced magnetic resonance imaging based on a convolutional neural network

Background

Several studies suggest that the evaluation of left atrial (LA) fibrosis is a relevant information for the assessment of the appropriate strategy in catheter ablation in atrial fibrillation (AF). Late gadolinium enhanced (LGE) cardiac magnetic resonance imaging (MRI) is a non-invasive technique, which might be employed for the non-invasive quantification of LA myocardial fibrotic tissue in patients with AF. Nowadays, the analysis of LGE MRI relies on manual tracing of LA boundaries and this procedure is time-consuming and prone to high inter-observer variability given the different degrees of observers' experience, LA wall thickness and data resolution. Therefore, an automated segmentation approach of the atrial cavity for the quantification of scar tissue would be highly desirable.

Methods

This study focuses on the design of a fully automated LGE MRI segmentation pipeline which includes a convolutional neural network (CNN) based on the successful architecture U-Net. The CNN was trained, validated and tested end-to-end with the data available from the Statistical Atlases and Computational Modelling of the Heart 2018 Atrial Segmentation Challenge (100 cardiac data). Two different approaches were tested: using both stacks of 2-D axial slices and using 3-D data (with the appropriate changes in the baseline architecture). In the latter approach, thanks to the 3-D convolution operator, all the information underlying 3-D data can be exploited. Once the training was completed using 80 cardiac data, a post-processing step was applied on 20 predicted segmentations belonging to the test set.

Results

By applying the 2-D and 3-D approaches, average Dice coefficient and mean Hausdorff distances were 0.896, 0.914, and 8.98 mm, 8.34 mm, respectively. Volumes of the anatomical LA meshes from the automated analysis were highly correlated with the volumes from ground truth [2-D: r=0.978, y=0.94x+0.07, bias=3.5 ml (5.6%), SD=5.3 mL (8.5%); 3-D: r=0.982, y=0.92x+2.9, bias=2.1 mL (3.5%), SD=5.2 mL (8.4%)].

Conclusions

These results suggest the proposed approach is feasible and provides accurate results. Despite the increase of the number of trainable parameters, the proposed 3-D CNN learns better features leading to higher performance, feasible for a real clinical application.

Clinical applications of artificial intelligence in cardiology on the verge of the decade

Artificial intelligence (AI) has been hailed as the fourth industrial revolution and its influence on people's lives is increasing. The research on AI applications in medicine is progressing rapidly. This revolution shows promise for more precise diagnoses, streamlined workflows, increased accessibility to healthcare services and new insights into ever-growing population-wide datasets. While some applications have already found their way into contemporary patient care, we are still in the early days of the AI-era in medicine. Despite the popularity of these new technologies, many practitioners lack an understanding of AI methods, their benefits, and pitfalls. This review aims to provide information about the general concepts of machine learning (ML) with special focus on the applications of such techniques in cardiovascular medicine. It also sets out the current trends in research related to medical applications of AI. Along with new possibilities, new threats arise - acknowledging and understanding them is as important as understanding the ML methodology itself. Therefore, attention is also paid to the current opinions and guidelines regarding the validation and safety of AI-powered tools.

Simultaneous left atrium anatomy and scar segmentations via deep learning in multiview information with attention

Three-dimensional late gadolinium enhanced (LGE) cardiac MR (CMR) of left atrial scar in patients with atrial fibrillation (AF) has recently emerged as a promising technique to stratify patients, to guide ablation therapy and to predict treatment success. This requires a segmentation of the high intensity scar tissue and also a segmentation of the left atrium (LA) anatomy, the latter usually being derived from a separate bright-blood acquisition. Performing both segmentations automatically from a single 3D LGE CMR acquisition would eliminate the need for an additional acquisition and avoid subsequent registration issues. In this paper, we propose a joint segmentation method based on multiview two-task (MVTT) recursive attention model working directly on 3D LGE CMR images to segment the LA (and proximal pulmonary veins) and to delineate the scar on the same dataset. Using our MVTT recursive attention model, both the LA anatomy and scar can be segmented accurately (mean Dice score of 93% for the LA anatomy and 87% for the scar segmentations) and efficiently ( ∼ 0.27 s to simultaneously segment the LA anatomy and scars directly from the 3D LGE CMR dataset with 60-68 2D slices). Compared to conventional unsupervised learning and other state-of-the-art deep learning based methods, the proposed MVTT model achieved excellent results, leading to an automatic generation of a patient-specific anatomical model combined with scar segmentation for patients in AF.

Artificial intelligence: improving the efficiency of cardiovascular imaging

INTRODUCTION

Artificial intelligence (AI) describes the use of computational techniques to mimic human intelligence. In healthcare, this typically involves large medical datasets being used to predict a diagnosis, identify new disease genotypes or phenotypes, or guide treatment strategies. Noninvasive imaging remains a cornerstone for the diagnosis, risk stratification, and management of patients with cardiovascular disease. AI can facilitate every stage of the imaging process, from acquisition and reconstruction, to segmentation, measurement, interpretation, and subsequent clinical pathways.

AREAS COVERED

In this paper, we review state-of-the-art AI techniques and their current applications in cardiac imaging, and discuss the future role of AI as a precision medicine tool.

EXPERT OPINION

Cardiovascular medicine is primed for scalable AI applications which can interpret vast amounts of clinical and imaging data in greater depth than ever before. AI-augmented medical systems have the potential to improve workflow and provide reproducible and objective quantitative results which can inform clinical decisions. In the foreseeable future, AI may work in the background of cardiac image analysis software and routine clinical reporting, automatically collecting data and enabling real-time diagnosis and risk stratification.

Deep Learning for Cardiac Image Segmentation: A Review

Deep learning has become the most widely used approach for cardiac image segmentation in recent years. In this paper, we provide a review of over 100 cardiac image segmentation papers using deep learning, which covers common imaging modalities including magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound and major anatomical structures of interest (ventricles, atria, and vessels). In addition, a summary of publicly available cardiac image datasets and code repositories are included to provide a base for encouraging reproducible research. Finally, we discuss the challenges and limitations with current deep learning-based approaches (scarcity of labels, model generalizability across different domains, interpretability) and suggest potential directions for future research.

Atrial scar quantification via multi-scale CNN in the graph-cuts framework

•

Propose a fully automatic method for left atrial scar quantification, with promising performance.

•

Formulate a new framework of scar quantification based on surface projection and graph-cuts framework.

•

Propose the multi-scale learning CNN, combined with the random shift training strategy, to learn and predict the graph potentials, which significantly improves the performance of the proposed method, and enables the full automation of the framework.

•

Provide thorough validation and parameter studies for the proposed techniques using fifty-eight clinical images.

Late gadolinium enhancement magnetic resonance imaging (LGE MRI) appears to be a promising alternative for scar assessment in patients with atrial fibrillation (AF). Automating the quantification and analysis of atrial scars can be challenging due to the low image quality. In this work, we propose a fully automated method based on the graph-cuts framework, where the potentials of the graph are learned on a surface mesh of the left atrium (LA) using a multi-scale convolutional neural network (MS-CNN). For validation, we have included fifty-eight images with manual delineations. MS-CNN, which can efficiently incorporate both the local and global texture information of the images, has been shown to evidently improve the segmentation accuracy of the proposed graph-cuts based method. The segmentation could be further improved when the contribution between the t-link and n-link weights of the graph is balanced. The proposed method achieves a mean accuracy of 0.856 ± 0.033 and mean Dice score of 0.702 ± 0.071 for LA scar quantification. Compared to the conventional methods, which are based on the manual delineation of LA for initialization, our method is fully automatic and has demonstrated significantly better Dice score and accuracy (p < 0.01). The method is promising and can be potentially useful in diagnosis and prognosis of AF.

Deep Learning for Quantitative Cardiac MRI

OBJECTIVE. The recent advancement of deep learning techniques has profoundly impacted research on quantitative cardiac MRI analysis. The purpose of this article is to introduce the concept of deep learning, review its current applications on quantitative cardiac MRI, and discuss its limitations and challenges. CONCLUSION. Deep learning has shown state-of-the-art performance on quantitative analysis of multiple cardiac MRI sequences and holds great promise for future use in clinical practice and scientific research.

Deep Learning for Diagnosis of Chronic Myocardial Infarction on Nonenhanced Cardiac Cine MRI

Background Renal impairment is common in patients with coronary artery disease and, if severe, late gadolinium enhancement (LGE) imaging for myocardial infarction (MI) evaluation cannot be performed. Purpose To develop a fully automatic framework for chronic MI delineation via deep learning on non-contrast material-enhanced cardiac cine MRI. Materials and Methods In this retrospective single-center study, a deep learning model was developed to extract motion features from the left ventricle and delineate MI regions on nonenhanced cardiac cine MRI collected between October 2015 and March 2017. Patients with chronic MI, as well as healthy control patients, had both nonenhanced cardiac cine (25 phases per cardiac cycle) and LGE MRI examinations. Eighty percent of MRI examinations were used for the training data set and 20% for the independent testing data set. Chronic MI regions on LGE MRI were defined as ground truth. Diagnostic performance was assessed by analysis of the area under the receiver operating characteristic curve (AUC). MI area and MI area percentage from nonenhanced cardiac cine and LGE MRI were compared by using the Pearson correlation, paired t test, and Bland-Altman analysis. Results Study participants included 212 patients with chronic MI (men, 171; age, 57.2 years ± 12.5) and 87 healthy control patients (men, 42; age, 43.3 years ± 15.5). Using the full cardiac cine MRI, the per-segment sensitivity and specificity for detecting chronic MI in the independent test set was 89.8% and 99.1%, respectively, with an AUC of 0.94. There were no differences between nonenhanced cardiac cine and LGE MRI analyses in number of MI segments (114 vs 127, respectively; P = .38), per-patient MI area (6.2 cm² ± 2.8 vs 5.5 cm² ± 2.3, respectively; P = .27; correlation coefficient, r = 0.88), and MI area percentage (21.5% ± 17.3 vs 18.5% ± 15.4; P = .17; correlation coefficient, r = 0.89). Conclusion The proposed deep learning framework on nonenhanced cardiac cine MRI enables the confirmation (presence), detection (position), and delineation (transmurality and size) of chronic myocardial infarction. However, future larger-scale multicenter studies are required for a full validation. Published under a CC BY 4.0 license. Online supplemental material is available for this article. See also the editorial by Leiner in this issue.

Fully Automatic Left Atrium Segmentation From Late Gadolinium Enhanced Magnetic Resonance Imaging Using a Dual Fully Convolutional Neural Network

Atrial fibrillation (AF) is the most prevalent form of cardiac arrhythmia. Current treatments for AF remain suboptimal due to a lack of understanding of the underlying atrial structures that directly sustain AF. Existing approaches for analyzing atrial structures in 3-D, especially from late gadolinium-enhanced (LGE) magnetic resonance imaging, rely heavily on manual segmentation methods that are extremely labor-intensive and prone to errors. As a result, a robust and automated method for analyzing atrial structures in 3-D is of high interest. We have, therefore, developed AtriaNet, a 16-layer convolutional neural network (CNN), on 154 3-D LGE-MRIs with a spatial resolution of 0.625 mm ×0.625 mm ×1.25 mm from patients with AF, to automatically segment the left atrial (LA) epicardium and endocardium. AtriaNet consists of a multi-scaled, dual-pathway architecture that captures both the local atrial tissue geometry and the global positional information of LA using 13 successive convolutions and three further convolutions for merging. By utilizing computationally efficient batch prediction, AtriaNet was able to successfully process each 3-D LGE-MRI within 1 min. Furthermore, benchmarking experiments have shown that AtriaNet has outperformed the state-of-the-art CNNs, with a DICE score of 0.940 and 0.942 for the LA epicardium and endocardium, respectively, and an inter-patient variance of <0.001. The estimated LA diameter and volume computed from the automatic segmentations were accurate to within 1.59 mm and 4.01 cm3 of the ground truths. Our proposed CNN was tested on the largest known data set for LA segmentation, and to the best of our knowledge, it is the most robust approach that has ever been developed for segmenting LGE-MRIs. The increased accuracy of atrial reconstruction and analysis could potentially improve the understanding and treatment of AF.

Development and testing of a deep learning-based strategy for scar segmentation on CMR-LGE images

OBJECTIVE

The aim of this paper is to investigate the use of fully convolutional neural networks (FCNNs) to segment scar tissue in the left ventricle from cardiac magnetic resonance with late gadolinium enhancement (CMR-LGE) images.

METHODS

A successful FCNN in the literature (the ENet) was modified and trained to provide scar-tissue segmentation. Two segmentation protocols (Protocol 1 and Protocol 2) were investigated, the latter limiting the scar-segmentation search area to the left ventricular myocardial tissue region. CMR-LGE from 30 patients with ischemic-heart disease were retrospectively analyzed, for a total of 250 images, presenting high variability in terms of scar dimension and location. Segmentation results were assessed against manual scar-tissue tracing using one-patient-out cross validation.

RESULTS

Protocol 2 outperformed Protocol 1 significantly (p value < 0.05), with median sensitivity and Dice similarity coefficient equal to 88.07% [inter-quartile range (IQR) 18.84%] and 71.25% (IQR 31.82%), respectively.

DISCUSSION

Both segmentation protocols were able to detect scar tissues in the CMR-LGE images but higher performance was achieved when limiting the search area to the myocardial region. The findings of this paper represent an encouraging starting point for the use of FCNNs for the segmentation of nonviable scar tissue from CMR-LGE images.