A novel skeleton based quantification and 3-D volumetric visualization of left atrium fibrosis using late gadolinium enhancement magnetic resonance imaging

Adaptive dynamic inference for few-shot left atrium segmentation

Accurate segmentation of the left atrium (LA) from late gadolinium-enhanced cardiac magnetic resonance (LGE CMR) images is crucial for aiding the treatment of patients with atrial fibrillation. Few-shot learning holds significant potential for achieving accurate LA segmentation with low demand on high-cost labeled LGE CMR data and fast generalization across different centers. However, accurate LA segmentation with few-shot learning is a challenging task due to the low-intensity contrast between the LA and other neighboring organs in LGE CMR images. To address this issue, we propose an Adaptive Dynamic Inference Network (ADINet) that explicitly models the differences between the foreground and background. Specifically, ADINet leverages dynamic collaborative inference (DCI) and dynamic reverse inference (DRI) to adaptively allocate semantic-aware and spatial-specific convolution weights and indication information. These allocations are conditioned on the support foreground and background knowledge, utilizing pixel-wise correlations, for different spatial positions of query images. The convolution weights adapt to different visual patterns based on spatial positions, enabling effective encoding of differences between foreground and background regions. Meanwhile, the indication information adapts to the background visual pattern to reversely decode foreground LA regions, leveraging their spatial complementarity. To promote the learning of ADINet, we propose hierarchical supervision, which enforces spatial consistency and differences between the background and foreground regions through pixel-wise semantic supervision and pixel-pixel correlation supervision. We demonstrated the performance of ADINet on three LGE CMR datasets from different centers. Compared to state-of-the-art methods with ten available samples, ADINet yielded better segmentation performance in terms of four metrics.

Edge and dense attention U-net for atrial scar segmentation in LGE-MRI

The segmentation of atrial scars in LGE-MRI images has huge potential value for clinical diagnosis and subsequent treatment. In clinical practice, atrial scars are usually manually calibrated by experienced experts, which is time-consuming and prone to errors. However, automatic segmentation also faces difficulties due to myocardial scars' small size and variable shape. The present study introduces a dual branch network, incorporating edge attention, and deep supervision strategy. Edge attention is introduced to fully utilize the spatial relationship between the scar and the atrium. Besides, dense attention is embedded in bottom layer to solve feature disappearance. At the same time, deep supervision accelerates the convergence of the model and improves segmentation accuracy. The experiments were conducted on the 2022 atrial and scar segmentation challenge dataset. The results demonstrate that the proposed method has achieved superior performance.

Medical image analysis on left atrial LGE MRI for atrial fibrillation studies: A review

Late gadolinium enhancement magnetic resonance imaging (LGE MRI) is commonly used to visualize and quantify left atrial (LA) scars. The position and extent of LA scars provide important information on the pathophysiology and progression of atrial fibrillation (AF). Hence, LA LGE MRI computing and analysis are essential for computer-assisted diagnosis and treatment stratification of AF patients. Since manual delineations can be time-consuming and subject to intra- and inter-expert variability, automating this computing is highly desired, which nevertheless is still challenging and under-researched. This paper aims to provide a systematic review on computing methods for LA cavity, wall, scar, and ablation gap segmentation and quantification from LGE MRI, and the related literature for AF studies. Specifically, we first summarize AF-related imaging techniques, particularly LGE MRI. Then, we review the methodologies of the four computing tasks in detail and summarize the validation strategies applied in each task as well as state-of-the-art results on public datasets. Finally, the possible future developments are outlined, with a brief survey on the potential clinical applications of the aforementioned methods. The review indicates that the research into this topic is still in the early stages. Although several methods have been proposed, especially for the LA cavity segmentation, there is still a large scope for further algorithmic developments due to performance issues related to the high variability of enhancement appearance and differences in image acquisition.

AtrialJSQnet: A New framework for joint segmentation and quantification of left atrium and scars incorporating spatial and shape information

Left atrial (LA) and atrial scar segmentation from late gadolinium enhanced magnetic resonance imaging (LGE MRI) is an important task in clinical practice. The automatic segmentation is however still challenging due to the poor image quality, the various LA shapes, the thin wall, and the surrounding enhanced regions. Previous methods normally solved the two tasks independently and ignored the intrinsic spatial relationship between LA and scars. In this work, we develop a new framework, namely AtrialJSQnet, where LA segmentation, scar projection onto the LA surface, and scar quantification are performed simultaneously in an end-to-end style. We propose a mechanism of shape attention (SA) via an implicit surface projection to utilize the inherent correlation between LA cavity and scars. In specific, the SA scheme is embedded into a multi-task architecture to perform joint LA segmentation and scar quantification. Besides, a spatial encoding (SE) loss is introduced to incorporate continuous spatial information of the target in order to reduce noisy patches in the predicted segmentation. We evaluated the proposed framework on 60 post-ablation LGE MRIs from the MICCAI2018 Atrial Segmentation Challenge. Moreover, we explored the domain generalization ability of the proposed AtrialJSQnet on 40 pre-ablation LGE MRIs from this challenge and 30 post-ablation multi-center LGE MRIs from another challenge (ISBI2012 Left Atrium Fibrosis and Scar Segmentation Challenge). Extensive experiments on public datasets demonstrated the effect of the proposed AtrialJSQnet, which achieved competitive performance over the state-of-the-art. The relatedness between LA segmentation and scar quantification was explicitly explored and has shown significant performance improvements for both tasks. The code has been released via https://zmiclab.github.io/projects.html.

JAS-GAN: Generative Adversarial Network Based Joint Atrium and Scar Segmentations on Unbalanced Atrial Targets

Automated and accurate segmentations of left atrium (LA) and atrial scars from late gadolinium-enhanced cardiac magnetic resonance (LGE CMR) images are in high demand for quantifying atrial scars. The previous quantification of atrial scars relies on a two-phase segmentation for LA and atrial scars due to their large volume difference (unbalanced atrial targets). In this paper, we propose an inter-cascade generative adversarial network, namely JAS-GAN, to segment the unbalanced atrial targets from LGE CMR images automatically and accurately in an end-to-end way. Firstly, JAS-GAN investigates an adaptive attention cascade to automatically correlate the segmentation tasks of the unbalanced atrial targets. The adaptive attention cascade mainly models the inclusion relationship of the two unbalanced atrial targets, where the estimated LA acts as the attention map to adaptively focus on the small atrial scars roughly. Then, an adversarial regularization is applied to the segmentation tasks of the unbalanced atrial targets for making a consistent optimization. It mainly forces the estimated joint distribution of LA and atrial scars to match the real ones. We evaluated the performance of our JAS-GAN on a 3D LGE CMR dataset with 192 scans. Compared with the state-of-the-art methods, our proposed approach yielded better segmentation performance (Average Dice Similarity Coefficient (DSC) values of 0.946 and 0.821 for LA and atrial scars, respectively), which indicated the effectiveness of our proposed approach for segmenting unbalanced atrial targets.

Atrial Myopathy Underlying Atrial Fibrillation

While AF most often occurs in the setting of atrial disease, current assessment and treatment of patients with AF does not focus on the extent of the atrial myopathy that serves as the substrate for this arrhythmia. Atrial myopathy, in particular atrial fibrosis, may initiate a vicious cycle in which atrial myopathy leads to AF, which in turn leads to a worsening myopathy. Various techniques, including ECG, plasma biomarkers, electroanatomical voltage mapping, echocardiography, and cardiac MRI, can help to identify and quantify aspects of the atrial myopathy. Current therapies, such as catheter ablation, do not directly address the underlying atrial myopathy. There is emerging research showing that by targeting this myopathy we can help decrease the occurrence and burden of AF.

Simultaneous left atrium anatomy and scar segmentations via deep learning in multiview information with attention

Three-dimensional late gadolinium enhanced (LGE) cardiac MR (CMR) of left atrial scar in patients with atrial fibrillation (AF) has recently emerged as a promising technique to stratify patients, to guide ablation therapy and to predict treatment success. This requires a segmentation of the high intensity scar tissue and also a segmentation of the left atrium (LA) anatomy, the latter usually being derived from a separate bright-blood acquisition. Performing both segmentations automatically from a single 3D LGE CMR acquisition would eliminate the need for an additional acquisition and avoid subsequent registration issues. In this paper, we propose a joint segmentation method based on multiview two-task (MVTT) recursive attention model working directly on 3D LGE CMR images to segment the LA (and proximal pulmonary veins) and to delineate the scar on the same dataset. Using our MVTT recursive attention model, both the LA anatomy and scar can be segmented accurately (mean Dice score of 93% for the LA anatomy and 87% for the scar segmentations) and efficiently ( ∼ 0.27 s to simultaneously segment the LA anatomy and scars directly from the 3D LGE CMR dataset with 60-68 2D slices). Compared to conventional unsupervised learning and other state-of-the-art deep learning based methods, the proposed MVTT model achieved excellent results, leading to an automatic generation of a patient-specific anatomical model combined with scar segmentation for patients in AF.

Atrial scar quantification via multi-scale CNN in the graph-cuts framework

•

Propose a fully automatic method for left atrial scar quantification, with promising performance.

•

Formulate a new framework of scar quantification based on surface projection and graph-cuts framework.

•

Propose the multi-scale learning CNN, combined with the random shift training strategy, to learn and predict the graph potentials, which significantly improves the performance of the proposed method, and enables the full automation of the framework.

•

Provide thorough validation and parameter studies for the proposed techniques using fifty-eight clinical images.

Late gadolinium enhancement magnetic resonance imaging (LGE MRI) appears to be a promising alternative for scar assessment in patients with atrial fibrillation (AF). Automating the quantification and analysis of atrial scars can be challenging due to the low image quality. In this work, we propose a fully automated method based on the graph-cuts framework, where the potentials of the graph are learned on a surface mesh of the left atrium (LA) using a multi-scale convolutional neural network (MS-CNN). For validation, we have included fifty-eight images with manual delineations. MS-CNN, which can efficiently incorporate both the local and global texture information of the images, has been shown to evidently improve the segmentation accuracy of the proposed graph-cuts based method. The segmentation could be further improved when the contribution between the t-link and n-link weights of the graph is balanced. The proposed method achieves a mean accuracy of 0.856 ± 0.033 and mean Dice score of 0.702 ± 0.071 for LA scar quantification. Compared to the conventional methods, which are based on the manual delineation of LA for initialization, our method is fully automatic and has demonstrated significantly better Dice score and accuracy (p < 0.01). The method is promising and can be potentially useful in diagnosis and prognosis of AF.

Multiview Sequential Learning and Dilated Residual Learning for a Fully Automatic Delineation of the Left Atrium and Pulmonary Veins from Late Gadolinium-Enhanced Cardiac MRI Images

Accurate delineation of heart substructures is a prerequisite for abnormality detection, for making quantitative and functional measurements, and for computer-aided diagnosis and treatment planning. Late Gadolinium-Enhanced Cardiac MRI (LGE-CMRI) is an emerging imaging technology for myocardial infarction or scar detection based on the differences in the volume of residual gadolinium distribution between scar and healthy tissues. While LGE-CMRI is a well-established non-invasive tool for detecting myocardial scar tissues in the ventricles, its application to left atrium (LA) imaging is more challenging due to its very thin wall of the LA and poor quality images, which may be produced because of motion artefacts and low signal-to-noise ratio. As the LGE-CMRI scan is designed to highlight scar tissues by altering the gadolinium kinetics, the anatomy among different heart substructures has less distinguishable boundaries. An accurate, robust and reproducible method for LA segmentation is highly in demand because it can not only provide valuable information of the heart function but also be helpful for the further delineation of scar tissue and measuring the scar percentage. In this study, we proposed a novel deep learning framework working on LGE-CMRI images directly by combining sequential learning and dilated residual learning to delineate LA and pulmonary veins fully automatically. The achieved results showed accurate segmentation results compared to the state-of-the-art methods. The proposed framework leads to an automatic generation of a patient-specific model that can potentially enable an objective atrial scarring assessment for the atrial fibrillation patients.

Fully automatic segmentation and objective assessment of atrial scars for long-standing persistent atrial fibrillation patients using late gadolinium-enhanced MRI

PURPOSE

Atrial fibrillation (AF) is the most common heart rhythm disorder and causes considerable morbidity and mortality, resulting in a large public health burden that is increasing as the population ages. It is associated with atrial fibrosis, the amount and distribution of which can be used to stratify patients and to guide subsequent electrophysiology ablation treatment. Atrial fibrosis may be assessed noninvasively using late gadolinium-enhanced (LGE) magnetic resonance imaging (MRI) where scar tissue is visualized as a region of signal enhancement. However, manual segmentation of the heart chambers and of the atrial scar tissue is time consuming and subject to interoperator variability, particularly as image quality in AF is often poor. In this study, we propose a novel fully automatic pipeline to achieve accurate and objective segmentation of the heart (from MRI Roadmap data) and of scar tissue within the heart (from LGE MRI data) acquired in patients with AF.

METHODS

Our fully automatic pipeline uniquely combines: (a) a multiatlas-based whole heart segmentation (MA-WHS) to determine the cardiac anatomy from an MRI Roadmap acquisition which is then mapped to LGE MRI, and (b) a super-pixel and supervised learning based approach to delineate the distribution and extent of atrial scarring in LGE MRI. We compared the accuracy of the automatic analysis to manual ground truth segmentations in 37 patients with persistent long-standing AF.

RESULTS

Both our MA-WHS and atrial scarring segmentations showed accurate delineations of cardiac anatomy (mean Dice = 89%) and atrial scarring (mean Dice = 79%), respectively, compared to the established ground truth from manual segmentation. In addition, compared to the ground truth, we obtained 88% segmentation accuracy, with 90% sensitivity and 79% specificity. Receiver operating characteristic analysis achieved an average area under the curve of 0.91.

CONCLUSION

Compared with previously studied methods with manual interventions, our innovative pipeline demonstrated comparable results, but was computed fully automatically. The proposed segmentation methods allow LGE MRI to be used as an objective assessment tool for localization, visualization, and quantitation of atrial scarring and to guide ablation treatment.

How to detect atrial fibrosis

In the last twenty years, new imaging techniques to assess atrial function and to predict the risk of recurrence of atrial fibrillation after treatment have been developed. The present review deals with the role of these techniques in the detection of structural and functional changes of the atrium and diagnosis of atrial remodeling, particularly atrial fibrosis. Echocardiography allows the detection of anatomical, functional changes and deformation of the atrial wall during the phases of the cardiac cycle. For this, adequate acquisition of atrial images is necessary using speckle tracking imaging and interpretation of the resulting strain and strain rate curves. This allows to predict new-onset atrial fibrillation and recurrences. Its main limitations are inter-observer variability, the existence of different software manufacturers, and the fact that the software used were originally developed for the evaluation of the ventricular function and are now applied to the atria. Cardiac magnetic resonance, using contrast enhancement with gadolinium, plays a key role in the visualization and quantification of atrial fibrosis. This is the established method for in vivo visualization of myocardial fibrotic tissue. The non-invasive evaluation of atrial fibrosis is associated with the risk of recurrence of atrial fibrillation and with electro-anatomical endocardial mapping. We discuss the limitations of these techniques, derived from the difficulty of demonstrating the correlation between fibrosis imaging and histology, and poor intra- and inter-observer reproducibility. The sources of discordance are described, mainly due to image acquisition and processing, and the challenges ahead in an attempt to eliminate differences between operators.

Biophysical Modeling Predicts Ventricular Tachycardia Inducibility and Circuit Morphology: A Combined Clinical Validation and Computer Modeling Approach

INTRODUCTION

Computational modeling of cardiac arrhythmogenesis and arrhythmia maintenance has made a significant contribution to the understanding of the underlying mechanisms of arrhythmia. We hypothesized that a cardiac model using personalized electro-anatomical parameters could define the underlying ventricular tachycardia (VT) substrate and predict reentrant VT circuits. We used a combined modeling and clinical approach in order to validate the concept.

METHODS AND RESULTS

Non-contact electroanatomic mapping studies were performed in 7 patients (5 ischemics, 2 non-ischemics). Three ischemic cardiomyopathy patients underwent a clinical VT stimulation study. Anatomical information was obtained from cardiac magnetic resonance imaging (CMR) including high-resolution scar imaging. A simplified biophysical mono-domain action potential model personalized with the patients' anatomical and electrical information was used to perform in silico VT stimulation studies for comparison. The personalized in silico VT stimulations were able to predict VT inducibility as well as the macroscopic characteristics of the VT circuits in patients who had clinical VT stimulation studies. The patients with positive clinical VT stimulation studies had wider distribution of action potential duration restitution curve (APD-RC) slopes and APDs than the patient with a negative VT stimulation study. The exit points of reentrant VT circuits encompassed a higher percentage of the maximum APD-RC slope compared to the scar and non-scar areas, 32%, 4%, and 0.2%, respectively.

CONCLUSIONS

VT stimulation studies can be simulated in silico using a personalized biophysical cardiac model. Myocardial spatial heterogeneity of APD restitution properties and conductivity may help predict the location of crucial entry/exit points of reentrant VT circuits.

Evaluation of state-of-the-art segmentation algorithms for left ventricle infarct from late Gadolinium enhancement MR images

Studies have demonstrated the feasibility of late Gadolinium enhancement (LGE) cardiovascular magnetic resonance (CMR) imaging for guiding the management of patients with sequelae to myocardial infarction, such as ventricular tachycardia and heart failure. Clinical implementation of these developments necessitates a reproducible and reliable segmentation of the infarcted regions. It is challenging to compare new algorithms for infarct segmentation in the left ventricle (LV) with existing algorithms. Benchmarking datasets with evaluation strategies are much needed to facilitate comparison. This manuscript presents a benchmarking evaluation framework for future algorithms that segment infarct from LGE CMR of the LV. The image database consists of 30 LGE CMR images of both humans and pigs that were acquired from two separate imaging centres. A consensus ground truth was obtained for all data using maximum likelihood estimation. Six widely-used fixed-thresholding methods and five recently developed algorithms are tested on the benchmarking framework. Results demonstrate that the algorithms have better overlap with the consensus ground truth than most of the n-SD fixed-thresholding methods, with the exception of the Full-Width-at-Half-Maximum (FWHM) fixed-thresholding method. Some of the pitfalls of fixed thresholding methods are demonstrated in this work. The benchmarking evaluation framework, which is a contribution of this work, can be used to test and benchmark future algorithms that detect and quantify infarct in LGE CMR images of the LV. The datasets, ground truth and evaluation code have been made publicly available through the website: https://www.cardiacatlas.org/web/guest/challenges.

Rapid automatic segmentation of abnormal tissue in late gadolinium enhancement cardiovascular magnetic resonance images for improved management of long-standing persistent atrial fibrillation

Background

Atrial fibrillation (AF) is the most common heart rhythm disorder. In order for late Gd enhancement cardiovascular magnetic resonance (LGE CMR) to ameliorate the AF management, the ready availability of the accurate enhancement segmentation is required. However, the computer-aided segmentation of enhancement in LGE CMR of AF is still an open question. Additionally, the number of centres that have reported successful application of LGE CMR to guide clinical AF strategies remains low, while the debate on LGE CMR’s diagnostic ability for AF still holds. The aim of this study is to propose a method that reliably distinguishes enhanced (abnormal) from non-enhanced (healthy) tissue within the left atrial wall of (pre-ablation and 3 months post-ablation) LGE CMR data-sets from long-standing persistent AF patients studied at our centre.

Methods

Enhancement segmentation was achieved by employing thresholds benchmarked against the statistics of the whole left atrial blood-pool (LABP). The test-set cross-validation mechanism was applied to determine the input feature representation and algorithm that best predict enhancement threshold levels.

Results

Global normalized intensity threshold levels T_PRE = 1 1/4 and T_POST = 1 5/8 were found to segment enhancement in data-sets acquired pre-ablation and at 3 months post-ablation, respectively. The segmentation results were corroborated by using visual inspection of LGE CMR brightness levels and one endocardial bipolar voltage map. The measured extent of pre-ablation fibrosis fell within the normal range for the specific arrhythmia phenotype. 3D volume renderings of segmented post-ablation enhancement emulated the expected ablation lesion patterns. By comparing our technique with other related approaches that proposed different threshold levels (although they also relied on reference regions from within the LABP) for segmenting enhancement in LGE CMR data-sets of AF patients, we illustrated that the cut-off levels employed by other centres may not be usable for clinical studies performed in our centre.

Conclusions

The proposed technique has great potential for successful employment in the AF management within our centre. It provides a highly desirable validation of the LGE CMR technique for AF studies. Inter-centre differences in the CMR acquisition protocol and image analysis strategy inevitably impede the selection of a universally optimal algorithm for segmentation of enhancement in AF studies.

Topology preserving thinning of cell complexes

A topology preserving skeleton is a synthetic representation of an object that retains its topology and many of its significant morphological properties. The process of obtaining the skeleton, referred to as skeletonization or thinning, is a very active research area. It plays a central role in reducing the amount of information to be processed during image analysis and visualization, computer-aided diagnosis, or by pattern recognition algorithms. This paper introduces a novel topology preserving thinning algorithm, which removes simple cells-a generalization of simple points-of a given cell complex. The test for simple cells is based on acyclicity tables automatically produced in advance with homology computations. Using acyclicity tables render the implementation of thinning algorithms straightforward. Moreover, the fact that tables are automatically filled for all possible configurations allows to rigorously prove the generality of the algorithm and to obtain fool-proof implementations. The novel approach enables, for the first time, according to our knowledge, to thin a general unstructured simplicial complex. Acyclicity tables for cubical and simplicial complexes and an open source implementation of the thinning algorithm are provided as an additional material to allow their immediate use in the vast number of applications arising in medical imaging and beyond.

A Method to Standardize Quantification of Left Atrial Scar From Delayed-Enhancement MR Images

Delayed-enhancement magnetic resonance imaging (DE-MRI) is an effective technique for detecting left atrial (LA) fibrosis both pre and postradiofrequency ablation for the treatment of atrial fibrillation. Fixed thresholding models are frequently utilized clinically to segment and quantify scar in DE-MRI due to their simplicity. These methods fail to provide a standardized quantification due to interobserver variability. Quantification of scar can be used as an endpoint in clinical studies and therefore standardization is important. In this paper, we propose a segmentation algorithm for LA fibrosis quantification and investigate its performance. The algorithm was validated using numerical phantoms and 15 clinical data sets from patients undergoing LA ablation. We demonstrate that the approach produces good concordance with expert manual delineations. The method offers a standardized quantification technique for evaluation and interpretation of DE-MRI scans.