Myocardium Segmentation From DE MRI Using Multicomponent Gaussian Mixture Model and Coupled Level Set

Cardiac segmentation on late gadolinium enhancement MRI: A benchmark study from multi-sequence cardiac MR segmentation challenge

Accurate computing, analysis and modeling of the ventricles and myocardium from medical images are important, especially in the diagnosis and treatment management for patients suffering from myocardial infarction (MI). Late gadolinium enhancement (LGE) cardiac magnetic resonance (CMR) provides an important protocol to visualize MI. However, compared with the other sequences LGE CMR images with gold standard labels are particularly limited. This paper presents the selective results from the Multi-Sequence Cardiac MR (MS-CMR) Segmentation challenge, in conjunction with MICCAI 2019. The challenge offered a data set of paired MS-CMR images, including auxiliary CMR sequences as well as LGE CMR, from 45 patients who underwent cardiomyopathy. It was aimed to develop new algorithms, as well as benchmark existing ones for LGE CMR segmentation focusing on myocardial wall of the left ventricle and blood cavity of the two ventricles. In addition, the paired MS-CMR images could enable algorithms to combine the complementary information from the other sequences for the ventricle segmentation of LGE CMR. Nine representative works were selected for evaluation and comparisons, among which three methods are unsupervised domain adaptation (UDA) methods and the other six are supervised. The results showed that the average performance of the nine methods was comparable to the inter-observer variations. Particularly, the top-ranking algorithms from both the supervised and UDA methods could generate reliable and robust segmentation results. The success of these methods was mainly attributed to the inclusion of the auxiliary sequences from the MS-CMR images, which provide important label information for the training of deep neural networks. The challenge continues as an ongoing resource, and the gold standard segmentation as well as the MS-CMR images of both the training and test data are available upon registration via its homepage (www.sdspeople.fudan.edu.cn/zhuangxiahai/0/mscmrseg/).

Optical flow estimation of coronary angiography sequences based on semi-supervised learning

Optical flow is widely used in medical image processing, such as image registration, segmentation, 3D reconstruction, and temporal super-resolution. However, high-precision optical flow training datasets for medical images are challenging to produce. The current optical flow estimation models trained on these non-medical datasets, such as KITTI, Sintel, and FlyingChairs are unsuitable for medical images. In this work, we propose a semi-supervised learning mechanism to estimate the optical flow of coronary angiography. Our proposed method only needs the original medical images, segmentation results of regions of interest, and pre-trained models based on other optical flow datasets to train a new optical flow estimation model suitable for medical images. First, we use the coronary segmentation results to perform image enhancement processing on the coronary vascular region to improve the image contrast between the vascular region and the surrounding tissues. Then, we extract the high-precision optical flow of coronary arteries based on the coronary-enhanced images and the pre-trained optical flow estimation model. After estimating the optical flow, we take it and its corresponding original coronary angiography images as the training dataset to train the optical flow estimation network. Furthermore, we generate a large-scale synthetic Flying-artery dataset based on coronary artery segmentation results and original coronary angiography images, which is used to improve and evaluate the accuracy of optical flow estimation for coronary angiography. The experimental results on the coronary angiography datasets demonstrate that our proposed method can significantly improve the optical flow estimation accuracy of coronary angiography sequences compared with other methods.

AtrialJSQnet: A New framework for joint segmentation and quantification of left atrium and scars incorporating spatial and shape information

Left atrial (LA) and atrial scar segmentation from late gadolinium enhanced magnetic resonance imaging (LGE MRI) is an important task in clinical practice. The automatic segmentation is however still challenging due to the poor image quality, the various LA shapes, the thin wall, and the surrounding enhanced regions. Previous methods normally solved the two tasks independently and ignored the intrinsic spatial relationship between LA and scars. In this work, we develop a new framework, namely AtrialJSQnet, where LA segmentation, scar projection onto the LA surface, and scar quantification are performed simultaneously in an end-to-end style. We propose a mechanism of shape attention (SA) via an implicit surface projection to utilize the inherent correlation between LA cavity and scars. In specific, the SA scheme is embedded into a multi-task architecture to perform joint LA segmentation and scar quantification. Besides, a spatial encoding (SE) loss is introduced to incorporate continuous spatial information of the target in order to reduce noisy patches in the predicted segmentation. We evaluated the proposed framework on 60 post-ablation LGE MRIs from the MICCAI2018 Atrial Segmentation Challenge. Moreover, we explored the domain generalization ability of the proposed AtrialJSQnet on 40 pre-ablation LGE MRIs from this challenge and 30 post-ablation multi-center LGE MRIs from another challenge (ISBI2012 Left Atrium Fibrosis and Scar Segmentation Challenge). Extensive experiments on public datasets demonstrated the effect of the proposed AtrialJSQnet, which achieved competitive performance over the state-of-the-art. The relatedness between LA segmentation and scar quantification was explicitly explored and has shown significant performance improvements for both tasks. The code has been released via https://zmiclab.github.io/projects.html.

Anatomical knowledge based level set segmentation of cardiac ventricles from MRI

This paper represents a novel level set framework for segmentation of cardiac left ventricle (LV) and right ventricle (RV) from magnetic resonance images based on anatomical structures of the heart. We first propose a level set approach to recover the endocardium and epicardium of LV by using a bi-layer level set (BILLS) formulation, in which the endocardium and epicardium are represented by the 0-level set and k-level set of a level set function. Furthermore, the recovery of LV endocardium and epicardium is achieved by a level set evolution process, called convexity preserving bi-layer level set (CP-BILLS). During the CP-BILLS evolution, the 0-level set and k-level set simultaneously evolve and move toward the true endocardium and epicardium under the guidance of image information and the impact of the convexity preserving mechanism as well. To eliminate the manual selection of the k-level, we develop an algorithm for automatic selection of an optimal k-level. As a result, the obtained endocardial and epicardial contours are convex and consistent with the anatomy of cardiac ventricles. For segmentation of the whole ventricle, we extend this method to the segmentation of RV and myocardium of both left and right ventricles by using a convex shape decomposition (CSD) structure of cardiac ventricles based on anatomical knowledge. Experimental results demonstrate promising performance of our method. Compared with some traditional methods, our method exhibits superior performance in terms of segmentation accuracy and algorithm stability. Our method is comparable with the state-of-the-art deep learning-based method in terms of segmentation accuracy and algorithm stability, but our method has no need for training and the manual segmentation of the training data.

Automatic cardiac cine MRI segmentation and heart disease classification

Cardiac cine magnetic resonance imaging (MRI) continues to be recognized as an established modality for non-invasive assessment of the function and structure of the cardiovascular system. Making full use of fully convolutional neural networks CNNs ability to operate pixel-wise classification, cine MRI sequences can be segmented and volumetric features of three key heart structures are computed for disease prediction. The three key heart structures are the left ventricle cavity, right ventricle cavity and the left ventricle myocardium. In this paper, we suggest an automated pipeline for both cardiac segmentation and diagnosis. The study was conducted on a dataset of 150 patients from Dijon Hospital in the context of the post-2017 Medical Image Computing and Computer Assisted Intervention MICCAI, Automated Cardiac Diagnosis Challenge (ACDC). The challenge consists in two phases: (i) a segmentation contest, where performance is evaluated on dice overlap coefficient and Hausdorff distance metrics, and a (ii) diagnosis contest for heart disease classification. For this aim, we propose the use of a deep learning based network for segmentation of the three key cardiac structures within short-axis cine MRI sequences and a classifier ensemble for heart disease classification. The deep learning segmentation network is a UNet fully convolutional neural network variant with fewer trainable parameters. The classifier ensemble consists in combining three classifiers, namely a multilayer perceptron, a random forest and a support vector machine. Before feeding the segmentation network, a preliminary step consists in localizing heart region and cropping input images to a restricted region of interest (ROI). This is achieved by a signal processing based approach and aims at reducing multi-class imbalance and computational load. We achieved nearly state of the art accuracy performances for both the segmentation and disease classification challenges. Reporting a mean dice overlap coefficient of 0.92 for the three cardiac structures segmentation, along with good limits of agreement for the various derived clinical indices, leading to an accuracy of 0.92 for the disease classification on unseen data.

Generation of a local lung respiratory motion model using a weighted sparse algorithm and motion prior-based registration

Respiration-introduced tumor location uncertainty is a challenge in lung percutaneous interventions, especially for the respiratory motion estimation of the tumor and surrounding vessel structures. In this work, a local motion modeling method is proposed based on whole-chest computed tomography (CT) and CT-fluoroscopy (CTF) scans. A weighted sparse statistical modeling (WSSM) method that can accurately capture location errors for each landmark point is proposed for lung motion prediction. By varying the sparse weight coefficients of the WSSM method, newly input motion information is approximately represented by a sparse linear combination of the respiratory motion repository and employed to serve as prior knowledge for the following registration process. We have also proposed an adaptive motion prior-based registration method to improve the motion prediction accuracy of the motion model in the region of interest (ROI). This registration method adopts a B-spline scheme to interactively weight the relative influence of the prior knowledge, model surface and image intensity information by locally controlling the deformation in the CTF image region. The proposed method has been evaluated on 15 image pairs between the end-expiratory (EE) and end-inspiratory (EI) phases and 31 four-dimensional CT (4DCT) datasets. The results reveal that the proposed WSSM method achieved a better motion prediction performance than other existing lung statistical motion modeling methods, and the motion prior-based registration method can generate more accurate local motion information in the ROI.

Atrial scar quantification via multi-scale CNN in the graph-cuts framework

•

Propose a fully automatic method for left atrial scar quantification, with promising performance.

•

Formulate a new framework of scar quantification based on surface projection and graph-cuts framework.

•

Propose the multi-scale learning CNN, combined with the random shift training strategy, to learn and predict the graph potentials, which significantly improves the performance of the proposed method, and enables the full automation of the framework.

•

Provide thorough validation and parameter studies for the proposed techniques using fifty-eight clinical images.

Late gadolinium enhancement magnetic resonance imaging (LGE MRI) appears to be a promising alternative for scar assessment in patients with atrial fibrillation (AF). Automating the quantification and analysis of atrial scars can be challenging due to the low image quality. In this work, we propose a fully automated method based on the graph-cuts framework, where the potentials of the graph are learned on a surface mesh of the left atrium (LA) using a multi-scale convolutional neural network (MS-CNN). For validation, we have included fifty-eight images with manual delineations. MS-CNN, which can efficiently incorporate both the local and global texture information of the images, has been shown to evidently improve the segmentation accuracy of the proposed graph-cuts based method. The segmentation could be further improved when the contribution between the t-link and n-link weights of the graph is balanced. The proposed method achieves a mean accuracy of 0.856 ± 0.033 and mean Dice score of 0.702 ± 0.071 for LA scar quantification. Compared to the conventional methods, which are based on the manual delineation of LA for initialization, our method is fully automatic and has demonstrated significantly better Dice score and accuracy (p < 0.01). The method is promising and can be potentially useful in diagnosis and prognosis of AF.

A Combined Fully Convolutional Networks and Deformable Model for Automatic Left Ventricle Segmentation Based on 3D Echocardiography

Segmentation of the left ventricle (LV) from three-dimensional echocardiography (3DE) plays a key role in the clinical diagnosis of the LV function. In this work, we proposed a new automatic method for the segmentation of LV, based on the fully convolutional networks (FCN) and deformable model. This method implemented a coarse-to-fine framework. Firstly, a new deep fusion network based on feature fusion and transfer learning, combining the residual modules, was proposed to achieve coarse segmentation of LV on 3DE. Secondly, we proposed a method of geometrical model initialization for a deformable model based on the results of coarse segmentation. Thirdly, the deformable model was implemented to further optimize the segmentation results with a regularization item to avoid the leakage between left atria and left ventricle to achieve the goal of fine segmentation of LV. Numerical experiments have demonstrated that the proposed method outperforms the state-of-the-art methods on the challenging CETUS benchmark in the segmentation accuracy and has a potential for practical applications.

Myocardium segmentation from DE MRI with guided random walks and sparse shape representation

PURPOSE

For patients with myocardial infarction (MI), delayed enhancement (DE) cardiovascular magnetic resonance imaging (MRI) is a sensitive and well-validated technique for the detection and visualization of MI. The myocardium viability assessment with DE MRI is important in diagnosis and treatment management, where myocardium segmentation is a prerequisite. However, few academic works have focused on automated myocardium segmentation from DE images. In this study, we aim to develop an automatic myocardium segmentation algorithm that targets DE images.

METHODS

We propose a segmentation framework based on both prior shape knowledge and image intensity. Instead of the strong request of the pre-segmentation of cine MRI in the same session, we use the sparse representation method to model the myocardium shape. Data from the Cardiac MR Left Ventricle Segmentation Challenge (2009) are used to build the shape template repository. The method of guided random walks is used to integrate the shape model and intensity information. An iterative approach is used to gradually improve the results.

RESULTS

The proposed method was tested on the DE MRI data from 30 MI patients. The proposed method achieved Dice similarity coefficients (DSC) of 74.60 ± 7.79% with 201 shape templates and 73.56 ± 6.32% with 56 shape templates, which were close to the inter-observer difference (73.94 ± 5.12%). To test the generalization of the proposed method to routine clinical images, the DE images of 10 successive new patients were collected, which were unseen during the method development and parameter tuning, and a DSC of 76.02 ± 7.43% was achieved.

CONCLUSION

The authors propose a novel approach for the segmentation of myocardium from DE MRI by using the sparse representation-based shape model and guided random walks. The sparse representation method effectively models the prior shape with a small number of shape templates, and the proposed method has the potential to achieve clinically relevant results.