Regional Cardiac Motion Scoring with Multi-scale Motion-based Spatial Attention

Regional cardiac motion scoring aims to classify the motion status of each myocardium segment into one of the four categories (normal, hypokinetic, akinetic and dyskinetic) from multiple short-axis MR sequences. It is essential for prognosis and early diagnosis for various cardiac diseases. However, the complex motion procedure of myocardium and the invisible pattern differences pose great challenges, leading to low performance for automatic methods. Most existing work mitigate the task by differentiating the normal motion patterns from the abnormal ones, without fine-grained motion scoring. We propose an effective method for the task of cardiac motion scoring by connecting a bottom-up and another top-down branch with a novel motion-based spatial attention module in multi-scale space. Specifically, we use the convolution blocks for low-level feature extraction that acts as a bottom-up mechanism, and the task of optical flow for explicit motion extraction that acts as a top-down mechanism for high-level allocation of spatial attention. To this end, a newly designed Multi-scale Motion-based Spatial Attention (MMSA) mechanism is used as the pivot connecting the bottom-up part and the top-down part, and adaptively weight the low-level features according to the motion information. Experimental results on a newly constructed dataset of 1440 myocardium segments from 90 subjects demonstrate that the proposed MMSA can accurately analyze the regional myocardium motion, with accuracies of 79.3% for 4-way motion scoring, 89.0% for abnormality detection, and correlation of 0.943 for estimation of motion score index. This work has great potential for practical assessment of cardiac motion function.

3D Motion Estimation of Left Ventricular Dynamics Using MRI and Track-to-Track Fusion

Objective: This study investigates the estimation of three dimensional (3D) left ventricular (LV) motion using the fusion of different two dimensional (2D) cine magnetic resonance (CMR) sequences acquired during routine imaging sessions. Although standard clinical cine CMR data is inherently 2D, the actual underlying LV dynamics lies in 3D space and cannot be captured entirely using single 2D CMR image sequences. By utilizing the image information from various short-axis and long-axis image sequences, the proposed method intends to estimate the dynamic state vectors consisting of the position and velocity information of the myocardial borders in 3D space. Method: The proposed method comprises two main components: tracking myocardial points in 2D CMR sequences and fusion of multiple trajectories correspond to the tracked points. The tracking which yields the set of corresponding temporal points representing the myocardial points is performed using a diffeomorphic nonrigid image registration approach. The trajectories obtained from each cine CMR sequence is then fused with the corresponding trajectories from other CMR views using an unscented Kalman smoother (UKS) and a track-to-track fusion algorithm. Results: We evaluated the proposed method by comparing the results against CMR imaging with myocardial tagging. We report a quantitative performance analysis by projecting the state vector estimates we obtained onto 2D tagged CMR images acquired from the same subjects and comparing them against harmonic phase estimates. The proposed algorithm yielded a competitive performance with a mean root mean square error of 1.3±0.5 pixels (1.8±0.6 mm) evaluated over 118 image sequences acquired from 30 subjects. Conclusion: This study demonstrates that fusing the information from short and long-axis views of CMR improves the accuracy of cardiac tissue motion estimation. Clinical Impact: The proposed method demonstrates that the fusion of tissue tracking information from long and short-axis views improves the binary classification of the automated regional function assessment.

Fast segmentation of the left ventricle in cardiac MRI using dynamic programming

BACKGROUND AND OBJECTIVE

The segmentation of the left ventricle (LV) in cardiac magnetic resonance imaging is a necessary step for the analysis and diagnosis of cardiac function. In most clinical setups, this step is still manually performed by cardiologists, which is time-consuming and laborious. This paper proposes a fast system for the segmentation of the LV that significantly reduces human intervention.

METHODS

A dynamic programming approach is used to obtain the border of the LV. Using very simple assumptions about the expected shape and location of the segmentation, this system is able to deal with many of the challenges associated with this problem. The system was evaluated on two public datasets: one with 33 patients, comprising a total of 660 magnetic resonance volumes and another with 45 patients, comprising a total of 90 volumes. Quantitative evaluation of the segmentation accuracy and computational complexity was performed.

RESULTS

The proposed system is able to segment a whole volume in 1.5 seconds and achieves an average Dice similarity coefficient of 86.0% and an average perpendicular distance of 2.4 mm, which compares favorably with other state-of-the-art methods.

CONCLUSIONS

A system for the segmentation of the left ventricle in cardiac magnetic resonance imaging is proposed. It is a fast framework that significantly reduces the amount of time and work required of cardiologists.

Detection of Cardiac Function Abnormality from MRI Images Using Normalized Wall Thickness Temporal Patterns

Purpose. To develop a method for identifying abnormal myocardial function based on studying the normalized wall motion pattern during the cardiac cycle. Methods. The temporal pattern of the normalized myocardial wall thickness is used as a feature vector to assess the cardiac wall motion abnormality. Principal component analysis is used to reduce the feature dimensionality and the maximum likelihood method is used to differentiate between normal and abnormal features. The proposed method was applied on a dataset of 27 cases from normal subjects and patients. Results. The developed method achieved 81.5%, 85%, and 88.5% accuracy for identifying abnormal contractility in the basal, midventricular, and apical slices, respectively. Conclusions. A novel feature vector, namely, the normalized wall thickness, has been introduced for detecting myocardial regional wall motion abnormality. The proposed method provides assessment of the regional myocardial contractility for each cardiac segment and slice; therefore, it could be a valuable tool for automatic and fast determination of regional wall motion abnormality from conventional cine MRI images.

Information maximizing component analysis of left ventricular remodeling due to myocardial infarction

BACKGROUND

Although adverse left ventricular shape changes (remodeling) after myocardial infarction (MI) are predictive of morbidity and mortality, current clinical assessment is limited to simple mass and volume measures, or dimension ratios such as length to width ratio. We hypothesized that information maximizing component analysis (IMCA), a supervised feature extraction method, can provide more efficient and sensitive indices of overall remodeling.

METHODS

IMCA was compared to linear discriminant analysis (LDA), both supervised methods, to extract the most discriminatory global shape changes associated with remodeling after MI. Finite element shape models from 300 patients with myocardial infarction from the DETERMINE study (age 31-86, mean age 63, 20 % women) were compared with 1991 asymptomatic cases from the MESA study (age 44-84, mean age 62, 52 % women) available from the Cardiac Atlas Project. IMCA and LDA were each used to identify a single mode of global remodeling best discriminating the two groups. Logistic regression was employed to determine the association between the remodeling index and MI. Goodness-of-fit results were compared against a baseline logistic model comprising standard clinical indices.

RESULTS

A single IMCA mode simultaneously describing end-diastolic and end-systolic shapes achieved best results (lowest Deviance, Akaike information criterion and Bayesian information criterion, and the largest area under the receiver-operating-characteristic curve). This mode provided a continuous scale where remodeling can be quantified and visualized, showing that MI patients tend to present larger size and more spherical shape, more bulging of the apex, and thinner wall thickness.

CONCLUSIONS

IMCA enables better characterization of global remodeling than LDA, and can be used to quantify progression of disease and the effect of treatment. These data and results are available from the Cardiac Atlas Project ( http://www.cardiacatlas.org ).

Distribution Matching with the Bhattacharyya Similarity: A Bound Optimization Framework

We present efficient graph cut algorithms for three problems: (1) finding a region in an image, so that the histogram (or distribution) of an image feature within the region most closely matches a given model; (2) co-segmentation of image pairs and (3) interactive image segmentation with a user-provided bounding box. Each algorithm seeks the optimum of a global cost function based on the Bhattacharyya measure, a convenient alternative to other matching measures such as the Kullback-Leibler divergence. Our functionals are not directly amenable to graph cut optimization as they contain non-linear functions of fractional terms, which make the ensuing optimization problems challenging. We first derive a family of parametric bounds of the Bhattacharyya measure by introducing an auxiliary labeling. Then, we show that these bounds are auxiliary functions of the Bhattacharyya measure, a result which allows us to solve each problem efficiently via graph cuts. We show that the proposed optimization procedures converge within very few graph cut iterations. Comprehensive and various experiments, including quantitative and comparative evaluations over two databases, demonstrate the advantages of the proposed algorithms over related works in regard to optimality, computational load, accuracy and flexibility.

Regional heart motion abnormality detection: an information theoretic approach

Tracking regional heart motion and detecting the corresponding abnormalities play an essential role in the diagnosis of cardiovascular diseases. Based on functional images, which are subject to noise and segmentation/registration inaccuracies, regional heart motion analysis is acknowledged as a difficult problem and, therefore, incorporation of prior knowledge is desirable to enhance accuracy. Given noisy data and a nonlinear dynamic model to describe myocardial motion, an unscented Kalman smoother is proposed in this study to estimate the myocardial points. Due to the similarity between the statistical information of normal and abnormal heart motions, detecting and classifying abnormality is a challenging problem. We use the Shannon's differential entropy of the distributions of potential classifier features to detect and locate regional heart motion abnormality. A naive Bayes classifier algorithm is constructed from the Shannon's differential entropy of different features to automatically detect abnormal functional regions of the myocardium. Using 174 segmented short-axis magnetic resonance cines obtained from 58 subjects (21 normal and 37 abnormal), the proposed method is quantitatively evaluated by comparison with ground truth classifications by radiologists over 928 myocardial segments. The proposed method performed significantly better than other recent methods, and yielded an accuracy of 86.5% (base), 89.4% (mid-cavity) and 84.5% (apex). The overall classification accuracy was 87.1%. Furthermore, standard kappa statistic comparisons between the proposed method and visual wall motion scoring by radiologists showed that the proposed algorithm can yield a kappa measure of 0.73.