Segmentation by retrieval with guided random walks: Application to left ventricle segmentation in MRI

Automatic pipeline for segmentation of LV myocardium on quantitative MR T1 maps using deep learning model and computation of radial T1 and ECV values

Native T1 mapping is a non-invasive technique used for early detection of diffused myocardial abnormalities, and it provides baseline tissue characterization. Post-contrast T1 mapping enhances tissue differentiation, enables extracellular volume (ECV) calculation, and improves myocardial viability assessment. Accurate and precise segmenting of the left ventricular (LV) myocardium on T1 maps is crucial for assessing myocardial tissue characteristics and diagnosing cardiovascular diseases (CVD). This study presents a deep learning (DL)-based pipeline for automatically segmenting LV myocardium on T1 maps and automatic computation of radial T1 and ECV values. The study employs a multicentric dataset consisting of retrospective multiparametric MRI data of 332 subjects to develop and assess the performance of the proposed method. The study compared DL architectures U-Net and Deep Res U-Net for LV myocardium segmentation, which achieved a dice similarity coefficient of 0.84 ± 0.43 and 0.85 ± 0.03, respectively. The dice similarity coefficients computed for radial sub-segmentation of the LV myocardium on basal, mid-cavity, and apical slices were 0.77 ± 0.21, 0.81 ± 0.17, and 0.61 ± 0.14, respectively. The t-test performed between ground truth vs. predicted values of native T1, post-contrast T1, and ECV showed no statistically significant difference (p > 0.05) for any of the radial sub-segments. The proposed DL method leverages the use of quantitative T1 maps for automatic LV myocardium segmentation and accurately computing radial T1 and ECV values, highlighting its potential for assisting radiologists in objective cardiac assessment and, hence, in CVD diagnostics.

Automated segmentation of 3D cine cardiovascular magnetic resonance imaging

Introduction

As the life expectancy of children with congenital heart disease (CHD) is rapidly increasing and the adult population with CHD is growing, there is an unmet need to improve clinical workflow and efficiency of analysis. Cardiovascular magnetic resonance (CMR) is a noninvasive imaging modality for monitoring patients with CHD. CMR exam is based on multiple breath-hold 2-dimensional (2D) cine acquisitions that should be precisely prescribed and is expert and institution dependent. Moreover, 2D cine images have relatively thick slices, which does not allow for isotropic delineation of ventricular structures. Thus, development of an isotropic 3D cine acquisition and automatic segmentation method is worthwhile to make CMR workflow straightforward and efficient, as the present work aims to establish.

Methods

Ninety-nine patients with many types of CHD were imaged using a non-angulated 3D cine CMR sequence covering the whole-heart and great vessels. Automatic supervised and semi-supervised deep-learning-based methods were developed for whole-heart segmentation of 3D cine images to separately delineate the cardiac structures, including both atria, both ventricles, aorta, pulmonary arteries, and superior and inferior vena cavae. The segmentation results derived from the two methods were compared with the manual segmentation in terms of Dice score, a degree of overlap agreement, and atrial and ventricular volume measurements.

Results

The semi-supervised method resulted in a better overlap agreement with the manual segmentation than the supervised method for all 8 structures (Dice score 83.23 ± 16.76% vs. 77.98 ± 19.64%; P-value ≤0.001). The mean difference error in atrial and ventricular volumetric measurements between manual segmentation and semi-supervised method was lower (bias ≤ 5.2 ml) than the supervised method (bias ≤ 10.1 ml).

Discussion

The proposed semi-supervised method is capable of cardiac segmentation and chamber volume quantification in a CHD population with wide anatomical variability. It accurately delineates the heart chambers and great vessels and can be used to accurately calculate ventricular and atrial volumes throughout the cardiac cycle. Such a segmentation method can reduce inter- and intra- observer variability and make CMR exams more standardized and efficient.

Left ventricle segmentation combining deep learning and deformable models with anatomical constraints

Segmentation of the left ventricle is a key approach in Cardiac Magnetic Resonance Imaging for calculating biomarkers in diagnosis. Since there is substantial effort required from the expert, many automatic segmentation methods have been proposed, in which deep learning networks have obtained remarkable performance. However, one of the main limitations of these approaches is the production of segmentations that contain anatomical errors. To avoid this limitation, we propose a new fully-automatic left ventricle segmentation method combining deep learning and deformable models. We propose a new level set energy formulation that includes exam-specific information estimated from the deep learning segmentation and shape constraints. The method is part of a pipeline containing pre-processing steps and a failure correction post-processing step. Experiments were conducted with the Sunnybrook and ACDC public datasets, and a private dataset. Results suggest that the method is competitive, that it can produce anatomically consistent segmentations, has good generalization ability, and is often able to estimate biomarkers close to the expert.

An Automatic Random Walker Algorithm for Segmentation of Ground Glass Opacity Pulmonary Nodules

Automatic and accurate segmentation of ground glass opacity (GGO) nodules still remains challenging due to inhomogeneous interiors, irregular shapes, and blurred boundaries from different patients. Despite successful applications in the image processing domains, the random walk has some limitations for segmentation of GGO pulmonary nodules. In this paper, an improved random walker method is proposed for the segmentation of GGO nodules. To calculate a new affinity matrix, intensity, spatial, and texture features are incorporated. It strengthens discriminative power between two adjacent nodes on the graph. To address the problem of robustness in seed acquisition, the geodesic distance is introduced and a novel local search strategy is presented to automatically acquire reliable seeds. For segmentation, a label constraint term is introduced to the energy function of original random walker, which alleviates the accumulation of errors caused by the initial seeds acquisition. Massive experiments conducted on Lung Images Dataset Consortium (LIDC) demonstrate that the proposed method achieves visually satisfactory results without user interactions. Both qualitative and quantitative evaluations also demonstrate that the proposed method obtains better performance compared with conventional random walker method and state-of-the-art segmentation methods in terms of the overlap score and F-measure.

Automatic left ventricular cavity segmentation via deep spatial sequential network in 4D computed tomography

Automated segmentation of left ventricular cavity (LVC) in temporal cardiac image sequences (consisting of multiple time-points) is a fundamental requirement for quantitative analysis of cardiac structural and functional changes. Deep learning methods for segmentation are the state-of-the-art in performance; however, these methods are generally formulated to work on a single time-point, and thus disregard the complementary information available from the temporal image sequences that can aid in segmentation accuracy and consistency across the time-points. In particular, single time-point segmentation methods perform poorly in segmenting the end-systole (ES) phase image in the cardiac sequence, where the left ventricle deforms to the smallest irregular shape, and the boundary between the blood chamber and the myocardium becomes inconspicuous and ambiguous. To overcome these limitations in automatically segmenting temporal LVCs, we present a spatial sequential network (SS-Net) to learn the deformation and motion characteristics of the LVCs in an unsupervised manner; these characteristics are then integrated with sequential context information derived from bi-directional learning (BL) where both chronological and reverse-chronological directions of the image sequence are used. Our experimental results on a cardiac computed tomography (CT) dataset demonstrate that our spatial-sequential network with bi-directional learning (SS-BL-Net) outperforms existing methods for spatiotemporal LVC segmentation.

Convexity preserving level set for left ventricle segmentation

In clinical applications of cardiac left ventricle (LV) segmentation, the segmented LV is desired to include the cavity, trabeculae, and papillary muscles, which form a convex shape. However, the intensities of trabeculae and papillary muscles are similar to myocardium. Consequently, segmentation algorithms may easily misclassify trabeculae and papillary muscles as myocardium. In this paper, we propose a level set method with a convexity preserving mechanism to ensure the convexity of the segmented LV. In the proposed level set method, the curvature of the level set contours is used to control their convexity, such that the level set contour is finally deformed as a convex shape. The experimental results and the comparison with other level set methods show the advantage of our method in terms of segmentation accuracy. Compared with the state-of-the-art methods using deep-learning, our method is able to achieve comparable segmentation accuracy without the need for training, while the deep-learning based method requires a large set of training data and high-quality manual segmentation. Therefore, our method can be conveniently used in situation where training data and their manual segmentation are not available.

Artificial Intelligence Will Transform Cardiac Imaging-Opportunities and Challenges

Artificial intelligence (AI) using machine learning techniques will change healthcare as we know it. While healthcare AI applications are currently trailing behind popular AI applications, such as personalized web-based advertising, the pace of research and deployment is picking up and about to become disruptive. Overcoming challenges such as patient and public support, transparency over the legal basis for healthcare data use, privacy preservation, technical challenges related to accessing large-scale data from healthcare systems not designed for Big Data analysis, and deployment of AI in routine clinical practice will be crucial. Cardiac imaging and imaging of other body parts is likely to be at the frontier for the development of applications as pattern recognition and machine learning are a significant strength of AI with practical links to image processing. Many opportunities in cardiac imaging exist where AI will impact patients, medical staff, hospitals, commissioners and thus, the entire healthcare system. This perspective article will outline our vision for AI in cardiac imaging with examples of potential applications, challenges and some lessons learnt in recent years.

Estimation of the Volume of the Left Ventricle From MRI Images Using Deep Neural Networks

Segmenting human left ventricle (LV) in magnetic resonance imaging images and calculating its volume are important for diagnosing cardiac diseases. The latter task became the topic of the Second Annual Data Science Bowl organized by Kaggle. The dataset consisted of a large number of cases with only systole and diastole volume labels. We designed a system based on neural networks to solve this problem. It began with a detector to detect the regions of interest (ROI) containing LV chambers. Then a deep neural network named hypercolumns fully convolutional network was used to segment LV in ROI. The 2-D segmentation results were integrated across different images to estimate the volume. With ground-truth volume labels, this model was trained end-to-end. To improve the result, an additional dataset with only segmentation labels was used. The model was trained alternately on these two tasks. We also proposed a variance estimation method for the final prediction. Our algorithm ranked the fourth on the test set in this competition.

Myocardium segmentation from DE MRI with guided random walks and sparse shape representation

PURPOSE

For patients with myocardial infarction (MI), delayed enhancement (DE) cardiovascular magnetic resonance imaging (MRI) is a sensitive and well-validated technique for the detection and visualization of MI. The myocardium viability assessment with DE MRI is important in diagnosis and treatment management, where myocardium segmentation is a prerequisite. However, few academic works have focused on automated myocardium segmentation from DE images. In this study, we aim to develop an automatic myocardium segmentation algorithm that targets DE images.

METHODS

We propose a segmentation framework based on both prior shape knowledge and image intensity. Instead of the strong request of the pre-segmentation of cine MRI in the same session, we use the sparse representation method to model the myocardium shape. Data from the Cardiac MR Left Ventricle Segmentation Challenge (2009) are used to build the shape template repository. The method of guided random walks is used to integrate the shape model and intensity information. An iterative approach is used to gradually improve the results.

RESULTS

The proposed method was tested on the DE MRI data from 30 MI patients. The proposed method achieved Dice similarity coefficients (DSC) of 74.60 ± 7.79% with 201 shape templates and 73.56 ± 6.32% with 56 shape templates, which were close to the inter-observer difference (73.94 ± 5.12%). To test the generalization of the proposed method to routine clinical images, the DE images of 10 successive new patients were collected, which were unseen during the method development and parameter tuning, and a DSC of 76.02 ± 7.43% was achieved.

CONCLUSION

The authors propose a novel approach for the segmentation of myocardium from DE MRI by using the sparse representation-based shape model and guided random walks. The sparse representation method effectively models the prior shape with a small number of shape templates, and the proposed method has the potential to achieve clinically relevant results.

Unsupervised Myocardial Segmentation for Cardiac BOLD

A fully automated 2-D+time myocardial segmentation framework is proposed for cardiac magnetic resonance (CMR) blood-oxygen-level-dependent (BOLD) data sets. Ischemia detection with CINE BOLD CMR relies on spatio-temporal patterns in myocardial intensity, but these patterns also trouble supervised segmentation methods, the de facto standard for myocardial segmentation in cine MRI. Segmentation errors severely undermine the accurate extraction of these patterns. In this paper, we build a joint motion and appearance method that relies on dictionary learning to find a suitable subspace. Our method is based on variational pre-processing and spatial regularization using Markov random fields, to further improve performance. The superiority of the proposed segmentation technique is demonstrated on a data set containing cardiac phase-resolved BOLD MR and standard CINE MR image sequences acquired in baseline and ischemic condition across ten canine subjects. Our unsupervised approach outperforms even supervised state-of-the-art segmentation techniques by at least 10% when using Dice to measure accuracy on BOLD data and performs at par for standard CINE MR. Furthermore, a novel segmental analysis method attuned for BOLD time series is utilized to demonstrate the effectiveness of the proposed method in preserving key BOLD patterns.

A 3D Hermite-based multiscale local active contour method with elliptical shape constraints for segmentation of cardiac MR and CT volumes

Analysis of cardiac images is a fundamental task to diagnose heart problems. Left ventricle (LV) is one of the most important heart structures used for cardiac evaluation. In this work, we propose a novel 3D hierarchical multiscale segmentation method based on a local active contour (AC) model and the Hermite transform (HT) for LV analysis in cardiac magnetic resonance (MR) and computed tomography (CT) volumes in short axis view. Features such as directional edges, texture, and intensities are analyzed using the multiscale HT space. A local AC model is configured using the HT coefficients and geometrical constraints. The endocardial and epicardial boundaries are used for evaluation. Segmentation of the endocardium is controlled using elliptical shape constraints. The final endocardial shape is used to define the geometrical constraints for segmentation of the epicardium. We follow the assumption that epicardial and endocardial shapes are similar in volumes with short axis view. An initialization scheme based on a fuzzy C-means algorithm and mathematical morphology was designed. The algorithm performance was evaluated using cardiac MR and CT volumes in short axis view demonstrating the feasibility of the proposed method.

Automatic initialization and quality control of large-scale cardiac MRI segmentations

Continuous advances in imaging technologies enable ever more comprehensive phenotyping of human anatomy and physiology. Concomitant reduction of imaging costs has resulted in widespread use of imaging in large clinical trials and population imaging studies. Magnetic Resonance Imaging (MRI), in particular, offers one-stop-shop multidimensional biomarkers of cardiovascular physiology and pathology. A wide range of analysis methods offer sophisticated cardiac image assessment and quantification for clinical and research studies. However, most methods have only been evaluated on relatively small databases often not accessible for open and fair benchmarking. Consequently, published performance indices are not directly comparable across studies and their translation and scalability to large clinical trials or population imaging cohorts is uncertain. Most existing techniques still rely on considerable manual intervention for the initialization and quality control of the segmentation process, becoming prohibitive when dealing with thousands of images. The contributions of this paper are three-fold. First, we propose a fully automatic method for initializing cardiac MRI segmentation, by using image features and random forests regression to predict an initial position of the heart and key anatomical landmarks in an MRI volume. In processing a full imaging database, the technique predicts the optimal corrective displacements and positions in relation to the initial rough intersections of the long and short axis images. Second, we introduce for the first time a quality control measure capable of identifying incorrect cardiac segmentations with no visual assessment. The method uses statistical, pattern and fractal descriptors in a random forest classifier to detect failures to be corrected or removed from subsequent statistical analysis. Finally, we validate these new techniques within a full pipeline for cardiac segmentation applicable to large-scale cardiac MRI databases. The results obtained based on over 1200 cases from the Cardiac Atlas Project show the promise of fully automatic initialization and quality control for population studies.

Multi-Views Fusion CNN for Left Ventricular Volumes Estimation on Cardiac MR Images

OBJECTIVE

Left ventricular (LV) volume estimation is a critical procedure for cardiac disease diagnosis. The objective of this paper is to address a direct LV volume prediction task.

METHODS

In this paper, we propose a direct volume prediction method based on the end-to-end deep convolutional neural networks. We study the end-to-end LV volume prediction method in items of the data preprocessing, network structure, and multiview fusion strategy. The main contributions of this paper are the following aspects. First, we propose a new data preprocessing method on cardiac magnetic resonance (CMR). Second, we propose a new network structure for end-to-end LV volume estimation. Third, we explore the representational capacity of different slices and propose a fusion strategy to improve the prediction accuracy.

RESULTS

The evaluation results show that the proposed method outperforms other state-of-the-art LV volume estimation methods on the open accessible benchmark datasets. The clinical indexes derived from the predicted volumes agree well with the ground truth ( ${\rm{EDV:R}}^{{\rm 2}}={\text{0.974}}$, ${\rm{RMSE\,}}= {\text{9.6}}{\rm{\,ml}}$; ${\rm{ESV:R}}^{{\rm 2}}={\text{0.976}}$, ${\rm{RMSE}}= {\text{7.1}}\,{\text{ml}}$; ${\rm{EF:R}}^{{\rm 2}} ={\text{0.828}}$, ${\rm{RMSE}}= {\text{4.71}}\% $).

CONCLUSION

Experimental results prove that the proposed method may be useful for the LV volume prediction task.

SIGNIFICANCE

The proposed method not only has application potential for cardiac diseases screening for large-scale CMR data, but also can be extended to other medical image research fields.

Segmentation of medical images using mean value guided contour

Partial differential equation-based (PDE-based) methods are extensively used in image segmentation, especially in contour models. Difficulties associated with the boundaries, namely troubles with developing initialization, inadequate convergence to boundary concavities, and difficulties connected to saddle points and stationary points of active contours make the contour models suffer from a feeble performance of referring to complex geometries. The present paper is designed to take advantage of mean value theorem rather than minimizing energy function for contours. It is efficiently capable of resolving above-mentioned problems by applying this theorem to the edge map gradient vectors, which is calculated from the image. Since the contour is computed in a straightforward manner from an edge map instead of force balance equation, it varies from other contour-based image segmentation methods. To illustrate the ability of the proposed model in complex geometries and ruptures, several experiments were also provided to validate the model. The experiments' results demonstrated that the proposed method, which is called mean value guided contour (MVGC), is capable of repositioning contours into boundary concavities and has suitable forcefulness in complex geometries.

Segmentation of myocardium from cardiac MR images using a novel dynamic programming based segmentation method

PURPOSE

Myocardium segmentation in cardiac magnetic resonance (MR) images plays a vital role in clinical diagnosis of the cardiovascular diseases. Because of the low contrast and large variation in intensity and shapes, myocardium segmentation has been a challenging task. A dynamic programming (DP) based segmentation method, incorporating the likelihood and shape information of the myocardium, is developed for segmenting myocardium in cardiac MR images.

METHODS

The endocardium, i.e., the left ventricle blood cavity, is segmented for initialization, and then the optimal epicardium contour is determined using the polar-transformed image and DP scheme. In the DP segmentation scheme, three techniques are proposed to improve the segmentation performance: (1) the likelihood image of the myocardium is constructed to define the external cost in the DP, thus the cost function incorporates prior probability estimation; (2) the adaptive search range is introduced to determine the polar-transformed image, thereby excluding irrelevant tissues; (3) the connectivity constrained DP algorithm is developed to obtain an optimal closed contour. Four metrics, including the Dice metric (Dice), root mean squared error (RMSE), reliability, and correlation coefficient, are used to assess the segmentation accuracy. The authors evaluated the performance of the proposed method on a private dataset and the MICCAI 2009 challenge dataset. The authors also explored the effects of the three new techniques of the DP scheme in the proposed method.

RESULTS

For the qualitative evaluation, the segmentation results of the proposed method were clinically acceptable. For the quantitative evaluation, the mean (Dice) for the endocardium and epicardium was 0.892 and 0.927, respectively; the mean RMSE was 2.30 mm for the endocardium and 2.39 mm for the epicardium. In addition, the three new techniques in the proposed DP scheme, i.e., the likelihood image of the myocardium, the adaptive search range, and the connectivity constrained DP algorithm, improved the segmentation performance for the epicardium with 0.029, 0.047, and 0.007 in terms of the Dice and 0.98, 1.31, and 0.21 mm in terms of the RMSE, respectively.

CONCLUSIONS

The three techniques (the likelihood image of the myocardium, the adaptive search range, and the connectivity constrained DP algorithm) can improve the segmentation ability of the DP method, and the proposed method with these techniques has the ability to achieve the acceptable segmentation result of the myocardium in cardiac MR images. Therefore, the proposed method would be useful in clinical diagnosis of the cardiovascular diseases.

A review of heart chamber segmentation for structural and functional analysis using cardiac magnetic resonance imaging

Cardiovascular magnetic resonance (CMR) has become a key imaging modality in clinical cardiology practice due to its unique capabilities for non-invasive imaging of the cardiac chambers and great vessels. A wide range of CMR sequences have been developed to assess various aspects of cardiac structure and function, and significant advances have also been made in terms of imaging quality and acquisition times. A lot of research has been dedicated to the development of global and regional quantitative CMR indices that help the distinction between health and pathology. The goal of this review paper is to discuss the structural and functional CMR indices that have been proposed thus far for clinical assessment of the cardiac chambers. We include indices definitions, the requirements for the calculations, exemplar applications in cardiovascular diseases, and the corresponding normal ranges. Furthermore, we review the most recent state-of-the art techniques for the automatic segmentation of the cardiac boundaries, which are necessary for the calculation of the CMR indices. Finally, we provide a detailed discussion of the existing literature and of the future challenges that need to be addressed to enable a more robust and comprehensive assessment of the cardiac chambers in clinical practice.

Random walks with shape prior for cochlea segmentation in ex vivo μCT

PURPOSE

Cochlear implantation is a safe and effective surgical procedure to restore hearing in deaf patients. However, the level of restoration achieved may vary due to differences in anatomy, implant type and surgical access. In order to reduce the variability of the surgical outcomes, we previously proposed the use of a high-resolution model built from [Formula: see text] images and then adapted to patient-specific clinical CT scans. As the accuracy of the model is dependent on the precision of the original segmentation, it is extremely important to have accurate [Formula: see text] segmentation algorithms.

METHODS

We propose a new framework for cochlea segmentation in ex vivo [Formula: see text] images using random walks where a distance-based shape prior is combined with a region term estimated by a Gaussian mixture model. The prior is also weighted by a confidence map to adjust its influence according to the strength of the image contour. Random walks is performed iteratively, and the prior mask is aligned in every iteration.

RESULTS

We tested the proposed approach in ten [Formula: see text] data sets and compared it with other random walks-based segmentation techniques such as guided random walks (Eslami et al. in Med Image Anal 17(2):236-253, 2013) and constrained random walks (Li et al. in Advances in image and video technology. Springer, Berlin, pp 215-226, 2012). Our approach demonstrated higher accuracy results due to the probability density model constituted by the region term and shape prior information weighed by a confidence map.

CONCLUSION

The weighted combination of the distance-based shape prior with a region term into random walks provides accurate segmentations of the cochlea. The experiments suggest that the proposed approach is robust for cochlea segmentation.

An Algorithm for the Segmentation of Highly Abnormal Hearts Using a Generic Statistical Shape Model

Statistical shape models (SSMs) have been widely employed in cardiac image segmentation. However, in conditions that induce severe shape abnormality and remodeling, such as in the case of pulmonary hypertension (PH) or hypertrophic cardiomyopathy (HCM), a single SSM is rarely capable of capturing the anatomical variability in the extremes of the distribution. This work presents a new algorithm for the segmentation of severely abnormal hearts. The algorithm is highly flexible, as it does not require a priori knowledge of the involved pathology or any specific parameter tuning to be applied to the cardiac image under analysis. The fundamental idea is to approximate the gross effect of the abnormality with a virtual remodeling transformation between the patient-specific geometry and the average shape of the reference model (e.g., average normal morphology). To define this mapping, a set of landmark points are automatically identified during boundary point search, by estimating the reliability of the candidate points. With the obtained transformation, the feature points extracted from the patient image volume are then projected onto the space of the reference SSM, where the model is used to effectively constrain and guide the segmentation process. The extracted shape in the reference space is finally propagated back to the original image of the abnormal heart to obtain the final segmentation. Detailed validation with patients diagnosed with PH and HCM shows the robustness and flexibility of the technique for the segmentation of highly abnormal hearts of different pathologies.

A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI

Segmentation of the left ventricle (LV) from cardiac magnetic resonance imaging (MRI) datasets is an essential step for calculation of clinical indices such as ventricular volume and ejection fraction. In this work, we employ deep learning algorithms combined with deformable models to develop and evaluate a fully automatic LV segmentation tool from short-axis cardiac MRI datasets. The method employs deep learning algorithms to learn the segmentation task from the ground true data. Convolutional networks are employed to automatically detect the LV chamber in MRI dataset. Stacked autoencoders are used to infer the LV shape. The inferred shape is incorporated into deformable models to improve the accuracy and robustness of the segmentation. We validated our method using 45 cardiac MR datasets from the MICCAI 2009 LV segmentation challenge and showed that it outperforms the state-of-the art methods. Excellent agreement with the ground truth was achieved. Validation metrics, percentage of good contours, Dice metric, average perpendicular distance and conformity, were computed as 96.69%, 0.94, 1.81 mm and 0.86, versus those of 79.2-95.62%, 0.87-0.9, 1.76-2.97 mm and 0.67-0.78, obtained by other methods, respectively.

Joint tumor growth prediction and tumor segmentation on therapeutic follow-up PET images

Tumor response to treatment varies among patients. Patient-specific prediction of tumor evolution based on medical images during the treatment can help to build and adapt patient's treatment planning in a non-invasive way. Personalized tumor growth modeling allows patient-specific prediction by estimating model parameters based on individual's images. The model parameters are often estimated by optimizing a cost function constructed based on the tumor delineations. In this paper, we propose a joint framework for tumor growth prediction and tumor segmentation in the context of patient's therapeutic follow ups. Throughout the treatment, a series of sequential positron emission tomography (PET) images are acquired for tumor response monitoring. We propose to take into account the predicted information, which is used in combination with the random walks (RW) algorithm, to develop an automatic tumor segmentation method on PET images. Moreover, we propose an iterative scheme of RW, making the segmentation more performant. Furthermore, the obtained segmentation is applied to the process of model parameter estimation so as to get the model based prediction of tumor evolution. We evaluate our methods on 7 lung tumor patients, totaling 29 PET exams, under radiotherapy by comparing the obtained tumor prediction and tumor segmentation with manual tumor delineation by expert. Our system produces promising results when compared to the state-of-the-art methods.

LV Segmentation Using Stochastic Resonance and Evolutionary Cellular Automata

High-level noise and low contrast characteristics in medical images continue to present major bottlenecks in their segmentation despite increased imaging modalities. This paper presents a semi-automatic algorithm that utilizes the noise for enhancing the contrast of low contrast input magnetic resonance images followed by a new graph cut method to reconstruct the surface of left ventricle. The main contribution in this work is a new formulation for preventing the conventional cellular automata method to leak into surrounding regions of similar intensity. Instead of segmenting each slice of a subject sequence individually, we empirically select a few slices, segment them, and reconstruct the left ventricular surface. During the course of surface reconstruction, we use level sets to segment the rest of the slices automatically. We have throughly evaluated the method on both York and MICCAI Grand Challenge workshop databases. The average Dice coefficient (in %) is found to be 92.4 ± 1.3 (value indicates the mean and standard deviation) whereas false positive ratio, false negative ratio, and specificity are found to be 0.019, 7.62 × 10-3, and 0.75, respectively. Average Hausdorff distance between segmented contour and ground truth is determined to be 2.94 mm. The encouraging quantitative and qualitative results reflect the potential of the proposed method.

Semiautomated hybrid algorithm for estimation of three-dimensional liver surface in CT using dynamic cellular automata and level-sets

Liver segmentation continues to remain a major challenge, largely due to its intense complexity with surrounding anatomical structures (stomach, kidney, and heart), high noise level and lack of contrast in pathological computed tomography (CT) data. We present an approach to reconstructing the liver surface in low contrast CT. The main contributions are: (1) a stochastic resonance-based methodology in discrete cosine transform domain is developed to enhance the contrast of pathological liver images, (2) a new formulation is proposed to prevent the object boundary, resulting from the cellular automata method, from leaking into the surrounding areas of similar intensity, and (3) a level-set method is suggested to generate intermediate segmentation contours from two segmented slices distantly located in a subject sequence. We have tested the algorithm on real datasets obtained from two sources, Hamad General Hospital and medical image computing and computer-assisted interventions grand challenge workshop. Various parameters in the algorithm, such as [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], and [Formula: see text], play imperative roles, thus their values are precisely selected. Both qualitative and quantitative evaluation performed on liver data show promising segmentation accuracy when compared with ground truth data reflecting the potential of the proposed method.

Left ventricle: fully automated segmentation based on spatiotemporal continuity and myocardium information in cine cardiac magnetic resonance imaging (LV-FAST)

CMR quantification of LV chamber volumes typically and manually defines the basal-most LV, which adds processing time and user-dependence. This study developed an LV segmentation method that is fully automated based on the spatiotemporal continuity of the LV (LV-FAST). An iteratively decreasing threshold region growing approach was used first from the midventricle to the apex, until the LV area and shape discontinued, and then from midventricle to the base, until less than 50% of the myocardium circumference was observable. Region growth was constrained by LV spatiotemporal continuity to improve robustness of apical and basal segmentations. The LV-FAST method was compared with manual tracing on cardiac cine MRI data of 45 consecutive patients. Of the 45 patients, LV-FAST and manual selection identified the same apical slices at both ED and ES and the same basal slices at both ED and ES in 38, 38, 38, and 41 cases, respectively, and their measurements agreed within -1.6 ± 8.7 mL, -1.4 ± 7.8 mL, and 1.0 ± 5.8% for EDV, ESV, and EF, respectively. LV-FAST allowed LV volume-time course quantitatively measured within 3 seconds on a standard desktop computer, which is fast and accurate for processing the cine volumetric cardiac MRI data, and enables LV filling course quantification over the cardiac cycle.

The segmentation of 3D images using the random walking technique on a randomly created image adjacency graph

This paper considers the problem of image segmentation using the random walker algorithm. In the case of 3D images, the method uses an extreme amount of memory and time resources. These are required in order to represent the corresponding enormous image graph and to solve the resulting sparse linear system. Having in mind these limitations, this paper proposes techniques for the optimization of the random walker approach. The optimization is obtained by processing supervoxels representing homogeneous image regions rather than single voxels. A fast and efficient method for supervoxel determination is introduced. A method for the creation of an image adjacency graph from an irregular grid of supervoxels is also proposed. The results of applying the introduced approach to segmentation of 3D CT data sets are presented and compared with the results of the original random walker approach and other state-of-the-art methods. The accuracy and the computational overhead is regarded in the comparison. The analysis of results shows that the modified method can be successfully applied for the segmentation of volumetric images and provides results in a reasonable time without a significant loss in the image segmentation accuracy. It also outperforms the state-of-the-art methods considered in the comparison.

Left ventricle segmentation by dynamic shape constrained random walks

Accurate and robust extraction of the left ventricle (LV) cavity is a key step for quantitative analysis of cardiac functions. In this study, we propose an improved LV cavity segmentation method that incorporates a dynamic shape constraint into the weighting function of the random walks algorithm. The method involves an iterative process that updates an intermediate result to the desired solution. The shape constraint restricts the solution space of the segmentation result, such that the robustness of the algorithm is increased to handle misleading information that emanates from noise, weak boundaries, and clutter. Our experiments on real cardiac magnetic resonance images demonstrate that the proposed method obtains better segmentation performance than standard method.

Automatic segmentation of the left ventricle in cardiac MRI using local binary fitting model and dynamic programming techniques

Segmentation of the left ventricle is very important to quantitatively analyze global and regional cardiac function from magnetic resonance. The aim of this study is to develop a novel algorithm for segmenting left ventricle on short-axis cardiac magnetic resonance images (MRI) to improve the performance of computer-aided diagnosis (CAD) systems. In this research, an automatic segmentation method for left ventricle is proposed on the basis of local binary fitting (LBF) model and dynamic programming techniques. The validation experiments are performed on a pool of data sets of 45 cases. For both endo- and epi-cardial contours of our results, percentage of good contours is about 93.5%, the average perpendicular distance are about 2 mm. The overlapping dice metric is about 0.91. The regression and determination coefficient between the experts and our proposed method on the LV mass is 1.038 and 0.9033, respectively; they are 1.076 and 0.9386 for ejection fraction (EF). The proposed segmentation method shows the better performance and has great potential in improving the accuracy of computer-aided diagnosis systems in cardiovascular diseases.