A variational method for geometric regularization of vascular segmentation in medical images

Automatic Muscle Fiber Orientation Tracking in Ultrasound Images Using a New Adaptive Fading Bayesian Kalman Smoother

This paper proposes a new algorithm for automatic estimation of muscle fiber orientation (MFO) in musculoskeletal ultrasound images, which is commonly used for both diagnosis and rehabilitation assessment of patients. The algorithm is based on a novel adaptive fading Bayesian Kalman filter (AF-BKF) and an automatic region of interest (ROI) extraction method. The ROI is first enhanced by the Gabor filter (GF) and extracted automatically using the revoting constrained Radon transform (RCRT) approach. The dominant MFO in the ROI is then detected by the RT and tracked by the proposed AF-BKF, which employs simplified Gaussian mixtures to approximate the non-Gaussian state densities and a new adaptive fading method to update the mixture parameters. An AF-BK smoother (AF-BKS) is also proposed by extending the AF-BKF using the concept of Rauch-Tung-Striebel smoother for further smoothing the fascicle orientations. The experimental results and comparisons show that: 1) the maximum segmentation error of the proposed RCRT is below nine pixels, which is sufficiently small for MFO tracking; 2) the accuracy of MFO gauged by RT in the ROI enhanced by the GF is comparable to that of using multiscale vessel enhancement filter-based method and better than those of local RT and revoting Hough transform approaches; and 3) the proposed AF-BKS algorithm outperforms the other tested approaches and achieves a performance close to those obtained by experienced operators (the overall covariance obtained by the AF-BKS is 3.19, which is rather close to that of the operators, 2.86). It, thus, serves as a valuable tool for automatic estimation of fascicle orientations and possibly for other applications in musculoskeletal ultrasound images.

Minimal Paths for Tubular Structure Segmentation With Coherence Penalty and Adaptive Anisotropy

The minimal path method has proven to be particularly useful and efficient in tubular structure segmentation applications. In this paper, we propose a new minimal path model associated with a dynamic Riemannian metric embedded with an appearance feature coherence penalty and an adaptive anisotropy enhancement term. The features that characterize the appearance and anisotropy properties of a tubular structure are extracted through the associated orientation score. The proposed the dynamic Riemannian metric is updated in the course of the geodesic distance computation carried out by the efficient single-pass fast marching method. Compared to the state-of-the-art minimal path models, the proposed minimal path model is able to extract the desired tubular structures from a complicated vessel tree structure. In addition, we propose an efficient prior path-based method to search for vessel radius value at each centerline position of the target. Finally, we perform the numerical experiments on both synthetic and real images. The quantitive validation is carried out on retinal vessel images. The results indicate that the proposed model indeed achieves a promising performance.

Tracking and diameter estimation of retinal vessels using Gaussian process and Radon transform

Extraction of blood vessels in retinal images is an important step for computer-aided diagnosis of ophthalmic pathologies. We propose an approach for blood vessel tracking and diameter estimation. We hypothesize that the curvature and the diameter of blood vessels are Gaussian processes (GPs). Local Radon transform, which is robust against noise, is subsequently used to compute the features and train the GPs. By learning the kernelized covariance matrix from training data, vessel direction and its diameter are estimated. In order to detect bifurcations, multiple GPs are used and the difference between their corresponding predicted directions is quantified. The combination of Radon features and GP results in a good performance in the presence of noise. The proposed method successfully deals with typically difficult cases such as bifurcations and central arterial reflex, and also tracks thin vessels with high accuracy. Experiments are conducted on the publicly available DRIVE, STARE, CHASEDB1, and high-resolution fundus databases evaluating sensitivity, specificity, and Matthew's correlation coefficient (MCC). Experimental results on these datasets show that the proposed method reaches an average sensitivity of 75.67%, specificity of 97.46%, and MCC of 72.18% which is comparable to the state-of-the-art.

An improved parallel fuzzy connected image segmentation method based on CUDA

PURPOSE

Fuzzy connectedness method (FC) is an effective method for extracting fuzzy objects from medical images. However, when FC is applied to large medical image datasets, its running time will be greatly expensive. Therefore, a parallel CUDA version of FC (CUDA-kFOE) was proposed by Ying et al. to accelerate the original FC. Unfortunately, CUDA-kFOE does not consider the edges between GPU blocks, which causes miscalculation of edge points. In this paper, an improved algorithm is proposed by adding a correction step on the edge points. The improved algorithm can greatly enhance the calculation accuracy.

METHODS

In the improved method, an iterative manner is applied. In the first iteration, the affinity computation strategy is changed and a look up table is employed for memory reduction. In the second iteration, the error voxels because of asynchronism are updated again.

RESULTS

Three different CT sequences of hepatic vascular with different sizes were used in the experiments with three different seeds. NVIDIA Tesla C2075 is used to evaluate our improved method over these three data sets. Experimental results show that the improved algorithm can achieve a faster segmentation compared to the CPU version and higher accuracy than CUDA-kFOE.

CONCLUSIONS

The calculation results were consistent with the CPU version, which demonstrates that it corrects the edge point calculation error of the original CUDA-kFOE. The proposed method has a comparable time cost and has less errors compared to the original CUDA-kFOE as demonstrated in the experimental results. In the future, we will focus on automatic acquisition method and automatic processing.

Automatic neuron segmentation and neural network analysis method for phase contrast microscopy images

Phase Contrast Microscopy (PCM) is an important tool for the long term study of living cells. Unlike fluorescence methods which suffer from photobleaching of fluorophore or dye molecules, PCM image contrast is generated by the natural variations in optical index of refraction. Unfortunately, the same physical principles which allow for these studies give rise to complex artifacts in the raw PCM imagery. Of particular interest in this paper are neuron images where these image imperfections manifest in very different ways for the two structures of specific interest: cell bodies (somas) and dendrites. To address these challenges, we introduce a novel parametric image model using the level set framework and an associated variational approach which simultaneously restores and segments this class of images. Using this technique as the basis for an automated image analysis pipeline, results for both the synthetic and real images validate and demonstrate the advantages of our approach.

Tubularity flow field--a technique for automatic neuron segmentation

A segmentation framework is proposed to trace neurons from confocal microscopy images. With an increasing demand for high throughput neuronal image analysis, we propose an automated scheme to perform segmentation in a variational framework. Our segmentation technique, called tubularity flow field (TuFF) performs directional regional growing guided by the direction of tubularity of the neurites. We further address the problem of sporadic signal variation in confocal microscopy by designing a local attraction force field, which is able to bridge the gaps between local neurite fragments, even in the case of complete signal loss. Segmentation is performed in an integrated fashion by incorporating the directional region growing and the attraction force-based motion in a single framework using level sets. This segmentation is accomplished without manual seed point selection; it is automated. The performance of TuFF is demonstrated over a set of 2D and 3D confocal microscopy images where we report an improvement of >75% in terms of mean absolute error over three extensively used neuron segmentation algorithms. Two novel features of the variational solution, the evolution force and the attraction force, hold promise as contributions that can be employed in a number of image analysis applications.

3D vasculature segmentation using localized hybrid level-set method

Background

Intensity inhomogeneity occurs in many medical images, especially in vessel images. Overcoming the difficulty due to image inhomogeneity is crucial for the segmentation of vessel image.

Methods

This paper proposes a localized hybrid level-set method for the segmentation of 3D vessel image. The proposed method integrates both local region information and boundary information for vessel segmentation, which is essential for the accurate extraction of tiny vessel structures. The local intensity information is firstly embedded into a region-based contour model, and then incorporated into the level-set formulation of the geodesic active contour model. Compared with the preset global threshold based method, the use of automatically calculated local thresholds enables the extraction of the local image information, which is essential for the segmentation of vessel images.

Results

Experiments carried out on the segmentation of 3D vessel images demonstrate the strengths of using locally specified dynamic thresholds in our level-set method. Furthermore, both qualitative comparison and quantitative validations have been performed to evaluate the effectiveness of our proposed model.

Conclusions

Experimental results and validations demonstrate that our proposed model can achieve more promising segmentation results than the original hybrid method does.

Images as occlusions of textures: a framework for segmentation

We propose a new mathematical and algorithmic framework for unsupervised image segmentation, which is a critical step in a wide variety of image processing applications. We have found that most existing segmentation methods are not successful on histopathology images, which prompted us to investigate segmentation of a broader class of images, namely those without clear edges between the regions to be segmented. We model these images as occlusions of random images, which we call textures, and show that local histograms are a useful tool for segmenting them. Based on our theoretical results, we describe a flexible segmentation framework that draws on existing work on nonnegative matrix factorization and image deconvolution. Results on synthetic texture mosaics and real histology images show the promise of the method.

Automatic segmentation and measurement of vasculature in retinal fundus images using probabilistic formulation

The automatic analysis of retinal blood vessels plays an important role in the computer-aided diagnosis. In this paper, we introduce a probabilistic tracking-based method for automatic vessel segmentation in retinal images. We take into account vessel edge detection on the whole retinal image and handle different vessel structures. During the tracking process, a Bayesian method with maximum a posteriori (MAP) as criterion is used to detect vessel edge points. Experimental evaluations of the tracking algorithm are performed on real retinal images from three publicly available databases: STARE (Hoover et al., 2000), DRIVE (Staal et al., 2004), and REVIEW (Al-Diri et al., 2008 and 2009). We got high accuracy in vessel segmentation, width measurements, and vessel structure identification. The sensitivity and specificity on STARE are 0.7248 and 0.9666, respectively. On DRIVE, the sensitivity is 0.6522 and the specificity is up to 0.9710.

An approach to localize the retinal blood vessels using bit planes and centerline detection

The change in morphology, diameter, branching pattern or tortuosity of retinal blood vessels is an important indicator of various clinical disorders of the eye and the body. This paper reports an automated method for segmentation of blood vessels in retinal images. A unique combination of techniques for vessel centerlines detection and morphological bit plane slicing is presented to extract the blood vessel tree from the retinal images. The centerlines are extracted by using the first order derivative of a Gaussian filter in four orientations and then evaluation of derivative signs and average derivative values is performed. Mathematical morphology has emerged as a proficient technique for quantifying the blood vessels in the retina. The shape and orientation map of blood vessels is obtained by applying a multidirectional morphological top-hat operator with a linear structuring element followed by bit plane slicing of the vessel enhanced grayscale image. The centerlines are combined with these maps to obtain the segmented vessel tree. The methodology is tested on three publicly available databases DRIVE, STARE and MESSIDOR. The results demonstrate that the performance of the proposed algorithm is comparable with state of the art techniques in terms of accuracy, sensitivity and specificity.

Vascular decomposition using weighted approximate convex decomposition

OBJECTIVE

Stroke treatment often requires analysis of vascular pathology evaluated using computed tomography (CT) angiography. Due to vascular variability and complexity, finding precise relationships between vessel geometries and arterial pathology is difficult. A new convex shape decomposition strategy was developed to understand complex vascular structures and synthesize a weighted approximate convex decomposition (WACD) method for vascular decomposition in computer-aided diagnosis.

MATERIALS AND METHODS

The vascular tree is decomposed into optimal number of components (determined by an expert). The decomposition is based on two primary features of vascular structures: (i) the branching factor that allows structural decomposition and (ii) the concavity over the vessel surface seen primarily at the site of an aneurysm. Such surfaces are decomposed into subcomponents. Vascular sections are reconstructed using CT angiograms. Next the dual graph is constructed, and edge weights for the graph are computed from shape indices. Graph vertices are iteratively clustered by a mesh decimation operator, while minimizing a cost function related to concavity.

RESULTS

The method was validated by first comparing results with an approximate convex decomposition (ACD) method and next on vessel sections (n = 177) whose number of clusters (ground truth) was predetermined by an expert. In both cases, WACD produced promising results with 84.7 % of the vessel sections correctly clustered and when compared with ACD produced a more effective decomposition. Next, the algorithm was validated in a longitudinal study data of 4 subjects where volumetric and surface area comparisons were made between expert segmented sections and WACD decomposed sections that contained aneurysms. The results showed a mean error rate of 7.8 % for volumetric comparisons and 10.4 % for surface area comparisons.

CONCLUSION

Decomposition of the cerebral vasculature from CT angiograms into a geometrically optimal set of convex regions may be useful for computer-assisted diagnosis. A new WACD method capable of decomposing complex vessel structures, including bifurcations and aneurysms, was developed and tested with promising results.

Longitudinally guided level sets for consistent tissue segmentation of neonates

Quantification of brain development as well as disease-induced pathologies in neonates often requires precise delineation of white matter, grey matter and cerebrospinal fluid. Unlike adults, tissue segmentation in neonates is significantly more challenging due to the inherently lower tissue contrast. Most existing methods take a voxel-based approach and are limited to working with images from a single time-point, even though longitudinal scans are available. We take a different approach by taking advantage of the fact that the pattern of the major sulci and gyri are already present in the neonates and generally preserved but fine-tuned during brain development. That is, the segmentation of late-time-point image can be used to guide the segmentation of neonatal image. Accordingly, we propose a novel longitudinally guided level-sets method for consistent neonatal image segmentation by combining local intensity information, atlas spatial prior, cortical thickness constraint, and longitudinal information into a variational framework. The minimization of the proposed energy functional is strictly derived from a variational principle. Validation performed on both simulated and in vivo neonatal brain images shows promising results.

A Hessian-based filter for vascular segmentation of noisy hepatic CT scans

PURPOSE

Extraction and enhancement of tubular structures are important in image processing applications, especially in the analysis of liver CT scans where delineation of vascular structures is needed for surgical planning. Portal vein cross-sections have circular or elliptical shapes, so an algorithm must accommodate both. A vessel segmentation method based on medial-axis points was developed and tested on portal veins in CT images.

METHODS

A medial-axis enhancement filter was developed. Consider a line passing through a point inside a tube and intersecting the edges of the tube. If the point is located on the medial axis, the distance of the point in the direction of the line to the edges of the tube will be equal. This feature was employed in a multi-scale framework to identify liver vessels. Dynamic thresholding was used to reduce noise sensitivity. The isotropic coefficient introduced by Pock et al. was used to reduce the response of the filter for asymmetric cross-sections.

RESULTS

Quantitative and qualitative evaluation of the proposed method were performed using both 2D/3D and synthetic/clinical datasets. Compared to other methods for medial-axis enhancement, our method produces better results in low-resolution CT images. Detection rate of the medial axis by the proposed method in a noisy image of standard deviation equal to 0.3 is 68% higher than prior methods.

CONCLUSION

A new Hessian-based method for medial axis vessel segmentation was developed and tested. This method produced superior results compared to prior methods. This new method has the potential for many applications of medial-axis enhancement.

Automatic segmentation of neonatal images using convex optimization and coupled level sets

Accurate segmentation of neonatal brain MR images remains challenging mainly due to their poor spatial resolution, inverted contrast between white matter and gray matter, and high intensity inhomogeneity. Most existing methods for neonatal brain segmentation are atlas-based and voxel-wise. Although active contour/surface models with geometric information constraint have been successfully applied to adult brain segmentation, they are not fully explored in the neonatal image segmentation. In this paper, we propose a novel neonatal image segmentation method by combining local intensity information, atlas spatial prior, and cortical thickness constraint in a single level-set framework. Besides, we also provide a robust and reliable tissue surface initialization for the proposed method by using a convex optimization technique. Thus, tissue segmentation, as well as inner and outer cortical surface reconstruction, can be obtained simultaneously. The proposed method has been tested on a large neonatal dataset, and the validation on 10 neonatal brain images (with manual segmentations) shows very promising results.

Segmentation of liver vasculature from contrast enhanced CT images using context-based voting

A novel vessel context-based voting is proposed for automatic liver vasculature segmentation in CT images. It is able to conduct full vessel segmentation and recognition of multiple vasculatures effectively. The vessel context describes context information of a voxel related to vessel properties, such as intensity, saliency, direction and connectivity. Voxels are grouped to liver vasculatures hierarchically based on vessel context. They are first grouped locally into vessel branches with the advantage of a vessel junction measurement, and then grouped globally into vasculatures, which is implemented using a multiple feature point voting mechanism. The proposed method has been evaluated on 10 clinical CT datasets. Segmentation of third-order vessel trees from CT images (0.76 × 0.76 × 2.0mm) of the portal venous phase takes less than 3 min on a PC with 2.0 GHz dual core processor and the average segmentation accuracy is up to 98%.