T-snakes: topology adaptive snakes

Anterior Mediastinal Lesion Segmentation Based on Two-Stage 3D ResUNet With Attention Gates and Lung Segmentation

OBJECTIVES

Anterior mediastinal disease is a common disease in the chest. Computed tomography (CT), as an important imaging technology, is widely used in the diagnosis of mediastinal diseases. Doctors find it difficult to distinguish lesions in CT images because of image artifact, intensity inhomogeneity, and their similarity with other tissues. Direct segmentation of lesions can provide doctors a method to better subtract the features of the lesions, thereby improving the accuracy of diagnosis.

METHOD

As the trend of image processing technology, deep learning is more accurate in image segmentation than traditional methods. We employ a two-stage 3D ResUNet network combined with lung segmentation to segment CT images. Given that the mediastinum is between the two lungs, the original image is clipped through the lung mask to remove some noises that may affect the segmentation of the lesion. To capture the feature of the lesions, we design a two-stage network structure. In the first stage, the features of the lesion are learned from the low-resolution downsampled image, and the segmentation results under a rough scale are obtained. The results are concatenated with the original image and encoded into the second stage to capture more accurate segmentation information from the image. In addition, attention gates are introduced in the upsampling of the network, and these gates can focus on the lesion and play a role in filtering the features. The proposed method has achieved good results in the segmentation of the anterior mediastinal.

RESULTS

The proposed method was verified on 230 patients, and the anterior mediastinal lesions were well segmented. The average Dice coefficient reached 87.73%. Compared with the model without lung segmentation, the model with lung segmentation greatly improved the accuracy of lesion segmentation by approximately 9%. The addition of attention gates slightly improved the segmentation accuracy.

CONCLUSION

The proposed automatic segmentation method has achieved good results in clinical data. In clinical application, automatic segmentation of lesions can assist doctors in the diagnosis of diseases and may facilitate the automated diagnosis of illnesses in the future.

Fréchet PDF based Matched Filter Approach for Retinal Blood Vessels Segmentation

BACKGROUND AND OBJECTIVE

Retinal pathology diseases such as glaucoma, obesity, diabetes, hypertension etc. have deadliest impact on life of human being today. Retinal blood vessels consist of various significant information which are helpful in detection and treatment of these diseases. Therefore, it is essential to segment these retinal vessels. Various matched filter approaches for segmentation of retinal blood vessels are reported in the literature but their kernel templates are not appropriate to vessel profile resulting poor performance. To overcome this, a novel matched filter approach based on Fréchet probability distribution function has been proposed.

METHODS

Image processing operations which we have used in the proposed approach are basically divided into three major stages viz; pre processing, Fréchet matched filter and post processing. In pre processing, principle component analysis (PCA) method is used to convert color image into grayscale image thereafter contrast limited adaptive histogram equalization (CLAHE) is applied on obtained grayscale to get enhanced grayscale image. In Fréchet matched filter, exhaustive experimental tests are conducted to choose optimal values for both Fréchet function parameters and matched filter parameters to design new matched filter. In post processing, entropy based optimal thresholding technique is applied on obtained MFR image to get binary image followed by length filtering and masking methods are applied to generate to a clear and whole vascular tree.

RESULTS

For evaluation of the proposed approach, quantitative performance metrics such as average specificity, average sensitivity and average accuracy and root mean square deviation (RMSD) are computed in the literature. We found the average specificity 97.24%, average sensitivity 72.78%, average accuracy 95.09% for STARE dataset while average specificity 97.61%, average sensitivity 73.07%, average accuracy 95.44% for DRIVE dataset. Average RMSD values are found 0.07 and 0.04 for STARE and DRIVE databases respectively.

CONCLUSIONS

From experimental results, it can be observed that our proposed approach outperforms over latest and prominent works reported in the literature. The cause of improved performance is due to better matching between vessel profile and Fréchet template.

Lumen-intima and media-adventitia segmentation in IVUS images using supervised classifications of arterial layers and morphological structures

BACKGROUND

Intravascular ultrasound (IVUS) provides axial grey-scale images of blood vessels. The large number of images require automatic analysis, specifically to identify the lumen and outer vessel wall. However, the high amount of noise, the presence of artifacts and anatomical structures, such as bifurcations, calcifications and fibrotic plaques, usually hinder the proper automatic segmentation of the vessel wall.

METHODS

Lumen, media, adventitia and surrounding tissues are automatically detected using Support Vector Machines (SVMs). The classification performance of the SVMs vary according to the kind of structure present within each region of the image. Random Forest (RF) is used to detect different morphological structures and to modify the initial layer classification depending on the detected structure. The resulting classification maps are fed into a segmentation method based on deformable contours to detect lumen-intima (LI) and media-adventitia (MA) interfaces.

RESULTS

The modifications in the layer classifications according to the presence of structures proved to be effective improving LI and MA segmentations. The proposed method reaches a Jaccard Measure (JM) of 0.88 ± 0.08 for LI segmentation, compared with 0.88 ± 0.05 of a semiautomatic method. When looking at MA, our method reaches a JM of 0.84 ± 0.09, and outperforms previous automatic methods in terms of HD, with 0.51mm ± 0.30.

CONCLUSIONS

A simple modification to the arterial layer classification produces results that match and improve state-of-the-art fully-automatic segmentation methods for LI and MA in 20MHz IVUS images. For LI segmentation, the proposed automatic method performs accurately as semi-automatic methods. For MA segmentation, our method matched the quality of state-of-the-art automatic methods described in the literature. Furthermore, our implementation is modular and open-source, allowing for future extensions and improvements.

LimeSeg: a coarse-grained lipid membrane simulation for 3D image segmentation

Background

3D segmentation is often a prerequisite for 3D object display and quantitative measurements. Yet existing voxel-based methods do not directly give information on the object surface or topology. As for spatially continuous approaches such as level-set, active contours and meshes, although providing surfaces and concise shape description, they are generally not suitable for multiple object segmentation and/or for objects with an irregular shape, which can hamper their adoption by bioimage analysts.

Results

We developed LimeSeg, a computationally efficient and spatially continuous 3D segmentation method. LimeSeg is easy-to-use and can process many and/or highly convoluted objects. Based on the concept of SURFace ELements (“Surfels”), LimeSeg resembles a highly coarse-grained simulation of a lipid membrane in which a set of particles, analogous to lipid molecules, are attracted to local image maxima. The particles are self-generating and self-destructing thus providing the ability for the membrane to evolve towards the contour of the objects of interest.

The capabilities of LimeSeg: simultaneous segmentation of numerous non overlapping objects, segmentation of highly convoluted objects and robustness for big datasets are demonstrated on experimental use cases (epithelial cells, brain MRI and FIB-SEM dataset of cellular membrane system respectively).

Conclusion

In conclusion, we implemented a new and efficient 3D surface reconstruction plugin adapted for various sources of images, which is deployed in the user-friendly and well-known ImageJ environment.

Accurate liver vessel segmentation via active contour model with dense vessel candidates

BACKGROUND AND OBJECTIVE

The purpose of this paper is to propose a fully automated liver vessel segmentation algorithm including portal vein and hepatic vein on contrast enhanced CTA images.

METHODS

First, points of a vessel candidate region are extracted from 3-dimensional (3D) CTA image. To generate accurate points, we reduce 3D segmentation problem to 2D problem by generating multiple maximum intensity (MI) images. After the segmentation of MI images, we back-project pixels to the original 3D domain. We call these voxels as vessel candidates (VCs). A large set of MI images can produce very dense and accurate VCs. Finally, for the accurate segmentation of a vessel region, we propose a newly designed active contour model (ACM) that uses the original image, vessel probability map from dense VCs, and the good prior of an initial contour.

RESULTS

We used 55 abdominal CTAs for a parameter study and a quantitative evaluation. We evaluated the performance of the proposed method comparing with other state-of-the-art ACMs for vascular images applied directly to the original data. The result showed that our method successfully segmented vascular structure 25%-122% more accurately than other methods without any extra false positive detection.

CONCLUSION

Our model can generate a smooth and accurate boundary of the vessel object and easily extract thin and weak peripheral branch vessels. The proposed approach can automatically segment a liver vessel without any manual interaction. The detailed result can aid further anatomical studies.

An Overview of Segmentation Algorithms for the Analysis of Anomalies on Medical Images

Human disease identification from the scanned body parts helps medical practitioners make the right decision in lesser time. Image segmentation plays a vital role in automated diagnosis for the delineation of anatomical organs and anomalies. There are many variants of segmentation algorithms used by current researchers, whereas there is no universal algorithm for all medical images. This paper classifies some of the widely used medical image segmentation algorithms based on their evolution, and the features of each generation are also discussed. The comparative analysis of segmentation algorithms is done based on characteristics like spatial consideration, region continuity, computation complexity, selection of parameters, noise immunity, accuracy, and computation time. Finally, in this work, some of the typical segmentation algorithms are implemented on real-time datasets using Matlab 2010 software, and the outcome of this work will be an aid for the researchers in medical image processing.

An Automated Approach for Localizing Retinal Blood Vessels in Confocal Scanning Laser Ophthalmoscopy Fundus Images

In this work, we present a rules-based method for localizing retinal blood vessels in confocal scanning laser ophthalmoscopy (cSLO) images and evaluate its feasibility. A total of 31 healthy participants (17 female; mean age: 64.0 ± 8.2 years) were studied using manual and automatic segmentation. High-resolution peripapillary scan acquisition cSLO images were acquired. The automated segmentation method consisted of image pre-processing for gray-level homogenization and blood vessel enhancement (morphological opening operation, Gaussian filter, morphological Top-Hat transformation), binary thresholding (entropy-based thresholding operation), and removal of falsely detected isolated vessel pixels. The proposed algorithm was first tested on the publically available dataset DRIVE, which contains color fundus photographs, and compared to performance results from the literature. Good results were obtained. Monochromatic cSLO images segmented using the proposed method were compared to those manually segmented by two independent observers. For the algorithm, a sensitivity of 0.7542, specificity of 0.8607, and accuracy of 0.8508 were obtained. For the two independent observers, a sensitivity of 0.6579, specificity of 0.9699, and accuracy of 0.9401 were obtained. The results demonstrate that it is possible to localize vessels in monochromatic cSLO images of the retina using a rules-based approach. The performance results are inferior to those obtained using fundus photography, which could be due to the nature of the technology.

Retinal blood vessels segmentation by using Gumbel probability distribution function based matched filter

BACKGROUND AND OBJECTIVE

Retinal blood vessel segmentation is a prominent task for the diagnosis of various retinal pathology such as hypertension, diabetes, glaucoma, etc. In this paper, a novel matched filter approach with the Gumbel probability distribution function as its kernel is introduced to improve the performance of retinal blood vessel segmentation.

METHODS

Before applying the proposed matched filter, the input retinal images are pre-processed. During pre-processing stage principal component analysis (PCA) based gray scale conversion followed by contrast limited adaptive histogram equalization (CLAHE) are applied for better enhancement of retinal image. After that an exhaustive experiments have been conducted for selecting the appropriate value of parameters to design a new matched filter. The post-processing steps after applying the proposed matched filter include the entropy based optimal thresholding and length filtering to obtain the segmented image.

RESULTS

For evaluating the performance of proposed approach, the quantitative performance measures, an average accuracy, average true positive rate (ATPR), and average false positive rate (AFPR) are calculated. The respective values of the quantitative performance measures are 0.9522, 0.7594, 0.0292 for DRIVE data set and 0.9270, 0.7939, 0.0624 for STARE data set. To justify the effectiveness of proposed approach, receiver operating characteristic (ROC) curve is plotted and the average area under the curve (AUC) is calculated. The average AUC for DRIVE and STARE data sets are 0.9287 and 0.9140 respectively.

CONCLUSIONS

The obtained experimental results confirm that the proposed approach performance better with respect to other prominent Gaussian distribution function and Cauchy PDF based matched filter approaches.

Energy minimization in medical image analysis: Methodologies and applications

Energy minimization is of particular interest in medical image analysis. In the past two decades, a variety of optimization schemes have been developed. In this paper, we present a comprehensive survey of the state-of-the-art optimization approaches. These algorithms are mainly classified into two categories: continuous method and discrete method. The former includes Newton-Raphson method, gradient descent method, conjugate gradient method, proximal gradient method, coordinate descent method, and genetic algorithm-based method, while the latter covers graph cuts method, belief propagation method, tree-reweighted message passing method, linear programming method, maximum margin learning method, simulated annealing method, and iterated conditional modes method. We also discuss the minimal surface method, primal-dual method, and the multi-objective optimization method. In addition, we review several comparative studies that evaluate the performance of different minimization techniques in terms of accuracy, efficiency, or complexity. These optimization techniques are widely used in many medical applications, for example, image segmentation, registration, reconstruction, motion tracking, and compressed sensing. We thus give an overview on those applications as well.

A quantitative study of nanoparticle skin penetration with interactive segmentation

In the last decade, the application of nanotechnology techniques has expanded within diverse areas such as pharmacology, medicine, and optical science. Despite such wide-ranging possibilities for implementation into practice, the mechanisms behind nanoparticle skin absorption remain unknown. Moreover, the main mode of investigation has been qualitative analysis. Using interactive segmentation, this study suggests a method of objectively and quantitatively analyzing the mechanisms underlying the skin absorption of nanoparticles. Silica nanoparticles (SNPs) were assessed using transmission electron microscopy and applied to the human skin equivalent model. Captured fluorescence images of this model were used to evaluate degrees of skin penetration. These images underwent interactive segmentation and image processing in addition to statistical quantitative analyses of calculated image parameters including the mean, integrated density, skewness, kurtosis, and area fraction. In images from both groups, the distribution area and intensity of fluorescent silica gradually increased in proportion to time. Since statistical significance was achieved after 2 days in the negative charge group and after 4 days in the positive charge group, there is a periodic difference. Furthermore, the quantity of silica per unit area showed a dramatic change after 6 days in the negative charge group. Although this quantitative result is identical to results obtained by qualitative assessment, it is meaningful in that it was proven by statistical analysis with quantitation by using image processing. The present study suggests that the surface charge of SNPs could play an important role in the percutaneous absorption of NPs. These findings can help achieve a better understanding of the percutaneous transport of NPs. In addition, these results provide important guidance for the design of NPs for biomedical applications.

Multi-object segmentation framework using deformable models for medical imaging analysis

Segmenting structures of interest in medical images is an important step in different tasks such as visualization, quantitative analysis, simulation, and image-guided surgery, among several other clinical applications. Numerous segmentation methods have been developed in the past three decades for extraction of anatomical or functional structures on medical imaging. Deformable models, which include the active contour models or snakes, are among the most popular methods for image segmentation combining several desirable features such as inherent connectivity and smoothness. Even though different approaches have been proposed and significant work has been dedicated to the improvement of such algorithms, there are still challenging research directions as the simultaneous extraction of multiple objects and the integration of individual techniques. This paper presents a novel open-source framework called deformable model array (DMA) for the segmentation of multiple and complex structures of interest in different imaging modalities. While most active contour algorithms can extract one region at a time, DMA allows integrating several deformable models to deal with multiple segmentation scenarios. Moreover, it is possible to consider any existing explicit deformable model formulation and even to incorporate new active contour methods, allowing to select a suitable combination in different conditions. The framework also introduces a control module that coordinates the cooperative evolution of the snakes and is able to solve interaction issues toward the segmentation goal. Thus, DMA can implement complex object and multi-object segmentations in both 2D and 3D using the contextual information derived from the model interaction. These are important features for several medical image analysis tasks in which different but related objects need to be simultaneously extracted. Experimental results on both computed tomography and magnetic resonance imaging show that the proposed framework has a wide range of applications especially in the presence of adjacent structures of interest or under intra-structure inhomogeneities giving excellent quantitative results.

Segmentation of uterine fibroid ultrasound images using a dynamic statistical shape model in HIFU therapy

Segmenting the lesion areas from ultrasound (US) images is an important step in the intra-operative planning of high-intensity focused ultrasound (HIFU). However, accurate segmentation remains a challenge due to intensity inhomogeneity, blurry boundaries in HIFU US images and the deformation of uterine fibroids caused by patient's breathing or external force. This paper presents a novel dynamic statistical shape model (SSM)-based segmentation method to accurately and efficiently segment the target region in HIFU US images of uterine fibroids. For accurately learning the prior shape information of lesion boundary fluctuations in the training set, the dynamic properties of stochastic differential equation and Fokker-Planck equation are incorporated into SSM (referred to as SF-SSM). Then, a new observation model of lesion areas (named to RPFM) in HIFU US images is developed to describe the features of the lesion areas and provide a likelihood probability to the prior shape given by SF-SSM. SF-SSM and RPFM are integrated into active contour model to improve the accuracy and robustness of segmentation in HIFU US images. We compare the proposed method with four well-known US segmentation methods to demonstrate its superiority. The experimental results in clinical HIFU US images validate the high accuracy and robustness of our approach, even when the quality of the images is unsatisfactory, indicating its potential for practical application in HIFU therapy.

Computer Vision Techniques for Transcatheter Intervention

Minimally invasive transcatheter technologies have demonstrated substantial promise for the diagnosis and the treatment of cardiovascular diseases. For example, transcatheter aortic valve implantation is an alternative to aortic valve replacement for the treatment of severe aortic stenosis, and transcatheter atrial fibrillation ablation is widely used for the treatment and the cure of atrial fibrillation. In addition, catheter-based intravascular ultrasound and optical coherence tomography imaging of coronary arteries provides important information about the coronary lumen, wall, and plaque characteristics. Qualitative and quantitative analysis of these cross-sectional image data will be beneficial to the evaluation and the treatment of coronary artery diseases such as atherosclerosis. In all the phases (preoperative, intraoperative, and postoperative) during the transcatheter intervention procedure, computer vision techniques (e.g., image segmentation and motion tracking) have been largely applied in the field to accomplish tasks like annulus measurement, valve selection, catheter placement control, and vessel centerline extraction. This provides beneficial guidance for the clinicians in surgical planning, disease diagnosis, and treatment assessment. In this paper, we present a systematical review on these state-of-the-art methods. We aim to give a comprehensive overview for researchers in the area of computer vision on the subject of transcatheter intervention. Research in medical computing is multi-disciplinary due to its nature, and hence, it is important to understand the application domain, clinical background, and imaging modality, so that methods and quantitative measurements derived from analyzing the imaging data are appropriate and meaningful. We thus provide an overview on the background information of the transcatheter intervention procedures, as well as a review of the computer vision techniques and methodologies applied in this area.

Computerized analysis of coronary artery disease: performance evaluation of segmentation and tracking of coronary arteries in CT angiograms

PURPOSE

The authors are developing a computer-aided detection system to assist radiologists in analysis of coronary artery disease in coronary CT angiograms (cCTA). This study evaluated the accuracy of the authors' coronary artery segmentation and tracking method which are the essential steps to define the search space for the detection of atherosclerotic plaques.

METHODS

The heart region in cCTA is segmented and the vascular structures are enhanced using the authors' multiscale coronary artery response (MSCAR) method that performed 3D multiscale filtering and analysis of the eigenvalues of Hessian matrices. Starting from seed points at the origins of the left and right coronary arteries, a 3D rolling balloon region growing (RBG) method that adapts to the local vessel size segmented and tracked each of the coronary arteries and identifies the branches along the tracked vessels. The branches are queued and subsequently tracked until the queue is exhausted. With Institutional Review Board approval, 62 cCTA were collected retrospectively from the authors' patient files. Three experienced cardiothoracic radiologists manually tracked and marked center points of the coronary arteries as reference standard following the 17-segment model that includes clinically significant coronary arteries. Two radiologists visually examined the computer-segmented vessels and marked the mistakenly tracked veins and noisy structures as false positives (FPs). For the 62 cases, the radiologists marked a total of 10191 center points on 865 visible coronary artery segments.

RESULTS

The computer-segmented vessels overlapped with 83.6% (8520/10191) of the center points. Relative to the 865 radiologist-marked segments, the sensitivity reached 91.9% (795/865) if a true positive is defined as a computer-segmented vessel that overlapped with at least 10% of the reference center points marked on the segment. When the overlap threshold is increased to 50% and 100%, the sensitivities were 86.2% and 53.4%, respectively. For the 62 test cases, a total of 55 FPs were identified by radiologist in 23 of the cases.

CONCLUSIONS

The authors' MSCAR-RBG method achieved high sensitivity for coronary artery segmentation and tracking. Studies are underway to further improve the accuracy for the arterial segments affected by motion artifacts, severe calcified and noncalcified soft plaques, and to reduce the false tracking of the veins and other noisy structures. Methods are also being developed to detect coronary artery disease along the tracked vessels.

Coronary vein extraction in MSCT volumes using minimum cost path and geometrical moments

This work deals with the extraction of patient-specific coronary venous anatomy in preoperative multislice computed tomography (MSCT) volumes. A hybrid approach has been specifically designed for low-contrast vascular structure detection. It makes use of a minimum cost path technique with a Fast-Marching front propagation to extract the vessel centerline. A second procedure was applied to refine the position of the path and estimate the local radius along the vessel. This was achieved with an iterative multiscale algorithm based on geometrical moments. Parameter tuning was performed using a dedicated numerical phantom, and then the algorithm was applied to extract the coronary venous system. Results are provided on three MSCT volume sequences acquired for patients selected for a cardiac resynchronization therapy procedure. A visibility study was carried out by a medical expert who labeled venous segments on a set of 18 volumes. A comparison with two other Fast-Marching techniques and a geometrical moment based tracking method is also reported.

Improved algorithm for gradient vector flow based active contour model using global and local information

Active contour models are used to extract object boundary from digital image, but there is poor convergence for the targets with deep concavities. We proposed an improved approach based on existing gradient vector flow methods. Main contributions of this paper are a new algorithm to determine the false part of active contour with higher accuracy from the global force of gradient vector flow and a new algorithm to update the external force field together with the local information of magnetostatic force. Our method has a semidynamic external force field, which is adjusted only when the false active contour exists. Thus, active contours have more chances to approximate the complex boundary, while the computational cost is limited effectively. The new algorithm is tested on irregular shapes and then on real images such as MRI and ultrasound medical data. Experimental results illustrate the efficiency of our method, and the computational complexity is also analyzed.

Augmented active surface model for the recovery of small structures in CT

This paper devises an augmented active surface model for the recovery of small structures in a low resolution and high noise setting, where the role of regularization is especially important. The emphasis here is on evaluating performance using real clinical computed tomography (CT) data with comparisons made to an objective ground truth acquired using micro-CT. In this paper, we show that the application of conventional active contour methods to small objects leads to non-optimal results because of the inherent properties of the energy terms and their interactions with one another. We show that the blind use of a gradient magnitude based energy performs poorly at these object scales and that the point spread function (PSF) is a critical factor that needs to be accounted for. We propose a new model that augments the external energy with prior knowledge by incorporating the PSF and the assumption of reasonably constant underlying CT numbers.

Spline-based deforming ellipsoids for interactive 3D bioimage segmentation

We present a new fast active-contour model (a.k.a. snake) for image segmentation in 3D microscopy. We introduce a parametric design that relies on exponential B-spline bases and allows us to build snakes that are able to reproduce ellipsoids. We design our bases to have the shortest-possible support, subject to some constraints. Thus, computational efficiency is maximized. The proposed 3D snake can approximate blob-like objects with good accuracy and can perfectly reproduce spheres and ellipsoids, irrespective of their position and orientation. The optimization process is remarkably fast due to the use of Gauss' theorem within our energy computation scheme. Our technique yields successful segmentation results, even for challenging data where object contours are not well defined. This is due to our parametric approach that allows one to favor prior shapes. In addition, this paper provides a software that gives full control over the snakes via an intuitive manipulation of few control points.

Computer-assisted system with multiple feature fused support vector machine for sperm morphology diagnosis

Sperm morphology is an important technique in identifying the health of sperms. In this paper we present a new system and novel approaches to classify different kinds of sperm images in order to assess their health. Our approach mainly relies on a one-dimensional feature which is extracted from the sperm's contour with gray level information. Our approach can handle rotation and scaling of the image. Moreover, it is fused with SVM classification to improve its accuracy. In our evaluation, our method has better performance than the existing approaches to sperm classification.

Segmentation and shape tracking of whole fluorescent cells based on the Chan-Vese model

We present a fast and robust approach to tracking the evolving shape of whole fluorescent cells in time-lapse series. The proposed tracking scheme involves two steps. First, coherence-enhancing diffusion filtering is applied on each frame to reduce the amount of noise and enhance flow-like structures. Second, the cell boundaries are detected by minimizing the Chan-Vese model in the fast level set-like and graph cut frameworks. To allow simultaneous tracking of multiple cells over time, both frameworks have been integrated with a topological prior exploiting the object indication function. The potential of the proposed tracking scheme and the advantages and disadvantages of both frameworks are demonstrated on 2-D and 3-D time-lapse series of rat adipose-derived mesenchymal stem cells and human lung squamous cell carcinoma cells, respectively.

Histology image analysis for carcinoma detection and grading

This paper presents an overview of the image analysis techniques in the domain of histopathology, specifically, for the objective of automated carcinoma detection and classification. As in other biomedical imaging areas such as radiology, many computer assisted diagnosis (CAD) systems have been implemented to aid histopathologists and clinicians in cancer diagnosis and research, which have been attempted to significantly reduce the labor and subjectivity of traditional manual intervention with histology images. The task of automated histology image analysis is usually not simple due to the unique characteristics of histology imaging, including the variability in image preparation techniques, clinical interpretation protocols, and the complex structures and very large size of the images themselves. In this paper we discuss those characteristics, provide relevant background information about slide preparation and interpretation, and review the application of digital image processing techniques to the field of histology image analysis. In particular, emphasis is given to state-of-the-art image segmentation methods for feature extraction and disease classification. Four major carcinomas of cervix, prostate, breast, and lung are selected to illustrate the functions and capabilities of existing CAD systems.

Self-crossing detection and location for parametric active contours

Active contours are very popular tools for video tracking and image segmentation. Parameterized contours are used due to their fast evolution and have become the method of choice in the Sobolev context. Unfortunately, these contours are not easily adaptable to topological changes, and they may sometimes develop undesirable loops, resulting in erroneous results. To solve such topological problems, one needs an algorithm for contour self-crossing detection. We propose a simple methodology via simple techniques from differential topology. The detection is accomplished by inspecting the total net change of a given contour's angle, without point sorting and plane sweeping. We discuss the efficient implementation of the algorithm. We also provide algorithms for locating crossings by angle considerations and by plotting the four-connected lines between the discrete contour points. The proposed algorithms can be added to any parametric active-contour model. We show examples of successful tracking in real-world video sequences by Sobolev active contours and the proposed algorithms and provide ideas for further research.

Snakes with an ellipse-reproducing property

We present a new class of continuously defined parametric snakes using a special kind of exponential splines as basis functions. We have enforced our bases to have the shortest possible support subject to some design constraints to maximize efficiency. While the resulting snakes are versatile enough to provide a good approximation of any closed curve in the plane, their most important feature is the fact that they admit ellipses within their span. Thus, they can perfectly generate circular and elliptical shapes. These features are appropriate to delineate cross sections of cylindrical-like conduits and to outline bloblike objects. We address the implementation details and illustrate the capabilities of our snake with synthetic and real data.

Machine Learning for Brain Image Segmentation

In this chapter, the authors review a variety of algorithms developed by different groups for automatically segmenting structures in medical images, such as brain MRI scans. Some of the simpler methods, based on active contours, deformable image registration, and anisotropic Markov random fields, have known weaknesses, which can be largely overcome by learning methods that better encode knowledge on anatomical variability. The authors show how the anatomical segmentation problem may be re-cast in a Bayesian framework. They then present several different learning techniques increasing in complexity until they derive two algorithms recently proposed by the authors. The authors show how these automated algorithms are validated empirically, by comparison with segmentations by experts, which serve as independent ground truth, and in terms of their power to detect disease effects in Alzheimer’s disease. They show how these methods can be used to investigate factors that influence disease progression in databases of thousands of images. Finally the authors indicate some promising directions for future work.

Contour detection and completion for inpainting and segmentation based on topological gradient and fast marching algorithms

We combine in this paper the topological gradient, which is a powerful method for edge detection in image processing, and a variant of the minimal path method in order to find connected contours. The topological gradient provides a more global analysis of the image than the standard gradient and identifies the main edges of an image. Several image processing problems (e.g., inpainting and segmentation) require continuous contours. For this purpose, we consider the fast marching algorithm in order to find minimal paths in the topological gradient image. This coupled algorithm quickly provides accurate and connected contours. We present then two numerical applications, to image inpainting and segmentation, of this hybrid algorithm.

IDENTIFICATION AND MATCHING OF PLANES IN A PAIR OF UNCALIBRATED IMAGES

In this paper, we propose a new method to simultaneously achieve segmentation and dense matching in a pair of stereo images. In contrast to conventional methods that are based on similarity or correlation techniques, this method is based on geometry, and uses correlations only on a limited number of key points. Stemming from the observation that our environment is abundant in planes, this method focuses on segmentation and matching of planes in an observed scene. Neither prior knowledge about the scene nor camera calibration are needed. Using two uncalibrated images as inputs, the method starts with a rough identification of a potential plane, defined by three points only. Based on these three points, a plane homography is then calculated and, used for validation. Starting from a seed region defined by the original three points, the method grows the current region by successive move/confirmation steps until occlusions and/or surface discontinuity occur. In this case, the homography-based mapping of points between the two images will not be valid anymore. This condition is detected by the correlation, used in the confirmation process. In particular, this method grows a region even across different colors as long as the region is planar. Experiments on real images validated our method and showed its capability and performance.

A framework of vertebra segmentation using the active shape model-based approach

We propose a medical image segmentation approach based on the Active Shape Model theory. We apply this method for cervical vertebra detection. The main advantage of this approach is the application of a statistical model created after a training stage. Thus, the knowledge and interaction of the domain expert intervene in this approach. Our application allows the use of two different models, that is, a global one (with several vertebrae) and a local one (with a single vertebra). Two modes of segmentation are also proposed: manual and semiautomatic. For the manual mode, only two points are selected by the user on a given image. The first point needs to be close to the lower anterior corner of the last vertebra and the second near the upper anterior corner of the first vertebra. These two points are required to initialize the segmentation process. We propose to use the Harris corner detector combined with three successive filters to carry out the semiautomatic process. The results obtained on a large set of X-ray images are very promising.

Topological correction of brain surface meshes using spherical harmonics

Surface reconstruction methods allow advanced analysis of structural and functional brain data beyond what can be achieved using volumetric images alone. Automated generation of cortical surface meshes from 3D brain MRI often leads to topological defects and geometrical artifacts that must be corrected to permit subsequent analysis. Here, we propose a novel method to repair topological defects using a surface reconstruction that relies on spherical harmonics. First, during reparameterization of the surface using a tiled platonic solid, the original MRI intensity values are used as a basis to select either a "fill" or "cut" operation for each topological defect. We modify the spherical map of the uncorrected brain surface mesh, such that certain triangles are favored while searching for the bounding triangle during reparameterization. Then, a low-pass filtered alternative reconstruction based on spherical harmonics is patched into the reconstructed surface in areas that previously contained defects. Self-intersections are repaired using a local smoothing algorithm that limits the number of affected points to less than 0.1% of the total, and as a last step, all modified points are adjusted based on the T1 intensity. We found that the corrected reconstructions have reduced distance error metrics compared with a "gold standard" surface created by averaging 12 scans of the same brain. Ninety-three percent of the topological defects in a set of 10 scans of control subjects were accurately corrected. The entire process takes 6-8 min of computation time. Further improvements are discussed, especially regarding the use of the T1-weighted image to make corrections.

3-D active meshes: fast discrete deformable models for cell tracking in 3-D time-lapse microscopy

Variational deformable models have proven over the past decades a high efficiency for segmentation and tracking in 2-D sequences. Yet, their application to 3-D time-lapse images has been hampered by discretization issues, heavy computational loads and lack of proper user visualization and interaction, limiting their use for routine analysis of large data-sets. We propose here to address these limitations by reformulating the problem entirely in the discrete domain using 3-D active meshes, which express a surface as a discrete triangular mesh, and minimize the energy functional accordingly. By performing computations in the discrete domain, computational costs are drastically reduced, whilst the mesh formalism allows to benefit from real-time 3-D rendering and other GPU-based optimizations. Performance evaluations on both simulated and real biological data sets show that this novel framework outperforms current state-of-the-art methods, constituting a light and fast alternative to traditional variational models for segmentation and tracking applications.

Automated coronary artery tree extraction in coronary CT angiography using a multiscale enhancement and dynamic balloon tracking (MSCAR-DBT) method

RATIONAL AND OBJECTIVES

To evaluate our prototype method for segmentation and tracking of the coronary arterial tree, which is the foundation for a computer-aided detection (CADe) system to be developed to assist radiologists in detecting non-calcified plaques in coronary CT angiography (cCTA) scans.

MATERIALS AND METHODS

The heart region was first extracted by a morphological operation and an adaptive thresholding method based on expectation-maximization (EM) estimation. The vascular structures within the heart region were enhanced and segmented using a multiscale coronary response (MSCAR) method that combined 3D multiscale filtering, analysis of the eigenvalues of Hessian matrices and EM estimation segmentation. After the segmentation of vascular structures, the coronary arteries were tracked by a 3D dynamic balloon tracking (DBT) method. The DBT method started at two manually identified seed points located at the origins of the left and right coronary arteries (LCA and RCA) for extraction of the arterial trees. The coronary arterial trees of a data set containing 20 ECG-gated contrast-enhanced cCTA scans were extracted by our MSCAR-DBT method and a clinical GE Advantage workstation. Two experienced thoracic radiologists visually examined the coronary arteries on the original cCTA scans and the rendered volume of segmented vessels to count the untracked false-negative (FN) segments and false positives (FPs) for both methods.

RESULTS

For the visible coronary arterial segments in the 20 cases, the radiologists identified that 25 segments were missed by our MSCAR-DBT method, ranging from 0 to 5 FN segments in individual cases, and that 55 artery segments were missed by the GE software, ranging from 0 to 7 FN segments in individual cases. 19 and 15 FPs were identified in our and the GE coronary trees, ranging from 0 to 4 FPs for both methods in individual cases, respectively.

CONCLUSION

The preliminary study demonstrates the feasibility of our MSCAR-DBT method for segmentation and tracking coronary artery trees. The results indicated that both our method and GE software can extract coronary artery trees reasonably well and the performance of our method is superior to that of GE software in this small data set. Further studies are underway to develop methods for improvement of the segmentation and tracking accuracy.