Rapid automated tracing and feature extraction from retinal fundus images using direct exploratory algorithms

Coronary artery center-line extraction using second order local features

Of interest is the accurate and robust delineation of vessel center-lines for complete arterial tree structure in coronary angiograms which is an imperative step towards 3D reconstruction of coronary tree and feature-based registration of multiple view angiograms. Most existing center-line tracking methods encounter limitations in coping with abrupt variations in local artery direction and sudden changes of lumen diameter that occur in the vicinity of arterial lesions. This paper presents an improved center-line tracing algorithm for automatic extraction of coronary arterial tree based on robust local features. The algorithm employs an improved scanning schema based on eigenvalues of Hessian matrix for reliable identification of true vessel points as well as an adaptive look-ahead distance schema for calculating the magnitude of scanning profile. In addition to a huge variety of clinical examples, a well-established vessel simulation tool was used to create several synthetic angiograms for objective comparison and performance evaluation. The experimental results on the accuracy and robustness of the proposed algorithm and its counterparts under difficult situations such as poor image quality and complicated vessel geometry are presented.

An approach to localize the retinal blood vessels using bit planes and centerline detection

The change in morphology, diameter, branching pattern or tortuosity of retinal blood vessels is an important indicator of various clinical disorders of the eye and the body. This paper reports an automated method for segmentation of blood vessels in retinal images. A unique combination of techniques for vessel centerlines detection and morphological bit plane slicing is presented to extract the blood vessel tree from the retinal images. The centerlines are extracted by using the first order derivative of a Gaussian filter in four orientations and then evaluation of derivative signs and average derivative values is performed. Mathematical morphology has emerged as a proficient technique for quantifying the blood vessels in the retina. The shape and orientation map of blood vessels is obtained by applying a multidirectional morphological top-hat operator with a linear structuring element followed by bit plane slicing of the vessel enhanced grayscale image. The centerlines are combined with these maps to obtain the segmented vessel tree. The methodology is tested on three publicly available databases DRIVE, STARE and MESSIDOR. The results demonstrate that the performance of the proposed algorithm is comparable with state of the art techniques in terms of accuracy, sensitivity and specificity.

Blood vessel segmentation methodologies in retinal images--a survey

Retinal vessel segmentation algorithms are a fundamental component of automatic retinal disease screening systems. This work examines the blood vessel segmentation methodologies in two dimensional retinal images acquired from a fundus camera and a survey of techniques is presented. The aim of this paper is to review, analyze and categorize the retinal vessel extraction algorithms, techniques and methodologies, giving a brief description, highlighting the key points and the performance measures. We intend to give the reader a framework for the existing research; to introduce the range of retinal vessel segmentation algorithms; to discuss the current trends and future directions and summarize the open problems. The performance of algorithms is compared and analyzed on two publicly available databases (DRIVE and STARE) of retinal images using a number of measures which include accuracy, true positive rate, false positive rate, sensitivity, specificity and area under receiver operating characteristic (ROC) curve.

Automatic reconstruction of neural morphologies with multi-scale tracking

Neurons have complex axonal and dendritic morphologies that are the structural building blocks of neural circuits. The traditional method to capture these morphological structures using manual reconstructions is time-consuming and partly subjective, so it appears important to develop automatic or semi-automatic methods to reconstruct neurons. Here we introduce a fast algorithm for tracking neural morphologies in 3D with simultaneous detection of branching processes. The method is based on existing tracking procedures, adding the machine vision technique of multi-scaling. Starting from a seed point, our algorithm tracks axonal or dendritic arbors within a sphere of a variable radius, then moves the sphere center to the point on its surface with the shortest Dijkstra path, detects branching points on the surface of the sphere, scales it until branches are well separated and then continues tracking each branch. We evaluate the performance of our algorithm on preprocessed data stacks obtained by manual reconstructions of neural cells, corrupted with different levels of artificial noise, and unprocessed data sets, achieving 90% precision and 81% recall in branch detection. We also discuss limitations of our method, such as reconstructing highly overlapping neural processes, and suggest possible improvements. Multi-scaling techniques, well suited to detect branching structures, appear a promising strategy for automatic neuronal reconstructions.

Towards Vision-Based Control of a Handheld Micromanipulator for Retinal Cannulation in an Eyeball Phantom

Injecting clot-busting drugs such as t-PA into tiny vessels thinner than a human hair in the eye is a challenging procedure, especially since the vessels lie directly on top of the delicate and easily damaged retina. Various robotic aids have been proposed with the goal of increasing safety by removing tremor and increasing precision with motion scaling. We have developed a fully handheld micromanipulator, Micron, that has demonstrated reduced tremor when cannulating porcine retinal veins in an "open sky" scenario. In this paper, we present work towards handheld robotic cannulation with the goal of vision-based virtual fixtures guiding the tip of the cannula to the vessel. Using a realistic eyeball phantom, we address sclerotomy constraints, eye movement, and non-planar retina. Preliminary results indicate a handheld micromanipulator aided by visual control is a promising solution to retinal vessel occlusion.

An automated computational framework for retinal vascular network labeling and branching order analysis

Changes in retinal vascular morphology are well known as predictive clinical signs of many diseases such as hypertension, diabetes and so on. Computer-aid image processing and analysis for retinal vessels in fundus images are effective and efficient in clinical diagnosis instead of tedious manual labeling and measurement. An automated computational framework for retinal vascular network labeling and analysis is presented in this work. The framework includes 1) detecting and locating the optic disc; 2) tracking the vessel centerline from detected seed points and linking the breaks after tracing; 3) extracting all the retinal vascular trees and identifying all the significant points; and 4) classifying terminal points into starting points and ending points based on the information of optic disc location, and finally assigning branch order for each extracted vascular tree in the image. All the modules in the framework are fully automated. Based on the results, morphological analysis is then applied to achieve geometrical and topological features based on branching order for one individual vascular tree or for the vascular network through the retinal vascular network in the images. Validation and experiments on the public DRIVE database have demonstrated that the proposed framework is a novel approach to analyze and study the vascular network pattern, and may offer new insights to the diagnosis of retinopathy.

Automated tracing of neurites from light microscopy stacks of images

Automating the process of neural circuit reconstruction on a large-scale is one of the foremost challenges in the field of neuroscience. In this study we examine the methodology for circuit reconstruction from three-dimensional light microscopy (LM) stacks of images. We show how the minimal error-rate of an ideal reconstruction procedure depends on the density of labeled neurites, giving rise to the fundamental limitation of an LM based approach for neural circuit research. Circuit reconstruction procedures typically involve steps related to neuron labeling and imaging, and subsequent image pre-processing and tracing of neurites. In this study, we focus on the last step--detection of traces of neurites from already pre-processed stacks of images. Our automated tracing algorithm, implemented as part of the Neural Circuit Tracer software package, consists of the following main steps. First, image stack is filtered to enhance labeled neurites. Second, centerline of the neurites is detected and optimized. Finally, individual branches of the optimal trace are merged into trees based on a cost minimization approach. The cost function accounts for branch orientations, distances between their end-points, curvature of the merged structure, and its intensity. The algorithm is capable of connecting branches which appear broken due to imperfect labeling and can resolve situations where branches appear to be fused due the limited resolution of light microscopy. The Neural Circuit Tracer software is designed to automatically incorporate ImageJ plug-ins and functions written in MatLab and provides roughly a 10-fold increases in speed in comparison to manual tracing.

Automated reconstruction of dendritic and axonal trees by global optimization with geometric priors

We present a novel probabilistic approach to fully automated delineation of tree structures in noisy 2D images and 3D image stacks. Unlike earlier methods that rely mostly on local evidence, ours builds a set of candidate trees over many different subsets of points likely to belong to the optimal tree and then chooses the best one according to a global objective function that combines image evidence with geometric priors. Since the best tree does not necessarily span all the points, the algorithm is able to eliminate false detections while retaining the correct tree topology. Manually annotated brightfield micrographs, retinal scans and the DIADEM challenge datasets are used to evaluate the performance of our method. We used the DIADEM metric to quantitatively evaluate the topological accuracy of the reconstructions and showed that the use of the geometric regularization yields a substantial improvement.

Contrast-independent curvilinear structure detection in biomedical images

Many biomedical applications require detection of curvilinear structures in images and would benefit from automatic or semiautomatic segmentation to allow high-throughput measurements. Here, we propose a contrast-independent approach to identify curvilinear structures based on oriented phase congruency, i.e., the phase congruency tensor (PCT). We show that the proposed method is largely insensitive to intensity variations along the curve and provides successful detection within noisy regions. The performance of the PCT is evaluated by comparing it with state-of-the-art intensity-based approaches on both synthetic and real biological images.

Multiscale exploration of mouse brain microstructures using the knife-edge scanning microscope brain atlas

Connectomics is the study of the full connection matrix of the brain. Recent advances in high-throughput, high-resolution 3D microscopy methods have enabled the imaging of whole small animal brains at a sub-micrometer resolution, potentially opening the road to full-blown connectomics research. One of the first such instruments to achieve whole-brain-scale imaging at sub-micrometer resolution is the Knife-Edge Scanning Microscope (KESM). KESM whole-brain data sets now include Golgi (neuronal circuits), Nissl (soma distribution), and India ink (vascular networks). KESM data can contribute greatly to connectomics research, since they fill the gap between lower resolution, large volume imaging methods (such as diffusion MRI) and higher resolution, small volume methods (e.g., serial sectioning electron microscopy). Furthermore, KESM data are by their nature multiscale, ranging from the subcellular to the whole organ scale. Due to this, visualization alone is a huge challenge, before we even start worrying about quantitative connectivity analysis. To solve this issue, we developed a web-based neuroinformatics framework for efficient visualization and analysis of the multiscale KESM data sets. In this paper, we will first provide an overview of KESM, then discuss in detail the KESM data sets and the web-based neuroinformatics framework, which is called the KESM brain atlas (KESMBA). Finally, we will discuss the relevance of the KESMBA to connectomics research, and identify challenges and future directions.

MORPHOLOGICAL STRUCTURE RECONSTRUCTION OF RETINAL VESSELS IN FUNDUS IMAGES

Vessels in retinal fundus images are useful in revealing the severity of eye-related diseases. In addition, they can act as landmarks for localizing lesions or the central vision area, and guide laser treatment of neovascularization. In this paper, we propose a two-stage scheme to extract vessels and reconstruct the morphological structure of vessels in retinal images. First, we employ mathematical morphology techniques to highlight large and small vessels with respect to their spatial properties. Different curvature response between vessel and noise patterns allows the use of curvature evaluation to remove enhanced vessel-like noise. A set of linear filters finalize the vessel map. However, the resulting vascular structure is incomplete of some important features in bifurcation points and central reflex. In order to rectify the pitfall, a reconstruction process is performed using dynamic local region growth to recover the morphological structure of vessels. Average performance of our method to extract vessels is 83.7% of TPR(True positive rate) and 3.8% of FPR(False positive rate) for 35 retinal images which include 21 abnormal images.

Digital ocular fundus imaging: a review

Ocular fundus imaging plays a key role in monitoring the health status of the human eye. Currently, a large number of imaging modalities allow the assessment and/or quantification of ocular changes from a healthy status. This review focuses on the main digital fundus imaging modality, color fundus photography, with a brief overview of complementary techniques, such as fluorescein angiography. While focusing on two-dimensional color fundus photography, the authors address the evolution from nondigital to digital imaging and its impact on diagnosis. They also compare several studies performed along the transitional path of this technology. Retinal image processing and analysis, automated disease detection and identification of the stage of diabetic retinopathy (DR) are addressed as well. The authors emphasize the problems of image segmentation, focusing on the major landmark structures of the ocular fundus: the vascular network, optic disk and the fovea. Several proposed approaches for the automatic detection of signs of disease onset and progression, such as microaneurysms, are surveyed. A thorough comparison is conducted among different studies with regard to the number of eyes/subjects, imaging modality, fundus camera used, field of view and image resolution to identify the large variation in characteristics from one study to another. Similarly, the main features of the proposed classifications and algorithms for the automatic detection of DR are compared, thereby addressing computer-aided diagnosis and computer-aided detection for use in screening programs.

Automatic detection and characterisation of retinal vessel tree bifurcations and crossovers in eye fundus images

Analysis of retinal vessel tree characteristics is an important task in medical diagnosis, specially in cases of diseases like vessel occlusion, hypertension or diabetes. The detection and classification of feature points in the arteriovenous eye tree will increase the information about the structure allowing its use for medical diagnosis. In this work a method for detection and classification of retinal vessel tree feature points is presented. The method applies and combines imaging techniques such as filters or morphologic operations to obtain an adequate structure for the detection. Classification is performed by analysing the feature points environment. Detection and classification of feature points is validated using the VARIA database. Experimental results are compared to previous approaches showing a much higher specificity in the characterisation of feature points while slightly increasing the sensitivity. These results provide a more reliable methodology for retinal structure analysis.

Real-time multimodal retinal image registration for a computer-assisted laser photocoagulation system

An algorithm for the real-time registration of a retinal video sequence captured with a scanning digital ophthalmoscope (SDO) to a retinal composite image is presented. This method is designed for a computer-assisted retinal laser photocoagulation system to compensate for retinal motion and hence enhance the accuracy, speed, and patient safety of retinal laser treatments. The procedure combines intensity and feature-based registration techniques. For the registration of an individual frame, the translational frame-to-frame motion between preceding and current frame is detected by normalized cross correlation. Next, vessel points on the current video frame are identified and an initial transformation estimate is constructed from the calculated translation vector and the quadratic registration matrix of the previous frame. The vessel points are then iteratively matched to the segmented vessel centerline of the composite image to refine the initial transformation and register the video frame to the composite image. Criteria for image quality and algorithm convergence are introduced, which assess the exclusion of single frames from the registration process and enable a loss of tracking signal if necessary. The algorithm was successfully applied to ten different video sequences recorded from patients. It revealed an average accuracy of 2.47 ± 2.0 pixels (∼23.2 ± 18.8 μm) for 2764 evaluated video frames and demonstrated that it meets the clinical requirements.

Anisotropic path searching for automatic neuron reconstruction

Full reconstruction of neuron morphology is of fundamental interest for the analysis and understanding of their functioning. We have developed a novel method capable of automatically tracing neurons in three-dimensional microscopy data. In contrast to template-based methods, the proposed approach makes no assumptions about the shape or appearance of neurite structure. Instead, an efficient seeding approach is applied to capture complex neuronal structures and the tracing problem is solved by computing the optimal reconstruction with a weighted graph. The optimality is determined by the cost function designed for the path between each pair of seeds and by topological constraints defining the component interrelations and completeness. In addition, an automated neuron comparison method is introduced for performance evaluation and structure analysis. The proposed algorithm is computationally efficient and has been validated using different types of microscopy data sets including Drosophila's projection neurons and fly neurons with presynaptic sites. In all cases, the approach yielded promising results.

Variable length open contour tracking using a deformable trellis

This paper focuses on contour tracking, an important problem in computer vision, and specifically on open contours that often directly represent a curvilinear object. Compelling applications are found in the field of bioimage analysis where blood vessels, dendrites, and various other biological structures are tracked over time. General open contour tracking, and biological images in particular, pose major challenges including scene clutter with similar structures (e.g., in the cell), and time varying contour length due to natural growth and shortening phenomena, which have not been adequately answered by earlier approaches based on closed and fixed end-point contours. We propose a model-based estimation algorithm to track open contours of time-varying length, which is robust to neighborhood clutter with similar structures. The method employs a deformable trellis in conjunction with a probabilistic (hidden Markov) model to estimate contour position, deformation, growth and shortening. It generates a maximum a posteriori estimate given observations in the current frame and prior contour information from previous frames. Experimental results on synthetic and real-world data demonstrate the effectiveness and performance gains of the proposed algorithm.

A new supervised method for blood vessel segmentation in retinal images by using gray-level and moment invariants-based features

This paper presents a new supervised method for blood vessel detection in digital retinal images. This method uses a neural network (NN) scheme for pixel classification and computes a 7-D vector composed of gray-level and moment invariants-based features for pixel representation. The method was evaluated on the publicly available DRIVE and STARE databases, widely used for this purpose, since they contain retinal images where the vascular structure has been precisely marked by experts. Method performance on both sets of test images is better than other existing solutions in literature. The method proves especially accurate for vessel detection in STARE images. Its application to this database (even when the NN was trained on the DRIVE database) outperforms all analyzed segmentation approaches. Its effectiveness and robustness with different image conditions, together with its simplicity and fast implementation, make this blood vessel segmentation proposal suitable for retinal image computer analyses such as automated screening for early diabetic retinopathy detection.

Automatic model-based tracing algorithm for vessel segmentation and diameter estimation

An automatic algorithm capable of segmenting the whole vessel tree and calculate vessel diameter and orientation in a digital ophthalmologic image is presented in this work. The algorithm is based on a parametric model of a vessel that can assume arbitrarily complex shape and a simple measure of match that quantifies how well the vessel model matches a given angiographic image. An automatic vessel tracing algorithm is described that exploits the geometric model and actively seeks vessel bifurcation, without user intervention. The proposed algorithm uses the geometric vessel model to determine the vessel diameter at each detected central axis pixel. For this reason, the algorithm is fine tuned using a subset of ophthalmologic images of the publically available DRIVE database, by maximizing vessel segmentation accuracy. The proposed algorithm is then applied to the remaining ophthalmological images of the DRIVE database. The segmentation results of the proposed algorithm compare favorably in terms of accuracy with six other well established vessel detection techniques, outperforming three of them in the majority of the available ophthalmologic images. The proposed algorithm achieves subpixel root mean square central axis positioning error that outperforms the non-expert based vessel segmentation, whereas the accuracy of vessel diameter estimation is comparable to that of the non-expert based vessel segmentation.

Automated image analysis for tracking cargo transport in axons

The dynamics of cargo movement in axons encodes crucial information about the underlying regulatory mechanisms of the axonal transport process in neurons, a central problem in understanding many neurodegenerative diseases. Quantitative analysis of cargo dynamics in axons usually includes three steps: (1) acquiring time-lapse image series, (2) localizing individual cargos at each time step, and (3) constructing dynamic trajectories for kinetic analysis. Currently, the later two steps are usually carried out with substantial human intervention. This article presents a method of automatic image analysis aiming for constructing cargo trajectories with higher data processing throughput, better spatial resolution, and minimal human intervention. The method is based on novel applications of several algorithms including 2D kymograph construction, seed points detection, trajectory curve tracing, back-projection to extract spatial information, and position refining using a 2D Gaussian fitting. This method is sufficiently robust for usage on images with low signal-to-noise ratio, such as those from single molecule experiments. The method was experimentally validated by tracking the axonal transport of quantum dot and DiI fluorophore-labeled vesicles in dorsal root ganglia neurons.

Retinal Fundus Image Registration via Vascular Structure Graph Matching

Motivated by the observation that a retinal fundus image may contain some unique geometric structures within its vascular trees which can be utilized for feature matching, in this paper, we proposed a graph-based registration framework called GM-ICP to align pairwise retinal images. First, the retinal vessels are automatically detected and represented as vascular structure graphs. A graph matching is then performed to find global correspondences between vascular bifurcations. Finally, a revised ICP algorithm incorporating with quadratic transformation model is used at fine level to register vessel shape models. In order to eliminate the incorrect matches from global correspondence set obtained via graph matching, we proposed a structure-based sample consensus (STRUCT-SAC) algorithm. The advantages of our approach are threefold: (1) global optimum solution can be achieved with graph matching; (2) our method is invariant to linear geometric transformations; and (3) heavy local feature descriptors are not required. The effectiveness of our method is demonstrated by the experiments with 48 pairs retinal images collected from clinical patients.

Multimodal registration procedure for the initial spatial alignment of a retinal video sequence to a retinal composite image

Accurate placement of lesions is crucial for the effectiveness and safety of a retinal laser photocoagulation treatment. Computer assistance provides the capability for improvements to treatment accuracy and execution time. The idea is to use video frames acquired from a scanning digital ophthalmoscope (SDO) to compensate for retinal motion during laser treatment. This paper presents a method for the multimodal registration of the initial frame from an SDO retinal video sequence to a retinal composite image, which may contain a treatment plan. The retinal registration procedure comprises the following steps: 1) detection of vessel centerline points and identification of the optic disc; 2) prealignment of the video frame and the composite image based on optic disc parameters; and 3) iterative matching of the detected vessel centerline points in expanding matching regions. This registration algorithm was designed for the initialization of a real-time registration procedure that registers the subsequent video frames to the composite image. The algorithm demonstrated its capability to register various pairs of SDO video frames and composite images acquired from patients.

Neurite outgrowth at the biomimetic interface

Understanding the cues that guide axons and how we can optimize these cues to achieve directed neuronal growth is imperative for neural tissue engineering. Cells in the local environment influence neurons with a rich combination of cues. This study deconstructs the complex mixture of guidance cues by working at the biomimetic interface--isolating the topographical information presented by cells and determining its capacity to guide neurons. We generated replica materials presenting topographies of oriented astrocytes (ACs), endothelial cells (ECs), and Schwann cells (SCs) as well as computer-aided design materials inspired by the contours of these cells (bioinspired-CAD). These materials presented distinct topographies and anisotropies and in all cases were sufficient to guide neurons. Dorsal root ganglia (DRG) cells and neurites demonstrated the most directed response on bioinspired-CAD materials which presented anisotropic features with 90 degrees edges. DRG alignment was strongest on SC bioinspired-CAD materials followed by AC bioinspired-CAD materials, with more uniform orientation to EC bioinspired-CAD materials. Alignment on replicas was strongest on SC replica materials followed by AC and EC replicas. These results suggest that the topographies of anisotropic tissue structures are sufficient for neuronal guidance. This work is discussed in the context of feature dimensions, morphology, and guidepost hypotheses.

A computational framework for studying neuron morphology from in vitro high content neuron-based screening

High content neuron image processing is considered as an important method for quantitative neurobiological studies. The main goal of analysis in this paper is to provide automatic image processing approaches to process neuron images for studying neuron mechanism in high content screening. In the nuclei channel, all nuclei are segmented and detected by applying the gradient vector field based watershed. Then the neuronal nuclei are selected based on the soma region detected in neurite channel. In neurite images, we propose a novel neurite centerline extraction approach using the improved line-pixel detection technique. The proposed neurite tracing method can detect the curvilinear structure more accurately compared with the current existing methods. An interface called NeuriteIQ based on the proposed algorithms is developed finally for better application in high content screening.

The edge-driven dual-bootstrap iterative closest point algorithm for registration of multimodal fluorescein angiogram sequence

Motivated by the need for multimodal image registration in ophthalmology, this paper introduces an algorithm which is tailored to jointly align in a common reference space all the images in a complete fluorescein angiogram (FA) sequence, which contains both red-free (RF) and FA images. Our work is inspired by Generalized Dual-Bootstrap Iterative Closest Point (GDB-ICP), which rank-orders Lowe keypoint matches and refines the transformation, going from local and low-order to global and higher-order model, computed from each keypoint match in succession. Albeit GDB-ICP has been shown to be robust in registering images taken under different lighting conditions, the performance is not satisfactory for image pairs with substantial, nonlinear intensity differences. Our algorithm, named Edge-Driven DB-ICP, targeting the least reliable component of GDB-ICP, modifies generation of keypoint matches for initialization by extracting the Lowe keypoints from the gradient magnitude image and enriching the keypoint descriptor with global-shape context using the edge points. Our dataset consists of 60 randomly-selected pathological sequences, each on average having up to two RF and 13 FA images. Edge-Driven DB-ICP successfully registered 92.4% of all pairs, and 81.1% multimodal pairs, whereas GDB-ICP registered 80.1% and 40.1%, respectively. For the joint registration of all images in a sequence, Edge-Driven DB-ICP succeeded in 59 sequences, which is a 23% improvement over GDB-ICP.

Automated analysis of retinal vascular network connectivity

This paper describes an algorithm that forms a retinal vessel graph by analysing the potential connectivity of segmented retinal vessels. Self organizing feature maps (SOFMs) are used to model implicit cost functions for the junction geometry. The algorithm uses these cost functions to resolve the configuration of local sets of segment ends, thus determining the network connectivity. The system includes specialized algorithms to handle overlapping vessels. The algorithm is tested on junctions drawn from the public-domain DRIVE database.

MDL constrained 3-D grayscale skeletonization algorithm for automated extraction of dendrites and spines from fluorescence confocal images

This paper presents a method for improved automatic delineation of dendrites and spines from three-dimensional (3-D) images of neurons acquired by confocal or multi-photon fluorescence microscopy. The core advance presented here is a direct grayscale skeletonization algorithm that is constrained by a structural complexity penalty using the minimum description length (MDL) principle, and additional neuroanatomy-specific constraints. The 3-D skeleton is extracted directly from the grayscale image data, avoiding errors introduced by image binarization. The MDL method achieves a practical tradeoff between the complexity of the skeleton and its coverage of the fluorescence signal. Additional advances include the use of 3-D spline smoothing of dendrites to improve spine detection, and graph-theoretic algorithms to explore and extract the dendritic structure from the grayscale skeleton using an intensity-weighted minimum spanning tree (IW-MST) algorithm. This algorithm was evaluated on 30 datasets organized in 8 groups from multiple laboratories. Spines were detected with false negative rates less than 10% on most datasets (the average is 7.1%), and the average false positive rate was 11.8%. The software is available in open source form.

Detection of blood vessels in ophthalmoscope images using MF/ant (matched filter/ant colony) algorithm

Blood vessels in ophthalmoscope images play an important role in diagnosis of some serious pathologies on retinal images. Hence, accurate extraction of vessels is becoming a main topic of this research area. Matched filter (MF) implementation for blood vessel detection is one of the methods giving more accurate results. Using this filter alone might not recover all the vessels (especially the capillaries). In this paper, a novel approach (MF/ant algorithm) is proposed to overcome the deficiency of the MF. The proposed method is a hybrid model of matched filter and ant colony algorithm. In this work, the accuracy and parameters of the hybrid algorithm are also discussed. The proposed method shows its success using the well known reference ophthalmoscope images of DRIVE database.

Unsupervised fuzzy based vessel segmentation in pathological digital fundus images

Performing the segmentation of vasculature in the retinal images having pathology is a challenging problem. This paper presents a novel approach for automated segmentation of the vasculature in retinal images. The approach uses the intensity information from red and green channels of the same retinal image to correct non-uniform illumination in color fundus images. Matched filtering is utilized to enhance the contrast of blood vessels against the background. The enhanced blood vessels are then segmented by employing spatially weighted fuzzy c-means clustering based thresholding which can well maintain the spatial structure of the vascular tree segments. The proposed method's performance is evaluated on publicly available DRIVE and STARE databases of manually labeled images. On the DRIVE and STARE databases, it achieves an area under the receiver operating characteristic curve of 0.9518 and 0.9602 respectively, being superior to those presented by state-of-the-art unsupervised approaches and comparable to those obtained with the supervised methods.

A unified framework for automated 3-d segmentation of surface-stained living cells and a comprehensive segmentation evaluation

This work presents a unified framework for whole cell segmentation of surface stained living cells from 3-D data sets of fluorescent images. Every step of the process is described, image acquisition, prefiltering, ridge enhancement, cell segmentation, and a segmentation evaluation. The segmentation results from two different automated approaches for segmentation are compared to manual segmentation of the same data using a rigorous evaluation scheme. This revealed that combination of the respective cell types with the most suitable microscopy method resulted in high success rates up to 97%. The described approach permits to automatically perform a statistical analysis of various parameters from living cells.

Retinal vessel segmentation on SLO image

A scanning laser ophthalmoscopy (SLO) image, taken from optical coherence tomography (OCT), usually has lower global/local contrast and more noise compared to the traditional retinal photograph, which makes the vessel segmentation challenging work. A hybrid algorithm is proposed to efficiently solve these problems by fusing several designed methods, taking the advantages of each method and reducing the error measurements. The algorithm has several steps consisting of image preprocessing, thresholding probe and weighted fusing. Four different methods are first designed to transform the SLO image into feature response images by taking different combinations of matched filter, contrast enhancement and mathematical morphology operators. A thresholding probe algorithm is then applied on those response images to obtain four vessel maps. Weighted majority opinion is used to fuse these vessel maps and generate a final vessel map. The experimental results showed that the proposed hybrid algorithm could successfully segment the blood vessels on SLO images, by detecting the major and small vessels and suppressing the noises. The algorithm showed substantial potential in various clinical applications. The use of this method can be also extended to medical image registration based on blood vessel location.

An algorithm for extracting the network geometry of three-dimensional collagen gels

The geometric structure of a biopolymer network impacts its mechanical and biological properties. In this paper, we develop an algorithm for extracting the network architecture of three-dimensional (3d) fluorescently labeled collagen gels, building on the initial work of Wu et al., (2003). Using artificially generated images, the network extraction algorithm is then validated for its ability to reconstruct the correct bulk properties of the network, including fiber length, persistence length, cross-link density, and shear modulus.

Sharpening of neurite morphology using complex coherence enhanced diffusion

The study of the molecular mechanisms involved in neurite outgrowth and differentiation, requires essential accurate and reproducible segmentation and quantification of neuronal processes. The common method used in this study is to detect and trace individual neurites, i.e. neurite tracing. The challenge comes mainly from the morphological problem in which these images contains ambiguities such as neurites discontinuities and intensity differences. In our work, we encounter a bigger challenge as the neurites in our images have a higher density of neurites. In this paper, we present a hybrid complex coherence-enhanced method for sharpening the morphology of neurons from such images. Coherence-enhanced diffusion (CED) is used to enhance the flowlike structures of the neurites, while the imaginary part of the complex nonlinear diffusion of the image cancels the appearance of 'clouds'. We also describe an elementary method for estimating the density of neuritis based on the obtained images. Our preliminary results show that the proposed methodology is a step ahead toward an effective neuronal morphology algorithm.

Neuron branch detection and description using random walk

The morphological studies of neuron structures are of great interests for biologists. However, manually detecting dendrites structures is very labor intensive, therefore unfeasible in studies that involve a large number of images. In this paper, we propose an automated neuron detection and description method. The proposed method uses ratios of probability maps from random walk sessions to detect initial seed-points and minimal cost path integrals with Delaunay triangulations.

Detection of the optimal neuron traces in confocal microscopy images

Quantitative methods of analysis of neural circuits rely on large datasets of neurons reconstructed accurately in three dimensions (3D). Due to the complexity of neuronal arbors, large datasets of reconstructed neurons must be generated with automated algorithms. Here, we attempted to automate the process of neuron tracing from sparsely labeled 3D stacks of confocal microscopy images. Our algorithm involves two steps. In the first step, the segmented image of neurites in the stack is voxel-coded. Centers of intensity of consecutively coded wave fronts are connected into a branched structure, which represents a coarse trace of the neurites. In the second step, this trace is optimized with the modified active contour method, which tends to maximize the intensity along the trace while keeping it under tension. To assess the performance of the algorithm we used manual reconstructions of neurons and converted them into artificial stacks of intensity images. These images were traced using the developed algorithm and quantitatively compared to the corresponding manual traces. The optimal traces were on average 6.0% shorter than the manual traces. This reduction in length resulted from the smoothness of the optimal traces, which, in comparison to the manual ones, were built out of shorter segments, and, as a result, were 3.3% less tortuous. The average distance between the optimal and the manual traces was 0.14 microm, and the average distance between their corresponding branch-points was 2.2 microm, illustrating good agreement between the traces.

3D Axon structure extraction and analysis in confocal fluorescence microscopy images

The morphological properties of axons, such as their branching patterns and oriented structures, are of great interest for biologists in the study of the synaptic connectivity of neurons. In these studies, researchers use triple immunofluorescent confocal microscopy to record morphological changes of neuronal processes. Three-dimensional (3D) microscopy image analysis is then required to extract morphological features of the neuronal structures. In this article, we propose a highly automated 3D centerline extraction tool to assist in this task. For this project, the most difficult part is that some axons are overlapping such that the boundaries distinguishing them are barely visible. Our approach combines a 3D dynamic programming (DP) technique and marker-controlled watershed algorithm to solve this problem. The approach consists of tracking and updating along the navigation directions of multiple axons simultaneously. The experimental results show that the proposed method can rapidly and accurately extract multiple axon centerlines and can handle complicated axon structures such as cross-over sections and overlapping objects.

Robust 3D reconstruction and identification of dendritic spines from optical microscopy imaging

In neurobiology, the 3D reconstruction of neurons followed by the identification of dendritic spines is essential for studying neuronal morphology, function and biophysical properties. Most existing methods suffer from problems of low reliability, poor accuracy and require much user interaction. In this paper, we present a method to reconstruct dendrites using a surface representation of the neuron. The skeleton of the dendrite is extracted by a procedure based on the medial geodesic function that is robust and topology preserving, and it is used to accurately identify spines. The sensitivity of the algorithm on the various parameters is explored in detail and the method is shown to be robust.