Automatic 2-D/3-D Vessel Enhancement in Multiple Modality Images Using a Weighted Symmetry Filter

Automated Iris Segmentation from Anterior Segment OCT Images with Occludable Angles via Local Phase Tensor

Morphological changes in the iris are one of the major causes of angle-closure glaucoma, and an anteriorly-bowed iris may be further associated with greater risk of disease progression from primary angle-closure suspect (PACS) to chronic primary angle-closure glaucoma (CPCAG). In consequence, the automated detection of abnormalities in the iris region is of great importance in the management of glaucoma. In this paper, we present a new method for the extraction of the iris region by using a local phase tensor-based curvilinear structure enhancement method, and apply it to anterior segment optical coherence tomography (AS-OCT) imagery in the presence of occludable iridocorneal angle. The proposed method is evaluated across a dataset of 200 anterior chamber angle (ACA) images, and the experimental results show that the proposed method outperforms existing state-of-the-art method in applicability, effectiveness, and accuracy.

Speckle Reduction in Optical Coherence Tomography via Super-Resolution Reconstruction

Reducing speckle noise from the optical coherence tomograms (OCT) of human retina is a fundamental step to a better visualization and analysis in retinal imaging, as thus to support examination, diagnosis and treatment of many eye diseases. In this study, we propose a new method for speckle reduction in OCT images using the super-resolution technology. It merges multiple images for the same scene but with sub-pixel movements and restores the missing signals in one pixel, which significantly improves the image quality. The proposed method is evaluated on a dataset of 20 OCT volumes (5120 images), through the mean square error, peak signal to noise ratio and the mean structure similarity index using high quality line-scan images as reference. The experimental results show that the proposed method outperforms existing state-of-the-art approaches in applicability, effectiveness, and accuracy.

Phase asymmetry ultrasound despeckling with fractional anisotropic diffusion and total variation

We propose an ultrasound speckle filtering method for not only preserving various edge features but also filtering tissue-dependent complex speckle noises in ultrasound images. The key idea is to detect these various edges using a phase congruence-based edge significance measure called phase asymmetry (PAS), which is invariant to the intensity amplitude of edges and takes 0 in non-edge smooth regions and 1 at the idea step edge, while also taking intermediate values at slowly varying ramp edges. By leveraging the PAS metric in designing weighting coefficients to maintain a balance between fractional-order anisotropic diffusion and total variation (TV) filters in TV cost function, we propose a new fractional TV framework to not only achieve the best despeckling performance with ramp edge preservation but also reduce the staircase effect produced by integral-order filters. Then, we exploit the PAS metric in designing a new fractional-order diffusion coefficient to properly preserve low-contrast edges in diffusion filtering. Finally, different from fixed fractional-order diffusion filters, an adaptive fractional order is introduced based on the PAS metric to enhance various weak edges in the spatially transitional areas between objects. The proposed fractional TV model is minimized using the gradient descent method to obtain the final denoised image. The experimental results and real application of ultrasound breast image segmentation show that the proposed method outperforms other state-of-the-art ultrasound despeckling filters for both speckle reduction and feature preservation in terms of visual evaluation and quantitative indices. The best scores on feature similarity indices have achieved 0.867, 0.844 and 0.834 under three different levels of noise, while the best breast ultrasound segmentation accuracy in terms of the mean and median dice similarity coefficient are 96.25% and 96.15%, respectively.

Deep Retinal Image Segmentation with Regularization Under Geometric Priors

Vessel segmentation of retinal images is a key diagnostic capability in ophthalmology. This problem faces several challenges including low contrast, variable vessel size and thickness, and presence of interfering pathology such as micro-aneurysms and hemorrhages. Early approaches addressing this problem employed hand-crafted filters to capture vessel structures, accompanied by morphological post-processing. More recently, deep learning techniques have been employed with significantly enhanced segmentation accuracy. We propose a novel domain enriched deep network that consists of two components: 1) a representation network that learns geometric features specific to retinal images, and 2) a custom designed computationally efficient residual task network that utilizes the features obtained from the representation layer to perform pixel-level segmentation. The representation and task networks are jointly learned for any given training set. To obtain physically meaningful and practically effective representation filters, we propose two new constraints that are inspired by expected prior structure on these filters: 1) orientation constraint that promotes geometric diversity of curvilinear features, and 2) a data adaptive noise regularizer that penalizes false positives. Multi-scale extensions are developed to enable accurate detection of thin vessels. Experiments performed on three challenging benchmark databases under a variety of training scenarios show that the proposed prior guided deep network outperforms state of the art alternatives as measured by common evaluation metrics, while being more economical in network size and inference time.

Recurrent residual U-Net for medical image segmentation

Deep learning (DL)-based semantic segmentation methods have been providing state-of-the-art performance in the past few years. More specifically, these techniques have been successfully applied in medical image classification, segmentation, and detection tasks. One DL technique, U-Net, has become one of the most popular for these applications. We propose a recurrent U-Net model and a recurrent residual U-Net model, which are named RU-Net and R2U-Net, respectively. The proposed models utilize the power of U-Net, residual networks, and recurrent convolutional neural networks. There are several advantages to using these proposed architectures for segmentation tasks. First, a residual unit helps when training deep architectures. Second, feature accumulation with recurrent residual convolutional layers ensures better feature representation for segmentation tasks. Third, it allows us to design better U-Net architectures with the same number of network parameters with better performance for medical image segmentation. The proposed models are tested on three benchmark datasets, such as blood vessel segmentation in retinal images, skin cancer segmentation, and lung lesion segmentation. The experimental results show superior performance on segmentation tasks compared to equivalent models, including a variant of a fully connected convolutional neural network called SegNet, U-Net, and residual U-Net.

Structure-Preserving Guided Retinal Image Filtering and Its Application for Optic Disk Analysis

Retinal fundus photographs have been used in the diagnosis of many ocular diseases such as glaucoma, pathological myopia, age-related macular degeneration, and diabetic retinopathy. With the development of computer science, computer aided diagnosis has been developed to process and analyze the retinal images automatically. One of the challenges in the analysis is that the quality of the retinal image is often degraded. For example, a cataract in human lens will attenuate the retinal image, just as a cloudy camera lens which reduces the quality of a photograph. It often obscures the details in the retinal images and posts challenges in retinal image processing and analyzing tasks. In this paper, we approximate the degradation of the retinal images as a combination of human-lens attenuation and scattering. A novel structure-preserving guided retinal image filtering (SGRIF) is then proposed to restore images based on the attenuation and scattering model. The proposed SGRIF consists of a step of global structure transferring and a step of global edge-preserving smoothing. Our results show that the proposed SGRIF method is able to improve the contrast of retinal images, measured by histogram flatness measure, histogram spread, and variability of local luminosity. In addition, we further explored the benefits of SGRIF for subsequent retinal image processing and analyzing tasks. In the two applications of deep learning-based optic cup segmentation and sparse learning-based cup-to-disk ratio (CDR) computation, our results show that we are able to achieve more accurate optic cup segmentation and CDR measurements from images processed by SGRIF.

Blood vessel segmentation of fundus images via cross-modality dictionary learning

Automated retinal blood vessel segmentation is important for the early computer-aided diagnosis of some ophthalmological diseases and cardiovascular disorders. Traditional supervised vessel segmentation methods are usually based on pixel classification, which categorizes all pixels into vessel and non-vessel pixels. In this paper, we propose a new retinal vessel segmentation method with the motivation to extract vessels based on vessel block segmentation via cross-modality dictionary learning. For this, we first enhance the structural information of vessels using multi-scale filtering. Then, cross-modality description and segmentation dictionaries are learned to build the intrinsic relationship between the enhanced vessels and the labeled ground truth vessels for the purpose of vessel segmentation. Also, effective pre-processing and post-processing are adopted to promote the performance. Experimental results on three benchmark data sets demonstrate that the proposed method can achieve good segmentation results.

Retinal vascular segmentation using superpixel-based line operator and its application to vascular topology estimation

PURPOSE

Automatic methods of analyzing of retinal vascular networks, such as retinal blood vessel detection, vascular network topology estimation, and arteries/veins classification are of great assistance to the ophthalmologist in terms of diagnosis and treatment of a wide spectrum of diseases.

METHODS

We propose a new framework for precisely segmenting retinal vasculatures, constructing retinal vascular network topology, and separating the arteries and veins. A nonlocal total variation inspired Retinex model is employed to remove the image intensity inhomogeneities and relatively poor contrast. For better generalizability and segmentation performance, a superpixel-based line operator is proposed as to distinguish between lines and the edges, thus allowing more tolerance in the position of the respective contours. The concept of dominant sets clustering is adopted to estimate retinal vessel topology and classify the vessel network into arteries and veins.

RESULTS

The proposed segmentation method yields competitive results on three public data sets (STARE, DRIVE, and IOSTAR), and it has superior performance when compared with unsupervised segmentation methods, with accuracy of 0.954, 0.957, and 0.964, respectively. The topology estimation approach has been applied to five public databases (DRIVE,STARE, INSPIRE, IOSTAR, and VICAVR) and achieved high accuracy of 0.830, 0.910, 0.915, 0.928, and 0.889, respectively. The accuracies of arteries/veins classification based on the estimated vascular topology on three public databases (INSPIRE, DRIVE and VICAVR) are 0.90.9, 0.910, and 0.907, respectively.

CONCLUSIONS

The experimental results show that the proposed framework has effectively addressed crossover problem, a bottleneck issue in segmentation and vascular topology reconstruction. The vascular topology information significantly improves the accuracy on arteries/veins classification.