A Multi-Anatomical Retinal Structure Segmentation System for Automatic Eye Screening Using Morphological Adaptive Fuzzy Thresholding

Artificial vascular image generation using blood vessel texture maps

BACKGROUND

Current methods for identifying blood vessels in digital images typically involve training neural networks on pixel-wise annotated data. However, manually outlining whole vessel trees in images tends to be very costly. One approach for reducing the amount of manual annotation is to pre-train networks on artificially generated vessel images. Recent pre-training approaches focus on generating proper artificial geometries for the vessels, while the appearance of the vessels is defined using general statistics of the real samples or generative networks requiring an additional training procedure to be defined. In contrast, we propose a methodology for generating blood vessels with realistic textures extracted directly from manually annotated vessel segments from real samples. The method allows the generation of artificial images having blood vessels with similar geometry and texture to the real samples using only a handful of manually annotated vessels.

METHODS

The first step of the method is the manual annotation of the borders of a small vessel segment, which takes only a few seconds. The annotation is then used for creating a reference image containing the texture of the vessel, called a texture map. A procedure is then defined to allow texture maps to be placed on top of any smooth curve using a piecewise linear transformation. Artificial images are then created by generating a set of vessel geometries using Bézier curves and assigning vessel texture maps to the curves.

RESULTS

The method is validated on a fluorescence microscopy (CORTEX) and a fundus photography (DRIVE) dataset. We show that manually annotating only 0.03% of the vessels in the CORTEX dataset allows pre-training a network to reach, on average, a Dice score of 0.87 ± 0.02, which is close to the baseline score of 0.92 obtained when all vessels of the training split of the dataset are annotated. For the DRIVE dataset, on average, a Dice score of 0.74 ± 0.02 is obtained by annotating only 0.29% of the vessels, which is also close to the baseline Dice score of 0.81 obtained when all vessels are annotated.

CONCLUSION

The proposed method can be used for disentangling the geometry and texture of blood vessels, which allows a significant improvement of network pre-training performance when compared to other pre-training methods commonly used in the literature.

Retinal Blood Vessel Tracking and Diameter Estimation via Gaussian Process With Rider Optimization Algorithm

Retinal blood vessels structure analysis is an important step in the detection of ocular diseases such as diabetic retinopathy and retinopathy of prematurity. Accurate tracking and estimation of retinal blood vessels in terms of their diameter remains a major challenge in retinal structure analysis. In this research, we develop a rider-based Gaussian approach for accurate tracking and diameter estimation of retinal blood vessels. The diameter and curvature of the blood vessel are assumed as the Gaussian processes. The features are determined for training the Gaussian process using Radon transform. The kernel hyperparameter of Gaussian processes is optimized using Rider Optimization Algorithm for evaluating the direction of the vessel. Multiple Gaussian processes are used for detecting the bifurcations and the difference in the prediction direction is quantified. The performance of the proposed Rider-based Gaussian process is evaluated with mean and standard deviation. Our method achieved high performance with the standard deviation of 0.2499 and mean average of 0.0147, which outperformed the state-of-the-art method by 6.32%. Although the proposed model outperformed the state-of-the-art method in normal blood vessels, in future research, one can include tortuous blood vessels of different retinopathy patients, which would be more challenging due to large angle variations. We used Rider-based Gaussian process for tracking blood vessels to obtain the diameter of retinal blood vessels, and the method performed well on the "STrutred Analysis of the REtina (STARE) Database" accessed on Oct. 2020 (https://cecas.clemson.edu/~ahoover/stare/). To the best of our knowledge, this experiment is one of the most recent analysis using this type of algorithm.

Semantic segmentation of retinal exudates using a residual encoder-decoder architecture in diabetic retinopathy

Exudates are a common sign of diabetic retinopathy, which is a disease that affects the blood vessels in the retina. Early detection of exudates is critical to avoiding vision problems through continuous screening and treatment. In traditional clinical practice, the involved lesions are manually detected using photographs of the fundus. However, this task is cumbersome and time-consuming and requires intense effort due to the small size of the lesion and the low contrast of the images. Thus, computer-assisted diagnosis of retinal disease based on the detection of red lesions has been actively explored recently. In this paper, we present a comparison of deep convolutional neural network (CNN) architectures and propose a residual CNN with residual skip connections to reduce the parameter for the semantic segmentation of exudates in retinal images. A suitable image augmentation technique is used to improve the performance of network architecture. The proposed network can robustly segment exudates with high accuracy, which makes it suitable for diabetic retinopathy screening. A comparative performance analysis of three benchmark databases: E-ophtha, DIARETDB1, and Hamilton Ophthalmology Institute's Macular Edema, is presented. The proposed method achieves a precision of 0.95, 0.92, 0.97, accuracy of 0.98, 0.98, 0.98, sensitivity of 0.97, 0.95, 0.95, specificity of 0.99, 0.99, 0.99, and area under the curve of 0.97, 0.94, and 0.96, respectively. RESEARCH HIGHLIGHTS: The research focuses on the detection and segmentation of exudates in diabetic retinopathy, a disease affecting the retina. Early detection of exudates is important to avoid vision problems and requires continuous screening and treatment. Currently, manual detection is time-consuming and requires intense effort. The authors compare qualitative results of the state-of-the-art convolutional neural network (CNN) architectures and propose a computer-assisted diagnosis approach based on deep learning, using a residual CNN with residual skip connections to reduce parameters. The proposed method is evaluated on three benchmark databases and demonstrates high accuracy and suitability for diabetic retinopathy screening.

Recent trends and advances in fundus image analysis: A review

Automated retinal image analysis holds prime significance in the accurate diagnosis of various critical eye diseases that include diabetic retinopathy (DR), age-related macular degeneration (AMD), atherosclerosis, and glaucoma. Manual diagnosis of retinal diseases by ophthalmologists takes time, effort, and financial resources, and is prone to error, in comparison to computer-aided diagnosis systems. In this context, robust classification and segmentation of retinal images are primary operations that aid clinicians in the early screening of patients to ensure the prevention and/or treatment of these diseases. This paper conducts an extensive review of the state-of-the-art methods for the detection and segmentation of retinal image features. Existing notable techniques for the detection of retinal features are categorized into essential groups and compared in depth. Additionally, a summary of quantifiable performance measures for various important stages of retinal image analysis, such as image acquisition and preprocessing, is provided. Finally, the widely used in the literature datasets for analyzing retinal images are described and their significance is emphasized.

Automatic Microaneurysms Detection for Early Diagnosis of Diabetic Retinopathy Using Improved Discrete Particle Swarm Optimization

Diabetic retinopathy (DR) is one of the most important microvascular complications associated with diabetes mellitus. The early signs of DR are microaneurysms, which can lead to complete vision loss. The detection of DR at an early stage can help to avoid non-reversible blindness. To do this, we incorporated fuzzy logic techniques into digital image processing to conduct effective detection. The digital fundus images were segmented using particle swarm optimization to identify microaneurysms. The particle swarm optimization clustering combined the membership functions by grouping the high similarity data into clusters. Model testing was conducted on the publicly available dataset called DIARETDB0, and image segmentation was done by probability-based (PBPSO) clustering algorithms. Different fuzzy models were applied and the outcomes were compared with our probability discrete particle swarm optimization algorithm. The results revealed that the proposed PSO algorithm achieved an accuracy of 99.9% in the early detection of DR.

Accuracy of Deep Learning Algorithms for the Diagnosis of Retinopathy of Prematurity by Fundus Images: A Systematic Review and Meta-Analysis

Background

Retinopathy of prematurity (ROP) occurs in preterm infants and may contribute to blindness. Deep learning (DL) models have been used for ophthalmologic diagnoses. We performed a systematic review and meta-analysis of published evidence to summarize and evaluate the diagnostic accuracy of DL algorithms for ROP by fundus images.

Methods

We searched PubMed, EMBASE, Web of Science, and Institute of Electrical and Electronics Engineers Xplore Digital Library on June 13, 2021, for studies using a DL algorithm to distinguish individuals with ROP of different grades, which provided accuracy measurements. The pooled sensitivity and specificity values and the area under the curve (AUC) of summary receiver operating characteristics curves (SROC) summarized overall test performance. The performances in validation and test datasets were assessed together and separately. Subgroup analyses were conducted between the definition and grades of ROP. Threshold and nonthreshold effects were tested to assess biases and evaluate accuracy factors associated with DL models.

Results

Nine studies with fifteen classifiers were included in our meta-analysis. A total of 521,586 objects were applied to DL models. For combined validation and test datasets in each study, the pooled sensitivity and specificity were 0.953 (95% confidence intervals (CI): 0.946-0.959) and 0.975 (0.973-0.977), respectively, and the AUC was 0.984 (0.978-0.989). For the validation dataset and test dataset, the AUC was 0.977 (0.968-0.986) and 0.987 (0.982-0.992), respectively. In the subgroup analysis of ROP vs. normal and differentiation of two ROP grades, the AUC was 0.990 (0.944-0.994) and 0.982 (0.964-0.999), respectively.

Conclusions

Our study shows that DL models can play an essential role in detecting and grading ROP with high sensitivity, specificity, and repeatability. The application of a DL-based automated system may improve ROP screening and diagnosis in the future.

Physiological changes in retinal layers thicknesses measured with swept source optical coherence tomography

PURPOSE

To evaluate the physiological changes related with age of all retinal layers thickness measurements in macular and peripapillary areas in healthy eyes.

METHODS

Wide protocol scan (with a field of view of 12x9 cm) from Triton SS-OCT instrument (Topcon Corporation, Japan) was performed 463 heathy eyes from 463 healthy controls. This protocol allows to measure the thickness of the following layers: Retina, Retinal nerve fiber layer (RNFL), Ganglion cell layer (GCL +), GCL++ and choroid. In those layers, mean thickness was compared in four groups of ages: Group 1 (71 healthy subjects aged between 20 and 34 years); Group 2 (65 individuals aged 35-49 years), Group 3 (230 healthy controls aged 50-64 years) and Group 4 (97 healthy subjects aged 65-79 years).

RESULTS

The most significant thinning of all retinal layers occurs particularly in the transition from group 2 to group 3, especially in temporal superior quadrant at RNFL, GCL++ and retinal layers (p≤0.001), and temporal superior, temporal inferior, and temporal half in choroid layer (p<0.001). Curiously group 2 when compared with group 1 presents a significant thickening of RNFL in temporal superior quadrant (p = 0.001), inferior (p<0.001) and temporal (p = 0.001) halves, and also in nasal half in choroid layer (p = 0.001).

CONCLUSIONS

Excepting the RNFL, which shows a thickening until the third decade of life, the rest of the layers seem to have a physiological progressive thinning.