Macular edema computer-aided evaluation in ocular vein occlusions

A Weakly Supervised Deep Learning Approach for Leakage Detection in Fluorescein Angiography Images

Purpose

The purpose of this study was to design an automated algorithm that can detect fluorescence leakage accurately and quickly without the use of a large amount of labeled data.

Methods

A weakly supervised learning-based method was proposed to detect fluorescein leakage without the need for manual annotation of leakage areas. To enhance the representation of the network, a residual attention module (RAM) was designed as the core component of the proposed generator. Moreover, class activation maps (CAMs) were used to define a novel anomaly mask loss to facilitate more accurate learning of leakage areas. In addition, sensitivity, specificity, accuracy, area under the curve (AUC), and dice coefficient (DC) were used to evaluate the performance of the methods.

Results

The proposed method reached a sensitivity of 0.73 ± 0.04, a specificity of 0.97 ± 0.03, an accuracy of 0.95 ± 0.05, an AUC of 0.86 ± 0.04, and a DC of 0.87 ± 0.01 on the HRA data set; a sensitivity of 0.91 ± 0.02, a specificity of 0.97 ± 0.02, an accuracy of 0.96 ± 0.03, an AUC of 0.94 ± 0.02, and a DC of 0.85 ± 0.03 on Zhao's publicly available data set; and a sensitivity of 0.71 ± 0.04, a specificity of 0.99 ± 0.06, an accuracy of 0.87 ± 0.06, an AUC of 0.85 ± 0.02, and a DC of 0.78 ± 0.04 on Rabbani's publicly available data set.

Conclusions

The experimental results showed that the proposed method achieves better performance on fluorescence leakage detection and can detect one image within 1 second and thus has great potential value for clinical diagnosis and treatment of retina-related diseases, such as diabetic retinopathy and malarial retinopathy.

Translational Relevance

The proposed weakly supervised learning-based method that automates the detection of fluorescence leakage can facilitate the assessment of retinal-related diseases.

Research on the Segmentation of Biomarker for Chronic Central Serous Chorioretinopathy Based on Multimodal Fundus Image

At present, laser surgery is one of the effective ways to treat the chronic central serous chorioretinopathy (CSCR), in which the location of the leakage area is of great importance. In order to alleviate the pressure on ophthalmologists to manually label the biomarkers as well as elevate the biomarker segmentation quality, a semiautomatic biomarker segmentation method is proposed in this paper, aiming to facilitate the accurate and rapid acquisition of biomarker location information. Firstly, the multimodal fundus images are introduced into the biomarker segmentation task, which can effectively weaken the interference of highlighted vessels in the angiography images to the location of biomarkers. Secondly, a semiautomatic localization technique is adopted to reduce the search range of biomarkers, thus enabling the improvement of segmentation efficiency. On the basis of the above, the low-rank and sparse decomposition (LRSD) theory is introduced to construct the baseline segmentation scheme for segmentation of the CSCR biomarkers. Moreover, a joint segmentation framework consisting of the above method and region growing (RG) method is further designed to improve the performance of the baseline scheme. On the one hand, the LRSD is applied to offer the initial location information of biomarkers for the RG method, so as to ensure that the RG method can capture effective biomarkers. On the other hand, the biomarkers obtained by RG are fused with those gained by LRSD to make up for the defect of undersegmentation of the baseline scheme. Finally, the quantitative and qualitative ablation experiments have been carried out to demonstrate that the joint segmentation framework performs well than the baseline scheme in most cases, especially in the sensitivity and F1-score indicators, which not only confirms the effectiveness of the framework in the CSCR biomarker segmentation scene but also implies its potential application value in CSCR laser surgery.

Intensity and Compactness Enabled Saliency Estimation for Leakage Detection in Diabetic and Malarial Retinopathy

Leakage in retinal angiography currently is a key feature for confirming the activities of lesions in the management of a wide range of retinal diseases, such as diabetic maculopathy and paediatric malarial retinopathy. This paper proposes a new saliency-based method for the detection of leakage in fluorescein angiography. A superpixel approach is firstly employed to divide the image into meaningful patches (or superpixels) at different levels. Two saliency cues, intensity and compactness, are then proposed for the estimation of the saliency map of each individual superpixel at each level. The saliency maps at different levels over the same cues are fused using an averaging operator. The two saliency maps over different cues are fused using a pixel-wise multiplication operator. Leaking regions are finally detected by thresholding the saliency map followed by a graph-cut segmentation. The proposed method has been validated using the only two publicly available datasets: one for malarial retinopathy and the other for diabetic retinopathy. The experimental results show that it outperforms one of the latest competitors and performs as well as a human expert for leakage detection and outperforms several state-of-the-art methods for saliency detection.

Fully automatic segmentation of fluorescein leakage in subjects with diabetic macular edema

PURPOSE

To create and validate software to automatically segment leakage area in real-world clinical fluorescein angiography (FA) images of subjects with diabetic macular edema (DME).

METHODS

Fluorescein angiography images obtained from 24 eyes of 24 subjects with DME were retrospectively analyzed. Both video and still-frame images were obtained using a Heidelberg Spectralis 6-mode HRA/OCT unit. We aligned early and late FA frames in the video by a two-step nonrigid registration method. To remove background artifacts, we subtracted early and late FA frames. Finally, after postprocessing steps, including detection and inpainting of the vessels, a robust active contour method was utilized to obtain leakage area in a 1500-μm-radius circular region centered at the fovea. Images were captured at different fields of view (FOVs) and were often contaminated with outliers, as is the case in real-world clinical imaging. Our algorithm was applied to these images with no manual input. Separately, all images were manually segmented by two retina specialists. The sensitivity, specificity, and accuracy of manual interobserver, manual intraobserver, and automatic methods were calculated.

RESULTS

The mean accuracy was 0.86 ± 0.08 for automatic versus manual, 0.83 ± 0.16 for manual interobserver, and 0.90 ± 0.08 for manual intraobserver segmentation methods.

CONCLUSIONS

Our fully automated algorithm can reproducibly and accurately quantify the area of leakage of clinical-grade FA video and is congruent with expert manual segmentation. The performance was reliable for different DME subtypes. This approach has the potential to reduce time and labor costs and may yield objective and reproducible quantitative measurements of DME imaging biomarkers.

Contextual detection of diabetic pathology in wide-field retinal angiograms

We report a novel algorithm to locate vascular leakage and ischemia in retinal angiographic image sequences leveraging contextual knowledge of co-occurring pathologies. The key contributions are the use of spatio-temporal features exploiting the evolution of intensity levels over the sequence and contextual knowledge to detect ischemia. The specific nature of these diseased regions is determined using an AdaBoost learning algorithm. Training was performed with a varied set of 16 ground-truth image sequences, and testing on unseen images. The images used were acquired with an Optos ultrawide-field scanning laser ophthalmoscope. Evaluation against manual annotations demonstrates successful location of 93% of leakage regions and 70% of ischemic regions.