Three-dimensional segmentation of fluid-associated abnormalities in retinal OCT: probability constrained graph-search-graph-cut

Influence of drusenoid pigment epithelial detachments on the progression of age-related macular degeneration and visual acuity

OBJECTIVE

To analyze the presence and morphologic characteristics of drusenoid pigment epithelial detachments (DPEDs) in spectral-domain optical coherence tomography (SD-OCT) in Caucasian patients with early and intermediate age-related macular degeneration (AMD) as well as the influence of these characteristics on best-corrected visual acuity (BCVA) and disease progression.

DESIGN

Prospective observational cohort study.

PARTICIPANTS

89 eyes of 56 patients with early and intermediate AMD.

METHODS

Examinations consisted of BCVA, SD-OCT, and indocyanine green angiography. Evaluated parameters included drusen type, mean drusen height and -volume, the presence of DPED, DPED maximum height, -maximum diameter, -volume, topographic location, the rate of DPED collapse, and the development of macular neovascularization (MNV) or geographic atrophy (GA).

RESULTS

DPED maximum height (162.34 µm ± 75.70 μm, p = 0.019) was significantly associated with the development of GA and MNV. For each additional 100 μm in maximum height, the odds of developing any late AMD (GA or MNV) increased by 2.23 (95% CI = 1.14-4.35). The presence of DPED (44 eyes, p = 0.01), its volume (0.20 mm ± 0.20 mm, p = 0.01), maximum diameter (1860.87 μm ± 880.74 μm, p = 0.03), maximum height (p < 0.001) and topographical location in the central millimetre (p = 0.004) of the Early Treatment Diabetic Retinopathy Study (ETDRS)-Grid were significantly correlated with BCVA at the last follow-up (0.15logMAR ± 0.20logMAR; Snellen equivalent approximately 20/28). DPEDs occurred significantly less in the outer quadrants than in the central millimetre and inner quadrants of ETDRS-Grid (all p values < 0.001).

CONCLUSIONS

The height of drusen and DPEDs is a biomarker that is significantly associated with the development of late AMD and visual loss. DPEDs affect predominantly the center and inner quadrants of the ETDRS-Grid.

Recent advances in the application of artificial intelligence in age-related macular degeneration

Recent advancements in ophthalmology have been driven by the incorporation of artificial intelligence (AI), especially in diagnosing, monitoring treatment and predicting outcomes for age-related macular degeneration (AMD). AMD is a leading cause of irreversible vision loss worldwide, and its increasing prevalence among the ageing population presents a significant challenge for managing the disease. AI holds considerable promise in tackling this issue. This paper provides an overview of the latest developments in AI applications for AMD. However, current limitations include insufficient and unbalanced data, lack of interpretability in models, dependence on data quality and limited generality.

Semantic uncertainty Guided Cross-Transformer for enhanced macular edema segmentation in OCT images

Macular edema, a prevalent ocular complication observed in various retinal diseases, can lead to significant vision loss or blindness, necessitating accurate and timely diagnosis. Despite the potential of deep learning for segmentation of macular edema, challenges persist in accurately identifying lesion boundaries, especially in low-contrast and noisy regions, and in distinguishing between Inner Retinal Fluid (IRF), Sub-Retinal Fluid (SRF), and Pigment Epithelial Detachment (PED) lesions. To address these challenges, we present a novel approach, termed Semantic Uncertainty Guided Cross-Transformer Network (SuGCTNet), for the simultaneous segmentation of multi-class macular edema. Our proposed method comprises two key components, the semantic uncertainty guided attention module (SuGAM) and the Cross-Transformer module (CTM). The SuGAM module utilizes semantic uncertainty to allocate additional attention to regions with semantic ambiguity, improves the segmentation performance of these challenging areas. On the other hand, the CTM module capitalizes on both uncertainty information and multi-scale image features to enhance the overall continuity of the segmentation process, effectively minimizing feature confusion among different lesion types. Rigorous evaluation on public datasets and various OCT imaging device data demonstrates the superior performance of our proposed method compared to state-of-the-art approaches, highlighting its potential as a valuable tool for improving the accuracy and reproducibility of macular edema segmentation in clinical settings, and ultimately aiding in the early detection and diagnosis of macular edema-related diseases and associated retinal conditions.

Automatic segmentation of layers in chorio-retinal complex using Graph-based method for ultra-speed 1.7 MHz wide field swept source FDML optical coherence tomography

The posterior segment of the human eye complex contains two discrete microstructure and vasculature network systems, namely, the retina and choroid. We present a single segmentation framework technique for segmenting the entire layers present in the chorio-retinal complex of the human eye using optical coherence tomography (OCT) images. This automatic program is based on the graph theory method. This single program is capable of segmenting seven layers of the retina and choroid scleral interface. The graph theory was utilized to find the probability matrix and subsequent boundaries of different layers. The program was also implemented to segment angiographic maps of different chorio-retinal layers using "segmentation matrices." The method was tested and successfully validated on OCT images from six normal human eyes as well as eyes with non-exudative age-related macular degeneration (AMD). The thickness of microstructure and microvasculature for different layers located in the chorio-retinal segment of the eye was also generated and compared. A decent efficiency in terms of processing time, sensitivity, and accuracy was observed compared to the manual segmentation and other existing methods. The proposed method automatically segments whole OCT images of chorio-retinal complex with augmented probability maps generation in OCT volume dataset. We have also evaluated the segmentation results using quantitative metrics such as Dice coefficient and Hausdorff distance This method realizes a mean descent Dice similarity coefficient (DSC) value of 0.82 (range, 0.816-0.864) for RPE and CSI layer.

Early inner plexiform layer thinning and retinal nerve fiber layer thickening in excitotoxic retinal injury using deep learning-assisted optical coherence tomography

Excitotoxicity from the impairment of glutamate uptake constitutes an important mechanism in neurodegenerative diseases such as Alzheimer's, multiple sclerosis, and Parkinson's disease. Within the eye, excitotoxicity is thought to play a critical role in retinal ganglion cell death in glaucoma, diabetic retinopathy, retinal ischemia, and optic nerve injury, yet how excitotoxic injury impacts different retinal layers is not well understood. Here, we investigated the longitudinal effects of N-methyl-D-aspartate (NMDA)-induced excitotoxic retinal injury in a rat model using deep learning-assisted retinal layer thickness estimation. Before and after unilateral intravitreal NMDA injection in nine adult Long Evans rats, spectral-domain optical coherence tomography (OCT) was used to acquire volumetric retinal images in both eyes over 4 weeks. Ten retinal layers were automatically segmented from the OCT data using our deep learning-based algorithm. Retinal degeneration was evaluated using layer-specific retinal thickness changes at each time point (before, and at 3, 7, and 28 days after NMDA injection). Within the inner retina, our OCT results showed that retinal thinning occurred first in the inner plexiform layer at 3 days after NMDA injection, followed by the inner nuclear layer at 7 days post-injury. In contrast, the retinal nerve fiber layer exhibited an initial thickening 3 days after NMDA injection, followed by normalization and thinning up to 4 weeks post-injury. Our results demonstrated the pathological cascades of NMDA-induced neurotoxicity across different layers of the retina. The early inner plexiform layer thinning suggests early dendritic shrinkage, whereas the initial retinal nerve fiber layer thickening before subsequent normalization and thinning indicates early inflammation before axonal loss and cell death. These findings implicate the inner plexiform layer as an early imaging biomarker of excitotoxic retinal degeneration, whereas caution is warranted when interpreting the ganglion cell complex combining retinal nerve fiber layer, ganglion cell layer, and inner plexiform layer thicknesses in conventional OCT measures. Deep learning-assisted retinal layer segmentation and longitudinal OCT monitoring can help evaluate the different phases of retinal layer damage upon excitotoxicity.

Federated learning for diagnosis of age-related macular degeneration

This paper presents a federated learning (FL) approach to train deep learning models for classifying age-related macular degeneration (AMD) using optical coherence tomography image data. We employ the use of residual network and vision transformer encoders for the normal vs. AMD binary classification, integrating four unique domain adaptation techniques to address domain shift issues caused by heterogeneous data distribution in different institutions. Experimental results indicate that FL strategies can achieve competitive performance similar to centralized models even though each local model has access to a portion of the training data. Notably, the Adaptive Personalization FL strategy stood out in our FL evaluations, consistently delivering high performance across all tests due to its additional local model. Furthermore, the study provides valuable insights into the efficacy of simpler architectures in image classification tasks, particularly in scenarios where data privacy and decentralization are critical using both encoders. It suggests future exploration into deeper models and other FL strategies for a more nuanced understanding of these models' performance. Data and code are available at https://github.com/QIAIUNCC/FL_UNCC_QIAI.

Annotation-efficient learning for OCT segmentation

Deep learning has been successfully applied to OCT segmentation. However, for data from different manufacturers and imaging protocols, and for different regions of interest (ROIs), it requires laborious and time-consuming data annotation and training, which is undesirable in many scenarios, such as surgical navigation and multi-center clinical trials. Here we propose an annotation-efficient learning method for OCT segmentation that could significantly reduce annotation costs. Leveraging self-supervised generative learning, we train a Transformer-based model to learn the OCT imagery. Then we connect the trained Transformer-based encoder to a CNN-based decoder, to learn the dense pixel-wise prediction in OCT segmentation. These training phases use open-access data and thus incur no annotation costs, and the pre-trained model can be adapted to different data and ROIs without re-training. Based on the greedy approximation for the k-center problem, we also introduce an algorithm for the selective annotation of the target data. We verified our method on publicly-available and private OCT datasets. Compared to the widely-used U-Net model with 100% training data, our method only requires ∼10% of the data for achieving the same segmentation accuracy, and it speeds the training up to ∼3.5 times. Furthermore, our proposed method outperforms other potential strategies that could improve annotation efficiency. We think this emphasis on learning efficiency may help improve the intelligence and application penetration of OCT-based technologies.

A Review of Machine Learning Algorithms for Retinal Cyst Segmentation on Optical Coherence Tomography

Optical coherence tomography (OCT) is an emerging imaging technique for diagnosing ophthalmic diseases and the visual analysis of retinal structure changes, such as exudates, cysts, and fluid. In recent years, researchers have increasingly focused on applying machine learning algorithms, including classical machine learning and deep learning methods, to automate retinal cysts/fluid segmentation. These automated techniques can provide ophthalmologists with valuable tools for improved interpretation and quantification of retinal features, leading to more accurate diagnosis and informed treatment decisions for retinal diseases. This review summarized the state-of-the-art algorithms for the three essential steps of cyst/fluid segmentation: image denoising, layer segmentation, and cyst/fluid segmentation, while emphasizing the significance of machine learning techniques. Additionally, we provided a summary of the publicly available OCT datasets for cyst/fluid segmentation. Furthermore, the challenges, opportunities, and future directions of artificial intelligence (AI) in OCT cyst segmentation are discussed. This review is intended to summarize the key parameters for the development of a cyst/fluid segmentation system and the design of novel segmentation algorithms and has the potential to serve as a valuable resource for imaging researchers in the development of assessment systems related to ocular diseases exhibiting cyst/fluid in OCT imaging.

FourierNet: Shape-Preserving Network for Henle's Fiber Layer Segmentation in Optical Coherence Tomography Images

Henle's fiber layer (HFL), a retinal layer located in the outer retina between the outer nuclear and outer plexiform layers (ONL and OPL, respectively), is composed of uniformly linear photoreceptor axons and Müller cell processes. However, in the standard optical coherence tomography (OCT) imaging, this layer is usually included in the ONL since it is difficult to perceive HFL contours on OCT images. Due to its variable reflectivity under an imaging beam, delineating the HFL contours necessitates directional OCT, which requires additional imaging. This paper addresses this issue by introducing a shape-preserving network, FourierNet, which achieves HFL segmentation in standard OCT scans with the target performance obtained when directional OCT is available. FourierNet is a new cascaded network design that puts forward the idea of benefiting the shape prior of the HFL in the network training. This design proposes to represent the shape prior by extracting Fourier descriptors on the HFL contours and defining an additional regression task of learning these descriptors. FourierNet then formulates HFL segmentation as concurrent learning of regression and classification tasks, in which estimated Fourier descriptors are used together with the input image to construct the HFL segmentation map. Our experiments on 1470 images of 30 OCT scans of healthy-looking macula reveal that quantifying the HFL shape with Fourier descriptors and concurrently learning them with the main segmentation task leads to significantly better results. These findings indicate the effectiveness of designing a shape-preserving network to facilitate HFL segmentation without performing directional OCT imaging.

Cyst identification in retinal optical coherence tomography images using hidden Markov model

Optical Coherence Tomography (OCT) is a useful imaging modality facilitating the capturing process from retinal layers. In the salient diseases of retina, cysts are formed in retinal layers. Therefore, the identification of cysts in the retinal layers is of great importance. In this paper, a new method is proposed for the rapid detection of cystic OCT B-scans. In the proposed method, a Hidden Markov Model (HMM) is used for mathematically modelling the existence of cyst. In fact, the existence of cyst in the image can be considered as a hidden state. Since the existence of cyst in an OCT B-scan depends on the existence of cyst in the previous B-scans, HMM is an appropriate tool for modelling this process. In the first phase, a number of features are extracted which are Harris, KAZE, HOG, SURF, FAST, Min-Eigen and feature extracted by deep AlexNet. It is shown that the feature with the best discriminating power is the feature extracted by AlexNet. The features extracted in the first phase are used as observation vectors to estimate the HMM parameters. The evaluation results show the improved performance of HMM in terms of accuracy.

Fully-Automatic 3D Intuitive Visualization of Age-Related Macular Degeneration Fluid Accumulations in OCT Cubes

Age-related macular degeneration is the leading cause of vision loss in developed countries, and wet-type AMD requires urgent treatment and rapid diagnosis because it causes rapid irreversible vision loss. Currently, AMD diagnosis is mainly carried out using images obtained by optical coherence tomography. This diagnostic process is performed by human clinicians, so human error may occur in some cases. Therefore, fully automatic methodologies are highly desirable adding a layer of robustness to the diagnosis. In this work, a novel computer-aided diagnosis and visualization methodology is proposed for the rapid identification and visualization of wet AMD. We adapted a convolutional neural network for segmentation of a similar domain of medical images to the problem of wet AMD segmentation, taking advantage of transfer learning, which allows us to work with and exploit a reduced number of samples. We generate a 3D intuitive visualization where the existence, position and severity of the fluid were represented in a clear and intuitive way to facilitate the analysis of the clinicians. The 3D visualization is robust and accurate, obtaining satisfactory 0.949 and 0.960 Dice coefficients in the different evaluated OCT cube configurations, allowing to quickly assess the presence and extension of the fluid associated to wet AMD.

The Role of Different Retinal Imaging Modalities in Predicting Progression of Diabetic Retinopathy: A Survey

Diabetic retinopathy (DR) is a devastating condition caused by progressive changes in the retinal microvasculature. It is a leading cause of retinal blindness in people with diabetes. Long periods of uncontrolled blood sugar levels result in endothelial damage, leading to macular edema, altered retinal permeability, retinal ischemia, and neovascularization. In order to facilitate rapid screening and diagnosing, as well as grading of DR, different retinal modalities are utilized. Typically, a computer-aided diagnostic system (CAD) uses retinal images to aid the ophthalmologists in the diagnosis process. These CAD systems use a combination of machine learning (ML) models (e.g., deep learning (DL) approaches) to speed up the diagnosis and grading of DR. In this way, this survey provides a comprehensive overview of different imaging modalities used with ML/DL approaches in the DR diagnosis process. The four imaging modalities that we focused on are fluorescein angiography, fundus photographs, optical coherence tomography (OCT), and OCT angiography (OCTA). In addition, we discuss limitations of the literature that utilizes such modalities for DR diagnosis. In addition, we introduce research gaps and provide suggested solutions for the researchers to resolve. Lastly, we provide a thorough discussion about the challenges and future directions of the current state-of-the-art DL/ML approaches. We also elaborate on how integrating different imaging modalities with the clinical information and demographic data will lead to promising results for the scientists when diagnosing and grading DR. As a result of this article's comparative analysis and discussion, it remains necessary to use DL methods over existing ML models to detect DR in multiple modalities.

Directional analysis of intensity changes for determining the existence of cyst in optical coherence tomography images

Diabetic retinopathy (DR) is an important cause of blindness in people with the long history of diabetes. DR is caused due to the damage to blood vessels in the retina. One of the most important manifestations of DR is the formation of fluid-filled regions between retinal layers. The evaluation of stage and transcribed drugs can be possible through the analysis of retinal Optical Coherence Tomography (OCT) images. Therefore, the detection of cysts in OCT images and the is of considerable importance. In this paper, a fast method is proposed to determine the status of OCT images as cystic or non-cystic. The method consists of three phases which are pre-processing, boundary pixel determination and post-processing. After applying a noise reduction method in the pre-processing step, the method finds the pixels which are the boundary pixels of cysts. This process is performed by finding the significant intensity changes in the vertical direction and considering rectangular patches around the candidate pixels. The patches are verified whether or not they contain enough pixels making considerable diagonal intensity changes. Then, a shadow omission method is proposed in the post-processing phase to extract the shadow regions which can be mistakenly considered as cystic areas. Then, the pixels extracted in the previous phase that are near the shadow regions are removed to prevent the production of false positive cases. The performance of the proposed method is evaluated in terms of sensitivity and specificity on real datasets. The experimental results show that the proposed method produces outstanding results from both accuracy and speed points of view.

MsTGANet: Automatic Drusen Segmentation From Retinal OCT Images

Drusen is considered as the landmark for diagnosis of AMD and important risk factor for the development of AMD. Therefore, accurate segmentation of drusen in retinal OCT images is crucial for early diagnosis of AMD. However, drusen segmentation in retinal OCT images is still very challenging due to the large variations in size and shape of drusen, blurred boundaries, and speckle noise interference. Moreover, the lack of OCT dataset with pixel-level annotation is also a vital factor hindering the improvement of drusen segmentation accuracy. To solve these problems, a novel multi-scale transformer global attention network (MsTGANet) is proposed for drusen segmentation in retinal OCT images. In MsTGANet, which is based on U-Shape architecture, a novel multi-scale transformer non-local (MsTNL) module is designed and inserted into the top of encoder path, aiming at capturing multi-scale non-local features with long-range dependencies from different layers of encoder. Meanwhile, a novel multi-semantic global channel and spatial joint attention module (MsGCS) between encoder and decoder is proposed to guide the model to fuse different semantic features, thereby improving the model's ability to learn multi-semantic global contextual information. Furthermore, to alleviate the shortage of labeled data, we propose a novel semi-supervised version of MsTGANet (Semi-MsTGANet) based on pseudo-labeled data augmentation strategy, which can leverage a large amount of unlabeled data to further improve the segmentation performance. Finally, comprehensive experiments are conducted to evaluate the performance of the proposed MsTGANet and Semi-MsTGANet. The experimental results show that our proposed methods achieve better segmentation accuracy than other state-of-the-art CNN-based methods.

Correlation of Volume of Macular Edema with Retinal Tomography Features in Diabetic Retinopathy Eyes

Optical coherence tomography (OCT) enables the detection of macular edema, a significant pathological outcome of diabetic retinopathy (DR). The aim of the study was to correlate edema volume with the severity of diabetic retinopathy and response to treatment with intravitreal injections (compared to baseline). Diabetic retinopathy (DR; n = 181) eyes were imaged with OCT (Heidelberg Engineering, Germany). They were grouped as responders (a decrease in thickness after intravitreal injection of Bevacizumab), non-responders (persistent edema or reduced decrease in thickness), recurrent (recurrence of edema after injection), and treatment naïve (no change in edema at follow-up without any injection). The post-treatment imaging of eyes was included for all groups, except for the treatment naïve group. All eyes underwent a 9 × 6 mm raster scan to measure the edema volume (EV). Central foveal thickness (CFT), central foveal volume (CFV), and total retinal volume (TRV) were obtained from the early treatment diabetic retinopathy study (ETDRS) map. The median EV increased with DR severity, with PDR having the greatest EV (4.01 mm³). This correlated positively with TRV (p < 0.001). Median CFV and CFT were the greatest in severe NPDR. Median EV was the greatest in the recurrent eyes (4.675 mm³) and lowest (1.6 mm³) in the treatment naïve group. Responders and non-responders groups had median values of 3.65 and 3.93 mm³, respectively. This trend was not observed with CFV, CFT, and TRV. A linear regression yielded threshold values of CFV (~0.3 mm³), CFT (~386 µm), and TRV (~9.06 mm³), above which EV may be detected by the current scanner. In this study, EV provided a better distinction between the response groups when compared to retinal tomography parameters. The EV increased with disease severity. Thus, EV can be a more precise parameter to identify subclinical edema and aid in better treatment planning.

LF-UNet - A novel anatomical-aware dual-branch cascaded deep neural network for segmentation of retinal layers and fluid from optical coherence tomography images

Computer-assistant diagnosis of retinal disease relies heavily on the accurate detection of retinal boundaries and other pathological features such as fluid accumulation. Optical coherence tomography (OCT) is a non-invasive ophthalmological imaging technique that has become a standard modality in the field due to its ability to detect cross-sectional retinal pathologies at the micrometer level. In this work, we presented a novel framework to achieve simultaneous retinal layers and fluid segmentation. A dual-branch deep neural network, termed LF-UNet, was proposed which combines the expansion path of the U-Net and original fully convolutional network, with a dilated network. In addition, we introduced a cascaded network framework to include the anatomical awareness embedded in the volumetric image. Cross validation experiments showed that the proposed LF-UNet has superior performance compared to the state-of-the-art methods, and that incorporating the relative positional map structural prior information could further improve the performance regardless of the network. The generalizability of the proposed network was demonstrated on an independent dataset acquired from the same types of device with different field of view, or images acquired from different device.

Deep learning based joint segmentation and characterization of multi-class retinal fluid lesions on OCT scans for clinical use in anti-VEGF therapy

BACKGROUND

In anti-vascular endothelial growth factor (anti-VEGF) therapy, an accurate estimation of multi-class retinal fluid (MRF) is required for the activity prescription and intravitreal dose. This study proposes an end-to-end deep learning-based retinal fluids segmentation network (RFS-Net) to segment and recognize three MRF lesion manifestations, namely, intraretinal fluid (IRF), subretinal fluid (SRF), and pigment epithelial detachment (PED), from multi-vendor optical coherence tomography (OCT) imagery. The proposed image analysis tool will optimize anti-VEGF therapy and contribute to reducing the inter- and intra-observer variability.

METHOD

The proposed RFS-Net architecture integrates the atrous spatial pyramid pooling (ASPP), residual, and inception modules in the encoder path to learn better features and conserve more global information for precise segmentation and characterization of MRF lesions. The RFS-Net model is trained and validated using OCT scans from multiple vendors (Topcon, Cirrus, Spectralis), collected from three publicly available datasets. The first dataset consisted of OCT volumes obtained from 112 subjects (a total of 11,334 B-scans) is used for both training and evaluation purposes. Moreover, the remaining two datasets are only used for evaluation purposes to check the trained RFS-Net's generalizability on unseen OCT scans. The two evaluation datasets contain a total of 1572 OCT B-scans from 1255 subjects. The performance of the proposed RFS-Net model is assessed through various evaluation metrics.

RESULTS

The proposed RFS-Net model achieved the mean F₁ scores of 0.762, 0.796, and 0.805 for segmenting IRF, SRF, and PED. Moreover, with the automated segmentation of the three retinal manifestations, the RFS-Net brings a considerable gain in efficiency compared to the tedious and demanding manual segmentation procedure of the MRF.

CONCLUSIONS

Our proposed RFS-Net is a potential diagnostic tool for the automatic segmentation of MRF (IRF, SRF, and PED) lesions. It is expected to strengthen the inter-observer agreement, and standardization of dosimetry is envisaged as a result.

Quantification of Key Retinal Features in Early and Late Age-Related Macular Degeneration Using Deep Learning

PURPOSE

We sought to develop and validate a deep learning model for segmentation of 13 features associated with neovascular and atrophic age-related macular degeneration (AMD).

DESIGN

Development and validation of a deep-learning model for feature segmentation.

METHODS

Data for model development were obtained from 307 optical coherence tomography volumes. Eight experienced graders manually delineated all abnormalities in 2712 B-scans. A deep neural network was trained with these data to perform voxel-level segmentation of the 13 most common abnormalities (features). For evaluation, 112 B-scans from 112 patients with a diagnosis of neovascular AMD were annotated by 4 independent observers. The main outcome measures were Dice score, intraclass correlation coefficient, and free-response receiver operating characteristic curve.

RESULTS

On 11 of 13 features, the model obtained a mean Dice score of 0.63 ± 0.15, compared with 0.61 ± 0.17 for the observers. The mean intraclass correlation coefficient for the model was 0.66 ± 0.22, compared with 0.62 ± 0.21 for the observers. Two features were not evaluated quantitatively because of a lack of data. Free-response receiver operating characteristic analysis demonstrated that the model scored similar or higher sensitivity per false positives compared with the observers.

CONCLUSIONS

The quality of the automatic segmentation matches that of experienced graders for most features, exceeding human performance for some features. The quantified parameters provided by the model can be used in the current clinical routine and open possibilities for further research into treatment response outside clinical trials.

RetFluidNet: Retinal Fluid Segmentation for SD-OCT Images Using Convolutional Neural Network

Age-related macular degeneration (AMD) is one of the leading causes of irreversible blindness and is characterized by fluid-related accumulations such as intra-retinal fluid (IRF), subretinal fluid (SRF), and pigment epithelial detachment (PED). Spectral-domain optical coherence tomography (SD-OCT) is the primary modality used to diagnose AMD, yet it does not have algorithms that directly detect and quantify the fluid. This work presents an improved convolutional neural network (CNN)-based architecture called RetFluidNet to segment three types of fluid abnormalities from SD-OCT images. The model assimilates different skip-connect operations and atrous spatial pyramid pooling (ASPP) to integrate multi-scale contextual information; thus, achieving the best performance. This work also investigates between consequential and comparatively inconsequential hyperparameters and skip-connect techniques for fluid segmentation from the SD-OCT image to indicate the starting choice for future related researches. RetFluidNet was trained and tested on SD-OCT images from 124 patients and achieved an accuracy of 80.05%, 92.74%, and 95.53% for IRF, PED, and SRF, respectively. RetFluidNet showed significant improvement over competitive works to be clinically applicable in reasonable accuracy and time efficiency. RetFluidNet is a fully automated method that can support early detection and follow-up of AMD.

Choroid Segmentation of Retinal OCT Images Based on CNN Classifier and l 2-l q Fitter

Optical coherence tomography (OCT) is a noninvasive cross-sectional imaging technology used to examine the retinal structure and pathology of the eye. Evaluating the thickness of the choroid using OCT images is of great interests for clinicians and researchers to monitor the choroidal thickness in many ocular diseases for diagnosis and management. However, manual segmentation and thickness profiling of choroid are time-consuming which lead to low efficiency in analyzing a large quantity of OCT images for swift treatment of patients. In this paper, an automatic segmentation approach based on convolutional neural network (CNN) classifier and l ₂-l _q (0 < q < 1) fitter is presented to identify boundaries of the choroid and to generate thickness profile of the choroid from retinal OCT images. The method of detecting inner choroidal surface is motivated by its biological characteristics after light reflection, while the outer chorioscleral interface segmentation is transferred into a classification and fitting problem. The proposed method is tested in a data set of clinically obtained retinal OCT images with ground-truth marked by clinicians. Our numerical results demonstrate the effectiveness of the proposed approach to achieve stable and clinically accurate autosegmentation of the choroid.

Lightweight Learning-Based Automatic Segmentation of Subretinal Blebs on Microscope-Integrated Optical Coherence Tomography Images

PURPOSE

Subretinal injections of therapeutics are commonly used to treat ocular diseases. Accurate dosing of therapeutics at target locations is crucial but difficult to achieve using subretinal injections due to leakage, and there is no method available to measure the volume of therapeutics successfully administered to the subretinal location during surgery. Here, we introduce the first automatic method for quantifying the volume of subretinal blebs, using porcine eyes injected with Ringer's lactate solution as samples.

DESIGN

Ex vivo animal study.

METHODS

Microscope-integrated optical coherence tomography was used to obtain 3D visualization of subretinal blebs in porcine eyes at Duke Eye Center. Two different injection phases were imaged and analyzed in 15 eyes (30 volumes), selected from a total of 37 eyes. The inclusion/exclusion criteria were set independently from the algorithm-development and testing team. A novel lightweight, deep learning-based algorithm was designed to segment subretinal bleb boundaries. A cross-validation method was used to avoid selection bias. An ensemble-classifier strategy was applied to generate final results for the test dataset.

RESULTS

The algorithm performs notably better than 4 other state-of-the-art deep learning-based segmentation methods, achieving an F1 score of 93.86 ± 1.17% and 96.90 ± 0.59% on the independent test data for entry and full blebs, respectively.

CONCLUSION

The proposed algorithm accurately segmented the volumetric boundaries of Ringer's lactate solution delivered into the subretinal space of porcine eyes with robust performance and real-time speed. This is the first step for future applications in computer-guided delivery of therapeutics into the subretinal space in human subjects.

Deep learning architectures analysis for age-related macular degeneration segmentation on optical coherence tomography scans

BACKGROUND AND OBJECTIVES

Aged people usually are more to be diagnosed with retinal diseases in developed countries. Retinal capillaries leakage into the retina swells and causes an acute vision loss, which is called age-related macular degeneration (AMD). The disease can not be adequately diagnosed solely using fundus images as depth information is not available. The variations in retina volume assist in monitoring ophthalmological abnormalities. Therefore, high-fidelity AMD segmentation in optical coherence tomography (OCT) imaging modality has raised the attention of researchers as well as those of the medical doctors. Many methods across the years encompassing machine learning approaches and convolutional neural networks (CNN) strategies have been proposed for object detection and image segmentation.

METHODS

In this paper, we analyze four wide-spread deep learning models designed for the segmentation of three retinal fluids outputting dense predictions in the RETOUCH challenge data. We aim to demonstrate how a patch-based approach could push the performance for each method. Besides, we also evaluate the methods using the OPTIMA challenge dataset for generalizing network performance. The analysis is driven into two sections: the comparison between the four approaches and the significance of patching the images.

RESULTS

The performance of networks trained on the RETOUCH dataset is higher than human performance. The analysis further generalized the performance of the best network obtained by fine-tuning it and achieved a mean Dice similarity coefficient (DSC) of 0.85. Out of the three types of fluids, intraretinal fluid (IRF) is more recognized, and the highest DSC value of 0.922 is achieved using Spectralis dataset. Additionally, the highest average DSC score is 0.84, which is achieved by PaDeeplabv3+ model using Cirrus dataset.

CONCLUSIONS

The proposed method segments the three fluids in the retina with high DSC value. Fine-tuning the networks trained on the RETOUCH dataset makes the network perform better and faster than training from scratch. Enriching the networks with inputting a variety of shapes by extracting patches helped to segment the fluids better than using a full image.

Automated classification of normal and Stargardt disease optical coherence tomography images using deep learning

PURPOSE

Recent advances in deep learning have seen an increase in its application to automated image analysis in ophthalmology for conditions with a high prevalence. We wanted to identify whether deep learning could be used for the automated classification of optical coherence tomography (OCT) images from patients with Stargardt disease (STGD) using a smaller dataset than traditionally used.

METHODS

Sixty participants with STGD and 33 participants with a normal retinal OCT were selected, and a single OCT scan containing the centre of the fovea was selected as the input data. Two approaches were used: Model 1 - a pretrained convolutional neural network (CNN); Model 2 - a new CNN architecture. Both models were evaluated on their accuracy, sensitivity, specificity and Jaccard similarity score (JSS).

RESULTS

About 102 OCT scans from participants with a normal retinal OCT and 647 OCT scans from participants with STGD were selected. The highest results were achieved when both models were implemented as a binary classifier: Model 1 - accuracy 99.6%, sensitivity 99.8%, specificity 98.0% and JSS 0.990; Model 2 - accuracy 97.9%, sensitivity 97.9%, specificity 98.0% and JSS 0.976.

CONCLUSION

The deep learning classification models used in this study were able to achieve high accuracy despite using a smaller dataset than traditionally used and are effective in differentiating between normal OCT scans and those from patients with STGD. This preliminary study provides promising results for the application of deep learning to classify OCT images from patients with inherited retinal diseases.

Approaches to quantify optical coherence tomography angiography metrics

Optical coherence tomography (OCT) has revolutionized the field of ophthalmology in the last three decades. As an OCT extension, OCT angiography (OCTA) utilizes a fast OCT system to detect motion contrast in ocular tissue and provides a three-dimensional representation of the ocular vasculature in a non-invasive, dye-free manner. The first OCT machine equipped with OCTA function was approved by U.S. Food and Drug Administration in 2016 and now it is widely applied in clinics. To date, numerous methods have been developed to aid OCTA interpretation and quantification. In this review, we focused on the workflow of OCTA-based interpretation, beginning from the generation of the OCTA images using signal decorrelation, which we divided into intensity-based, phase-based and phasor-based methods. We further discussed methods used to address image artifacts that are commonly observed in clinical settings, to the algorithms for image enhancement, binarization, and OCTA metrics extraction. We believe a better grasp of these technical aspects of OCTA will enhance the understanding of the technology and its potential application in disease diagnosis and management. Moreover, future studies will also explore the use of ocular OCTA as a window to link ocular vasculature to the function of other organs such as the kidney and brain.

An unsupervised hierarchical approach for automatic intra-retinal cyst segmentation in spectral-domain optical coherence tomography images

PURPOSE

Intra-retinal cyst (IRC) is a symptom of macular disorders that occurs due to retinal blood vessel damage and fluid leakage to the macula area. These abnormalities are efficiently visualized using optical coherence tomography (OCT) imaging. These patients need to be regularly monitored for the presence and changes of IRC regions. Thus, automatic segmentation of IRCs can be beneficial to investigate disease progression.

METHODS

In this study, automatic IRC segmentation is accomplished by building three different masks in three unsupervised segmentation levels of a hierarchical framework. In the first level, the ROI-mask (R-mask) is built, and the retina area is cropped based on this mask. In the second level, the prune-mask (P-mask) is built, and the searching space is significantly reduced toward the target objects using this mask; and finally in the third level, by applying the Markov random field (MRF) model and employing intensity and contextual information, the cyst mask (C-mask) is extracted.

RESULTS

The proposed method is evaluated on three datasets including OPTIMA, UMN, and KERMANY datasets. The experimental results showed that the proposed method is effective with a mean dice coefficient rate of 0.74, 0.75 and 0.79 by the intersection of ground truths on the OPTIMA, UMN and KERMANY datasets, respectively.

CONCLUSION

The proposed method outperforms the state-of-the-art methods on the OPTIMA and UMN datasets while achieving comparable results to the most recently proposed method on the KERMANY dataset.

Performance Evaluation Of Convolutions And Atrous Convolutions In Deep Networks For Retinal Disease Segmentation On Optical Coherence Tomography Volumes

The deterioration of the retina center could be the main reason for vision loss. Older people usually ranging from 50 years and above are exposed to age-related macular degeneration (AMD) disease that strikes the retina. The lack of human expertise to interpret the complexity in diagnosing diseases leads to the importance of developing an accurate method to detect and localize the targeted infection. Approaching the performance of ophthalmologists is the consistent main challenge in retinal disease segmentation. Artificial intelligence techniques have shown enormous achievement in various tasks in computer vision. This paper depicts an automated end-to-end deep neural network for retinal disease segmentation on optical coherence tomography (OCT) scans. The work proposed in this study shows the performance difference between convolution operations and atrous convolution operations. Three deep semantic segmentation architectures, namely U-net, Segnet, and Deeplabv3+, have been considered to evaluate the performance of varying convolution operations. Empirical outcomes show a competitive performance to the human level, with an average dice score of 0.73 for retinal diseases.

3D Shape Modeling and Analysis of Retinal Microvasculature in OCT-Angiography Images

3D optical coherence tomography angiography (OCT-A) is a novel and non-invasive imaging modality for analyzing retinal diseases. The studies of microvasculature in 2D en face projection images have been widely implemented, but comprehensive 3D analysis of OCT-A images with rich depth-resolved microvascular information is rarely considered. In this paper, we propose a robust, effective, and automatic 3D shape modeling framework to provide a high-quality 3D vessel representation and to preserve valuable 3D geometric and topological information for vessel analysis. Effective vessel enhancement and extraction steps by means of curvelet denoising and optimally oriented flux (OOF) filtering are first designed to produce 3D microvascular networks. Afterwards, a novel 3D data representation of OCT-A microvasculature is reconstructed via advanced mesh reconstruction techniques. Based on the 3D surfaces, shape analysis is established to extract novel shape-based microvascular area distortion via the Laplace-Beltrami eigen-projection. The extracted feature is integrated into a graph-cut segmentation system to categorize large vessels and small capillaries for more precise shape analysis. The proposed framework is validated on a dedicated repeated scan dataset including 260 volume images and shows high repeatability. Statistical analysis using the surface area biomarker is performed on small capillaries to avoid the effect of tailing artifact from large vessels. It shows significant differences ( ) between DR stages on 100 subjects in a OCTA-DR dataset. The proposed shape modeling and analysis framework opens the possibility for further investigating OCT-A microvasculature in a new perspective.

Focal alteration of the intraretinal layers in neurodegenerative disorders

Focal intraretinal alterations have been studied to advance our understanding of the pathology of neurodegenerative diseases. The current literature involving focal alterations in the intraretinal layers was reviewed through PubMed using the search terms "focal alteration", "region of interest", "optical coherence tomography", "glaucoma", "multiple sclerosis", "Alzheimer's disease", "Parkinson disease", "neurodegenerative diseases" and other related items. It was found that focal alterations of intraretinal layers were different in various neurodegenerative diseases. The typical focal thinning might help differentiate various ocular and cerebral diseases, track disease progression, and evaluate the outcome of clinical trials. Advanced exploration of focal intraretinal alterations will help to further validate their clinical and research utility.

OCTRexpert:A Feature-based 3D Registration Method for Retinal OCT Images

Medical image registration can be used for studying longitudinal and cross-sectional data, quantitatively monitoring disease progression and guiding computer assisted diagnosis and treatments. However, deformable registration which enables more precise and quantitative comparison has not been well developed for retinal optical coherence tomography (OCT) images. This paper proposes a new 3D registration approach for retinal OCT data called OCTRexpert. To the best of our knowledge, the proposed algorithm is the first full 3D registration approach for retinal OCT images which can be applied to longitudinal OCT images for both normal and serious pathological subjects. In this approach, a pre-processing method is first performed to remove eye motion artifact and then a novel design-detection-deformation strategy is applied for the registration. In the design step, a couple of features are designed for each voxel in the image. In the detection step, active voxels are selected and the point-to-point correspondences between the subject and template images are established. In the deformation step, the image is hierarchically deformed according to the detected correspondences in multi-resolution. The proposed method is evaluated on a dataset with longitudinal OCT images from 20 healthy subjects and 4 subjects diagnosed with serious Choroidal Neovascularization (CNV). Experimental results show that the proposed registration algorithm consistently yields statistically significant improvements in both Dice similarity coefficient and the average unsigned surface error compared with the other registration methods.

3D Segmentation Algorithms for Computerized Tomographic Imaging: a Systematic Literature Review

This paper presents a systematic literature review concerning 3D segmentation algorithms for computerized tomographic imaging. This analysis covers articles published in the range 2006-March 2018 found in four scientific databases (Science Direct, IEEEXplore, ACM, and PubMed), using the methodology for systematic review proposed by Kitchenham. We present the analyzed segmentation methods categorized according to its application, algorithmic strategy, validation, and use of prior knowledge, as well as its general conceptual description. Additionally, we present a general overview, discussions, and further prospects for the 3D segmentation methods applied for tomographic images.

Deriving external forces via convolutional neural networks for biomedical image segmentation

Active contours, or snakes, are widely applied on biomedical image segmentation. They are curves defined within an image domain that can move to object boundaries under the influence of internal forces and external forces, in which the internal forces are generally computed from curves themselves and external forces from image data. Designing external forces properly is a key point with active contour algorithms since the external forces play a leading role in the evolution of active contours. One of most popular external forces for active contour models is gradient vector flow (GVF). However, GVF is sensitive to noise and false edges, which limits its application area. To handle this problem, in this paper, we propose using GVF as reference to train a convolutional neural network to derive an external force. The derived external force is then integrated into the active contour models for curve evolution. Three clinical applications, segmentation of optic disk in fundus images, fluid in retinal optical coherence tomography images and fetal head in ultrasound images, are employed to evaluate the proposed method. The results show that the proposed method is very promising since it achieves competitive performance for different tasks compared to the state-of-the-art algorithms.

RETOUCH: The Retinal OCT Fluid Detection and Segmentation Benchmark and Challenge

Retinal swelling due to the accumulation of fluid is associated with the most vision-threatening retinal diseases. Optical coherence tomography (OCT) is the current standard of care in assessing the presence and quantity of retinal fluid and image-guided treatment management. Deep learning methods have made their impact across medical imaging, and many retinal OCT analysis methods have been proposed. However, it is currently not clear how successful they are in interpreting the retinal fluid on OCT, which is due to the lack of standardized benchmarks. To address this, we organized a challenge RETOUCH in conjunction with MICCAI 2017, with eight teams participating. The challenge consisted of two tasks: fluid detection and fluid segmentation. It featured for the first time: all three retinal fluid types, with annotated images provided by two clinical centers, which were acquired with the three most common OCT device vendors from patients with two different retinal diseases. The analysis revealed that in the detection task, the performance on the automated fluid detection was within the inter-grader variability. However, in the segmentation task, fusing the automated methods produced segmentations that were superior to all individual methods, indicating the need for further improvements in the segmentation performance.

Double-branched and area-constraint fully convolutional networks for automated serous retinal detachment segmentation in SD-OCT images

BACKGROUND AND OBJECTIVE

Quantitative assessment of subretinal fluid in spectral domain optical coherence tomography (SD-OCT) images is crucial for the diagnosis of central serous chorioretinopathy. For the subretinal fluid segmentation, the traditional methods need to segment retinal layers and then segment subretinal fluid. The layer segmentation has a high influence on subretinal fluid segmentation, so we aim to develop a deep learning model to segment subretinal fluid automatically without layer segmentation.

METHODS

In this paper, we propose a novel image-to-image double-branched and area-constraint fully convolutional networks (DA-FCN) for segmenting subretinal fluid in SD-OCT images. Firstly, the dataset is extended by mirroring image, which helps to overcome the over-fitting problem in the training stage. Then, double-branched structures are designed to learn the shallow coarse and deep representations from the SD-OCT images. DA-FCN model is directly trained using the image and corresponding pixel-based ground truth. Finally, we introduce a novel supervision mechanism by jointing the area loss L_A with the softmax loss L_S to learn more representative features.

RESULTS

The testing dataset with 52 SD-OCT volumes from 35 eyes of 35 patients is used for the evaluation of the proposed algorithm based on the cross-validation method. For the three criterions, including the true positive volume fraction, dice similarity coefficient, and positive predicative value, our method can obtain the results of (1) 94.3, 95.3, and 96.4 for dataset 1; (2) 97.3, 95.3, and 93.4 for dataset 2; (3) 93.0, 92.8, and 92.8 for dataset 3; (4) 89.7, 90.1, and 92.6 for dataset 4.

CONCLUSION

In this work, we propose a novel fully convolutional network for the automatic segmentation of the subretinal fluid. By constructing the double branched structures and area constraint term, our method shows higher segmentation accuracy without layer segmentation compared with other methods.

Segmentation of retinal fluid based on deep learning: application of three-dimensional fully convolutional neural networks in optical coherence tomography images

AIM

To explore a segmentation algorithm based on deep learning to achieve accurate diagnosis and treatment of patients with retinal fluid.

METHODS

A two-dimensional (2D) fully convolutional network for retinal segmentation was employed. In order to solve the category imbalance in retinal optical coherence tomography (OCT) images, the network parameters and loss function based on the 2D fully convolutional network were modified. For this network, the correlations of corresponding positions among adjacent images in space are ignored. Thus, we proposed a three-dimensional (3D) fully convolutional network for segmentation in the retinal OCT images.

RESULTS

The algorithm was evaluated according to segmentation accuracy, Kappa coefficient, and F1 score. For the 3D fully convolutional network proposed in this paper, the overall segmentation accuracy rate is 99.56%, Kappa coefficient is 98.47%, and F1 score of retinal fluid is 95.50%.

CONCLUSION

The OCT image segmentation algorithm based on deep learning is primarily founded on the 2D convolutional network. The 3D network architecture proposed in this paper reduces the influence of category imbalance, realizes end-to-end segmentation of volume images, and achieves optimal segmentation results. The segmentation maps are practically the same as the manual annotations of doctors, and can provide doctors with more accurate diagnostic data.

The European Eye Epidemiology spectral-domain optical coherence tomography classification of macular diseases for epidemiological studies

PURPOSE

The aim of the European Eye Epidemiology (E3) consortium was to develop a spectral-domain optical coherence tomography (SD-OCT)-based classification for macular diseases to standardize epidemiological studies.

METHODS

A European panel of vitreoretinal disease experts and epidemiologists belonging to the E3 consortium was assembled to define a classification for SD-OCT imaging of the macula. A series of meeting was organized, to develop, test and finalize the classification. First, grading methods used by the different research groups were presented and discussed, and a first version of classification was proposed. This first version was then tested on a set of 50 SD-OCT images in the Bordeaux and Rotterdam centres. Agreements were analysed and discussed with the panel of experts and a final version of the classification was produced.

RESULTS

Definitions and classifications are proposed for the structure assessment of the vitreomacular interface (visibility of vitreous interface, vitreomacular adhesion, vitreomacular traction, epiretinal membrane, full-thickness macular hole, lamellar macular hole, macular pseudo-hole) and of the retina (retinoschisis, drusen, pigment epithelium detachment, hyper-reflective clumps, retinal pigment epithelium atrophy, intraretinal cystoid spaces, intraretinal tubular changes, subretinal fluid, subretinal material). Classifications according to size and location are defined. Illustrations of each item are provided, as well as the grading form.

CONCLUSION

The E3 SD-OCT classification has been developed to harmonize epidemiological studies. This homogenization will allow comparing and sharing data collection between European and international studies.

Automated segmentation of macular edema in OCT using deep neural networks

Macular edema is an eye disease that can affect visual acuity. Typical disease symptoms include subretinal fluid (SRF) and pigment epithelium detachment (PED). Optical coherence tomography (OCT) has been widely used for diagnosing macular edema because of its non-invasive and high resolution properties. Segmentation for macular edema lesions from OCT images plays an important role in clinical diagnosis. Many computer-aided systems have been proposed for the segmentation. Most traditional segmentation methods used in these systems are based on low-level hand-crafted features, which require significant domain knowledge and are sensitive to the variations of lesions. To overcome these shortcomings, this paper proposes to use deep neural networks (DNNs) together with atrous spatial pyramid pooling (ASPP) to automatically segment the SRF and PED lesions. Lesions-related features are first extracted by DNNs, then processed by ASPP which is composed of multiple atrous convolutions with different fields of view to accommodate the various scales of the lesions. Based on ASPP, a novel module called stochastic ASPP (sASPP) is proposed to combat the co-adaptation of multiple atrous convolutions. A large OCT dataset provided by a competition platform called "AI Challenger" are used to train and evaluate the proposed model. Experimental results demonstrate that the DNNs together with ASPP achieve higher segmentation accuracy compared with the state-of-the-art method. The stochastic operation added in sASPP is empirically verified as an effective regularization method that can alleviate the overfitting problem and significantly reduce the validation error.

Retinal vessel optical coherence tomography images for anemia screening

Anemia is a disease that leads to low oxygen carrying capacity in the blood. Early detection of anemia is critical for the diagnosis and treatment of blood diseases. We find that retinal vessel optical coherence tomography (OCT) images of patients with anemia have abnormal performance because the internal material of the vessel absorbs light. In this study, an automatic anemia screening method based on retinal vessel OCT images is proposed. The method consists of seven steps, namely, denoising, region of interest (ROI) extraction, layer segmentation, vessel segmentation, feature extraction, feature dimensionality reduction, and classification. We propose gradient and threshold algorithm for ROI extraction and improve region growing algorithm based on adaptive seed point for vessel segmentation. We also conduct a statistical analysis of the correlation between hemoglobin concentration and intravascular brightness and vascular shadow in OCT images before feature extraction. Eighteen statistical features and 118 texture features are extracted for classification. This study is the first to use retinal vessel OCT images for anemia screening. Experimental results demonstrate the accuracy of the proposed method is 0.8358, which indicates that the method has clinical potential for anemia screening. Graphical abstract.

Automatic segmentation of OCT retinal boundaries using recurrent neural networks and graph search

The manual segmentation of individual retinal layers within optical coherence tomography (OCT) images is a time-consuming task and is prone to errors. The investigation into automatic segmentation methods that are both efficient and accurate has seen a variety of methods proposed. In particular, recent machine learning approaches have focused on the use of convolutional neural networks (CNNs). Traditionally applied to sequential data, recurrent neural networks (RNNs) have recently demonstrated success in the area of image analysis, primarily due to their usefulness to extract temporal features from sequences of images or volumetric data. However, their potential use in OCT retinal layer segmentation has not previously been reported, and their direct application for extracting spatial features from individual 2D images has been limited. This paper proposes the use of a recurrent neural network trained as a patch-based image classifier (retinal boundary classifier) with a graph search (RNN-GS) to segment seven retinal layer boundaries in OCT images from healthy children and three retinal layer boundaries in OCT images from patients with age-related macular degeneration (AMD). The optimal architecture configuration to maximize classification performance is explored. The results demonstrate that a RNN is a viable alternative to a CNN for image classification tasks in the case where the images exhibit a clear sequential structure. Compared to a CNN, the RNN showed a slightly superior average generalization classification accuracy. Secondly, in terms of segmentation, the RNN-GS performed competitively against a previously proposed CNN based method (CNN-GS) with respect to both accuracy and consistency. These findings apply to both normal and AMD data. Overall, the RNN-GS method yielded superior mean absolute errors in terms of the boundary position with an average error of 0.53 pixels (normal) and 1.17 pixels (AMD). The methodology and results described in this paper may assist the future investigation of techniques within the area of OCT retinal segmentation and highlight the potential of RNN methods for OCT image analysis.

Intraretinal fluid identification via enhanced maps using optical coherence tomography images

Nowadays, among the main causes of blindness in developed countries are age-related macular degeneration (AMD) and the diabetic macular edema (DME). Both diseases present, as a common symptom, the appearance of cystoid fluid regions inside the retinal layers. Optical coherence tomography (OCT) image modality was one of the main medical imaging techniques for the early diagnosis and monitoring of AMD and DME via this intraretinal fluid detection and characterization. We present a novel methodology to identify these fluid accumulations by means of generating binary maps (offering a direct representation of these areas) and heat maps (containing the region confidence). To achieve this, a set of 312 intensity and texture-based features were studied. The most relevant features were selected using the sequential forward selection (SFS) strategy and tested with three archetypal classifiers: LDC, SVM and Parzen window. Finally, the most proficient classifier is used to create the proposed maps. All of the tested classifiers returned satisfactory results, the best classifier achieving a mean test accuracy higher than 94% in all of the experiments. The suitability of the maps was evaluated in a context of a screening issue with three different datasets obtained with two different devices, testing the capabilities of the system to work independently of the used OCT device. The experiments with the map creation were performed using 323 OCT images. Using only the binary maps, more than 91.33% of the images were correctly classified. With only the heat maps, the proposed methodology correctly separated 93.50% of the images.

OIPAV: an Integrated Software System for Ophthalmic Image Processing, Analysis, and Visualization

Ophthalmic medical images, such as optical coherence tomography (OCT) images and color photo of fundus, provide valuable information for clinical diagnosis and treatment of ophthalmic diseases. In this paper, we introduce a software system specially oriented to ophthalmic images processing, analysis, and visualization (OIPAV) to assist users. OIPAV is a cross-platform system built on a set of powerful and widely used toolkit libraries. Based on the plugin mechanism, the system has an extensible framework. It provides rich functionalities including data I/O, image processing, interaction, ophthalmic diseases detection, data analysis, and visualization. By using OIPAV, users can easily access to the ophthalmic image data manufactured from different imaging devices, facilitate workflows of processing ophthalmic images, and improve quantitative evaluations. With a satisfying function scalability and expandability, the software is applicable for both ophthalmic researchers and clinicians.