Structure tensor based automated detection of macular edema and central serous retinopathy using optical coherence tomography images

MsTGANet: Automatic Drusen Segmentation From Retinal OCT Images

Drusen is considered as the landmark for diagnosis of AMD and important risk factor for the development of AMD. Therefore, accurate segmentation of drusen in retinal OCT images is crucial for early diagnosis of AMD. However, drusen segmentation in retinal OCT images is still very challenging due to the large variations in size and shape of drusen, blurred boundaries, and speckle noise interference. Moreover, the lack of OCT dataset with pixel-level annotation is also a vital factor hindering the improvement of drusen segmentation accuracy. To solve these problems, a novel multi-scale transformer global attention network (MsTGANet) is proposed for drusen segmentation in retinal OCT images. In MsTGANet, which is based on U-Shape architecture, a novel multi-scale transformer non-local (MsTNL) module is designed and inserted into the top of encoder path, aiming at capturing multi-scale non-local features with long-range dependencies from different layers of encoder. Meanwhile, a novel multi-semantic global channel and spatial joint attention module (MsGCS) between encoder and decoder is proposed to guide the model to fuse different semantic features, thereby improving the model's ability to learn multi-semantic global contextual information. Furthermore, to alleviate the shortage of labeled data, we propose a novel semi-supervised version of MsTGANet (Semi-MsTGANet) based on pseudo-labeled data augmentation strategy, which can leverage a large amount of unlabeled data to further improve the segmentation performance. Finally, comprehensive experiments are conducted to evaluate the performance of the proposed MsTGANet and Semi-MsTGANet. The experimental results show that our proposed methods achieve better segmentation accuracy than other state-of-the-art CNN-based methods.

Automated retinal boundary segmentation of optical coherence tomography images using an improved Canny operator

Retinal segmentation is a prerequisite for quantifying retinal structural features and diagnosing related ophthalmic diseases. Canny operator is recognized as the best boundary detection operator so far, and is often used to obtain the initial boundary of the retina in retinal segmentation. However, the traditional Canny operator is susceptible to vascular shadows, vitreous artifacts, or noise interference in retinal segmentation, causing serious misdetection or missed detection. This paper proposed an improved Canny operator for automatic segmentation of retinal boundaries. The improved algorithm solves the problems of the traditional Canny operator by adding a multi-point boundary search step on the basis of the original method, and adjusts the convolution kernel. The algorithm was used to segment the retinal images of healthy subjects and age-related macular degeneration (AMD) patients; eleven retinal boundaries were identified and compared with the results of manual segmentation by the ophthalmologists. The average difference between the automatic and manual methods is: 2–6 microns (1–2 pixels) for healthy subjects and 3–10 microns (1–3 pixels) for AMD patients. Qualitative method is also used to verify the accuracy and stability of the algorithm. The percentage of “perfect segmentation” and “good segmentation” is 98% in healthy subjects and 94% in AMD patients. This algorithm can be used alone or in combination with other methods as an initial boundary detection algorithm. It is easy to understand and improve, and may become a useful tool for analyzing and diagnosing eye diseases.

Correlation of Volume of Macular Edema with Retinal Tomography Features in Diabetic Retinopathy Eyes

Optical coherence tomography (OCT) enables the detection of macular edema, a significant pathological outcome of diabetic retinopathy (DR). The aim of the study was to correlate edema volume with the severity of diabetic retinopathy and response to treatment with intravitreal injections (compared to baseline). Diabetic retinopathy (DR; n = 181) eyes were imaged with OCT (Heidelberg Engineering, Germany). They were grouped as responders (a decrease in thickness after intravitreal injection of Bevacizumab), non-responders (persistent edema or reduced decrease in thickness), recurrent (recurrence of edema after injection), and treatment naïve (no change in edema at follow-up without any injection). The post-treatment imaging of eyes was included for all groups, except for the treatment naïve group. All eyes underwent a 9 × 6 mm raster scan to measure the edema volume (EV). Central foveal thickness (CFT), central foveal volume (CFV), and total retinal volume (TRV) were obtained from the early treatment diabetic retinopathy study (ETDRS) map. The median EV increased with DR severity, with PDR having the greatest EV (4.01 mm³). This correlated positively with TRV (p < 0.001). Median CFV and CFT were the greatest in severe NPDR. Median EV was the greatest in the recurrent eyes (4.675 mm³) and lowest (1.6 mm³) in the treatment naïve group. Responders and non-responders groups had median values of 3.65 and 3.93 mm³, respectively. This trend was not observed with CFV, CFT, and TRV. A linear regression yielded threshold values of CFV (~0.3 mm³), CFT (~386 µm), and TRV (~9.06 mm³), above which EV may be detected by the current scanner. In this study, EV provided a better distinction between the response groups when compared to retinal tomography parameters. The EV increased with disease severity. Thus, EV can be a more precise parameter to identify subclinical edema and aid in better treatment planning.

A Deep Learning Model and a Dataset for Diagnosing Ophthalmology Diseases

The rapid development of artificial neural network techniques, especially convolutional neural networks, encouraged the researchers to adapt such techniques in the medical domain. Specifically, to provide assist tools to help the professionals in patients’ diagnosis. The main problem faced by the researchers in the medical domain is the lack of available annotated datasets which can be used to train and evaluate large and complex deep neural networks. In this paper, to assist researchers who are interested in applying deep learning techniques to aid the ophthalmologists in diagnosing eye-related diseases, we provide an optical coherence tomography dataset with collaboration with ophthalmologists from the King Abdullah University Hospital, Irbid, Jordan. This dataset consists of 21,991 OCT images distributed over seven eye diseases in addition to normal images (no disease), namely, Choroidal Neovascularisation, Full Macular Hole (Full Thickness), Partial Macular Hole, Central Serous Retinopathy, Geographic atrophy, Macular Retinal Oedema, and Vitreomacular Traction. To the best of our knowledge, this dataset is the largest of its kind, where images belong to actual patients from Jordan and the annotation was carried out by ophthalmologists. Two classification tasks were applied to this dataset; a binary classification to distinguish between images which belong to healthy eyes (normal) and images which belong to diseased eyes (abnormal). The second classification task is a multi-class classification, where the deep neural network is trained to distinguish between the seven diseases listed above in addition to the normal case. In both classification tasks, the U-Net neural network was modified and subsequently utilised. This modification adds an additional block of layers to the original U-Net model to become capable of handling classification as the original network is used for image segmentation. The results of the binary classification were equal to 84.90% and 69.50% as accuracy and quadratic weighted kappa, respectively. The results of the multi-class classification, by contrast, were equal to 63.68% and 66.06% as accuracy and quadratic weighted kappa, respectively.

Deep learning based joint segmentation and characterization of multi-class retinal fluid lesions on OCT scans for clinical use in anti-VEGF therapy

BACKGROUND

In anti-vascular endothelial growth factor (anti-VEGF) therapy, an accurate estimation of multi-class retinal fluid (MRF) is required for the activity prescription and intravitreal dose. This study proposes an end-to-end deep learning-based retinal fluids segmentation network (RFS-Net) to segment and recognize three MRF lesion manifestations, namely, intraretinal fluid (IRF), subretinal fluid (SRF), and pigment epithelial detachment (PED), from multi-vendor optical coherence tomography (OCT) imagery. The proposed image analysis tool will optimize anti-VEGF therapy and contribute to reducing the inter- and intra-observer variability.

METHOD

The proposed RFS-Net architecture integrates the atrous spatial pyramid pooling (ASPP), residual, and inception modules in the encoder path to learn better features and conserve more global information for precise segmentation and characterization of MRF lesions. The RFS-Net model is trained and validated using OCT scans from multiple vendors (Topcon, Cirrus, Spectralis), collected from three publicly available datasets. The first dataset consisted of OCT volumes obtained from 112 subjects (a total of 11,334 B-scans) is used for both training and evaluation purposes. Moreover, the remaining two datasets are only used for evaluation purposes to check the trained RFS-Net's generalizability on unseen OCT scans. The two evaluation datasets contain a total of 1572 OCT B-scans from 1255 subjects. The performance of the proposed RFS-Net model is assessed through various evaluation metrics.

RESULTS

The proposed RFS-Net model achieved the mean F₁ scores of 0.762, 0.796, and 0.805 for segmenting IRF, SRF, and PED. Moreover, with the automated segmentation of the three retinal manifestations, the RFS-Net brings a considerable gain in efficiency compared to the tedious and demanding manual segmentation procedure of the MRF.

CONCLUSIONS

Our proposed RFS-Net is a potential diagnostic tool for the automatic segmentation of MRF (IRF, SRF, and PED) lesions. It is expected to strengthen the inter-observer agreement, and standardization of dosimetry is envisaged as a result.

Capsule Network-based architectures for the segmentation of sub-retinal serous fluid in optical coherence tomography images of central serous chorioretinopathy

Central serous chorioretinopathy (CSCR) is a chorioretinal disorder of the eye characterized by serous detachment of the neurosensory retina at the posterior pole of the eye. CSCR results from the accumulation of subretinal fluid (SRF) due to idiopathic defects at the level of the retinal pigment epithelial (RPE) that allows serous fluid from the choriocapillaris to diffuse into the subretinal space between RPE and neurosensory retinal layers. This condition is presently investigated by clinicians using invasive angiography or non-invasive optical coherence tomography (OCT) imaging. OCT images provide a representation of the fluid underlying the retina, and in the absence of automated segmentation tools, currently only a qualitative assessment of the same is used to follow the progression of the disease. Automated segmentation of the SRF can prove to be extremely useful for the assessment of progression and for the timely management of CSCR. In this paper, we adopt an existing architecture called SegCaps, which is based on the recently introduced Capsule Networks concept, for the segmentation of SRF from CSCR OCT images. Furthermore, we propose an enhancement to SegCaps, which we have termed as DRIP-Caps, that utilizes the concepts of Dilation, Residual Connections, Inception Blocks, and Capsule Pooling to address the defined problem. The proposed model outperforms the benchmark UNet architecture while reducing the number of trainable parameters by 54.21%. Moreover, it reduces the computation complexity of SegCaps by reducing the number of trainable parameters by 37.85%, with competitive performance. The experiments demonstrate the generalizability of the proposed model, as evidenced by its remarkable performance even with a limited number of training samples. Graphical abstract is mandatory please provide.

Correcting intra-volume distortion for AO-OCT using 3D correlation based registration

Adaptive optics (AO) based ophthalmic imagers, such as scanning laser ophthalmoscopes (SLO) and optical coherence tomography (OCT), are used to evaluate the structure and function of the retina with high contrast and resolution. Fixational eye movements during a raster-scanned image acquisition lead to intra-frame and intra-volume distortion, resulting in an inaccurate reproduction of the underlying retinal structure. For three-dimensional (3D) AO-OCT, segmentation-based and 3D correlation based registration methods have been applied to correct eye motion and achieve a high signal-to-noise ratio registered volume. This involves first selecting a reference volume, either manually or automatically, and registering the image/volume stream against the reference using correlation methods. However, even within the chosen reference volume, involuntary eye motion persists and affects the accuracy with which the 3D retinal structure is finally rendered. In this article, we introduced reference volume distortion correction for AO-OCT using 3D correlation based registration and demonstrate a significant improvement in registration performance via a few metrics. Conceptually, the general paradigm follows that developed previously for intra-frame distortion correction for 2D raster-scanned images, as in an AOSLO, but extended here across all three spatial dimensions via 3D correlation analyses. We performed a frequency analysis of eye motion traces before and after intra-volume correction and revealed how periodic artifacts in eye motion estimates are effectively reduced upon correction. Further, we quantified how the intra-volume distortions and periodic artifacts in the eye motion traces, in general, decrease with increasing AO-OCT acquisition speed. Overall, 3D correlation based registration with intra-volume correction significantly improved the visualization of retinal structure and estimation of fixational eye movements.

Weakly supervised detection of central serous chorioretinopathy based on local binary patterns and discrete wavelet transform

Central serous chorioretinopathy (CSCR) is a common fundus disease. Early detection of CSCR is of great importance to prevent visual loss. Therefore, a novel automatic detection method is presented in this paper which integrates technologies including discrete wavelet transform (DWT) image decomposition, local binary patterns (LBP) based texture feature extraction, and multi-instance learning (MIL). LBP is selected due to its robustness to low contrast and low quality images, which can reduce the interference of image itself on the detection method. DWT image decomposition provides high-frequency components with rich details for extracting LBP texture features, which can remove redundant information that is not necessary for diagnosis of CSCR in the raw image. The tedious task of accurately locating and segmenting CSCR lesions is avoided by using MIL. Experiments on 358 optical coherence tomography (OCT) B-scan images demonstrate the effectiveness of our method. Even under the condition of single threshold, the accuracy of 99.58% is obtained at K = 35 by only using a high-frequency feature fusion scheme, which is competitive with the existing methods. Additionally, through further detail innovation, such as multi-threshold optimization (MTO) and integrated decision-making (IDM), the performance of our method is further improved and the detection accuracy is 100% at K = 40.

Extraction of Retinal Layers Through Convolution Neural Network (CNN) in an OCT Image for Glaucoma Diagnosis

Glaucoma is a progressive and deteriorating optic neuropathy that leads to visual field defects. The damage occurs as glaucoma is irreversible, so early and timely diagnosis is of significant importance. The proposed system employs the convolution neural network (CNN) for automatic segmentation of the retinal layers. The inner limiting membrane (ILM) and retinal pigmented epithelium (RPE) are used to calculate cup-to-disc ratio (CDR) for glaucoma diagnosis. The proposed system uses structure tensors to extract candidate layer pixels, and a patch across each candidate layer pixel is extracted, which is classified using CNN. The proposed framework is based upon VGG-16 architecture for feature extraction and classification of retinal layer pixels. The output feature map is merged into SoftMax layer for classification and produces probability map for central pixel of each patch and decides whether it is ILM, RPE, or background pixels. Graph search theory refines the extracted layers by interpolating the missing points, and these extracted ILM and RPE are finally used to compute CDR value and diagnose glaucoma. The proposed system is validated using a local dataset of optical coherence tomography images from 196 patients, including normal and glaucoma subjects. The dataset contains manually annotated ILM and RPE layers; manually extracted patches for ILM, RPE, and background pixels; CDR values; and eventually final finding related to glaucoma. The proposed system is able to extract ILM and RPE with a small absolute mean error of 6.03 and 5.56, respectively, and it finds CDR value within average range of ± 0.09 as compared with glaucoma expert. The proposed system achieves average sensitivity, specificity, and accuracies of 94.6, 94.07, and 94.68, respectively.

Automated Segmentation and Quantification of Drusen in Fundus and Optical Coherence Tomography Images for Detection of ARMD

Age-related macular degeneration (ARMD) is one of the most common retinal syndromes that occurs in elderly people. Different eye testing techniques such as fundus photography and optical coherence tomography (OCT) are used to clinically examine the ARMD-affected patients. Many researchers have worked on detecting ARMD from fundus images, few of them also worked on detecting ARMD from OCT images. However, there are only few systems that establish the correspondence between fundus and OCT images to give an accurate prediction of ARMD pathology. In this paper, we present fully automated decision support system that can automatically detect ARMD by establishing correspondence between OCT and fundus imagery. The proposed system also distinguishes between early, suspect and confirmed ARMD by correlating OCT B-scans with respective region of the fundus image. In first phase, proposed system uses different B-scan based features along with support vector machine (SVM) to detect the presence of drusens and classify it as ARMD or normal case. In case input OCT scan is classified as ARMD, region of interest from corresponding fundus image is considered for further evaluation. The analysis of fundus image is performed using contrast enhancement and adaptive thresholding to detect possible drusens from fundus image and proposed system finally classified it as early stage ARMD or advance stage ARMD. The proposed system is tested on local data set of 100 patients with100 fundus images and 6800 OCT B-scans. Proposed system detects ARMD with the accuracy, sensitivity, and specificity ratings of 98.0, 100, and 97.14%, respectively.

Feasibility of support vector machine learning in age-related macular degeneration using small sample yielding sparse optical coherence tomography data

PURPOSE

A retrospective pilot study is conducted to demonstrate the utility of a novel support vector machine learning (SVML) algorithm in a small three-dimensional (3D) sample yielding sparse optical coherence tomography (spOCT) data for the automatic monitoring of neovascular (wet) age-related macular degeneration (wAMD).

METHODS

From the anti-vascular endothelial growth factor injection database, 588 consecutive pairs of OCT volumes (57.624 B-scans) were selected in 70 randomly chosen wAMD patients treated with ranibizumab. The SVML algorithm was applied to 183 OCT volume pairs (17.934 B-scans) in 30 patients. Four independent, diagnosis-blinded retina specialists indicated whether wAMD activity was present between 100 pairs of consecutive OCT volumes (9800 B-scans) in the remaining 40 patients for comparison with the SVML algorithm and a non-complex baseline algorithm using only retinal thickness. The SVML algorithm was assessed using inter-observer variability and receiver operating characteristic (ROC) analyses.

RESULTS

The retina specialists showed an average Cohen's κ of 0.57 ± 0.13 (minimum: 0.41, maximum: 0.83). The average κ between the proposed algorithm and the retina specialists was 0.62 ± 0.05 and 0.43 ± 0.14 between the baseline algorithm and the retina specialists. Using each of the four retina specialists as the reference, the proposed method showed a superior area under the ROC curve of 0.91 ± 0.03 compared to the ROC 0.81 ± 0.05 shown by the baseline algorithm.

CONCLUSION

The SVML algorithm was as effective as the retina specialists were in detecting activity in wAMD. Support vector machine learning (SVML) may be a useful monitoring tool in wAMD suited for small samples that yield sparse OCT data possibly derived from self-measuring OCT-robots.

Deep Ensemble Learning Based Objective Grading of Macular Edema by Extracting Clinically Significant Findings from Fused Retinal Imaging Modalities

Macular edema (ME) is a retinal condition in which central vision of a patient is affected. ME leads to accumulation of fluid in the surrounding macular region resulting in a swollen macula. Optical coherence tomography (OCT) and the fundus photography are the two widely used retinal examination techniques that can effectively detect ME. Many researchers have utilized retinal fundus and OCT imaging for detecting ME. However, to the best of our knowledge, no work is found in the literature that fuses the findings from both retinal imaging modalities for the effective and more reliable diagnosis of ME. In this paper, we proposed an automated framework for the classification of ME and healthy eyes using retinal fundus and OCT scans. The proposed framework is based on deep ensemble learning where the input fundus and OCT scans are recognized through the deep convolutional neural network (CNN) and are processed accordingly. The processed scans are further passed to the second layer of the deep CNN model, which extracts the required feature descriptors from both images. The extracted descriptors are then concatenated together and are passed to the supervised hybrid classifier made through the ensemble of the artificial neural networks, support vector machines and naïve Bayes. The proposed framework has been trained on 73,791 retinal scans and is validated on 5100 scans of publicly available Zhang dataset and Rabbani dataset. The proposed framework achieved the accuracy of 94.33% for diagnosing ME and healthy subjects and achieved the mean dice coefficient of 0.9019 ± 0.04 for accurately extracting the retinal fluids, 0.7069 ± 0.11 for accurately extracting hard exudates and 0.8203 ± 0.03 for accurately extracting retinal blood vessels against the clinical markings.

Convolutional Mixture of Experts Model: A Comparative Study on Automatic Macular Diagnosis in Retinal Optical Coherence Tomography Imaging

BACKGROUND

Macular disorders, such as diabetic macular edema (DME) and age-related macular degeneration (AMD) are among the major ocular diseases. Having one of these diseases can lead to vision impairments or even permanent blindness in a not-so-long time span. So, the early diagnosis of these diseases are the main goals for researchers in the field.

METHODS

This study is designed in order to present a comparative analysis on the recent convolutional mixture of experts (CMoE) models for distinguishing normal macular OCT from DME and AMD. For this purpose, we considered three recent CMoE models called Mixture ensemble of convolutional neural networks (ME-CNN), Multi-scale Convolutional Mixture of Experts (MCME), and Wavelet-based Convolutional Mixture of Experts (WCME) models. For this research study, the models were evaluated on a database of three different macular OCT sets. Two first OCT sets were acquired by Heidelberg imaging systems consisting of 148 and 45 subjects respectively and set3 was constituted of 384 Bioptigen OCT acquisitions. To provide better performance insight into the CMoE ensembles, we extensively analyzed the models based on the 5-fold cross-validation method and various classification measures such as precision and average area under the ROC curve (AUC).

RESULTS

Experimental evaluations showed that the MCME and WCME outperformed the ME-CNN model and presented overall precisions of 98.14% and 96.06% for aligned OCTs respectively. For non-aligned retinal OCTs, these values were 93.95% and 95.56%.

CONCLUSION

Based on the comparative analysis, although the MCME model outperformed the other CMoE models in the analysis of aligned retinal OCTs, the WCME offers a robust model for diagnosis of non-aligned retinal OCTs. This allows having a fast and robust computer-aided system in macular OCT imaging which does not rely on the routine computerized processes such as denoising, segmentation of retinal layers, and also retinal layers alignment.

Automatic Segmentation of Retinal Layer in OCT Images With Choroidal Neovascularization

Age-related macular degeneration is one of the main causes of blindness. However, the internal structures of retinas are complex and difficult to be recognized due to the occurrence of neovascularization. Traditional surface detection methods may fail in the layer segmentation. In this paper, a supervised method is reported for simultaneously segmenting layers and neovascularization. Three spatial features, seven gray-level-based features, and 14 layer-like features are extracted for the neural network classifier. The coarse surfaces of different optical coherence tomography (OCT) images can thus be found. To describe and enhance retinal layers with different thicknesses and abnormalities, multi-scale bright and dark layer detection filters are introduced. A constrained graph search algorithm is also proposed to accurately detect retinal surfaces. The weights of nodes in the graph are computed based on these layer-like responses. The proposed method was evaluated on 42 spectral-domain OCT images with age-related macular degeneration. The experimental results show that the proposed method outperforms state-of-the-art methods.

Multilayered Deep Structure Tensor Delaunay Triangulation and Morphing Based Automated Diagnosis and 3D Presentation of Human Macula

Maculopathy is the group of diseases that affects central vision of a person and they are often associated with diabetes. Many researchers reported automated diagnosis of maculopathy from optical coherence tomography (OCT) images. However, to the best of our knowledge there is no literature that presents a complete 3D suite for the extraction as well as diagnosis of macula. Therefore, this paper presents a multilayered convolutional neural networks (CNN) structure tensor Delaunay triangulation and morphing based fully autonomous system that extracts up to nine retinal and choroidal layers along with the macular fluids. Furthermore, the proposed system utilizes the extracted retinal information for the automated diagnosis of maculopathy as well as for the robust reconstruction of 3D macula of retina. The proposed system has been validated on 41,921 retinal OCT scans acquired from different OCT machines and it significantly outperformed existing state of the art solutions by achieving the mean accuracy of 95.27% for extracting retinal and choroidal layers, mean dice coefficient of 0.90 for extracting fluid pathology and the overall accuracy of 96.07% for maculopathy diagnosis. To the best of our knowledge, the proposed framework is first of its kind that provides a fully automated and complete 3D integrated solution for the extraction of candidate macula along with its fully automated diagnosis against different macular syndromes.

Effect of patch size and network architecture on a convolutional neural network approach for automatic segmentation of OCT retinal layers

Deep learning strategies, particularly convolutional neural networks (CNNs), are especially suited to finding patterns in images and using those patterns for image classification. The method is normally applied to an image patch and assigns a class weight to the patch; this method has recently been used to detect the probability of retinal boundary locations in OCT images, which is subsequently used to segment the OCT image using a graph-search approach. This paper examines the effects of a number of modifications to the CNN architecture with the aim of optimizing retinal layer segmentation, specifically the effect of patch size as well as the network architecture design on CNN performance and subsequent layer segmentation. The results demonstrate that increasing patch size can improve the performance of the classification and provides a more reliable segmentation in the analysis of retinal layer characteristics in OCT imaging. Similarly, this work shows that changing aspects of the CNN network design can also significantly improve the segmentation results. This work also demonstrates that the performance of the method can change depending on the number of classes (i.e. boundaries) used to train the CNN, with fewer classes showing an inferior performance due to the presence of similar image features between classes that can trigger false positives. Changes in the network (patch size and or architecture) can be applied to provide a superior segmentation performance, which is robust to the class effect. The findings from this work may inform future CNN development in OCT retinal image analysis.

Automatic diagnosis of abnormal macula in retinal optical coherence tomography images using wavelet-based convolutional neural network features and random forests classifier

The present research intends to propose a fully automatic algorithm for the classification of three-dimensional (3-D) optical coherence tomography (OCT) scans of patients suffering from abnormal macula from normal candidates. The method proposed does not require any denoising, segmentation, retinal alignment processes to assess the intraretinal layers, as well as abnormalities or lesion structures. To classify abnormal cases from the control group, a two-stage scheme was utilized, which consists of automatic subsystems for adaptive feature learning and diagnostic scoring. In the first stage, a wavelet-based convolutional neural network (CNN) model was introduced and exploited to generate B-scan representative CNN codes in the spatial-frequency domain, and the cumulative features of 3-D volumes were extracted. In the second stage, the presence of abnormalities in 3-D OCTs was scored over the extracted features. Two different retinal SD-OCT datasets are used for evaluation of the algorithm based on the unbiased fivefold cross-validation (CV) approach. The first set constitutes 3-D OCT images of 30 normal subjects and 30 diabetic macular edema (DME) patients captured from the Topcon device. The second publicly available set consists of 45 subjects with a distribution of 15 patients in age-related macular degeneration, DME, and normal classes from the Heidelberg device. With the application of the algorithm on overall OCT volumes and 10 repetitions of the fivefold CV, the proposed scheme obtained an average precision of 99.33% on dataset1 as a two-class classification problem and 98.67% on dataset2 as a three-class classification task.

Automatic classification of retinal three-dimensional optical coherence tomography images using principal component analysis network with composite kernels

We present an automatic method, termed as the principal component analysis network with composite kernel (PCANet-CK), for the classification of three-dimensional (3-D) retinal optical coherence tomography (OCT) images. Specifically, the proposed PCANet-CK method first utilizes the PCANet to automatically learn features from each B-scan of the 3-D retinal OCT images. Then, multiple kernels are separately applied to a set of very important features of the B-scans and these kernels are fused together, which can jointly exploit the correlations among features of the 3-D OCT images. Finally, the fused (composite) kernel is incorporated into an extreme learning machine for the OCT image classification. We tested our proposed algorithm on two real 3-D spectral domain OCT (SD-OCT) datasets (of normal subjects and subjects with the macular edema and age-related macular degeneration), which demonstrated its effectiveness.

Automatic detection and recognition of multiple macular lesions in retinal optical coherence tomography images with multi-instance multilabel learning

Detection and recognition of macular lesions in optical coherence tomography (OCT) are very important for retinal diseases diagnosis and treatment. As one kind of retinal disease (e.g., diabetic retinopathy) may contain multiple lesions (e.g., edema, exudates, and microaneurysms) and eye patients may suffer from multiple retinal diseases, multiple lesions often coexist within one retinal image. Therefore, one single-lesion-based detector may not support the diagnosis of clinical eye diseases. To address this issue, we propose a multi-instance multilabel-based lesions recognition (MIML-LR) method for the simultaneous detection and recognition of multiple lesions. The proposed MIML-LR method consists of the following steps: (1) segment the regions of interest (ROIs) for different lesions, (2) compute descriptive instances (features) for each lesion region, (3) construct multilabel detectors, and (4) recognize each ROI with the detectors. The proposed MIML-LR method was tested on 823 clinically labeled OCT images with normal macular and macular with three common lesions: epiretinal membrane, edema, and drusen. For each input OCT image, our MIML-LR method can automatically identify the number of lesions and assign the class labels, achieving the average accuracy of 88.72% for the cases with multiple lesions, which better assists macular disease diagnosis and treatment.

Fully Automated Robust System to Detect Retinal Edema, Central Serous Chorioretinopathy, and Age Related Macular Degeneration from Optical Coherence Tomography Images

Maculopathy is the excessive damage to macula that leads to blindness. It mostly occurs due to retinal edema (RE), central serous chorioretinopathy (CSCR), or age related macular degeneration (ARMD). Optical coherence tomography (OCT) imaging is the latest eye testing technique that can detect these syndromes in early stages. Many researchers have used OCT images to detect retinal abnormalities. However, to the best of our knowledge, no research that presents a fully automated system to detect all of these macular syndromes is reported. This paper presents the world's first ever decision support system to automatically detect RE, CSCR, and ARMD retinal pathologies and healthy retina from OCT images. The automated disease diagnosis in our proposed system is based on multilayered support vector machines (SVM) classifier trained on 40 labeled OCT scans (10 healthy, 10 RE, 10 CSCR, and 10 ARMD). After training, SVM forms an accurate decision about the type of retinal pathology using 9 extracted features. We have tested our proposed system on 2819 OCT scans (1437 healthy, 640 RE, and 742 CSCR) of 502 patients from two different datasets and our proposed system correctly diagnosed 2817/2819 subjects with the accuracy, sensitivity, and specificity ratings of 99.92%, 100%, and 99.86%, respectively.

Machine learning based detection of age-related macular degeneration (AMD) and diabetic macular edema (DME) from optical coherence tomography (OCT) images

Non-lethal macular diseases greatly impact patients' life quality, and will cause vision loss at the late stages. Visual inspection of the optical coherence tomography (OCT) images by the experienced clinicians is the main diagnosis technique. We proposed a computer-aided diagnosis (CAD) model to discriminate age-related macular degeneration (AMD), diabetic macular edema (DME) and healthy macula. The linear configuration pattern (LCP) based features of the OCT images were screened by the Correlation-based Feature Subset (CFS) selection algorithm. And the best model based on the sequential minimal optimization (SMO) algorithm achieved 99.3% in the overall accuracy for the three classes of samples.

Automated diagnosis of macular edema and central serous retinopathy through robust reconstruction of 3D retinal surfaces

BACKGROUND AND OBJECTIVES

Macular diseases tend to damage macula within human retina due to which the central vision of a person is affected. Macular edema (ME) and central serous retinopathy (CSR) are two of the most common macular diseases. Many researchers worked on automated detection of ME from optical coherence tomography (OCT) and fundus images, whereas few researchers have worked on diagnosing central serous retinopathy. But this paper proposes a fully automated method for the classification of ME and CSR through robust reconstruction of 3D OCT retinal surfaces.

METHODS

The proposed system uses structure tensors to extract retinal layers from OCT images. The 3D retinal surface is then reconstructed by extracting the brightness scan (B-scan) thickness profile from each coherent tensor. The proposed system extracts 8 distinct features (3 based on retinal thickness profile of right side, 3 based on thickness profile of left side and 2 based on top surface and cyst spaces within retinal layers) from 30 labeled volumes (10 healthy, 10 CSR and 10 ME) which are used to train the supervised support vector machines (SVM) classifier.

RESULTS

In this research we have considered 90 OCT volumes (30 Healthy, 30 CSR and 30 ME) of 73 patients to test the proposed system where our proposed system correctly classified 89 out of 90 cases and has promising receiver operator characteristics (ROC) ratings with accuracy, sensitivity and specificity of 98.88%, 100%, and 96.66% respectively.

CONCLUSION

The proposed system is quite fast and robust in detecting all the three types of retinal pathologies from volumetric OCT scans. The proposed system is fully automated and provides an early and on fly diagnosis of ME and CSR syndromes. 3D macular thickness surfaces can further be used as decision support parameter in clinical studies to check the volume of cyst.