Real-Time Automatic Segmentation of Optical Coherence Tomography Volume Data of the Macular Region

Automatic segmentation of layers in chorio-retinal complex using Graph-based method for ultra-speed 1.7 MHz wide field swept source FDML optical coherence tomography

The posterior segment of the human eye complex contains two discrete microstructure and vasculature network systems, namely, the retina and choroid. We present a single segmentation framework technique for segmenting the entire layers present in the chorio-retinal complex of the human eye using optical coherence tomography (OCT) images. This automatic program is based on the graph theory method. This single program is capable of segmenting seven layers of the retina and choroid scleral interface. The graph theory was utilized to find the probability matrix and subsequent boundaries of different layers. The program was also implemented to segment angiographic maps of different chorio-retinal layers using "segmentation matrices." The method was tested and successfully validated on OCT images from six normal human eyes as well as eyes with non-exudative age-related macular degeneration (AMD). The thickness of microstructure and microvasculature for different layers located in the chorio-retinal segment of the eye was also generated and compared. A decent efficiency in terms of processing time, sensitivity, and accuracy was observed compared to the manual segmentation and other existing methods. The proposed method automatically segments whole OCT images of chorio-retinal complex with augmented probability maps generation in OCT volume dataset. We have also evaluated the segmentation results using quantitative metrics such as Dice coefficient and Hausdorff distance This method realizes a mean descent Dice similarity coefficient (DSC) value of 0.82 (range, 0.816-0.864) for RPE and CSI layer.

Artificial intelligence in retinal image analysis: Development, advances, and challenges

Modern advances in diagnostic technologies offer the potential for unprecedented insight into ophthalmic conditions relating to the retina. We discuss the current landscape of artificial intelligence in retina with respect to screening, diagnosis, and monitoring of retinal pathologies such as diabetic retinopathy, diabetic macular edema, central serous chorioretinopathy, and age-related macular degeneration. We review the methods used in these models and evaluate their performance in both research and clinical contexts and discuss potential future directions for investigation, use of multiple imaging modalities in artificial intelligence algorithms, and challenges in the application of artificial intelligence in retinal pathologies.

Deep learning network with differentiable dynamic programming for retina OCT surface segmentation

Multiple-surface segmentation in optical coherence tomography (OCT) images is a challenging problem, further complicated by the frequent presence of weak image boundaries. Recently, many deep learning-based methods have been developed for this task and yield remarkable performance. Unfortunately, due to the scarcity of training data in medical imaging, it is challenging for deep learning networks to learn the global structure of the target surfaces, including surface smoothness. To bridge this gap, this study proposes to seamlessly unify a U-Net for feature learning with a constrained differentiable dynamic programming module to achieve end-to-end learning for retina OCT surface segmentation to explicitly enforce surface smoothness. It effectively utilizes the feedback from the downstream model optimization module to guide feature learning, yielding better enforcement of global structures of the target surfaces. Experiments on Duke AMD (age-related macular degeneration) and JHU MS (multiple sclerosis) OCT data sets for retinal layer segmentation demonstrated that the proposed method was able to achieve subvoxel accuracy on both datasets, with the mean absolute surface distance (MASD) errors of 1.88 ± 1.96μm and 2.75 ± 0.94μm, respectively, over all the segmented surfaces.

Multiscale joint segmentation method for retinal optical coherence tomography images using a bidirectional wave algorithm and improved graph theory

Morphology and functional metrics of retinal layers are important biomarkers for many human ophthalmic diseases. Automatic and accurate segmentation of retinal layers is crucial for disease diagnosis and research. To improve the performance of retinal layer segmentation, a multiscale joint segmentation framework for retinal optical coherence tomography (OCT) images based on bidirectional wave algorithm and improved graph theory is proposed. In this framework, the bidirectional wave algorithm was used to segment edge information in multiscale images, and the improved graph theory was used to modify edge information globally, to realize automatic and accurate segmentation of eight retinal layer boundaries. This framework was tested on two public datasets and two OCT imaging systems. The test results show that, compared with other state-of-the-art methods, this framework does not need data pre-training and parameter pre-adjustment on different datasets, and can achieve sub-pixel retinal layer segmentation on a low-configuration computer.

Functional and anatomic changes between early postoperative recovery and long-term follow-up after combined epiretinal and internal limiting membrane peeling

OBJECTIVE

To evaluate short- and long-term changes in best-corrected visual acuity (BCVA) and retinal layer thicknesses after combined epiretinal membrane (ERM) and internal limiting membrane (ILM) peeling for macular holes and symptomatic ERMs.

DESIGN

Retrospective observational case series.

PARTICIPANTS

Patients with ERMs or with macular holes and ERMs treated with combined ERM and ILM peeling.

METHODS

Study eyes (n = 36) and healthy fellow eyes (n = 17) were evaluated using the automated segmentation of retinal layers performed by SPECTRALIS software that automatically calculated the average central retinal thickness and the average thickness in each of the individual retinal layers. The analysis was performed at 6-18 months after surgery and after 60 months.

MAIN OUTCOME MEASURES

Changes in BCVA and retinal layer thicknesses determined by automated segmentation at the first and last follow-up visits.

RESULTS

BCVA improved from a baseline 0.48 ± 0.25 logMAR (20/60 Snellen) to 0.18 ± 0.18 logMAR (20/30 Snellen) at the short-term postoperative examination (p < 0.0001). Between first and last follow-up visit, 5 eyes (14%) were classified as better, 28 (78%) as stable, and 3 (8%) as worse. BCVA of the control fellow eyes remained stable during the follow-up. The thicknesses of retinal layers decreased significantly (p < 0.009). At the last follow-up, the ganglion cell layer was thinner and the inner nuclear layer was thicker in the operated eyes compared with the healthy fellow eyes.

CONCLUSION

Combined ERM and ILM peeling may improve BCVA in some patients. However, over a long follow-up period, it can be associated with progressive ganglion cell layer thinning that could affect BCVA stability.

Non-Destructive Direct Pericarp Thickness Measurement of Sorghum Kernels Using Extended-Focus Optical Coherence Microscopy

Non-destructive measurements of internal morphological structures in plant materials such as seeds are of high interest in agricultural research. The estimation of pericarp thickness is important to understand the grain quality and storage stability of seeds and can play a crucial role in improving crop yield. In this study, we demonstrate the applicability of fiber-based Bessel beam Fourier domain (FD) optical coherence microscopy (OCM) with a nearly constant high lateral resolution maintained at over ~400 µm for direct non-invasive measurement of the pericarp thickness of two different sorghum genotypes. Whereas measurements based on axial profiles need additional knowledge of the pericarp refractive index, en-face views allow for direct distance measurements. We directly determine pericarp thickness from lateral sections with a 3 µm resolution by taking the width of the signal corresponding to the pericarp at the 1/e threshold. These measurements enable differentiation of the two genotypes with 100% accuracy. We find that trading image resolution for acquisition speed and view size reduces the classification accuracy. Average pericarp thicknesses of 74 µm (thick phenotype) and 43 µm (thin phenotype) are obtained from high-resolution lateral sections, and are in good agreement with previously reported measurements of the same genotypes. Extracting the morphological features of plant seeds using Bessel beam FD-OCM is expected to provide valuable information to the food processing industry and plant breeding programs.

The Assessment of Acute Chorioretinal Changes Due to Intensive Physical Exercise in Senior Elite Athletes

Regular physical exercise is known to lower the incidence of age-related eye diseases. We aimed to assess the acute chorioretinal alterations in older adults following intense physical strain. Seventeen senior elite athletes were recruited who underwent an aerobic exercise on a cycle ergometer and macular scanning by optical coherence tomography. A significant thinning of the entire retina was observed 1 min after exercise, followed by a thickening at 5 min, after which the thickness returned to baseline. This trend was similar in almost every single retinal layer, although a significant change was observed only in the inner retina. Choroidal thickness changes were neither significant nor did they correlate with the thickness changes of intraretinal layers. The mechanism of how these immediate retinal changes chronically impact age-related sight-threatening pathologies that, in turn, result in a substantially reduced quality of life warrants further investigation on nontrained older adults as well.

Wavelet attention network for the segmentation of layer structures on OCT images

Automatic segmentation of layered tissue is critical for optical coherence tomography (OCT) image analysis. The development of deep learning techniques provides various solutions to this problem, while most existing methods suffer from topological errors such as outlier prediction and label disconnection. The channel attention mechanism is a powerful technique to address these problems due to its simplicity and robustness. However, it relies on global average pooling (GAP), which only calculates the lowest frequency component and leaves other potentially useful information unexplored. In this study, we use the discrete wavelet transform (DWT) to extract multi-spectral information and propose the wavelet attention network (WATNet) for tissue layer segmentation. The DWT-based attention mechanism enables multi-spectral analysis with no complex frequency-selection process and can be easily embedded to existing frameworks. Furthermore, the various wavelet bases make the WATNet adaptable to different tasks. Experiments on a self-collected esophageal dataset and two public retinal OCT dataset demonstrated that the WATNet achieved better performance compared to several widely used deep networks, confirming the advantages of the proposed method.

LOCTseg: A lightweight fully convolutional network for end-to-end optical coherence tomography segmentation

This article presents a novel end-to-end automatic solution for semantic segmentation of optical coherence tomography (OCT) images. OCT is a non-invasive imaging technology widely used in clinical practice due to its ability to acquire high-resolution cross-sectional images of the ocular fundus. Due to the large variability of the retinal structures, OCT segmentation is usually carried out manually and requires expert knowledge. This study introduces a novel fully convolutional network (FCN) architecture designated by LOCTSeg, for end-to-end automatic segmentation of diagnostic markers in OCT b-scans. LOCTSeg is a lightweight deep FCN optimized for balancing performance and efficiency. Unlike state-of-the-art FCNs used in image segmentation, LOCTSeg achieves competitive inference speed without sacrificing segmentation accuracy. The proposed LOCTSeg is evaluated on two publicly available benchmarking datasets: (1) annotated retinal OCT image database (AROI) comprising 1136 images, and (2) healthy controls and multiple sclerosis lesions (HCMS) consisting of 1715 images. Moreover, we evaluated the proposed LOCTSeg with a private dataset of 250 OCT b-scans acquired from epiretinal membrane (ERM) and healthy patients. Results of the evaluation demonstrate empirically the effectiveness of the proposed algorithm, which improves the state-of-the-art Dice score from 69% to 73% and from 91% to 92% on AROI and HCMS datasets, respectively. Furthermore, LOCTSeg outperforms comparable lightweight FCNs' Dice score by margins between 4% and 15% on ERM segmentation.

A comparison of deep learning U-Net architectures for posterior segment OCT retinal layer segmentation

Deep learning methods have enabled a fast, accurate and automated approach for retinal layer segmentation in posterior segment OCT images. Due to the success of semantic segmentation methods adopting the U-Net, a wide range of variants and improvements have been developed and applied to OCT segmentation. Unfortunately, the relative performance of these methods is difficult to ascertain for OCT retinal layer segmentation due to a lack of comprehensive comparative studies, and a lack of proper matching between networks in previous comparisons, as well as the use of different OCT datasets between studies. In this paper, a detailed and unbiased comparison is performed between eight U-Net architecture variants across four different OCT datasets from a range of different populations, ocular pathologies, acquisition parameters, instruments and segmentation tasks. The U-Net architecture variants evaluated include some which have not been previously explored for OCT segmentation. Using the Dice coefficient to evaluate segmentation performance, minimal differences were noted between most of the tested architectures across the four datasets. Using an extra convolutional layer per pooling block gave a small improvement in segmentation performance for all architectures across all four datasets. This finding highlights the importance of careful architecture comparison (e.g. ensuring networks are matched using an equivalent number of layers) to obtain a true and unbiased performance assessment of fully semantic models. Overall, this study demonstrates that the vanilla U-Net is sufficient for OCT retinal layer segmentation and that state-of-the-art methods and other architectural changes are potentially unnecessary for this particular task, especially given the associated increased complexity and slower speed for the marginal performance gains observed. Given the U-Net model and its variants represent one of the most commonly applied image segmentation methods, the consistent findings across several datasets here are likely to translate to many other OCT datasets and studies. This will provide significant value by saving time and cost in experimentation and model development as well as reduced inference time in practice by selecting simpler models.

The assessment of acute chorioretinal changes due to intensive physical exercise in young adults

Purpose

There is abundant evidence on the benefits of physical activity on cardiovascular health. However, there are only few data on the acute effects of physical exercise on the retina and choroid. Our aim was the in vivo examination of chorioretinal alterations following short intense physical activity by spectral domain optical coherence tomography (SD-OCT).

Methods

Twenty-one eyes of 21 healthy, young subjects (mean age 22.5 ± 4.1 years, 15 males and 6 females) were recruited. Macular scanning with a SD-OCT was performed before and following a vita maxima-type physical strain exercise on a rowing ergometer until complete fatigue. Follow-up OCT scans were performed 1, 5, 15, 30 and 60 minutes following the exercise. The OCT images were exported and analyzed using our custom-built OCTRIMA 3D software and the thickness of 7 retinal layers was calculated, along with semi-automated measurement of the choroidal thickness. One-way ANOVA analysis was performed followed by Dunnett post hoc test for the thickness change compared to baseline and the correlation between performance and thickness change has also been calculated. The level of significance was set at 0.001.

Results

We observed a significant thinning of the total retina 1 minute post-exercise (-7.3 ± 0.6 μm, p < 0.001) which was followed by a significant thickening by 5 and 15 minutes (+3.6 ± 0.6 μm and +4.0 ± 0.6 μm, respectively, both p <0.001). Post-exercise retinal thickness returned to baseline by 30 minutes. This trend was present throughout the most layers of the retina, with significant changes in the ganglion cell–inner plexiform layer complex, (-1.3 ± 0.1 μm, +0.6 ± 0.1 μm and +0.7 ± 0.1 μm, respectively, p <0.001 for all), in the inner nuclear layer at 1 and 5 minutes (-0.8 ± 0.1 μm and +0.8 ± 0.1 μm, respectively, p <0.001 for both), in the outer nuclear layer–photoreceptor inner segment complex at 5 minute (+2.3 ± 0.4 μm, p <0.001 for all) and in the interdigitation zone–retinal pigment epithelium complex at 1 and 15 minutes (-3.3 ± 0.4 μm and +1.8 ± 0.4 μm, respectively, p <0.001 for both). There was no significant change in choroidal thickness; however, we could detect a tendency towards thinning at 1, 15, and 30 minutes following exercise. The observed changes in thickness change did not correlate with performance. Similar trends were observed in both professional and amateur sportsmen (n = 15 and n = 6, respectively). The absolute changes in choroidal thickness did not show any correlation with the thickness changes of the intraretinal layers.

Conclusions

Our study implies that in young adults, intense physical exercise has an acute effect on the granular layers of the retina, resulting in thinning followed by rebound thickening before normalization. We could not identify any clear correlation with either choroidal changes or performance that might explain our observations, and hence the exact mechanism warrants further clarification. We believe that a combination of vascular and mechanic changes is behind the observed trends.

Automated retinal boundary segmentation of optical coherence tomography images using an improved Canny operator

Retinal segmentation is a prerequisite for quantifying retinal structural features and diagnosing related ophthalmic diseases. Canny operator is recognized as the best boundary detection operator so far, and is often used to obtain the initial boundary of the retina in retinal segmentation. However, the traditional Canny operator is susceptible to vascular shadows, vitreous artifacts, or noise interference in retinal segmentation, causing serious misdetection or missed detection. This paper proposed an improved Canny operator for automatic segmentation of retinal boundaries. The improved algorithm solves the problems of the traditional Canny operator by adding a multi-point boundary search step on the basis of the original method, and adjusts the convolution kernel. The algorithm was used to segment the retinal images of healthy subjects and age-related macular degeneration (AMD) patients; eleven retinal boundaries were identified and compared with the results of manual segmentation by the ophthalmologists. The average difference between the automatic and manual methods is: 2–6 microns (1–2 pixels) for healthy subjects and 3–10 microns (1–3 pixels) for AMD patients. Qualitative method is also used to verify the accuracy and stability of the algorithm. The percentage of “perfect segmentation” and “good segmentation” is 98% in healthy subjects and 94% in AMD patients. This algorithm can be used alone or in combination with other methods as an initial boundary detection algorithm. It is easy to understand and improve, and may become a useful tool for analyzing and diagnosing eye diseases.

Globally optimal OCT surface segmentation using a constrained IPM optimization

Segmentation of multiple surfaces in optical coherence tomography (OCT) images is a challenging problem, further complicated by the frequent presence of weak boundaries, varying layer thicknesses, and mutual influence between adjacent surfaces. The traditional graph-based optimal surface segmentation method has proven its effectiveness with its ability to capture various surface priors in a uniform graph model. However, its efficacy heavily relies on handcrafted features that are used to define the surface cost for the "goodness" of a surface. Recently, deep learning (DL) is emerging as a powerful tool for medical image segmentation thanks to its superior feature learning capability. Unfortunately, due to the scarcity of training data in medical imaging, it is nontrivial for DL networks to implicitly learn the global structure of the target surfaces, including surface interactions. This study proposes to parameterize the surface cost functions in the graph model and leverage DL to learn those parameters. The multiple optimal surfaces are then simultaneously detected by minimizing the total surface cost while explicitly enforcing the mutual surface interaction constraints. The optimization problem is solved by the primal-dual interior-point method (IPM), which can be implemented by a layer of neural networks, enabling efficient end-to-end training of the whole network. Experiments on spectral-domain optical coherence tomography (SD-OCT) retinal layer segmentation demonstrated promising segmentation results with sub-pixel accuracy.

Benchmarking automated detection of the retinal external limiting membrane in a 3D spectral domain optical coherence tomography image dataset of full thickness macular holes

In this article, we present a new benchmark for the segmentation of the retinal external limiting membrane (ELM) using an image dataset of spectral domain optical coherence tomography (OCT) scans in a patient population with idiopathic full-thickness macular holes. Specifically, the dataset used contains OCT images from one eye of 107 patients with an idiopathic full-thickness macular hole. In total, the dataset contains 5243 individual 2-dimensional (2-D) OCT image slices, with each patient contributing 49 individual spectral-domain OCT tagged image slices. We display precise image-wise binary annotations to segment the ELM line. The OCT images present high variations in image contrast, motion, brightness, and speckle noise which can affect the robustness of applied algorithms, so we performed an extensive OCT imaging and annotation data quality analysis. Imaging data quality control included noise, blurriness and contrast scores, motion estimation, darkness and average pixel scores, and anomaly detection. Annotation quality was measured using gradient mapping of ELM line annotation confidence, and idiopathic full-thickness macular hole detection. Finally, we compared qualitative and quantitative results with seven state-of-the-art machine learning-based segmentation methods to identify the ELM line with an automated system.

A modular platform for automated cryo-FIB workflows

Lamella micromachining by focused ion beam milling at cryogenic temperature (cryo-FIB) has matured into a preparation method widely used for cellular cryo-electron tomography. Due to the limited ablation rates of low Ga+ ion beam currents required to maintain the structural integrity of vitreous specimens, common preparation protocols are time-consuming and labor intensive. The improved stability of new-generation cryo-FIB instruments now enables automated operations. Here, we present an open-source software tool, SerialFIB, for creating automated and customizable cryo-FIB preparation protocols. The software encompasses a graphical user interface for easy execution of routine lamellae preparations, a scripting module compatible with available Python packages, and interfaces with three-dimensional correlative light and electron microscopy (CLEM) tools. SerialFIB enables the streamlining of advanced cryo-FIB protocols such as multi-modal imaging, CLEM-guided lamella preparation and in situ lamella lift-out procedures. Our software therefore provides a foundation for further development of advanced cryogenic imaging and sample preparation protocols.

Segmentation of Preretinal Space in Optical Coherence Tomography Images Using Deep Neural Networks

This paper proposes an efficient segmentation of the preretinal area between the inner limiting membrane (ILM) and posterior cortical vitreous (PCV) of the human eye in an image obtained with the use of optical coherence tomography (OCT). The research was carried out using a database of three-dimensional OCT imaging scans obtained with the Optovue RTVue XR Avanti device. Various types of neural networks (UNet, Attention UNet, ReLayNet, LFUNet) were tested for semantic segmentation, their effectiveness was assessed using the Dice coefficient and compared to the graph theory techniques. Improvement in segmentation efficiency was achieved through the use of relative distance maps. We also show that selecting a larger kernel size for convolutional layers can improve segmentation quality depending on the neural network model. In the case of PVC, we obtain the effectiveness reaching up to 96.35%. The proposed solution can be widely used to diagnose vitreomacular traction changes, which is not yet available in scientific or commercial OCT imaging solutions.

Automatic Segmentation in Multiple OCT Layers For Stargardt Disease Characterization Via Deep Learning

Purpose

This study sought to perform automated segmentation of 11 retinal layers and Stargardt-associated features on spectral-domain optical coherence tomography (SD-OCT) images and to analyze differences between normal eyes and eyes diagnosed with Stargardt disease.

Methods

Automated segmentation was accomplished through application of the deep learning–shortest path (DL-SP) framework, a shortest path segmentation approach that is enhanced by a deep learning fully convolutional neural network. To compare normal eyes and eyes diagnosed with Stargardt disease, various retinal layer thickness and intensity feature maps associated with the outer retinal layers were generated.

Results

The automated DL-SP approach achieved a mean difference within a subpixel accuracy range for all layers when compared to manually traced layers by expert graders. The algorithm achieved mean and absolute mean differences in border positions for Stargardt features of −0.11 ± 4.17 pixels and 1.92 ± 3.71 pixels, respectively. In several of the feature maps generated, the characteristic Stargardt features of flecks and atrophic-appearing lesions were readily visualized.

Conclusions

To the best of our knowledge, this is the first automated algorithm for 11 retinal layer segmentation on OCT in eyes with Stargardt disease, and, furthermore, the feature differences found between eyes diagnosed with Stargardt disease and normal eyes may inform new insights and the better understanding of retinal characteristic morphologic changes caused by Stargardt disease.

Translational Relevance

The automated algorithm's performance and the feature differences found using the algorithm's segmentation support the future applications of SD-OCT for the quantitative monitoring of Stargardt disease.

CNN-based CP-OCT sensor integrated with a subretinal injector for retinal boundary tracking and injection guidance

SIGNIFICANCE

Subretinal injection is an effective way of delivering transplant genes and cells to treat many degenerative retinal diseases. However, the technique requires high-dexterity and microscale precision of experienced surgeons, who have to overcome the physiological hand tremor and limited visualization of the subretinal space.

AIM

To automatically guide the axial motion of microsurgical tools (i.e., a subretinal injector) with microscale precision in real time using a fiber-optic common-path swept-source optical coherence tomography distal sensor.

APPROACH

We propose, implement, and study real-time retinal boundary tracking of A-scan optical coherence tomography (OCT) images using a convolutional neural network (CNN) for automatic depth targeting of a selected retinal boundary for accurate subretinal injection guidance. A simplified 1D U-net is used for the retinal layer segmentation on A-scan OCT images. A Kalman filter, combining retinal boundary position measurement by CNN and velocity measurement by cross correlation between consecutive A-scan images, is applied to optimally estimate the retinal boundary position. Unwanted axial motions of the surgical tools are compensated by a piezoelectric linear motor based on the retinal boundary tracking.

RESULTS

CNN-based segmentation on A-scan OCT images achieves the mean unsigned error (MUE) of ∼3  pixels (8.1  μm) using an ex vivo bovine retina model. GPU parallel computing allows real-time inference (∼2  ms) and thus real-time retinal boundary tracking. Involuntary tremors, which include low-frequency draft in hundreds of micrometers and physiological tremors in tens of micrometers, are compensated effectively. The standard deviations of photoreceptor (PR) and choroid (CH) boundary positions get as low as 10.8  μm when the depth targeting is activated.

CONCLUSIONS

A CNN-based common-path OCT distal sensor successfully tracks retinal boundaries, especially the PR/CH boundary for subretinal injection, and automatically guides the tooltip's axial position in real time. The microscale depth targeting accuracy of our system shows its promising possibility for clinical application.

Automatic segmentation of retinal layers in OCT images with intermediate age-related macular degeneration using U-Net and DexiNed

Age-related macular degeneration (AMD) is an eye disease that can cause visual impairment and affects the elderly over 50 years of age. AMD is characterized by the presence of drusen, which causes changes in the physiological structure of the retinal pigment epithelium (RPE) and the boundaries of the Bruch’s membrane layer (BM). Optical coherence tomography is one of the main exams for the detection and monitoring of AMD, which seeks changes through the evaluation of successive sectional cuts in the search for morphological changes caused by drusen. The use of CAD (Computer-Aided Detection) systems has contributed to increasing the chances of correct detection, assisting specialists in diagnosing and monitoring disease. Thus, the objective of this work is to present a method for the segmentation of the inner limiting membrane (ILM), retinal pigment epithelium, and Bruch’s membrane in OCT images of healthy and Intermediate AMD patients. The method uses two deep neural networks, U-Net and DexiNed to perform the segmentation. The results were promising, reaching an average absolute error of 0.49 pixel for ILM, 0.57 for RPE, and 0.66 for BM.

Choroid Segmentation of Retinal OCT Images Based on CNN Classifier and l 2-l q Fitter

Optical coherence tomography (OCT) is a noninvasive cross-sectional imaging technology used to examine the retinal structure and pathology of the eye. Evaluating the thickness of the choroid using OCT images is of great interests for clinicians and researchers to monitor the choroidal thickness in many ocular diseases for diagnosis and management. However, manual segmentation and thickness profiling of choroid are time-consuming which lead to low efficiency in analyzing a large quantity of OCT images for swift treatment of patients. In this paper, an automatic segmentation approach based on convolutional neural network (CNN) classifier and l ₂-l _q (0 < q < 1) fitter is presented to identify boundaries of the choroid and to generate thickness profile of the choroid from retinal OCT images. The method of detecting inner choroidal surface is motivated by its biological characteristics after light reflection, while the outer chorioscleral interface segmentation is transferred into a classification and fitting problem. The proposed method is tested in a data set of clinically obtained retinal OCT images with ground-truth marked by clinicians. Our numerical results demonstrate the effectiveness of the proposed approach to achieve stable and clinically accurate autosegmentation of the choroid.

Pseudo-real-time retinal layer segmentation for high-resolution adaptive optics optical coherence tomography

We present a pseudo-real-time retinal layer segmentation for high-resolution Sensorless Adaptive Optics-Optical Coherence Tomography (SAO-OCT). Our pseudo-real-time segmentation method is based on Dijkstra's algorithm that uses the intensity of pixels and the vertical gradient of the image to find the minimum cost in a geometric graph formulation within a limited search region. It segments six retinal layer boundaries in an iterative process according to their order of prominence. The segmentation time is strongly correlated to the number of retinal layers to be segmented. Our program permits en face images to be extracted during data acquisition to guide the depth specific focus control and depth dependent aberration correction for high-resolution SAO-OCT systems. The average processing times for our entire pipeline for segmenting six layers in a retinal B-scan of 496 × 400 and 240 × 400 pixels are around 25.60 and 13.76 ms, respectively. When reducing the number of layers segmented to only two layers, the time required for a 240 × 400 pixel image is 8.26 ms.

Automated Retinal Layer Segmentation Using Graph-based Algorithm Incorporating Deep-learning-derived Information

Regular drusen, an accumulation of material below the retinal pigment epithelium (RPE), have long been established as a hallmark early feature of nonneovascular age-related macular degeneration (AMD). Advances in imaging have expanded the phenotype of AMD to include another extracellular deposit, reticular pseudodrusen (RPD) (also termed subretinal drusenoid deposits, SDD), which are located above the RPE. We developed an approach to automatically segment retinal layers associated with regular drusen and RPD in spectral domain (SD) optical coherence tomography (OCT) images. More specifically, a shortest-path algorithm enhanced with probability maps generated through a fully convolutional neural network was used to segment drusen and RPD, as well as 11 retinal layers in SD-OCT volumes. This algorithm achieves a mean difference that is within the subpixel accuracy range drusen and RPD, alongside the other 11 retinal layers, highlighting the high robustness of this algorithm for this dataset. To the best of our knowledge, this is the first report of a validated algorithm for the automated segmentation of the retinal layers including early AMD features of RPD and regular drusen separately on SD-OCT images.

Correction propagation for user-assisted optical coherence tomography segmentation: general framework and application to Bruch's membrane segmentation

Optical coherence tomography (OCT) is a commonly used ophthalmic imaging modality. While OCT has traditionally been viewed cross-sectionally (i.e., as a sequence of B-scans), higher A-scan rates have increased interest in en face OCT visualization and analysis. The recent clinical introduction of OCT angiography (OCTA) has further spurred this interest, with chorioretinal OCTA being predominantly displayed via en face projections. Although en face visualization and quantitation are natural for many retinal features (e.g., drusen and vasculature), it requires segmentation. Because manual segmentation of volumetric OCT data is prohibitively laborious in many settings, there has been significant research and commercial interest in developing automatic segmentation algorithms. While these algorithms have achieved impressive results, the variability of image qualities and the variety of ocular pathologies cause even the most robust automatic segmentation algorithms to err. In this study, we develop a user-assisted segmentation approach, complementary to fully-automatic methods, wherein correction propagation is used to reduce the burden of manually correcting automatic segmentations. The approach is evaluated for Bruch's membrane segmentation in eyes with advanced age-related macular degeneration.

Beyond Performance Metrics: Automatic Deep Learning Retinal OCT Analysis Reproduces Clinical Trial Outcome

PURPOSE

To validate the efficacy of a fully automatic, deep learning-based segmentation algorithm beyond conventional performance metrics by measuring the primary outcome of a clinical trial for macular telangiectasia type 2 (MacTel2).

DESIGN

Evaluation of diagnostic test or technology.

PARTICIPANTS

A total of 92 eyes from 62 participants with MacTel2 from a phase 2 clinical trial (NCT01949324) randomized to 1 of 2 treatment groups METHODS: The ellipsoid zone (EZ) defect areas were measured on spectral domain OCT images of each eye at 2 time points (baseline and month 24) by a fully automatic, deep learning-based segmentation algorithm. The change in EZ defect area from baseline to month 24 was calculated and analyzed according to the clinical trial protocol.

MAIN OUTCOME MEASURE

Difference in the change in EZ defect area from baseline to month 24 between the 2 treatment groups.

RESULTS

The difference in the change in EZ defect area from baseline to month 24 between the 2 treatment groups measured by the fully automatic segmentation algorithm was 0.072±0.035 mm² (P = 0.021). This was comparable to the outcome of the clinical trial using semiautomatic measurements by expert readers, 0.065±0.033 mm² (P = 0.025).

CONCLUSIONS

The fully automatic segmentation algorithm was as accurate as semiautomatic expert segmentation to assess EZ defect areas and was able to reliably reproduce the statistically significant primary outcome measure of the clinical trial. This approach, to validate the performance of an automatic segmentation algorithm on the primary clinical trial end point, provides a robust gauge of its clinical applicability.

Automatic Annotation of Retinal Layers in Optical Coherence Tomography Images

Early diagnosis of retinal OCT images has been shown to curtail blindness and visual impairments. However, the advancement of ophthalmic imaging technologies produces an ever-growing scale of retina images, both in volume and variety, which overwhelms the ophthalmologist ability to segment these images. While many automated methods exist, speckle noise and intensity inhomogeneity negatively impacts the performance of these methods. We present a comprehensive and fully automatic method for annotation of retinal layers in OCT images comprising of fuzzy histogram hyperbolisation (FHH) and graph cut methods to segment 7 retinal layers across 8 boundaries. The FHH handles speckle noise and inhomogeneity in the preprocessing step. Then the normalised vertical image gradient, and it’s inverse to represent image intensity in calculating two adjacency matrices and then the FHH reassigns the edge-weights to make edges along retinal boundaries have a low cost, and graph cut method identifies the shortest-paths (layer boundaries). The method is evaluated on 150 B-Scan images, 50 each from the temporal, foveal and nasal regions were used in our study. Promising experimental results have been achieved with high tolerance and adaptability to contour variance and pathological inconsistency of the retinal layers in all (temporal, foveal and nasal) regions. The method also achieves high accuracy, sensitivity, and Dice score of 0.98360, 0.9692 and 0.9712, respectively in segmenting the retinal nerve fibre layer. The annotation can facilitate eye examination by providing accurate results. The integration of the vertical gradients into the graph cut framework, which captures the unique characteristics of retinal structures, is particularly useful in finding the actual minimum paths across multiple retinal layer boundaries. Prior knowledge plays an integral role in image segmentation.

Accurate tissue interface segmentation via adversarial pre-segmentation of anterior segment OCT images

Optical Coherence Tomography (OCT) is an imaging modality that has been widely adopted for visualizing corneal, retinal and limbal tissue structure with micron resolution. It can be used to diagnose pathological conditions of the eye, and for developing pre-operative surgical plans. In contrast to the posterior retina, imaging the anterior tissue structures, such as the limbus and cornea, results in B-scans that exhibit increased speckle noise patterns and imaging artifacts. These artifacts, such as shadowing and specularity, pose a challenge during the analysis of the acquired volumes as they substantially obfuscate the location of tissue interfaces. To deal with the artifacts and speckle noise patterns and accurately segment the shallowest tissue interface, we propose a cascaded neural network framework, which comprises of a conditional Generative Adversarial Network (cGAN) and a Tissue Interface Segmentation Network (TISN). The cGAN pre-segments OCT B-scans by removing undesired specular artifacts and speckle noise patterns just above the shallowest tissue interface, and the TISN combines the original OCT image with the pre-segmentation to segment the shallowest interface. We show the applicability of the cascaded framework to corneal datasets, demonstrate that it precisely segments the shallowest corneal interface, and also show its generalization capacity to limbal datasets. We also propose a hybrid framework, wherein the cGAN pre-segmentation is passed to a traditional image analysis-based segmentation algorithm, and describe the improved segmentation performance. To the best of our knowledge, this is the first approach to remove severe specular artifacts and speckle noise patterns (prior to the shallowest interface) that affects the interpretation of anterior segment OCT datasets, thereby resulting in the accurate segmentation of the shallowest tissue interface. To the best of our knowledge, this is the first work to show the potential of incorporating a cGAN into larger deep learning frameworks for improved corneal and limbal OCT image segmentation. Our cGAN design directly improves the visualization of corneal and limbal OCT images from OCT scanners, and improves the performance of current OCT segmentation algorithms.

Deep learning based retinal OCT segmentation

We look at the recent application of deep learning (DL) methods in automated fine-grained segmentation of spectral domain optical coherence tomography (OCT) images of the retina. We describe a new method combining fully convolutional networks (FCN) with Gaussian Processes for post processing. We report performance comparisons between the proposed approach, human clinicians, and other machine learning (ML) such as graph based approaches. The approach is demonstrated on an OCT dataset consisting of mild non-proliferative diabetic retinopathy from the University of Miami. The method is shown to have performance on par with humans, also compares favorably with the other ML methods, and appears to have as small or smaller mean unsigned error (equal to 1.06), versus errors ranging from 1.17 to 1.81 for other methods, and compared with human error of 1.10.

Multi-phase level set algorithm based on fully convolutional networks (FCN-MLS) for retinal layer segmentation in SD-OCT images with central serous chorioretinopathy (CSC)

As a function of the spatial position of the optical coherence tomography (OCT) image, retinal layer thickness is an important diagnostic indicator for many retinal diseases. Reliable segmentation of the retinal layer is necessary for extracting useful clinical information. However, manual segmentation of these layers is time-consuming and prone to bias. Furthermore, due to speckle noise, low image contrast, retinal detachment, and also irregular morphological features make the automatic segmentation task challenging. To alleviate these challenges, in this paper, we propose a new coarse-fine framework combining the full convolutional network (FCN) with a multiphase level set (named FCN-MLS) for automatic segmentation of nine boundaries in retinal spectral OCT images. In the coarse stage, FCN is used to learn the characteristics of specific retinal layer boundaries and achieve classification of four retinal layers. The boundaries are then extracted and the remaining boundaries are initialized based on a priori information about the thickness of the retinal layer. In order to prevent the overlapping of the segmentation interfaces, a regional restriction technique is used in the multi-phase level to evolve the boundaries to achieve fine nine retinal layers segmentation. Experimental results on 1280 B-scans show that the proposed method can segment nine retinal boundaries accurately. Compared with the manual delineation, the overall mean absolute boundary location difference and the overall mean absolute thickness difference were 5.88 ± 2.38μm and 5.81 ± 2.19μm, which showed a good consistency with manual segmentation by the physicians. Our experimental results also outperform state-of-the-art methods.

Layer boundary evolution method for macular OCT layer segmentation

Optical coherence tomography (OCT) is used to produce high resolution depth images of the retina and is now the standard of care for in-vivo ophthalmological assessment. It is also increasingly being used for evaluation of neurological disorders such as multiple sclerosis (MS). Automatic segmentation methods identify the retinal layers of the macular cube providing consistent results without intra- and inter-rater variation and is faster than manual segmentation. In this paper, we propose a fast multi-layer macular OCT segmentation method based on a fast level set method. Our framework uses contours in an optimized approach specifically for OCT layer segmentation over the whole macular cube. Our algorithm takes boundary probability maps from a trained random forest and iteratively refines the prediction to subvoxel precision. Evaluation on both healthy and multiple sclerosis subjects shows that our method is statistically better than a state-of-the-art graph-based method.

Automatic Segmentation of Retinal Layer in OCT Images With Choroidal Neovascularization

Age-related macular degeneration is one of the main causes of blindness. However, the internal structures of retinas are complex and difficult to be recognized due to the occurrence of neovascularization. Traditional surface detection methods may fail in the layer segmentation. In this paper, a supervised method is reported for simultaneously segmenting layers and neovascularization. Three spatial features, seven gray-level-based features, and 14 layer-like features are extracted for the neural network classifier. The coarse surfaces of different optical coherence tomography (OCT) images can thus be found. To describe and enhance retinal layers with different thicknesses and abnormalities, multi-scale bright and dark layer detection filters are introduced. A constrained graph search algorithm is also proposed to accurately detect retinal surfaces. The weights of nodes in the graph are computed based on these layer-like responses. The proposed method was evaluated on 42 spectral-domain OCT images with age-related macular degeneration. The experimental results show that the proposed method outperforms state-of-the-art methods.

Automatic segmentation of OCT retinal boundaries using recurrent neural networks and graph search

The manual segmentation of individual retinal layers within optical coherence tomography (OCT) images is a time-consuming task and is prone to errors. The investigation into automatic segmentation methods that are both efficient and accurate has seen a variety of methods proposed. In particular, recent machine learning approaches have focused on the use of convolutional neural networks (CNNs). Traditionally applied to sequential data, recurrent neural networks (RNNs) have recently demonstrated success in the area of image analysis, primarily due to their usefulness to extract temporal features from sequences of images or volumetric data. However, their potential use in OCT retinal layer segmentation has not previously been reported, and their direct application for extracting spatial features from individual 2D images has been limited. This paper proposes the use of a recurrent neural network trained as a patch-based image classifier (retinal boundary classifier) with a graph search (RNN-GS) to segment seven retinal layer boundaries in OCT images from healthy children and three retinal layer boundaries in OCT images from patients with age-related macular degeneration (AMD). The optimal architecture configuration to maximize classification performance is explored. The results demonstrate that a RNN is a viable alternative to a CNN for image classification tasks in the case where the images exhibit a clear sequential structure. Compared to a CNN, the RNN showed a slightly superior average generalization classification accuracy. Secondly, in terms of segmentation, the RNN-GS performed competitively against a previously proposed CNN based method (CNN-GS) with respect to both accuracy and consistency. These findings apply to both normal and AMD data. Overall, the RNN-GS method yielded superior mean absolute errors in terms of the boundary position with an average error of 0.53 pixels (normal) and 1.17 pixels (AMD). The methodology and results described in this paper may assist the future investigation of techniques within the area of OCT retinal segmentation and highlight the potential of RNN methods for OCT image analysis.

Comparison of Individual Retinal Layer Thicknesses after Epiretinal Membrane Surgery with or without Internal Limiting Membrane Peeling

Purpose

To compare changes in the retinal layer thickness and visual outcomes in patients undergoing epiretinal membrane (ERM) surgery with or without internal limiting membrane (ILM) peeling.

Methods

Seventy-six eyes of 76 patients who underwent ERM surgery from January 2013 to March 2015 at the Department of Ophthalmology, Yonsei University College of Medicine, Seoul, South Korea, were analyzed. While ERM removal with ILM peeling was performed in ILM peeling (P) group (n=39), ILM peeling was not performed in non-ILM peeling (NP) group (n=37). Retinal layer segmentation was performed using optical coherence tomography images. Individual retinal layer thicknesses before and at 6 months after ERM surgery were compared. The postoperative best-corrected visual acuity (BCVA) was also compared.

Results

In the P group, the thicknesses of retinal nerve fiber layer (RNFL), ganglion cell layer (GCL), and inner plexiform layer (IPL) were significantly reduced. In the NP group, significant decreases in the RNFL, GCL, IPL, inner nuclear layer, and outer plexiform layer were observed. The P group manifested a greater mean postoperative GCL (35.56 ± 1.53 µm vs 29.86 ± 2.16 µm; p=0.033) and less loss of GCL (−10.26 ± 1.91 µm vs −19.86 ± 2.74 µm; p=0.004) compared to the NP group. No statistically significant differences were observed when comparing the changes in BCVA.

Conclusions

This study demonstrates that ILM peeling for ERM surgery may result in better preservation of GCL compared to no ILM peeling.

A supervised joint multi-layer segmentation framework for retinal optical coherence tomography images using conditional random field

BACKGROUND AND OBJECTIVE

Accurate segmentation of the intra-retinal tissue layers in Optical Coherence Tomography (OCT) images plays an important role in the diagnosis and treatment of ocular diseases such as Age-Related Macular Degeneration (AMD) and Diabetic Macular Edema (DME). The existing energy minimization based methods employ multiple, manually handcrafted cost terms and often fail in the presence of pathologies. In this work, we eliminate the need to handcraft the energy by learning it from training images in an end-to-end manner. Our method can be easily adapted to pathologies by re-training it on an appropriate dataset.

METHODS

We propose a Conditional Random Field (CRF) framework for the joint multi-layer segmentation of OCT B-scans. The appearance of each retinal layer and boundary is modeled by two convolutional filter banks and the shape priors are modeled using Gaussian distributions. The total CRF energy is linearly parameterized to allow a joint, end-to-end training by employing the Structured Support Vector Machine formulation.

RESULTS

The proposed method outperformed three benchmark algorithms on four public datasets. The NORMAL-1 and NORMAL-2 datasets contain healthy OCT B-scans while the AMD-1 and DME-1 dataset contain B-scans of AMD and DME cases respectively. The proposed method achieved an average unsigned boundary localization error (U-BLE) of 1.52 pixels on NORMAL-1, 1.11 pixels on NORMAL-2 and 2.04 pixels on the combined NORMAL-1 and DME-1 dataset across the eight layer boundaries, outperforming the three benchmark methods in each case. The Dice coefficient was 0.87 on NORMAL-1, 0.89 on NORMAL-2 and 0.84 on the combined NORMAL-1 and DME-1 dataset across the seven retinal layers. On the combined NORMAL-1 and AMD-1 dataset, we achieved an average U-BLE of 1.86 pixels on the ILM, inner and outer RPE boundaries and a Dice of 0.98 for the ILM-RPE_in region and 0.81 for the RPE layer.

CONCLUSION

We have proposed a supervised CRF based method to jointly segment multiple tissue layers in OCT images. It can aid the ophthalmologists in the quantitative analysis of structural changes in the retinal tissue layers for clinical practice and large-scale clinical studies.

Multiple surface segmentation using convolution neural nets: application to retinal layer segmentation in OCT images

Automated segmentation of object boundaries or surfaces is crucial for quantitative image analysis in numerous biomedical applications. For example, retinal surfaces in optical coherence tomography (OCT) images play a vital role in the diagnosis and management of retinal diseases. Recently, graph based surface segmentation and contour modeling have been developed and optimized for various surface segmentation tasks. These methods require expertly designed, application specific transforms, including cost functions, constraints and model parameters. However, deep learning based methods are able to directly learn the model and features from training data. In this paper, we propose a convolutional neural network (CNN) based framework to segment multiple surfaces simultaneously. We demonstrate the application of the proposed method by training a single CNN to segment three retinal surfaces in two types of OCT images - normal retinas and retinas affected by intermediate age-related macular degeneration (AMD). The trained network directly infers the segmentations for each B-scan in one pass. The proposed method was validated on 50 retinal OCT volumes (3000 B-scans) including 25 normal and 25 intermediate AMD subjects. Our experiment demonstrated statistically significant improvement of segmentation accuracy compared to the optimal surface segmentation method with convex priors (OSCS) and two deep learning based UNET methods for both types of data. The average computation time for segmenting an entire OCT volume (consisting of 60 B-scans each) for the proposed method was 12.3 seconds, demonstrating low computation costs and higher performance compared to the graph based optimal surface segmentation and UNET based methods.

Visible light OCT-based quantitative imaging of lipofuscin in the retinal pigment epithelium with standard reference targets

We developed a technology for quantitative retinal autofluorescence (AF, or FAF for fundus AF) imaging for quantifying lipofuscin in the retinal pigment epithelium (RPE). The technology is based on simultaneous visible light optical coherence tomography (VIS-OCT) and AF imaging of the retina and a pair of reference standard targets at the intermediate retinal imaging plane with known reflectivity for the OCT and fluorescence efficiency for the FAF. The technology is able to eliminate the pre-RPE attenuation in FAF imaging by using the simultaneously acquired VIS-OCT image. With the OCT and fluorescence images of the reference targets, the effects of illumination power and detector sensitivity can be eliminated.

Luu C, Theodore Smith R, H. Guymer R, Ishikawa H, S. Schuman J, Ramamohanarao K. Classification of healthy and diseased retina using SD-OCT imaging and Random Forest algorithm

In this paper, we propose a novel classification model for automatically identifying individuals with age-related macular degeneration (AMD) or Diabetic Macular Edema (DME) using retinal features from Spectral Domain Optical Coherence Tomography (SD-OCT) images. Our classification method uses retinal features such as the thickness of the retina and the thickness of the individual retinal layers, and the volume of the pathologies such as drusen and hyper-reflective intra-retinal spots. We extract automatically, ten clinically important retinal features by segmenting individual SD-OCT images for classification purposes. The effectiveness of the extracted features is evaluated using several classification methods such as Random Forrest on 251 (59 normal, 177 AMD and 15 DME) subjects. We have performed 15-fold cross-validation tests for three phenotypes; DME, AMD and normal cases using these data sets and achieved accuracy of more than 95% on each data set with the classification method using Random Forrest. When we trained the system as a two-class problem of normal and eye with pathology, using the Random Forrest classifier, we obtained an accuracy of more than 96%. The area under the receiver operating characteristic curve (AUC) finds a value of 0.99 for each dataset. We have also shown the performance of four state-of-the-methods for classification the eye participants and found that our proposed method showed the best accuracy.

Deep longitudinal transfer learning-based automatic segmentation of photoreceptor ellipsoid zone defects on optical coherence tomography images of macular telangiectasia type 2

Photoreceptor ellipsoid zone (EZ) defects visible on optical coherence tomography (OCT) are important imaging biomarkers for the onset and progression of macular diseases. As such, accurate quantification of EZ defects is paramount to monitor disease progression and treatment efficacy over time. We developed and trained a novel deep learning-based method called Deep OCT Atrophy Detection (DOCTAD) to automatically segment EZ defect areas by classifying 3-dimensional A-scan clusters as normal or defective. Furthermore, we introduce a longitudinal transfer learning paradigm in which the algorithm learns from segmentation errors on images obtained at one time point to segment subsequent images with higher accuracy. We evaluated the performance of this method on 134 eyes of 67 subjects enrolled in a clinical trial of a novel macular telangiectasia type 2 (MacTel2) therapeutic agent. Our method compared favorably to other deep learning-based and non-deep learning-based methods in matching expert manual segmentations. To the best of our knowledge, this is the first automatic segmentation method developed for EZ defects on OCT images of MacTel2.

Real-time corneal segmentation and 3D needle tracking in intrasurgical OCT

Ophthalmic procedures demand precise surgical instrument control in depth, yet standard operating microscopes supply limited depth perception. Current commercial microscope-integrated optical coherence tomography partially meets this need with manually-positioned cross-sectional images that offer qualitative estimates of depth. In this work, we present methods for automatic quantitative depth measurement using real-time, two-surface corneal segmentation and needle tracking in OCT volumes. We then demonstrate these methods for guidance of ex vivo deep anterior lamellar keratoplasty (DALK) needle insertions. Surgeons using the output of these methods improved their ability to reach a target depth, and decreased their incidence of corneal perforations, both with statistical significance. We believe these methods could increase the success rate of DALK and thereby improve patient outcomes.

Macular and Retinal Nerve Fibre Layer Thinning in Xeroderma Pigmentosum: A Cross-sectional Study

The purpose of this study was to evaluate retinal thickness in different Xeroderma Pigmentosum (XP) complementation groups using spectral-domain optical coherence tomography (SD-OCT). This was a cross-sectional pilot study of 40 patients with XP. All patients had healthy-looking retinae and optic nerves on slit lamp biomicroscopy, and subtle or no neurological deficits. Patients were divided into two groups based on the known tendency for neurodegeneration associated with certain XP complementation groups. A third control group was obtained from a normative database. Using SD-OCT, we compared peripapillary retinal nerve fibre layer (pRNFL) and macular thickness between the groups. XP patients with a known tendency for neurodegeneration were found to have a statistically significant reduction in both pRNFL (p < 0.01) and macular thickness (p < 0.001) compared with healthy controls. In contrast, there was no statistically significant difference between pRNFL and macular thickness in XP patients not expected to develop neurodegeneration compared to the same control group. When both XP groups were compared, a statistically significant reduction in total pRNFL (p = 0.02) and macular thickness (p = 0.002) was found in XP patients predisposed to neurodegeneration. Our results suggest that pRNFL and macular thickness are reduced in XP patients with a known tendency for neurodegeneration, even before any marked neurological deficits become manifest. These findings demonstrate the potential role of retinal thickness as an anatomic biomarker and prognostic indicator for XP neurodegeneration.

Relationship between the morphology of the foveal avascular zone, retinal structure, and macular circulation in patients with diabetes mellitus

Diabetic Retinopathy (DR) is an extremely severe and common degenerative disease. The purpose of this study was to quantify the relationship between various parameters including the Foveal Avascular Zone (FAZ) morphology, retinal layer thickness, and retinal hemodynamic properties in healthy controls and patients with diabetes mellitus (DM) with and with no mild DR (MDR) using Spectral-Domain Optical Coherence Tomography (Spectralis SDOCT, Heidelberg Engineering GmbH, Germany) and the Retinal Function Imager (Optical Imaging, Ltd., Rehovot, Israel). Our results showed a higher FAZ area and diameter in MDR patients. Blood flow analysis also showed that there is a significantly smaller venous blood flow velocity in MDR patients. Also, a significant difference in roundness was observed between DM and MDR groups supporting the development of asymmetrical FAZ expansion with worsening DR. Our results suggest a potential anisotropy in the mechanical properties of the diabetic retina with no retinopathy that may trigger the FAZ elongation in a preferred direction resulting in either thinning or thickening of intraretinal layers in the inner and outer segments of the retina as a result of autoregulation. A detailed understanding of these relationships may facilitate earlier detection of DR, allowing for preservation of vision and better clinical outcomes.

Analysis of Agreement of Retinal-Layer Thickness Measures Derived from the Segmentation of Horizontal and Vertical Spectralis OCT Macular Scans

PURPOSE

Optical coherence tomography (OCT) is a reliable method used to quantify discrete layers of the retina. Spectralis OCT is a device used for this purpose. Spectralis OCT macular scan imaging acquisition can be obtained on either the horizontal or vertical plane. The vertical protocol has been proposed as favorable, due to postulated reduction in confound of Henle's fibers on segmentation-derived metrics. Yet, agreement of the segmentation measures of horizontal and vertical macular scans remains unexplored. Our aim was to determine this agreement.

MATERIALS AND METHODS

Horizontal and vertical macular scans on Spectralis OCT were acquired in 20 healthy controls (HCs) and 20 multiple sclerosis (MS) patients. All scans were segmented using Heidelberg software and a Johns Hopkins University (JHU)-developed method. Agreement was analyzed using Bland-Altman analyses and intra-class correlation coefficients (ICCs).

RESULTS

Using both segmentation techniques, mean differences (agreement at the cohort level) in the thicknesses of all macular layers derived from both acquisition protocols in MS patients and HCs were narrow (<1 µm), while the limits of agreement (LOA) (agreement at the individual level) were wider. Using JHU segmentation mean differences (and LOA) for the macular retinal nerve fiber layer (RNFL) and ganglion cell layer + inner plexiform layer (GCIP) in MS were 0.21 µm (-1.57-1.99 µm) and -0.36 µm (-1.44-1.37 µm), respectively.

CONCLUSIONS

OCT segmentation measures of discrete retinal-layer thicknesses derived from both vertical and horizontal protocols on Spectralis OCT agree excellently at the cohort level (narrow mean differences), but only moderately at the individual level (wide LOA). This suggests patients scanned using either protocol should continue to be scanned with the same protocol. However, due to excellent agreement at the cohort level, measures derived from both acquisitions can be pooled for outcome purposes in clinical trials.

Fully-automated segmentation of fluid regions in exudative age-related macular degeneration subjects: Kernel graph cut in neutrosophic domain

A fully-automated method based on graph shortest path, graph cut and neutrosophic (NS) sets is presented for fluid segmentation in OCT volumes for exudative age related macular degeneration (EAMD) subjects. The proposed method includes three main steps: 1) The inner limiting membrane (ILM) and the retinal pigment epithelium (RPE) layers are segmented using proposed methods based on graph shortest path in NS domain. A flattened RPE boundary is calculated such that all three types of fluid regions, intra-retinal, sub-retinal and sub-RPE, are located above it. 2) Seed points for fluid (object) and tissue (background) are initialized for graph cut by the proposed automated method. 3) A new cost function is proposed in kernel space, and is minimized with max-flow/min-cut algorithms, leading to a binary segmentation. Important properties of the proposed steps are proven and quantitative performance of each step is analyzed separately. The proposed method is evaluated using a publicly available dataset referred as Optima and a local dataset from the UMN clinic. For fluid segmentation in 2D individual slices, the proposed method outperforms the previously proposed methods by 18%, 21% with respect to the dice coefficient and sensitivity, respectively, on the Optima dataset, and by 16%, 11% and 12% with respect to the dice coefficient, sensitivity and precision, respectively, on the local UMN dataset. Finally, for 3D fluid volume segmentation, the proposed method achieves true positive rate (TPR) and false positive rate (FPR) of 90% and 0.74%, respectively, with a correlation of 95% between automated and expert manual segmentations using linear regression analysis.

Robust total retina thickness segmentation in optical coherence tomography images using convolutional neural networks

We developed a fully automated system using a convolutional neural network (CNN) for total retina segmentation in optical coherence tomography (OCT) that is robust to the presence of severe retinal pathology. A generalized U-net network architecture was introduced to include the large context needed to account for large retinal changes. The proposed algorithm outperformed qualitative and quantitatively two available algorithms. The algorithm accurately estimated macular thickness with an error of 14.0 ± 22.1 µm, substantially lower than the error obtained using the other algorithms (42.9 ± 116.0 µm and 27.1 ± 69.3 µm, respectively). These results highlighted the proposed algorithm's capability of modeling the wide variability in retinal appearance and obtained a robust and reliable retina segmentation even in severe pathological cases.

Long-term Characterization of Retinal Degeneration in Royal College of Surgeons Rats Using Spectral-Domain Optical Coherence Tomography

Purpose

Prospective treatments for age-related macular degeneration and inherited retinal degenerations are commonly evaluated in the Royal College of Surgeons (RCS) rat before translation into clinical application. Historically, retinal thickness obtained through postmortem anatomic assessments has been a key outcome measure; however, utility of this measurement is limited because it precludes the ability to perform longitudinal studies. To overcome this limitation, the present study was designed to provide a baseline longitudinal quantification of retinal thickness in the RCS rat by using spectral-domain optical coherence tomography (SD-OCT).

Methods

Horizontal and vertical linear SD-OCT scans centered on the optic nerve were captured from Long-Evans control rats at P30, P60, P90 and from RCS rats between P17 and P90. Total retina (TR), outer nuclear layer+ (ONL+), inner nuclear layer (INL), and retinal pigment epithelium (RPE) thicknesses were quantified. Histologic sections of RCS retina obtained from P21 to P60 were compared to SD-OCT images.

Results

In RCS rats, TR and ONL+ thickness decreased significantly as compared to Long-Evans controls. Changes in INL and RPE thickness were not significantly different between control and RCS retinas. From P30 to P90 a subretinal hyperreflective layer (HRL) was observed and quantified in RCS rats. After correlation with histology, the HRL was identified as disorganized outer segments and the location of accumulated debris.

Conclusions

Retinal layer thickness can be quantified longitudinally throughout the course of retinal degeneration in the RCS rat by using SD-OCT. Thickness measurements obtained with SD-OCT were consistent with previous anatomic thickness assessments. This study provides baseline data for future longitudinal assessment of therapeutic agents in the RCS rat.

Automatic segmentation of nine retinal layer boundaries in OCT images of non-exudative AMD patients using deep learning and graph search

We present a novel framework combining convolutional neural networks (CNN) and graph search methods (termed as CNN-GS) for the automatic segmentation of nine layer boundaries on retinal optical coherence tomography (OCT) images. CNN-GS first utilizes a CNN to extract features of specific retinal layer boundaries and train a corresponding classifier to delineate a pilot estimate of the eight layers. Next, a graph search method uses the probability maps created from the CNN to find the final boundaries. We validated our proposed method on 60 volumes (2915 B-scans) from 20 human eyes with non-exudative age-related macular degeneration (AMD), which attested to effectiveness of our proposed technique.