1
|
CTS-Net: A Segmentation Network for Glaucoma Optical Coherence Tomography Retinal Layer Images. Bioengineering (Basel) 2023; 10:bioengineering10020230. [PMID: 36829724 PMCID: PMC9952657 DOI: 10.3390/bioengineering10020230] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Revised: 01/29/2023] [Accepted: 02/04/2023] [Indexed: 02/11/2023] Open
Abstract
Optical Coherence Tomography (OCT) technology is essential to obtain glaucoma diagnostic data non-invasively and rapidly. Early diagnosis of glaucoma can be achieved by analyzing the thickness and shape of retinal layers. Accurate retinal layer segmentation assists ophthalmologists in improving the efficiency of disease diagnosis. Deep learning technology is one of the most effective methods for processing OCT retinal layer images, which can segment different retinal layers and effectively obtain the topological structure of the boundary. This paper proposes a neural network method for retinal layer segmentation based on the CSWin Transformer (CTS-Net), which can achieve pixel-level segmentation and obtain smooth boundaries. A Dice loss function based on boundary areas (BADice Loss) is proposed to make CTS-Net learn more features of edge regions and improve the accuracy of boundary segmentation. We applied the model to the publicly available dataset of glaucoma retina, and the test results showed that mean absolute distance (MAD), root mean square error (RMSE), and dice-similarity coefficient (DSC) metrics were 1.79 pixels, 2.15 pixels, and 92.79%, respectively, which are better than those of the compared model. In the cross-validation experiment, the ranges of MAD, RMSE, and DSC are 0.05 pixels, 0.03 pixels, and 0.33%, respectively, with a slight difference, which further verifies the generalization ability of CTS-Net.
Collapse
|
2
|
Past, present and future role of retinal imaging in neurodegenerative disease. Prog Retin Eye Res 2021; 83:100938. [PMID: 33460813 PMCID: PMC8280255 DOI: 10.1016/j.preteyeres.2020.100938] [Citation(s) in RCA: 67] [Impact Index Per Article: 16.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Revised: 12/11/2020] [Accepted: 12/17/2020] [Indexed: 02/08/2023]
Abstract
Retinal imaging technology is rapidly advancing and can provide ever-increasing amounts of information about the structure, function and molecular composition of retinal tissue in humans in vivo. Most importantly, this information can be obtained rapidly, non-invasively and in many cases using Food and Drug Administration-approved devices that are commercially available. Technologies such as optical coherence tomography have dramatically changed our understanding of retinal disease and in many cases have significantly improved their clinical management. Since the retina is an extension of the brain and shares a common embryological origin with the central nervous system, there has also been intense interest in leveraging the expanding armamentarium of retinal imaging technology to understand, diagnose and monitor neurological diseases. This is particularly appealing because of the high spatial resolution, relatively low-cost and wide availability of retinal imaging modalities such as fundus photography or OCT compared to brain imaging modalities such as magnetic resonance imaging or positron emission tomography. The purpose of this article is to review and synthesize current research about retinal imaging in neurodegenerative disease by providing examples from the literature and elaborating on limitations, challenges and future directions. We begin by providing a general background of the most relevant retinal imaging modalities to ensure that the reader has a foundation on which to understand the clinical studies that are subsequently discussed. We then review the application and results of retinal imaging methodologies to several prevalent neurodegenerative diseases where extensive work has been done including sporadic late onset Alzheimer's Disease, Parkinson's Disease and Huntington's Disease. We also discuss Autosomal Dominant Alzheimer's Disease and cerebrovascular small vessel disease, where the application of retinal imaging holds promise but data is currently scarce. Although cerebrovascular disease is not generally considered a neurodegenerative process, it is both a confounder and contributor to neurodegenerative disease processes that requires more attention. Finally, we discuss ongoing efforts to overcome the limitations in the field and unmet clinical and scientific needs.
Collapse
|
3
|
He Y, Carass A, Liu Y, Jedynak BM, Solomon SD, Saidha S, Calabresi PA, Prince JL. Structured layer surface segmentation for retina OCT using fully convolutional regression networks. Med Image Anal 2021; 68:101856. [PMID: 33260113 PMCID: PMC7855873 DOI: 10.1016/j.media.2020.101856] [Citation(s) in RCA: 44] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2020] [Revised: 08/27/2020] [Accepted: 09/14/2020] [Indexed: 12/18/2022]
Abstract
Optical coherence tomography (OCT) is a noninvasive imaging modality with micrometer resolution which has been widely used for scanning the retina. Retinal layers are important biomarkers for many diseases. Accurate automated algorithms for segmenting smooth continuous layer surfaces with correct hierarchy (topology) are important for automated retinal thickness and surface shape analysis. State-of-the-art methods typically use a two step process. Firstly, a trained classifier is used to label each pixel into either background and layers or boundaries and non-boundaries. Secondly, the desired smooth surfaces with the correct topology are extracted by graph methods (e.g., graph cut). Data driven methods like deep networks have shown great ability for the pixel classification step, but to date have not been able to extract structured smooth continuous surfaces with topological constraints in the second step. In this paper, we combine these two steps into a unified deep learning framework by directly modeling the distribution of the surface positions. Smooth, continuous, and topologically correct surfaces are obtained in a single feed forward operation. The proposed method was evaluated on two publicly available data sets of healthy controls and subjects with either multiple sclerosis or diabetic macular edema, and is shown to achieve state-of-the art performance with sub-pixel accuracy.
Collapse
Affiliation(s)
- Yufan He
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218, USA.
| | - Aaron Carass
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218, USA; Department of Computer Science, The Johns Hopkins University, Baltimore, MD 21218, USA
| | - Yihao Liu
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218, USA
| | - Bruno M Jedynak
- Department of Mathematics & Statistics, Portland State University, Portland, OR 97201, USA
| | - Sharon D Solomon
- Wilmer Eye Institute, The Johns Hopkins University School of Medicine, MD 21287, USA
| | - Shiv Saidha
- Department of Neurology, The Johns Hopkins University School of Medicine, MD 21287, USA
| | - Peter A Calabresi
- Department of Neurology, The Johns Hopkins University School of Medicine, MD 21287, USA
| | - Jerry L Prince
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218, USA; Department of Computer Science, The Johns Hopkins University, Baltimore, MD 21218, USA
| |
Collapse
|
4
|
Khansari MM, Zhang J, Qiao Y, Gahm JK, Sarabi MS, Kashani AH, Shi Y. Automated Deformation-Based Analysis of 3D Optical Coherence Tomography in Diabetic Retinopathy. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:236-245. [PMID: 31247547 PMCID: PMC6928449 DOI: 10.1109/tmi.2019.2924452] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
Diabetic retinopathy (DR) is a significant microvascular complication of diabetes mellitus and a leading cause of vision impairment in working age adults. Optical coherence tomography (OCT) is a routinely used clinical tool to observe retinal structural and thickness alterations in DR. Pathological changes that alter the normal anatomy of the retina, such as intraretinal edema, pose great challenges for conventional layer-based analysis of OCT images. We present an alternative approach for the automated analysis of OCT volumes in DR research based on nonlinear registration. In this paper, we first obtain an anatomically consistent volume of interest (VOI) in different OCT images via carefully designed masking and affine registration. After that, efficient B-spline transformations are computed using stochastic gradient descent optimization. Using the OCT volumes of normal controls, for which layer-based segmentation works well, we demonstrate the accuracy of our registration-based analysis in aligning layer boundaries. By nonlinearly registering the OCT volumes of DR subjects to an atlas constructed from normal controls and measuring the Jacobian determinant of the deformation, we can simultaneously visualize tissue contraction and expansion due to DR pathology. Tensor-based morphometry (TBM) can also be performed for quantitative analysis of local structural changes. In our experimental results, we apply our method to a dataset of 105 subjects and demonstrate that volumetric OCT registration and TBM analysis can successfully detect local retinal structural alterations due to DR.
Collapse
Affiliation(s)
- Maziyar M. Khansari
- USC Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of University of Southern California, Los Angeles, CA, US; USC Roski Eye Institute, Department of Ophthalmology, Keck School of Medicine of University of Southern California, Los Angeles, CA, US
| | - Jiong Zhang
- USC Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of University of Southern California, Los Angeles, CA, US; USC Roski Eye Institute, Department of Ophthalmology, Keck School of Medicine of University of Southern California, Los Angeles, CA, US
| | - Yuchuan Qiao
- USC Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of University of Southern California, Los Angeles, CA, US
| | - Jin Kyu Gahm
- USC Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of University of Southern California, Los Angeles, CA, US
| | - Mona Sharifi Sarabi
- USC Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of University of Southern California, Los Angeles, CA, US
| | - Amir H. Kashani
- USC Roski Eye Institute, Department of Ophthalmology, Keck School of Medicine of University of Southern California, Los Angeles, CA, US
| | - Yonggang Shi
- USC Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of University of Southern California, Los Angeles, CA, US
| |
Collapse
|
5
|
Chen M, Gee JC, Prince JL, Aguirre GK. 2D Modeling and Correction of Fan-beam Scan Geometry in OCT. COMPUTATIONAL PATHOLOGY AND OPHTHALMIC MEDICAL IMAGE ANALYSIS : FIRST INTERNATIONAL WORKSHOP, COMPAY 2018, AND 5TH INTERNATIONAL WORKSHOP, OMIA 2018, HELD IN CONJUNCTION WITH MICCAI 2018, GRANADA, SPAIN, SEPTEMBER 16-20, 2018, PROCEEDIN... 2018; 11039:328-335. [PMID: 31131377 DOI: 10.1007/978-3-030-00949-6_39] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Abstract
A-scan acquisitions in OCT images are acquired in a fan-beam pattern, but saved and displayed in a rectangular space. This results in an inaccurate representation of the scan geometry of OCT images, which introduces systematic distortions that can greatly impact shape and morphology based analysis of the retina. Correction of OCT scan geometry has proven to be a challenging task due to a lack of information regarding the true angle of entry of each A-scan through the pupil and the location of the A-scan nodal points. In this work, we present a preliminary model that solves for the OCT scan geometry in a restricted 2D setting. Our approach uses two repeat scans with corresponding landmarks to estimate the necessary parameters to correctly restore the fan-beam geometry of the input B-scans. Our results show accurate estimation of the ground truth geometry from simulated B-scans, and we found qualitatively promising result when the correction was applied to longitudinal B-scans of the same subject. We establish a robust 2D framework that can potentially be expanded for full 3D estimation and correction of OCT scan geometries.
Collapse
Affiliation(s)
- Min Chen
- Department of Radiology, University of Pennsylvania, Philadelphia PA 19104, USA
| | - James C Gee
- Department of Radiology, University of Pennsylvania, Philadelphia PA 19104, USA
| | - Jerry L Prince
- Department of ECE, Johns Hopkins University, Baltimore M D 21218, USA
| | - Geoffrey K Aguirre
- Department of Neurology, University of Pennsylvania, Philadelphia PA 19104, USA
| |
Collapse
|
6
|
Lang A, Carass A, Jedynak BM, Solomon SD, Calabresi PA, Prince JL. Intensity inhomogeneity correction of SD-OCT data using macular flatspace. Med Image Anal 2018; 43:85-97. [PMID: 29040910 PMCID: PMC6311386 DOI: 10.1016/j.media.2017.09.008] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2017] [Revised: 09/25/2017] [Accepted: 09/29/2017] [Indexed: 01/12/2023]
Abstract
Images of the retina acquired using optical coherence tomography (OCT) often suffer from intensity inhomogeneity problems that degrade both the quality of the images and the performance of automated algorithms utilized to measure structural changes. This intensity variation has many causes, including off-axis acquisition, signal attenuation, multi-frame averaging, and vignetting, making it difficult to correct the data in a fundamental way. This paper presents a method for inhomogeneity correction by acting to reduce the variability of intensities within each layer. In particular, the N3 algorithm, which is popular in neuroimage analysis, is adapted to work for OCT data. N3 works by sharpening the intensity histogram, which reduces the variation of intensities within different classes. To apply it here, the data are first converted to a standardized space called macular flat space (MFS). MFS allows the intensities within each layer to be more easily normalized by removing the natural curvature of the retina. N3 is then run on the MFS data using a modified smoothing model, which improves the efficiency of the original algorithm. We show that our method more accurately corrects gain fields on synthetic OCT data when compared to running N3 on non-flattened data. It also reduces the overall variability of the intensities within each layer, without sacrificing contrast between layers, and improves the performance of registration between OCT images.
Collapse
Affiliation(s)
- Andrew Lang
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218, USA.
| | - Aaron Carass
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218, USA; Department of Computer Science, The Johns Hopkins University, Baltimore, MD 21218, USA.
| | - Bruno M Jedynak
- Department of Mathematics and Statistics, Portland State University, Portland, OR 97201, USA.
| | - Sharon D Solomon
- Department of Ophthalmology, The Johns Hopkins School of Medicine, Baltimore, MD 21287, USA.
| | - Peter A Calabresi
- Department of Neurology, The Johns Hopkins School of Medicine, Baltimore, MD 21287, USA.
| | - Jerry L Prince
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218, USA.
| |
Collapse
|
7
|
Lee S, Heisler ML, Popuri K, Charon N, Charlier B, Trouvé A, Mackenzie PJ, Sarunic MV, Beg MF. Age and Glaucoma-Related Characteristics in Retinal Nerve Fiber Layer and Choroid: Localized Morphometrics and Visualization Using Functional Shapes Registration. Front Neurosci 2017; 11:381. [PMID: 28747871 PMCID: PMC5506345 DOI: 10.3389/fnins.2017.00381] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2017] [Accepted: 06/19/2017] [Indexed: 11/13/2022] Open
Abstract
Optical coherence tomography provides high-resolution 3D imaging of the posterior segment of the eye. However, quantitative morphological analysis, particularly relevant in retinal degenerative diseases such as glaucoma, has been confined to simple sectorization and averaging with limited spatial sensitivity for detection of clinical markers. In this paper, we present point-wise analysis and visualization of the retinal nerve fiber layer and choroid from cross-sectional data using functional shapes (fshape) registration. The fshape framework matches two retinas, or generates a mean of multiple retinas, by jointly optimizing the surface geometry and functional signals mapped on the surface. We generated group-wise mean retinal nerve fiber layer and choroidal surfaces with the respective layer thickness mapping and showed the difference by age (normal, younger vs. older) and by disease (age-matched older, normal vs. glaucomatous) in the two layers, along with a more conventional sector-based analysis for comparison. The fshape results visualized the detailed spatial patterns of the differences between the age-matched normal and glaucomatous retinal nerve fiber layers, with the glaucomatous layers most significantly thinner in the inferior region close to Bruch's membrane opening. Between the young and older normal cases, choroid was shown to be significantly thinner in the older subjects across all regions, but particularly in the nasal and inferior regions. The results demonstrate a comprehensive and detailed analysis with visualization of morphometric patterns by multiple factors.
Collapse
Affiliation(s)
- Sieun Lee
- Faculty of Applied Sciences, School of Engineering Science, Simon Fraser UniversityBurnaby, BC, Canada
| | - Morgan L Heisler
- Faculty of Applied Sciences, School of Engineering Science, Simon Fraser UniversityBurnaby, BC, Canada
| | - Karteek Popuri
- Faculty of Applied Sciences, School of Engineering Science, Simon Fraser UniversityBurnaby, BC, Canada
| | - Nicolas Charon
- Center for Imaging Sciences, Johns Hopkins UniversityBaltimore, MD, United States
| | - Benjamin Charlier
- Institut Montpelliérain Alexander Grothendieck, CNRS, Université de MontpellierMontpellier, France
| | - Alain Trouvé
- CMLA, ENS Cachan, Centre National de la Recherche Scientifique, Université Paris-SaclayCachan, France
| | - Paul J Mackenzie
- Department of Ophthalmology and Visual Sciences, Faculty of Medicine, University of British ColumbiaVancouver, BC, Canada
| | - Marinko V Sarunic
- Faculty of Applied Sciences, School of Engineering Science, Simon Fraser UniversityBurnaby, BC, Canada
| | - Mirza Faisal Beg
- Faculty of Applied Sciences, School of Engineering Science, Simon Fraser UniversityBurnaby, BC, Canada
| |
Collapse
|