51
|
Ishibashi F, Tavakoli M. Thinning of Macular Neuroretinal Layers Contributes to Sleep Disorder in Patients With Type 2 Diabetes Without Clinical Evidences of Neuropathy and Retinopathy. Front Endocrinol (Lausanne) 2020; 11:69. [PMID: 32184758 PMCID: PMC7058995 DOI: 10.3389/fendo.2020.00069] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/17/2019] [Accepted: 02/03/2020] [Indexed: 12/15/2022] Open
Abstract
Aims: To investigate the impact of thinning at individual grids of macular neuroretinal layers, clinical factors, and inadequate light exposure on the specific components of sleep disorder in patients with type 2 diabetes. Methods: One hundred twenty-four patients with type 2 diabetes without clinical evidences of diabetic retinopathy and neuropathy (HbA1c: 8.3%, diabetes duration; 8.7 years) and 54 age- and sex-matched control subjects (HbA1c: 5.6%) underwent detailed clinical, neurological, and ophthalmological examinations. The sleep disorder was assessed by the Pittsburgh Sleep Quality Index Japanese Version (PSQI-J). The temporal structures of daily life were assessed by the Munich Chronotype Questionnaire Japanese Version. The thickness at nine grids defined by the Early Treatment Diabetic Retinopathy Study of nine macular neuroretinal layers was determined by swept-source optical coherence tomography and OCT-Explorer. The associations between the individual components of sleep disorders and the thickness at each grid of macular neuroretinal layers, clinical factors, or the temporal structures of daily life were examined. Results: The prevalence of the sleep disorder, global score, and four individual PSQI-J scores in patients with type 2 diabetes were higher than control subjects. The thickness of two and five grids of two inner retinal layers and four to seven grids of four outer retinal layers in patients with type 2 diabetes was thinner than those in control subjects. The thickness at one to eight grids of four outer retinal layers in type 2 diabetic patients was inversely associated with global score and five individual scores of sleep disorder. The thinning at one to two grids of the inner plexiform layer was related to three high individual scores of sleep disorder. The inappropriate light exposure was associated with the sleep disorder and altered macular neuroretinal layers. The high HbA1c and LDL-cholesterol levels were related to the high global score and two individual scores of sleep disorder, respectively. Conclusion: In patients with type 2 diabetes, the thinning at grids of the inner plexiform layer and outer retinal layers was associated with the high scores of specific components of the sleep disorder. The sleep disorder was also related to hyperglycemia, dyslipidemia, and inappropriate light exposure.
Collapse
Affiliation(s)
| | - Mitra Tavakoli
- University of Exeter Medical School, Exeter, United Kingdom
- *Correspondence: Mitra Tavakoli
| |
Collapse
|
52
|
Brücher VC, Heiduschka P, Grenzebach U, Eter N, Biermann J. Distribution of macular ganglion cell layer thickness in foveal hypoplasia: A new diagnostic criterion for ocular albinism. PLoS One 2019; 14:e0224410. [PMID: 31738774 PMCID: PMC6860421 DOI: 10.1371/journal.pone.0224410] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2019] [Accepted: 10/11/2019] [Indexed: 02/06/2023] Open
Abstract
Background/Aims To analyse the distribution of macular ganglion cell layer thickness (GCLT) in patients with foveal hypoplasia (FH) with or without albinism to obtain new insights into visual pathway anomalies in albinos. Methods Patients with FH who presented at our institution between 2013 and 2018 were retrospectively drawn for analysis. Mean GCLT was calculated after automated segmentation of spectral domain-optical coherence tomography (SD-OCT) scans. Patients with FH due to albinism (n = 13, termed ‘albinism FH’) or other kinds (n = 10, termed ‘non-albinism FH’) were compared with control subjects (n = 15). The areas: fovea (central), parafovea (nasal I, temporal I) and perifovea (nasal II, temporal II) along the horizontal meridian were of particular interest. Primary endpoints of this study were the ratios (GCLT-I- and GCLT-II-Quotient) between the GCLT measured in the temporal I or II and nasal I or II areas. Results There was a significant difference between the GCLT-I-Quotient of healthy controls and albinism FH (p<0.001), as well as between non-albinism FH and albinism FH (p = 0.004). GCLT-II-Quotient showed significant differences between healthy controls and albinism FH (p<0.001) and between non-albinism FH and albinism FH (p = 0.006). The best measure for distinguishing between non-albinism FH and albinism FH was the calculation of GCLT-II-Quotient (area temporal II divided by area nasal II), indicating albinism at a cut-off of <0.7169. The estimated specificity and sensitivity for this cut-off were 84.6% and 100.0%, respectively. The estimated area under the curve (AUC) was 0.892 [95%CI: 0.743–1.000, p = 0.002]. Conclusion Macular GCLT-distribution showed a characteristic temporal to central shift in patients with FH due to albinism. Calculation of the GCLT-II-Quotient at a cut-off of <0.7169 presents a new diagnostic criterion for identification of ocular albinism.
Collapse
Affiliation(s)
- Viktoria C. Brücher
- Dept. of Ophthalmology, University of Muenster Medical Centre, Muenster, Germany
| | - Peter Heiduschka
- Dept. of Ophthalmology, University of Muenster Medical Centre, Muenster, Germany
| | - Ulrike Grenzebach
- Dept. of Ophthalmology, University of Muenster Medical Centre, Muenster, Germany
| | - Nicole Eter
- Dept. of Ophthalmology, University of Muenster Medical Centre, Muenster, Germany
| | - Julia Biermann
- Dept. of Ophthalmology, University of Muenster Medical Centre, Muenster, Germany
- * E-mail:
| |
Collapse
|
53
|
Zang P, Wang J, Hormel TT, Liu L, Huang D, Jia Y. Automated segmentation of peripapillary retinal boundaries in OCT combining a convolutional neural network and a multi-weights graph search. BIOMEDICAL OPTICS EXPRESS 2019; 10:4340-4352. [PMID: 31453015 PMCID: PMC6701529 DOI: 10.1364/boe.10.004340] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/29/2019] [Revised: 07/05/2019] [Accepted: 07/10/2019] [Indexed: 05/16/2023]
Abstract
Quantitative analysis of the peripapillary retinal layers and capillary plexuses from optical coherence tomography (OCT) and OCT angiography images depend on two segmentation tasks - delineating the boundary of the optic disc and delineating the boundaries between retinal layers. Here, we present a method combining a neural network and graph search to perform these two tasks. A comparison of this novel method's segmentation of the disc boundary showed good agreement with the ground truth, achieving an overall Dice similarity coefficient of 0.91 ± 0.04 in healthy and glaucomatous eyes. The absolute error of retinal layer boundaries segmentation in the same cases was 4.10 ± 1.25 µm.
Collapse
Affiliation(s)
- Pengxiao Zang
- Casey Eye Institute, Oregon Health & Science University, Portland, OR 97239, USA
| | - Jie Wang
- Casey Eye Institute, Oregon Health & Science University, Portland, OR 97239, USA
| | - Tristan T. Hormel
- Casey Eye Institute, Oregon Health & Science University, Portland, OR 97239, USA
| | - Liang Liu
- Casey Eye Institute, Oregon Health & Science University, Portland, OR 97239, USA
| | - David Huang
- Casey Eye Institute, Oregon Health & Science University, Portland, OR 97239, USA
| | - Yali Jia
- Casey Eye Institute, Oregon Health & Science University, Portland, OR 97239, USA
| |
Collapse
|
54
|
Petersen J, Arias-Lorza AM, Selvan R, Bos D, van der Lugt A, Pedersen JH, Nielsen M, de Bruijne M. Increasing Accuracy of Optimal Surfaces Using Min-Marginal Energies. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:1559-1568. [PMID: 30605096 DOI: 10.1109/tmi.2018.2890386] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Optimal surface methods are a class of graph cut methods posing surface estimation as an n-ary ordered labeling problem. They are used in medical imaging to find interacting and layered surfaces optimally and in low order polynomial time. Representing continuous surfaces with discrete sets of labels, however, leads to discretization errors and, if graph representations are made dense, excessive memory usage. Limiting memory usage and computation time of graph cut methods are important and graphs that locally adapt to the problem has been proposed as a solution. Min-marginal energies computed using dynamic graph cuts offer a way to estimate solution uncertainty and these uncertainties have been used to decide where graphs should be adapted. Adaptive graphs, however, introduce extra parameters, complexity, and heuristics. We propose a way to use min-marginal energies to estimate continuous solution labels that does not introduce extra parameters and show empirically on synthetic and medical imaging datasets that it leads to improved accuracy. The increase in accuracy was consistent and in many cases comparable with accuracy otherwise obtained with graphs up to eight times denser, but with proportionally less memory usage and improvements in computation time.
Collapse
|
55
|
Kepp T, Droigk C, Casper M, Evers M, Hüttmann G, Salma N, Manstein D, Heinrich MP, Handels H. Segmentation of mouse skin layers in optical coherence tomography image data using deep convolutional neural networks. BIOMEDICAL OPTICS EXPRESS 2019; 10:3484-3496. [PMID: 31467791 PMCID: PMC6706029 DOI: 10.1364/boe.10.003484] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/22/2019] [Revised: 05/24/2019] [Accepted: 05/24/2019] [Indexed: 05/22/2023]
Abstract
Optical coherence tomography (OCT) enables the non-invasive acquisition of high-resolution three-dimensional cross-sectional images at micrometer scale and is mainly used in the field of ophthalmology for diagnosis as well as monitoring of eye diseases. Also in other areas, such as dermatology, OCT is already well established. Due to its non-invasive nature, OCT is also employed for research studies involving animal models. Manual evaluation of OCT images of animal models is a challenging task due to the lack of imaging standards and the varying anatomy among models. In this paper, we present a deep learning algorithm for the automatic segmentation of several layers of mouse skin in OCT image data using a deep convolutional neural network (CNN). The architecture of our CNN is based on the U-net and is modified by densely connected convolutions. We compared our adapted CNN with our previous algorithm, a combination of a random forest classification and a graph-based refinement, and a baseline U-net. The results showed that, on average, our proposed CNN outperformed our previous algorithm and the baseline U-net. In addition, a reduction of outliers could be observed through the use of densely connected convolutions.
Collapse
Affiliation(s)
- Timo Kepp
- Institute of Medical Informatics, University of Lübeck, Lübeck,
Germany
- Graduate School for Computing in Medicine and Life Sciences, University of Lübeck, Lübeck,
Germany
| | - Christine Droigk
- Institute for Signal Processing, University of Lübeck, Lübeck,
Germany
| | - Malte Casper
- Institute of Biomedical Optics, University of Lübeck, Lübeck,
Germany
- Cutaneous Biology Research Center, Massachusetts General Hospital, Boston,
USA
| | - Michael Evers
- Institute of Biomedical Optics, University of Lübeck, Lübeck,
Germany
- Cutaneous Biology Research Center, Massachusetts General Hospital, Boston,
USA
| | - Gereon Hüttmann
- Institute of Biomedical Optics, University of Lübeck, Lübeck,
Germany
| | - Nunciada Salma
- Cutaneous Biology Research Center, Massachusetts General Hospital, Boston,
USA
| | - Dieter Manstein
- Cutaneous Biology Research Center, Massachusetts General Hospital, Boston,
USA
| | | | - Heinz Handels
- Institute of Medical Informatics, University of Lübeck, Lübeck,
Germany
| |
Collapse
|
56
|
Verticchio Vercellin AC, Jassim F, Poon LYC, Tsikata E, Braaf B, Shah S, Ben-David G, Shieh E, Lee R, Simavli H, Que CJ, Papadogeorgou G, Guo R, Vakoc BJ, Bouma BE, de Boer JF, Chen TC. Diagnostic Capability of Three-Dimensional Macular Parameters for Glaucoma Using Optical Coherence Tomography Volume Scans. Invest Ophthalmol Vis Sci 2019; 59:4998-5010. [PMID: 30326067 PMCID: PMC6188465 DOI: 10.1167/iovs.18-23813] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Purpose To compare the diagnostic capability of three-dimensional (3D) macular parameters against traditional two-dimensional (2D) retinal nerve fiber layer (RNFL) thickness using spectral domain optical coherence tomography. To determine if manual correction and interpolation of B-scans improve the ability of 3D macular parameters to diagnose glaucoma. Methods A total of 101 open angle glaucoma patients (29 with early glaucoma) and 57 healthy subjects had peripapillary 2D RNFL thickness and 3D macular volume scans. Four parameters were calculated for six different-sized annuli: total macular thickness (M-thickness), total macular volume (M-volume), ganglion cell complex (GCC) thickness, and GCC volume of the innermost 3 macular layers (retinal nerve fiber layer + ganglion cell layer + inner plexiform layer). All macular parameters were calculated with and without correction and interpolation of frames with artifacts. The areas under the receiver operating characteristic curves (AUROC) were calculated for all the parameters. Results The 3D macular parameter with the best diagnostic performance was GCC-volume-34, with an inner diameter of 3 mm and an outer of 4 mm. The AUROC for RNFL thickness and GCC-volume-34 were statistically similar for all regions (global: RNFL thickness 0.956, GCC-volume-34 0.939, P value = 0.3827), except for the temporal GCC-volume-34, which was significantly better than temporal RNFL thickness (P value = 0.0067). Correction of artifacts did not significantly change the AUROC of macular parameters (P values between 0.8452 and 1.0000). Conclusions The diagnostic performance of best macular parameters (GCC-volume-34 and GCC-thickness-34) were similar to or better than 2D RNFL thickness. Manual correction of artifacts with data interpolation is unnecessary in the clinical setting.
Collapse
Affiliation(s)
- Alice C Verticchio Vercellin
- University Eye Clinic, Istituto di Ricovero e Cura a Carattere Scientifico (IRCCS), Policlinico San Matteo, Pavia, Italy.,IRCCS-Fondazione Bietti, Rome, Italy.,Massachusetts Eye and Ear Infirmary, Department of Ophthalmology, Glaucoma Service, Boston, Massachusetts, United States.,Harvard Medical School, Boston, Massachusetts, United States
| | - Firas Jassim
- Massachusetts Eye and Ear Infirmary, Department of Ophthalmology, Glaucoma Service, Boston, Massachusetts, United States.,Harvard Medical School, Boston, Massachusetts, United States
| | - Linda Yi-Chieh Poon
- Massachusetts Eye and Ear Infirmary, Department of Ophthalmology, Glaucoma Service, Boston, Massachusetts, United States.,Harvard Medical School, Boston, Massachusetts, United States.,Kaohsiung Chang Gung Memorial Hospital, Chang Gung University College of Medicine, Department of Ophthalmology, Kaohsiung, Taiwan
| | - Edem Tsikata
- Massachusetts Eye and Ear Infirmary, Department of Ophthalmology, Glaucoma Service, Boston, Massachusetts, United States.,Harvard Medical School, Boston, Massachusetts, United States
| | - Boy Braaf
- Harvard Medical School, Boston, Massachusetts, United States.,Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, Massachusetts, United States
| | - Sneha Shah
- Massachusetts Eye and Ear Infirmary, Department of Ophthalmology, Glaucoma Service, Boston, Massachusetts, United States.,Johns Hopkins School of Medicine, Baltimore, Maryland, United States
| | - Geulah Ben-David
- Massachusetts Eye and Ear Infirmary, Department of Ophthalmology, Glaucoma Service, Boston, Massachusetts, United States.,Harvard Medical School, Boston, Massachusetts, United States.,Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Eric Shieh
- Massachusetts Eye and Ear Infirmary, Department of Ophthalmology, Glaucoma Service, Boston, Massachusetts, United States.,Harvard Medical School, Boston, Massachusetts, United States.,Jules Stein Eye Institute, David Geffen School of Medicine, University of California, Los Angeles, California, United States
| | - Ramon Lee
- Massachusetts Eye and Ear Infirmary, Department of Ophthalmology, Glaucoma Service, Boston, Massachusetts, United States.,Harvard Medical School, Boston, Massachusetts, United States.,University of Southern California Roski Eye Institute, Department of Ophthalmology, Keck School of Medicine, Los Angeles, California, United States
| | - Huseyin Simavli
- Massachusetts Eye and Ear Infirmary, Department of Ophthalmology, Glaucoma Service, Boston, Massachusetts, United States.,Harvard Medical School, Boston, Massachusetts, United States.,Kudret Eye Hospital, Kadikoy, Istanbul, Turkey
| | - Christian J Que
- Massachusetts Eye and Ear Infirmary, Department of Ophthalmology, Glaucoma Service, Boston, Massachusetts, United States.,Harvard Medical School, Boston, Massachusetts, United States.,University of the East Ramon Magsaysay Memorial Medical Center, Quezon City, Philippines.,Romblon Provincial Hospital, Liwanag, Odiongan, Romblon, Philippines
| | - Georgia Papadogeorgou
- Harvard School of Public Health, Department of Biostatistics, Boston, Massachusetts, United States
| | - Rong Guo
- Harvard Medical School, Boston, Massachusetts, United States.,University of California, Los Angeles, Department of Internal Medicine, Los Angeles, California, United States
| | - Benjamin J Vakoc
- Harvard Medical School, Boston, Massachusetts, United States.,Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, Massachusetts, United States
| | - Brett E Bouma
- Harvard Medical School, Boston, Massachusetts, United States.,Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, Massachusetts, United States
| | - Johannes F de Boer
- LaserLaB Amsterdam, Department of Physics and Astronomy, Vrije Universiteit, The Netherlands.,Department of Ophthalmology, VU Medical Center, The Netherlands
| | - Teresa C Chen
- Massachusetts Eye and Ear Infirmary, Department of Ophthalmology, Glaucoma Service, Boston, Massachusetts, United States.,Harvard Medical School, Boston, Massachusetts, United States
| |
Collapse
|
57
|
Liaskos M, Asvestas PA, Matsopoulos GK, Charonis A, Anastassopoulos V. Detection of retinal pigment epithelium detachment from OCT images using multiscale Gaussian filtering. Technol Health Care 2019; 27:301-316. [PMID: 30829626 DOI: 10.3233/thc-181501] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Macular diseases, including neovascular age-related macular degeneration (nvAMD), are leading causes of irreversible blindness and visual impairment. One prominent feature of nvAMD is the detachment of the retinal pigment epithelium. The aim of this study is to implement an automated method for the segmentation of the pigment epithelial detachment (PED) using optical coherence tomography (OCT). OCT datasets from 8 patients with nvAMD were acquired during multiple sessions. At each session, 17 images with a resolution of 1020 × 640 pixels were obtained. The images were segmented using Gaussian filtering and template matching for the detection of the upper and lower border of the PED, respectively. The results of the method were compared with the ones obtained from the manual segmentation of the images by an expert. Four well-known metrics were used to evaluate the performance of the method with respect to the manual segmentation, resulting in high scores of consistency. Furthermore, the proposed method was also compared with four other well-known methods providing similar or superior performance.
Collapse
Affiliation(s)
- Meletios Liaskos
- Physics Department, University of Patras, Patras, Greece.,School of Electrical and Computer Engineering, National Technical University of Athens, Athens, Greece
| | - Pantelis A Asvestas
- Department of Biomedical Engineering, University of West Attica, Athens, Greece
| | - George K Matsopoulos
- School of Electrical and Computer Engineering, National Technical University of Athens, Athens, Greece
| | | | | |
Collapse
|
58
|
Masood S, Fang R, Li P, Li H, Sheng B, Mathavan A, Wang X, Yang P, Wu Q, Qin J, Jia W. Automatic Choroid Layer Segmentation from Optical Coherence Tomography Images Using Deep Learning. Sci Rep 2019; 9:3058. [PMID: 30816296 PMCID: PMC6395677 DOI: 10.1038/s41598-019-39795-x] [Citation(s) in RCA: 45] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2018] [Accepted: 01/21/2019] [Indexed: 01/03/2023] Open
Abstract
The choroid layer is a vascular layer in human retina and its main function is to provide oxygen and support to the retina. Various studies have shown that the thickness of the choroid layer is correlated with the diagnosis of several ophthalmic diseases. For example, diabetic macular edema (DME) is a leading cause of vision loss in patients with diabetes. Despite contemporary advances, automatic segmentation of the choroid layer remains a challenging task due to low contrast, inhomogeneous intensity, inconsistent texture and ambiguous boundaries between the choroid and sclera in Optical Coherence Tomography (OCT) images. The majority of currently implemented methods manually or semi-automatically segment out the region of interest. While many fully automatic methods exist in the context of choroid layer segmentation, more effective and accurate automatic methods are required in order to employ these methods in the clinical sector. This paper proposed and implemented an automatic method for choroid layer segmentation in OCT images using deep learning and a series of morphological operations. The aim of this research was to segment out Bruch's Membrane (BM) and choroid layer to calculate the thickness map. BM was segmented using a series of morphological operations, whereas the choroid layer was segmented using a deep learning approach as more image statistics were required to segment accurately. Several evaluation metrics were used to test and compare the proposed method against other existing methodologies. Experimental results showed that the proposed method greatly reduced the error rate when compared with the other state-of-the-art methods.
Collapse
Affiliation(s)
- Saleha Masood
- Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Ruogu Fang
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA
| | - Ping Li
- Faculty of Information Technology, Macau University of Science and Technology, Macau, 999078, China
| | - Huating Li
- Shanghai Jiao Tong University Affiliated Sixth People's Hospital, Shanghai, 200233, China
| | - Bin Sheng
- Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China.
| | - Akash Mathavan
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA
| | - Xiangning Wang
- Shanghai Jiao Tong University Affiliated Sixth People's Hospital, Shanghai, 200233, China
| | - Po Yang
- Department of Computer Science, Liverpool John Moores University, Liverpool, L3 3AF, UK
| | - Qiang Wu
- Shanghai Jiao Tong University Affiliated Sixth People's Hospital, Shanghai, 200233, China.
| | - Jing Qin
- Centre for Smart Health, School of Nursing, The Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Weiping Jia
- Shanghai Jiao Tong University Affiliated Sixth People's Hospital, Shanghai, 200233, China
| |
Collapse
|
59
|
Qi L, Zheng K, Li X, Feng Q, Chen Z, Chen W. Automatic three-dimensional segmentation of endoscopic airway OCT images. BIOMEDICAL OPTICS EXPRESS 2019; 10:642-656. [PMID: 30800505 PMCID: PMC6377898 DOI: 10.1364/boe.10.000642] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/13/2018] [Revised: 12/23/2018] [Accepted: 12/24/2018] [Indexed: 05/25/2023]
Abstract
Automatic delineation and segmentation of airway structures from endoscopic optical coherence tomography (OCT) images improve image analysis efficiency and thus has been of particular interest. Conventional two-dimensional automatic segmentation methods, such as the dynamic programming approach, ensures the edge-continuity in the xz-direction (intra-B-scan), but fails to preserve the surface-continuity when concerning the y-direction (inter-B-scan). To solve this, we present a novel automatic three-dimensional (3D) airway segmentation strategy. Our segmentation scheme includes an artifact-oriented pre-processing pipeline and a modified 3D optimal graph search algorithm incorporating adaptive tissue-curvature adjustment. The proposed algorithm is tested on endoscopic airway OCT image data sets acquired by different swept-source OCT platforms, and on different animal and human models. With our method, the results show continuous surface segmentation performance, which is both robust and accurate.
Collapse
Affiliation(s)
- Li Qi
- School of Biomedical Engineering and Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, 510515, China
| | - Kaibin Zheng
- School of Biomedical Engineering and Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, 510515, China
| | - Xipan Li
- School of Biomedical Engineering and Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, 510515, China
| | - Qianjin Feng
- School of Biomedical Engineering and Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, 510515, China
| | - Zhongping Chen
- Beckman Laser Institute, University of California, Irvine, Irvine, CA 92612, USA
- Department of Biomedical Engineering, University of California, Irvine, Irvine, CA 92612, USA
- Key Laboratory of Nondestructive Test (Ministry of Education), Nanchang Hangkong University, Nanchang, Jiangxi, 330063, China
| | - Wufan Chen
- School of Biomedical Engineering and Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, Guangdong, 510515, China
| |
Collapse
|
60
|
Wang C, Gan M, Yang N, Yang T, Zhang M, Nao S, Zhu J, Ge H, Wang L. Fast esophageal layer segmentation in OCT images of guinea pigs based on sparse Bayesian classification and graph search. BIOMEDICAL OPTICS EXPRESS 2019; 10:978-994. [PMID: 30800527 PMCID: PMC6377884 DOI: 10.1364/boe.10.000978] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2018] [Revised: 01/11/2019] [Accepted: 01/11/2019] [Indexed: 05/02/2023]
Abstract
Endoscopic optical coherence tomography (OCT) devices are capable of generating high-resolution images of esophageal structures at high speed. To make the obtained data easy to interpret and reveal the clinical significance, an automatic segmentation algorithm is needed. This work proposes a fast algorithm combining sparse Bayesian learning and graph search (termed as SBGS) to automatically identify six layer boundaries on esophageal OCT images. The SBGS first extracts features, including multi-scale gradients, averages and Gabor wavelet coefficients, to train the sparse Bayesian classifier, which is used to generate probability maps indicating boundary positions. Given these probability maps, the graph search method is employed to create the final continuous smooth boundaries. The segmentation performance of the proposed SBGS algorithm was verified by esophageal OCT images from healthy guinea pigs and the eosinophilic esophagitis (EoE) models. Experiments confirmed that the SBGS method is able to implement robust esophageal segmentation for all the tested cases. In addition, benefiting from the sparse model of SBGS, the segmentation efficiency is significantly improved compared to other widely used techniques.
Collapse
Affiliation(s)
- Cong Wang
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006,
China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163,
China
| | - Meng Gan
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163,
China
| | - Na Yang
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006,
China
| | - Ting Yang
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006,
China
| | - Miao Zhang
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006,
China
| | - Sihan Nao
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006,
China
| | - Jing Zhu
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006,
China
| | - Hongyu Ge
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006,
China
| | - Lirong Wang
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006,
China
| |
Collapse
|
61
|
Xiang D, Chen G, Shi F, Zhu W, Liu Q, Yuan S, Chen X. Automatic Retinal Layer Segmentation of OCT Images With Central Serous Retinopathy. IEEE J Biomed Health Inform 2019; 23:283-295. [DOI: 10.1109/jbhi.2018.2803063] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
62
|
Xiang D, Tian H, Yang X, Shi F, Zhu W, Chen H, Chen X. Automatic Segmentation of Retinal Layer in OCT Images With Choroidal Neovascularization. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2018; 27:5880-5891. [PMID: 30059302 DOI: 10.1109/tip.2018.2860255] [Citation(s) in RCA: 39] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
Age-related macular degeneration is one of the main causes of blindness. However, the internal structures of retinas are complex and difficult to be recognized due to the occurrence of neovascularization. Traditional surface detection methods may fail in the layer segmentation. In this paper, a supervised method is reported for simultaneously segmenting layers and neovascularization. Three spatial features, seven gray-level-based features, and 14 layer-like features are extracted for the neural network classifier. The coarse surfaces of different optical coherence tomography (OCT) images can thus be found. To describe and enhance retinal layers with different thicknesses and abnormalities, multi-scale bright and dark layer detection filters are introduced. A constrained graph search algorithm is also proposed to accurately detect retinal surfaces. The weights of nodes in the graph are computed based on these layer-like responses. The proposed method was evaluated on 42 spectral-domain OCT images with age-related macular degeneration. The experimental results show that the proposed method outperforms state-of-the-art methods.
Collapse
|
63
|
Yadav SK, Kadas EM, Motamedi S, Polthier K, Haußer F, Gawlik K, Paul F, Brandt A. Optic nerve head three-dimensional shape analysis. JOURNAL OF BIOMEDICAL OPTICS 2018; 23:1-13. [PMID: 30315645 DOI: 10.1117/1.jbo.23.10.106004] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2018] [Accepted: 08/06/2018] [Indexed: 06/08/2023]
Abstract
We present a method for optic nerve head (ONH) 3-D shape analysis from retinal optical coherence tomography (OCT). The possibility to noninvasively acquire in vivo high-resolution 3-D volumes of the ONH using spectral domain OCT drives the need to develop tools that quantify the shape of this structure and extract information for clinical applications. The presented method automatically generates a 3-D ONH model and then allows the computation of several 3-D parameters describing the ONH. The method starts with a high-resolution OCT volume scan as input. From this scan, the model-defining inner limiting membrane (ILM) as inner surface and the retinal pigment epithelium as outer surface are segmented, and the Bruch's membrane opening (BMO) as the model origin is detected. Based on the generated ONH model by triangulated 3-D surface reconstruction, different parameters (areas, volumes, annular surface ring, minimum distances) of different ONH regions can then be computed. Additionally, the bending energy (roughness) in the BMO region on the ILM surface and 3-D BMO-MRW surface area are computed. We show that our method is reliable and robust across a large variety of ONH topologies (specific to this structure) and present a first clinical application.
Collapse
Affiliation(s)
- Sunil Kumar Yadav
- Charité - Universitätsmedizin Berlin, NeuroCure Clinical Research Center, Corporate Member of Freie, Germany
- Charité - Universitätsmedizin, Experimental and Clinical Research Center, Max Delbrück Center for Mo, Germany
- Freie Universität Berlin, Mathematical Geometry Processing Group, Berlin, Germany
| | - Ella Maria Kadas
- Charité - Universitätsmedizin Berlin, NeuroCure Clinical Research Center, Corporate Member of Freie, Germany
- Charité - Universitätsmedizin, Experimental and Clinical Research Center, Max Delbrück Center for Mo, Germany
| | - Seyedamirhosein Motamedi
- Charité - Universitätsmedizin Berlin, NeuroCure Clinical Research Center, Corporate Member of Freie, Germany
- Charité - Universitätsmedizin, Experimental and Clinical Research Center, Max Delbrück Center for Mo, Germany
| | - Konrad Polthier
- Freie Universität Berlin, Mathematical Geometry Processing Group, Berlin, Germany
| | - Frank Haußer
- Beuth University of Applied Sciences, Berlin, Germany
| | - Kay Gawlik
- Charité - Universitätsmedizin Berlin, NeuroCure Clinical Research Center, Corporate Member of Freie, Germany
- Charité - Universitätsmedizin, Experimental and Clinical Research Center, Max Delbrück Center for Mo, Germany
- Beuth University of Applied Sciences, Berlin, Germany
| | - Friedemann Paul
- Charité - Universitätsmedizin Berlin, Department of Neurology, Berlin, Germany
| | - Alexander Brandt
- Charité - Universitätsmedizin Berlin, NeuroCure Clinical Research Center, Corporate Member of Freie, Germany
- Charité - Universitätsmedizin, Experimental and Clinical Research Center, Max Delbrück Center for Mo, Germany
| |
Collapse
|
64
|
Eladawi N, Elmogy M, Khalifa F, Ghazal M, Ghazi N, Aboelfetouh A, Riad A, Sandhu H, Schaal S, El-Baz A. Early diabetic retinopathy diagnosis based on local retinal blood vessel analysis in optical coherence tomography angiography (OCTA) images. Med Phys 2018; 45:4582-4599. [DOI: 10.1002/mp.13142] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2018] [Revised: 08/13/2018] [Accepted: 08/15/2018] [Indexed: 11/10/2022] Open
Affiliation(s)
- Nabila Eladawi
- Faculty of Computers and Information; Mansoura University; Mansoura 35516 Egypt
- Bioengineering Department; University of Louisville; Louisville KY40292 USA
| | - Mohammed Elmogy
- Faculty of Computers and Information; Mansoura University; Mansoura 35516 Egypt
- Bioengineering Department; University of Louisville; Louisville KY40292 USA
| | - Fahmi Khalifa
- Electronics and Communications Engineering Department; Mansoura University; Mansoura Egypt
| | - Mohammed Ghazal
- Electrical and Computer Engineering Department; Abu Dhabi University; Abu Dhabi UAE
| | - Nicola Ghazi
- Eye Institute at Cleveland Clinic; Abu Dhabi UAE
| | - Ahmed Aboelfetouh
- Faculty of Computers and Information; Mansoura University; Mansoura 35516 Egypt
| | - Alaa Riad
- Faculty of Computers and Information; Mansoura University; Mansoura 35516 Egypt
| | - Harpal Sandhu
- Ophthalmology and Visual Sciences Department; School of Medicine; University of Louisville; Louisville KY USA
| | - Shlomit Schaal
- Department of Ophthalmology and Visual Sciences; University of Massachusetts Medical School; Worcester MA USA
| | - Ayman El-Baz
- Bioengineering Department; University of Louisville; Louisville KY40292 USA
| |
Collapse
|
65
|
Gan M, Wang C, Yang T, Yang N, Zhang M, Yuan W, Li X, Wang L. Robust layer segmentation of esophageal OCT images based on graph search using edge-enhanced weights. BIOMEDICAL OPTICS EXPRESS 2018; 9:4481-4495. [PMID: 30615715 PMCID: PMC6157790 DOI: 10.1364/boe.9.004481] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/01/2018] [Revised: 08/17/2018] [Accepted: 08/20/2018] [Indexed: 05/18/2023]
Abstract
Automatic segmentation of esophageal layers in OCT images is crucial for studying esophageal diseases and computer-assisted diagnosis. This work aims to improve the current techniques to increase the accuracy and robustness for esophageal OCT image segmentation. A two-step edge-enhanced graph search (EEGS) framework is proposed in this study. Firstly, a preprocessing scheme is applied to suppress speckle noise and remove the disturbance in the esophageal structure. Secondly, the image is formulated into a graph and layer boundaries are located by graph search. In this process, we propose an edge-enhanced weight matrix for the graph by combining the vertical gradients with a Canny edge map. Experiments on esophageal OCT images from guinea pigs demonstrate that the EEGS framework is more robust and more accurate than the current segmentation method. It can be potentially useful for the early detection of esophageal diseases.
Collapse
Affiliation(s)
- Meng Gan
- Department of Electronic and Information Engineering, Soochow University, Suzhou 215006,
China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163,
China
| | - Cong Wang
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163,
China
| | - Ting Yang
- Department of Electronic and Information Engineering, Soochow University, Suzhou 215006,
China
| | - Na Yang
- Department of Electronic and Information Engineering, Soochow University, Suzhou 215006,
China
| | - Miao Zhang
- Department of Electronic and Information Engineering, Soochow University, Suzhou 215006,
China
| | - Wu Yuan
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21205,
USA
| | - Xingde Li
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21205,
USA
| | - Lirong Wang
- Department of Electronic and Information Engineering, Soochow University, Suzhou 215006,
China
| |
Collapse
|
66
|
Dubose TB, Cunefare D, Cole E, Milanfar P, Izatt JA, Farsiu S. Statistical Models of Signal and Noise and Fundamental Limits of Segmentation Accuracy in Retinal Optical Coherence Tomography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:1978-1988. [PMID: 29990154 PMCID: PMC6146969 DOI: 10.1109/tmi.2017.2772963] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2023]
Abstract
Optical coherence tomography (OCT) has revolutionized diagnosis and prognosis of ophthalmic diseases by visualization and measurement of retinal layers. To speed up the quantitative analysis of disease biomarkers, an increasing number of automatic segmentation algorithms have been proposed to estimate the boundary locations of retinal layers. While the performance of these algorithms has significantly improved in recent years, a critical question to ask is how far we are from a theoretical limit to OCT segmentation performance. In this paper, we present the Cramèr-Rao lower bounds (CRLBs) for the problem of OCT layer segmentation. In deriving the CRLBs, we address the important problem of defining statistical models that best represent the intensity distribution in each layer of the retina. Additionally, we calculate the bounds under an optimal affine bias, reflecting the use of prior knowledge in many segmentation algorithms. Experiments using in vivo images of human retina from a commercial spectral domain OCT system are presented, showing potential for improvement of automated segmentation accuracy. Our general mathematical model can be easily adapted for virtually any OCT system. Furthermore, the statistical models of signal and noise developed in this paper can be utilized for the future improvements of OCT image denoising, reconstruction, and many other applications.
Collapse
|
67
|
Guo Y, Camino A, Zhang M, Wang J, Huang D, Hwang T, Jia Y. Automated segmentation of retinal layer boundaries and capillary plexuses in wide-field optical coherence tomographic angiography. BIOMEDICAL OPTICS EXPRESS 2018; 9:4429-4442. [PMID: 30615747 PMCID: PMC6157796 DOI: 10.1364/boe.9.004429] [Citation(s) in RCA: 48] [Impact Index Per Article: 6.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/12/2018] [Revised: 08/16/2018] [Accepted: 08/17/2018] [Indexed: 05/22/2023]
Abstract
Advances in the retinal layer segmentation of structural optical coherence tomography (OCT) images have allowed the separation of capillary plexuses in OCT angiography (OCTA). With the increased scanning speeds of OCT devices and wider field images (≥10 mm on fast-axis), greater retinal curvature and anatomic variations have introduced new challenges. In this study, we developed a novel automated method to segment seven retinal layer boundaries and two retinal plexuses in wide-field OCTA images. The algorithm was initialized by a series of points forming a guidance point array that estimates the location of retinal layer boundaries. A guided bidirectional graph search method consisting of an improvement of our previous segmentation algorithm was used to search for the precise boundaries. We validated the method on normal and diseased eyes, demonstrating subpixel accuracy for all groups. By allowing independent visualization of the superficial and deep plexuses, this method shows potential for the detection of plexus-specific peripheral vascular abnormalities.
Collapse
Affiliation(s)
- Yukun Guo
- Casey Eye Institute, Oregon Health & Science University, Portland, OR 97239, USA
| | - Acner Camino
- Casey Eye Institute, Oregon Health & Science University, Portland, OR 97239, USA
| | - Miao Zhang
- Topcon Healthcare Solutions, Inc., Milpitas, CA 95035, USA
| | - Jie Wang
- Casey Eye Institute, Oregon Health & Science University, Portland, OR 97239, USA
- Department of Biomedical Engineering, Oregon Health & Science University, Portland, OR 97239, USA
| | - David Huang
- Casey Eye Institute, Oregon Health & Science University, Portland, OR 97239, USA
| | - Thomas Hwang
- Casey Eye Institute, Oregon Health & Science University, Portland, OR 97239, USA
| | - Yali Jia
- Casey Eye Institute, Oregon Health & Science University, Portland, OR 97239, USA
- Department of Biomedical Engineering, Oregon Health & Science University, Portland, OR 97239, USA
| |
Collapse
|
68
|
Qu Y, He Y, Zhang Y, Ma T, Zhu J, Miao Y, Dai C, Humayun M, Zhou Q, Chen Z. Quantified elasticity mapping of retinal layers using synchronized acoustic radiation force optical coherence elastography. BIOMEDICAL OPTICS EXPRESS 2018; 9:4054-4063. [PMID: 30615733 PMCID: PMC6157789 DOI: 10.1364/boe.9.004054] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/08/2018] [Revised: 06/25/2018] [Accepted: 07/04/2018] [Indexed: 05/20/2023]
Abstract
Age-related macular degeneration (AMD) is the leading cause of blindness in the elderly (over the age of 60 years) in western countries. In the early stages of the disease, structural changes may be subtle and cannot be detected. Recently it has been postulated that the mechanical properties of the retina may change with the onset of AMD. In this manuscript, we present a novel, non-invasive means that utilizes synchronized acoustic radiation force optical coherence elastography (ARF-OCE) to measure and estimate the elasticity of cadaver porcine retina. Both regions near the optic nerve and in the peripheral retina were studied. An acoustic force is exerted on the tissue for excitation and the resulting tissue vibrations, often in the nanometer scale, are detected with high-resolution optical methods. Segmentation has been performed to isolate individual layers and the Young's modulus has been estimated for each. The results have been successfully compared and mapped to corresponding histological results using H&E staining. Finally, 64 elastograms of the retina were analyzed, as well as the elastic properties, with stiffness ranging from 1.3 to 25.9 kPa in the ganglion to the photoreceptor sides respectively. ARF-OCE allows for the elasticity mapping of anatomical retinal layers. This imaging approach needs further evaluation but has the potential to allow physicians to gain a better understanding of the elasticity of retinal layers in retinal diseases such as AMD.
Collapse
Affiliation(s)
- Yueqiao Qu
- Beckman Laser Institute, University of California, Irvine, 1002 Health Sciences Road East, Irvine, CA 92612, USA
- First two authors contributed equally to this work
| | - Youmin He
- Beckman Laser Institute, University of California, Irvine, 1002 Health Sciences Road East, Irvine, CA 92612, USA
- First two authors contributed equally to this work
| | - Yi Zhang
- USC Roski Eye Institute & Institute for Biomedical Therapeutics, University of Southern California, Los Angeles, CA 90033, USA
| | - Teng Ma
- NIH Ultrasonic Transducer Resource Center, Department of Biomedical Engineering, University of Southern California, Los Angeles, CA 90089, USA
| | - Jiang Zhu
- Beckman Laser Institute, University of California, Irvine, 1002 Health Sciences Road East, Irvine, CA 92612, USA
| | - Yusi Miao
- Beckman Laser Institute, University of California, Irvine, 1002 Health Sciences Road East, Irvine, CA 92612, USA
| | - Cuixia Dai
- Beckman Laser Institute, University of California, Irvine, 1002 Health Sciences Road East, Irvine, CA 92612, USA
| | - Mark Humayun
- USC Roski Eye Institute & Institute for Biomedical Therapeutics, University of Southern California, Los Angeles, CA 90033, USA
| | - Qifa Zhou
- USC Roski Eye Institute & Institute for Biomedical Therapeutics, University of Southern California, Los Angeles, CA 90033, USA
- NIH Ultrasonic Transducer Resource Center, Department of Biomedical Engineering, University of Southern California, Los Angeles, CA 90089, USA
| | - Zhongping Chen
- Beckman Laser Institute, University of California, Irvine, 1002 Health Sciences Road East, Irvine, CA 92612, USA
| |
Collapse
|
69
|
Srivastava R, Yow AP, Cheng J, Wong DWK, Tey HL. Three-dimensional graph-based skin layer segmentation in optical coherence tomography images for roughness estimation. BIOMEDICAL OPTICS EXPRESS 2018; 9:3590-3606. [PMID: 30338142 PMCID: PMC6191621 DOI: 10.1364/boe.9.003590] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/19/2018] [Revised: 05/10/2018] [Accepted: 05/16/2018] [Indexed: 06/01/2023]
Abstract
Automatic skin layer segmentation in optical coherence tomography (OCT) images is important for a topographic assessment of skin or skin disease detection. However, existing methods cannot deal with the problem of shadowing in OCT images due to the presence of hair, scales, etc. In this work, we propose a method to segment the topmost layer of the skin (or the skin surface) using 3D graphs with a novel cost function to deal with shadowing in OCT images. 3D graph cuts use context information across B-scans when segmenting the skin surface, which improves the segmentation as compared to segmenting each B-scan separately. The proposed method reduces the segmentation error by more than 20% as compared to the best performing related work. The method has been applied to roughness estimation and shows a high correlation with a manual assessment. Promising results demonstrate the usefulness of the proposed method for skin layer segmentation and roughness estimation in both normal OCT images and OCT images with shadowing.
Collapse
Affiliation(s)
- Ruchir Srivastava
- Institute for Infocomm Research, 1 Fusionopolis Way, No. 21-01 Connexis (South Tower), 138632,
Singapore
| | - Ai Ping Yow
- Institute for Infocomm Research, 1 Fusionopolis Way, No. 21-01 Connexis (South Tower), 138632,
Singapore
| | - Jun Cheng
- Cixi Institute of Biomedical Engineering, Ningbo Institute of Industrial Technology, Chinese Academy of Sciences, 1219 Zhongguan West Road, Zhenhai District, Ningbo 315201,
China
| | - Damon W. K. Wong
- Institute for Infocomm Research, 1 Fusionopolis Way, No. 21-01 Connexis (South Tower), 138632,
Singapore
| | - Hong Liang Tey
- National Skin Center, 1 Mandalay Road, 308205,
Singapore
- Lee Kong Chian School of Medicine, Headquarters and Clinical Sciences Building, 11 Mandalay Road, 308232,
Singapore
| |
Collapse
|
70
|
Azuma S, Makita S, Miyazawa A, Ikuno Y, Miura M, Yasuno Y. Pixel-wise segmentation of severely pathologic retinal pigment epithelium and choroidal stroma using multi-contrast Jones matrix optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2018; 9:2955-2973. [PMID: 29984078 PMCID: PMC6033570 DOI: 10.1364/boe.9.002955] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/06/2018] [Revised: 05/22/2018] [Accepted: 05/23/2018] [Indexed: 05/04/2023]
Abstract
Tissue segmentation of retinal optical coherence tomography (OCT) is widely used in ophthalmic diagnosis. However, its performance in severe pathologic cases is still insufficient. We propose a pixel-wise segmentation method that uses the multi-contrast measurement capability of Jones matrix OCT (JM-OCT). This method is applicable to both normal and pathologic retinal pigment epithelium (RPE) and choroidal stroma. In this method, "features," which are sensitive to specific tissues of interest, are synthesized by combining the multi-contrast images of JM-OCT, including attenuation coefficient, degree-of-polarization-uniformity, and OCT angiography. The tissue segmentation is done by simple thresholding of the feature. Compared with conventional segmentation methods for pathologic maculae, the proposed method is less computationally intensive. The segmentation method was validated by applying it to images from normal and severely pathologic cases. The segmentation results enabled the development of several types of en face visualizations, including melano-layer thickness maps, RPE elevation maps, choroidal thickness maps, and choroidal stromal attenuation coefficient maps. These facilitate close examination of macular pathology. The melano-layer thickness map is very similar to a near infrared fundus autofluorescence image, so the map can be used to identify the source of a hyper-autofluorescent signal.
Collapse
Affiliation(s)
- Shinnosuke Azuma
- Computational Optics Group, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8573,
Japan
- Computational Optics and Ophthalmology Group, Tsukuba, Ibaraki 305-8531,
Japan
| | - Shuichi Makita
- Computational Optics Group, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8573,
Japan
- Computational Optics and Ophthalmology Group, Tsukuba, Ibaraki 305-8531,
Japan
| | - Arata Miyazawa
- Computational Optics Group, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8573,
Japan
- Computational Optics and Ophthalmology Group, Tsukuba, Ibaraki 305-8531,
Japan
| | - Yasushi Ikuno
- Ikuno Eye Center, 2-9-10-3F Juso-Higashi, Yodogawa-Ku, Osaka 532-0023,
Japan
| | - Masahiro Miura
- Computational Optics and Ophthalmology Group, Tsukuba, Ibaraki 305-8531,
Japan
- Tokyo Medical University Ibaraki Medical Center, 3-20-1 Chuo, Ami, Ibaraki 300-0395,
Japan
| | - Yoshiaki Yasuno
- Computational Optics Group, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8573,
Japan
- Computational Optics and Ophthalmology Group, Tsukuba, Ibaraki 305-8531,
Japan
| |
Collapse
|
71
|
Kasaragod D, Makita S, Hong YJ, Yasuno Y. Machine-learning based segmentation of the optic nerve head using multi-contrast Jones matrix optical coherence tomography with semi-automatic training dataset generation. BIOMEDICAL OPTICS EXPRESS 2018; 9:3220-3243. [PMID: 29984095 PMCID: PMC6033556 DOI: 10.1364/boe.9.003220] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/04/2018] [Revised: 06/08/2018] [Accepted: 06/08/2018] [Indexed: 05/18/2023]
Abstract
A pixel-by-pixel tissue classification framework using multiple contrasts obtained by Jones matrix optical coherence tomography (JM-OCT) is demonstrated. The JM-OCT is an extension of OCT that provides OCT, OCT angiography, birefringence tomography, degree-of-polarization uniformity tomography, and attenuation coefficient tomography, simultaneously. The classification framework consists of feature engineering, k-means clustering that generates a training dataset, training of a tissue classifier using the generated training dataset, and tissue classification by the trained classifier. The feature engineering process generates synthetic features from the primary optical contrasts obtained by JM-OCT. The tissue classification is performed in the feature space of the engineered features. We applied this framework to the in vivo analysis of optic nerve heads of posterior eyes. This classified each JM-OCT pixel into prelamina, lamina cribrosa (lamina beam), and retrolamina tissues. The lamina beam segmentation results were further utilized for birefringence and attenuation coefficient analysis of lamina beam.
Collapse
Affiliation(s)
- Deepa Kasaragod
- Computational Optics Group, University of Tsukuba, Tsukuba,
Japan
| | - Shuichi Makita
- Computational Optics Group, University of Tsukuba, Tsukuba,
Japan
| | - Young-Joo Hong
- Computational Optics Group, University of Tsukuba, Tsukuba,
Japan
| | - Yoshiaki Yasuno
- Computational Optics Group, University of Tsukuba, Tsukuba,
Japan
| |
Collapse
|
72
|
Venhuizen FG, van Ginneken B, Liefers B, van Asten F, Schreur V, Fauser S, Hoyng C, Theelen T, Sánchez CI. Deep learning approach for the detection and quantification of intraretinal cystoid fluid in multivendor optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2018; 9:1545-1569. [PMID: 29675301 PMCID: PMC5905905 DOI: 10.1364/boe.9.001545] [Citation(s) in RCA: 84] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/15/2017] [Revised: 01/13/2018] [Accepted: 01/31/2018] [Indexed: 05/18/2023]
Abstract
We developed a deep learning algorithm for the automatic segmentation and quantification of intraretinal cystoid fluid (IRC) in spectral domain optical coherence tomography (SD-OCT) volumes independent of the device used for acquisition. A cascade of neural networks was introduced to include prior information on the retinal anatomy, boosting performance significantly. The proposed algorithm approached human performance reaching an overall Dice coefficient of 0.754 ± 0.136 and an intraclass correlation coefficient of 0.936, for the task of IRC segmentation and quantification, respectively. The proposed method allows for fast quantitative IRC volume measurements that can be used to improve patient care, reduce costs, and allow fast and reliable analysis in large population studies.
Collapse
Affiliation(s)
- Freerk G. Venhuizen
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen,
the Netherlands
- Department of Ophthalmology, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen,
the Netherlands
| | - Bram van Ginneken
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen,
the Netherlands
| | - Bart Liefers
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen,
the Netherlands
- Department of Ophthalmology, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen,
the Netherlands
| | - Freekje van Asten
- Department of Ophthalmology, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen,
the Netherlands
| | - Vivian Schreur
- Department of Ophthalmology, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen,
the Netherlands
| | - Sascha Fauser
- Roche Pharma Research and Early Development, F. Hoffmann-La Roche Ltd, Basel,
Switzerland
- Cologne University Eye Clinic, Cologne,
Germany
| | - Carel Hoyng
- Department of Ophthalmology, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen,
the Netherlands
| | - Thomas Theelen
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen,
the Netherlands
- Department of Ophthalmology, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen,
the Netherlands
| | - Clara I. Sánchez
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen,
the Netherlands
- Department of Ophthalmology, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen,
the Netherlands
| |
Collapse
|
73
|
COMPARISON OF GANGLION CELL INNER PLEXIFORM LAYER THICKNESS BY CIRRUS AND SPECTRALIS OPTICAL COHERENCE TOMOGRAPHY IN DIABETIC MACULAR EDEMA. Retina 2018; 38:820-827. [DOI: 10.1097/iae.0000000000001631] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
74
|
EFFECT OF OPTIC DISK-FOVEA DISTANCE ON MEASUREMENTS OF INDIVIDUAL MACULAR INTRARETINAL LAYERS IN NORMAL SUBJECTS. Retina 2018; 39:999-1008. [PMID: 29489565 DOI: 10.1097/iae.0000000000002043] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
PURPOSE To investigate the effect of optic disk-fovea distance (DFD) on measurements of macular intraretinal layers using spectral domain optical coherence tomography in normal subjects. METHODS One hundred and eighty-two eyes from 182 normal subjects were imaged using spectral domain optical coherence tomography. The average thicknesses of eight macular intraretinal layers were measured using an automatic segmentation algorithm. Partial correlation test and multiple regression analysis were used to determine the effect of DFD on thicknesses of intraretinal layers. RESULTS Disk-fovea distance correlated negatively with the overall average thickness in all the intraretinal layers (r ≤ -0.17, all P ≤ 0.025) except the ganglion cell layer and photoreceptor. In multiple regression analysis, greater DFD was associated with thinner nerve fiber layer (6.78 μm decrease per each millimeter increase in DFD, P < 0.001), thinner ganglion cell-inner plexiform layer (2.16 μm decrease per each millimeter increase in DFD, P = 0.039), thinner ganglion cell complex (8.94 μm decrease per each millimeter increase in DFD, P < 0.001), thinner central macular thickness (18.16 μm decrease per each millimeter increase in DFD, P < 0.001), and thinner total macular thickness (15.94 μm decrease per each millimeter increase in DFD, P < 0.001). CONCLUSION Thinner measurements of macular intraretinal layers were significantly associated with greater DFD. A clinical assessment of macular intraretinal layers in the evaluation of various macular diseases should always be interpreted in the context of DFD.
Collapse
|
75
|
Yu K, Shi F, Gao E, Zhu W, Chen H, Chen X. Shared-hole graph search with adaptive constraints for 3D optic nerve head optical coherence tomography image segmentation. BIOMEDICAL OPTICS EXPRESS 2018; 9:962-983. [PMID: 29541497 PMCID: PMC5846542 DOI: 10.1364/boe.9.000962] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/13/2017] [Revised: 01/08/2018] [Accepted: 01/23/2018] [Indexed: 05/18/2023]
Abstract
Optic nerve head (ONH) is a crucial region for glaucoma detection and tracking based on spectral domain optical coherence tomography (SD-OCT) images. In this region, the existence of a "hole" structure makes retinal layer segmentation and analysis very challenging. To improve retinal layer segmentation, we propose a 3D method for ONH centered SD-OCT image segmentation, which is based on a modified graph search algorithm with a shared-hole and locally adaptive constraints. With the proposed method, both the optic disc boundary and nine retinal surfaces can be accurately segmented in SD-OCT images. An overall mean unsigned border positioning error of 7.27 ± 5.40 µm was achieved for layer segmentation, and a mean Dice coefficient of 0.925 ± 0.03 was achieved for optic disc region detection.
Collapse
Affiliation(s)
- Kai Yu
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006, China
- Indicates these authors contributed equally
| | - Fei Shi
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006, China
- Indicates these authors contributed equally
| | - Enting Gao
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006, China
| | - Weifang Zhu
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006, China
| | - Haoyu Chen
- Joint Shantou International Eye Center, Shantou University and the Chinese University of Hong Kong, Shantou 515041, China
| | - Xinjian Chen
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006, China
- corresponding author:
| |
Collapse
|
76
|
Abstract
Medical image segmentation is a fundamental and challenging problem for analyzing medical images. Among different existing medical image segmentation methods, graph-based approaches are relatively new and show good features in clinical applications. In the graph-based method, pixels or regions in the original image are interpreted into nodes in a graph. By considering Markov random field to model the contexture information of the image, the medical image segmentation problem can be transformed into a graph-based energy minimization problem. This problem can be solved by the use of minimum s-t cut/ maximum flow algorithm. This review is devoted to cut-based medical segmentation methods, including graph cuts and graph search for region and surface segmentation. Different varieties of cut-based methods, including graph-cuts-based methods, model integrated graph cuts methods, graph-search-based methods, and graph search/graph cuts based methods, are systematically reviewed. Graph cuts and graph search with deep learning technique are also discussed.
Collapse
|
77
|
Gopinath K, Sivaswamy J. Segmentation of Retinal Cysts From Optical Coherence Tomography Volumes Via Selective Enhancement. IEEE J Biomed Health Inform 2018; 23:273-282. [PMID: 29994501 DOI: 10.1109/jbhi.2018.2793534] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Automated and accurate segmentation of cystoid structures in optical coherence tomography (OCT) is of interest in the early detection of retinal diseases. It is, however, a challenging task. We propose a novel method for localizing cysts in 3-D OCT volumes. The proposed work is biologically inspired and based on selective enhancement of the cysts, by inducing motion to a given OCT slice. A convolutional neural network is designed to learn a mapping function that combines the result of multiple such motions to produce a probability map for cyst locations in a given slice. The final segmentation of cysts is obtained via simple clustering of the detected cyst locations. The proposed method is evaluated on two public datasets and one private dataset. The public datasets include the one released for the OPTIMA cyst segmentation challenge (OCSC) in MICCAI 2015 and the DME dataset. After training on the OCSC train set, the method achieves a mean dice coefficient (DC) of 0.71 on the OCSC test set. The robustness of the algorithm was examined by cross validation on the DME and AEI (private) datasets and a mean DC values obtained were 0.69 and 0.79, respectively. Overall, the proposed system has the highest performance on all the benchmarks. These results underscore the strengths of the proposed method in handling variations in both data acquisition protocols and scanners.
Collapse
|
78
|
Alluwimi MS, Swanson WH, Malinovsky VE, King BJ. A basis for customising perimetric locations within the macula in glaucoma. Ophthalmic Physiol Opt 2018; 38:164-173. [PMID: 29315706 PMCID: PMC5887979 DOI: 10.1111/opo.12435] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2017] [Accepted: 11/23/2017] [Indexed: 11/27/2022]
Abstract
PURPOSE It has been recognised that the 24-2 grid used for perimetry may poorly sample the macula, which has been recently identified as a critical region for diagnosing and managing patients with glaucoma. We compared data derived from patients and controls to investigate the efficacy of a basis for customising perimetric locations within the macula, guided by en face images of retinal nerve fibre layer (RNFL) bundles. METHODS We used SD-OCT en face montages (www.heidelbergengineering.com) of the RNFL in 10 patients with glaucoma (ages 56-80 years, median 67.5 years) and 30 age-similar controls (ages 47-77, median 58). These patients were selected because of either the absence of perimetric defect while glaucomatous damage to the RNFL bundles was observed, or because of perimetric defect that did not reflect the extent and locations of the glaucomatous damage that appeared in the RNFL images. We used a customised blob stimulus for perimetric testing (a Gaussian blob with 0.25° standard deviation) at 10-2 grid locations, to assess the correspondence between perimetric defects and damaged RNFL bundles observed on en face images and perimetric defects. Data from the age-similar controls were used to compute total deviation (TD) and pattern deviation (PD) values at each location; a perimetric defect for a location was defined as a TD or PD value of -0.5 log unit or deeper. A McNemar's test was used to compare the proportions of locations with perimetric defects that fell outside the damaged RNFL bundles, with and without accounting for displacement of ganglion cell bodies. RESULTS All patients but one had perimetric defects that were consistent with the patterns of damaged RNFL bundles observed on the en face images. We found six abnormal perimetric locations of 2040 tested in controls and 132 abnormal perimetric locations of 680 tested in patients. The proportions of abnormal locations that fell outside the damaged RNFL bundles, with and without accounting for displacement of the ganglion cell bodies were 0.08 and 0.07, respectively. The difference between the two proportions did not reach statistical significance (p = 0.5 for a one-tailed test). CONCLUSIONS We demonstrated that it is effective to customise perimetric locations within the macula, guided by en face images of the RNFL bundles. The perimetric losses found with a 10-2 grid demonstrated similar patterns as the damaged RNFL bundles observed on the en face images.
Collapse
Affiliation(s)
| | | | | | - Brett J King
- School of Optometry, Indiana University, Bloomington, USA
| |
Collapse
|
79
|
Xiang D, Bagci U, Jin C, Shi F, Zhu W, Yao J, Sonka M, Chen X. CorteXpert: A model-based method for automatic renal cortex segmentation. Med Image Anal 2017; 42:257-273. [DOI: 10.1016/j.media.2017.06.010] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2016] [Revised: 05/17/2017] [Accepted: 06/22/2017] [Indexed: 10/19/2022]
|
80
|
Shigeta H, Mashita T, Kikuta J, Seno S, Takemura H, Ishii M, Matsuda H. Bone marrow cavity segmentation using graph-cuts with wavelet-based texture feature. J Bioinform Comput Biol 2017; 15:1740004. [PMID: 28877645 DOI: 10.1142/s0219720017400042] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Emerging bioimaging technologies enable us to capture various dynamic cellular activities [Formula: see text]. As large amounts of data are obtained these days and it is becoming unrealistic to manually process massive number of images, automatic analysis methods are required. One of the issues for automatic image segmentation is that image-taking conditions are variable. Thus, commonly, many manual inputs are required according to each image. In this paper, we propose a bone marrow cavity (BMC) segmentation method for bone images as BMC is considered to be related to the mechanism of bone remodeling, osteoporosis, and so on. To reduce manual inputs to segment BMC, we classified the texture pattern using wavelet transformation and support vector machine. We also integrated the result of texture pattern classification into the graph-cuts-based image segmentation method because texture analysis does not consider spatial continuity. Our method is applicable to a particular frame in an image sequence in which the condition of fluorescent material is variable. In the experiment, we evaluated our method with nine types of mother wavelets and several sets of scale parameters. The proposed method with graph-cuts and texture pattern classification performs well without manual inputs by a user.
Collapse
Affiliation(s)
- Hironori Shigeta
- Graduate School of Information Science and Technology, Osaka University, Yamadaoka 1-5, Suita, Osaka, Japan
| | - Tomohiro Mashita
- Graduate School of Information Science and Technology, Osaka University, Yamadaoka 1-5, Suita, Osaka, Japan
- Cybermedia Center, Osaka University, Japan
| | - Junichi Kikuta
- Graduate School of Medicine and Frontier Biosciences, Osaka University, Japan
| | - Shigeto Seno
- Graduate School of Information Science and Technology, Osaka University, Yamadaoka 1-5, Suita, Osaka, Japan
| | - Haruo Takemura
- Graduate School of Information Science and Technology, Osaka University, Yamadaoka 1-5, Suita, Osaka, Japan
- Cybermedia Center, Osaka University, Japan
| | - Masaru Ishii
- Graduate School of Medicine and Frontier Biosciences, Osaka University, Japan
| | - Hideo Matsuda
- Graduate School of Information Science and Technology, Osaka University, Yamadaoka 1-5, Suita, Osaka, Japan
| |
Collapse
|
81
|
Gerendas BS, Bogunovic H, Sadeghipour A, Schlegl T, Langs G, Waldstein SM, Schmidt-Erfurth U. Computational image analysis for prognosis determination in DME. Vision Res 2017; 139:204-210. [DOI: 10.1016/j.visres.2017.03.008] [Citation(s) in RCA: 36] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2017] [Revised: 03/10/2017] [Accepted: 03/14/2017] [Indexed: 11/26/2022]
|
82
|
Avoiding Clinical Misinterpretation and Artifacts of Optical Coherence Tomography Analysis of the Optic Nerve, Retinal Nerve Fiber Layer, and Ganglion Cell Layer. J Neuroophthalmol 2017; 36:417-438. [PMID: 27636747 PMCID: PMC5113253 DOI: 10.1097/wno.0000000000000422] [Citation(s) in RCA: 49] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
Background: Optical coherence tomography (OCT) has become an important tool for diagnosing optic nerve disease. The structural details and reproducibility of OCT continues to improve with further advances in technology. However, artifacts and misinterpretation of OCT can lead to clinical misdiagnosis of diseases if they go unrecognized. Evidence Acquisition: A literature review using PubMed combined with clinical and research experience. Results: We describe the most common artifacts and errors in interpretation seen on OCT in both optic nerve and ganglion cell analyses. We provide examples of the artifacts, discuss the causes, and provide methods of detecting them. In addition, we discuss a systematic approach to OCT analysis to facilitate the recognition of artifacts and to avoid clinical misinterpretation. Conclusions: While OCT is invaluable in diagnosing optic nerve disease, we need to be cognizant of the artifacts that can occur with OCT. Failure to recognize some of these artifacts can lead to misdiagnoses and inappropriate investigations.
Collapse
|
83
|
Zhang J, Williams BM, Lawman S, Atkinson D, Zhang Z, Shen Y, Zheng Y. Non-destructive analysis of flake properties in automotive paints with full-field optical coherence tomography and 3D segmentation. OPTICS EXPRESS 2017; 25:18614-18628. [PMID: 29041059 DOI: 10.1364/oe.25.018614] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/11/2017] [Accepted: 06/30/2017] [Indexed: 05/18/2023]
Abstract
Automotive coating systems are designed to protect vehicle bodies from corrosion and enhance their aesthetic value. The number, size and orientation of small metallic flakes in the base coat of the paint has a significant effect on the appearance of automotive bodies. It is important for quality assurance (QA) to be able to measure the properties of these small flakes, which are approximately 10μm in radius, yet current QA techniques are limited to measuring layer thickness. We design and develop a time-domain (TD) full-field (FF) optical coherence tomography (OCT) system to scan automotive panels volumetrically, non-destructively and without contact. We develop and integrate a segmentation method to automatically distinguish flakes and allow measurement of their properties. We test our integrated system on nine sections of five panels and demonstrate that this integrated approach can characterise small flakes in automotive coating systems in 3D, calculating the number, size and orientation accurately and consistently. This has the potential to significantly impact QA testing in the automotive industry.
Collapse
|
84
|
Rashno A, Koozekanani DD, Drayna PM, Nazari B, Sadri S, Rabbani H, Parhi KK. Fully Automated Segmentation of Fluid/Cyst Regions in Optical Coherence Tomography Images With Diabetic Macular Edema Using Neutrosophic Sets and Graph Algorithms. IEEE Trans Biomed Eng 2017; 65:989-1001. [PMID: 28783619 DOI: 10.1109/tbme.2017.2734058] [Citation(s) in RCA: 37] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
This paper presents a fully automated algorithm to segment fluid-associated (fluid-filled) and cyst regions in optical coherence tomography (OCT) retina images of subjects with diabetic macular edema. The OCT image is segmented using a novel neutrosophic transformation and a graph-based shortest path method. In neutrosophic domain, an image is transformed into three sets: (true), (indeterminate) that represents noise, and (false). This paper makes four key contributions. First, a new method is introduced to compute the indeterminacy set , and a new -correction operation is introduced to compute the set in neutrosophic domain. Second, a graph shortest-path method is applied in neutrosophic domain to segment the inner limiting membrane and the retinal pigment epithelium as regions of interest (ROI) and outer plexiform layer and inner segment myeloid as middle layers using a novel definition of the edge weights . Third, a new cost function for cluster-based fluid/cyst segmentation in ROI is presented which also includes a novel approach in estimating the number of clusters in an automated manner. Fourth, the final fluid regions are achieved by ignoring very small regions and the regions between middle layers. The proposed method is evaluated using two publicly available datasets: Duke, Optima, and a third local dataset from the UMN clinic which is available online. The proposed algorithm outperforms the previously proposed Duke algorithm by 8% with respect to the dice coefficient and by 5% with respect to precision on the Duke dataset, while achieving about the same sensitivity. Also, the proposed algorithm outperforms a prior method for Optima dataset by 6%, 22%, and 23% with respect to the dice coefficient, sensitivity, and precision, respectively. Finally, the proposed algorithm also achieves sensitivity of 67.3%, 88.8%, and 76.7%, for the Duke, Optima, and the university of minnesota (UMN) datasets, respectively.
Collapse
|
85
|
Wintergerst MWM, Schultz T, Birtel J, Schuster AK, Pfeiffer N, Schmitz-Valckenberg S, Holz FG, Finger RP. Algorithms for the Automated Analysis of Age-Related Macular Degeneration Biomarkers on Optical Coherence Tomography: A Systematic Review. Transl Vis Sci Technol 2017; 6:10. [PMID: 28729948 PMCID: PMC5516568 DOI: 10.1167/tvst.6.4.10] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2017] [Accepted: 05/30/2017] [Indexed: 11/24/2022] Open
Abstract
PURPOSE To assess the quality of optical coherence tomography (OCT) grading algorithms for retinal biomarkers of age-related macular degeneration (AMD). METHODS Following a systematic review of the literature data on detection and quantification of AMD retinal biomarkers by available algorithms were extracted and descriptively synthesized. Algorithm quality was assessed using a modified version of the Quality Assessment of Diagnostic Accuracy Studies 2 checklist with a focus on accuracy against established reference standards and risk of bias. RESULTS Thirty five studies reporting computer-aided diagnosis (CAD) tools for qualitative analysis or algorithms for quantitative analysis were identified. Compared with manual assessment in reference standards correlation coefficients ranged from 0.54 to 0.97 for drusen, 0.80 to 0.98 for geographic atrophy (GA), and 0.30 to 0.98 for intra- or subretinal fluid and pigment epithelial detachment (PED) detection by automated algorithms. CAD tools achieved area under the curve (AUC) values of 0.94 to 0.99, sensitivity of 0.90 to 1.00, and specificity of 0.89 to 0.92. CONCLUSIONS Automated analysis of AMD biomarkers on OCT is promising. However, most of the algorithm validation was performed in preselected patients, exhibiting the targeted biomarker only. In addition, type and quality of reported algorithm validation varied substantially. TRANSLATIONAL RELEVANCE The development of algorithms for combined, simultaneous analysis of multiple AMD biomarkers including AMD staging and the agreement on standardized validation procedures would be of considerable translational value for the clinician and the clinical researcher.
Collapse
Affiliation(s)
| | - Thomas Schultz
- Department of Computer Science, University of Bonn, Bonn, Germany
| | - Johannes Birtel
- Department of Ophthalmology, University of Bonn, Bonn, Germany
| | | | - Norbert Pfeiffer
- Department of Ophthalmology, University Medical Center Mainz, Mainz, Germany
| | | | - Frank G Holz
- Department of Ophthalmology, University of Bonn, Bonn, Germany
| | - Robert P Finger
- Department of Ophthalmology, University of Bonn, Bonn, Germany
| |
Collapse
|
86
|
Venhuizen FG, van Ginneken B, Liefers B, van Grinsven MJ, Fauser S, Hoyng C, Theelen T, Sánchez CI. Robust total retina thickness segmentation in optical coherence tomography images using convolutional neural networks. BIOMEDICAL OPTICS EXPRESS 2017; 8:3292-3316. [PMID: 28717568 PMCID: PMC5508829 DOI: 10.1364/boe.8.003292] [Citation(s) in RCA: 78] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/13/2017] [Revised: 05/22/2017] [Accepted: 06/03/2017] [Indexed: 05/18/2023]
Abstract
We developed a fully automated system using a convolutional neural network (CNN) for total retina segmentation in optical coherence tomography (OCT) that is robust to the presence of severe retinal pathology. A generalized U-net network architecture was introduced to include the large context needed to account for large retinal changes. The proposed algorithm outperformed qualitative and quantitatively two available algorithms. The algorithm accurately estimated macular thickness with an error of 14.0 ± 22.1 µm, substantially lower than the error obtained using the other algorithms (42.9 ± 116.0 µm and 27.1 ± 69.3 µm, respectively). These results highlighted the proposed algorithm's capability of modeling the wide variability in retinal appearance and obtained a robust and reliable retina segmentation even in severe pathological cases.
Collapse
Affiliation(s)
- Freerk G. Venhuizen
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, the
Netherlands
- Department of Ophthalmology, Radboud University Medical Center, Nijmegen, the
Netherlands
| | - Bram van Ginneken
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, the
Netherlands
| | - Bart Liefers
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, the
Netherlands
- Department of Ophthalmology, Radboud University Medical Center, Nijmegen, the
Netherlands
| | - Mark J.J.P. van Grinsven
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, the
Netherlands
- Department of Ophthalmology, Radboud University Medical Center, Nijmegen, the
Netherlands
| | - Sascha Fauser
- Roche Pharma Research and Early Development, F. Hoffmann-La Roche Ltd, Basel,
Switzerland
- Cologne University Eye Clinic, Cologne,
Germany
| | - Carel Hoyng
- Department of Ophthalmology, Radboud University Medical Center, Nijmegen, the
Netherlands
| | - Thomas Theelen
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, the
Netherlands
- Department of Ophthalmology, Radboud University Medical Center, Nijmegen, the
Netherlands
| | - Clara I. Sánchez
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, the
Netherlands
- Department of Ophthalmology, Radboud University Medical Center, Nijmegen, the
Netherlands
| |
Collapse
|
87
|
Guo J, Zhu W, Shi F, Xiang D, Chen H, Chen X. A Framework for Classification and Segmentation of Branch Retinal Artery Occlusion in SD-OCT. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2017; 26:3518-3527. [PMID: 28459688 DOI: 10.1109/tip.2017.2697762] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Branch retinal artery occlusion (BRAO) is an ocular emergency, which could lead to blindness. Quantitative analysis of the BRAO region in the retina is necessary for the assessment of the severity of retinal ischemia. In this paper, a fully automatic framework was proposed to segment BRAO regions based on 3D spectral-domain optical coherence tomography (SD-OCT) images. To the best of our knowledge, this is the first automatic 3D BRAO segmentation framework. First, the input 3D image is automatically classified into BRAO of acute phase and BRAO of chronic phase or normal retina using an AdaBoost classifier based on combining local structural, intensity, textural features with our new feature distribution analyzing strategy. Then, BRAO regions of acute phase and chronic phase are segmented separately. A thickness model is built to segment BRAO in the chronic phase. While for segmenting BRAO in the acute phase, a two-step segmentation strategy is performed: rough initialization and refine segmentation. The proposed method was tested on SD-OCT images of 35 patients (12 BRAO acute phase, 11 BRAO chronic phase, and 12 normal eyes) using the leave-one-out strategy. The classification accuracy for BRAO acute phase, BRAO chronic phase, and normal retina were 100%, 90.9%, and 91.7%, respectively. The overall true positive volume fraction (TPVF) and false positive volume fraction (FPVF) for the acute phase were 91.1% and 5.5% and for the chronic phase were 92.7% and 8.4%, respectively.
Collapse
|
88
|
Mallery RM, Poolman P, Thurtell MJ, Wang JK, Garvin MK, Ledolter J, Kardon RH. The Pattern of Visual Fixation Eccentricity and Instability in Optic Neuropathy and Its Spatial Relationship to Retinal Ganglion Cell Layer Thickness. Invest Ophthalmol Vis Sci 2017; 57:OCT429-37. [PMID: 27409502 PMCID: PMC4968926 DOI: 10.1167/iovs.15-18916] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Purpose The purpose of this study was to assess whether clinically useful measures of fixation instability and eccentricity can be derived from retinal tracking data obtained during optical coherence tomography (OCT) in patients with optic neuropathy (ON) and to develop a method for relating fixation to the retinal ganglion cell complex (GCC) thickness. Methods Twenty-nine patients with ON underwent macular volume OCT with 30 seconds of confocal scanning laser ophthalmoscope (cSLO)-based eye tracking during fixation. Kernel density estimation quantified fixation instability and fixation eccentricity from the distribution of fixation points on the retina. Preferred ganglion cell layer loci (PGCL) and their relationship to the GCC thickness map were derived, accounting for radial displacement of retinal ganglion cell soma from their corresponding cones. Results Fixation instability was increased in ON eyes (0.21 deg2) compared with normal eyes (0.06982 deg2; P < 0.001), and fixation eccentricity was increased in ON eyes (0.48°) compared with normal eyes (0.24°; P = 0.03). Fixation instability and eccentricity each correlated moderately with logMAR acuity and were highly predictive of central visual field loss. Twenty-six of 35 ON eyes had PGCL skewed toward local maxima of the GCC thickness map. Patients with bilateral dense central scotomas had PGCL in homonymous retinal locations with respect to the fovea. Conclusions Fixation instability and eccentricity measures obtained during cSLO-OCT assess the function of perifoveal retinal elements and predict central visual field loss in patients with ON. A model relating fixation to the GCC thickness map offers a method to assess the structure–function relationship between fixation and areas of preserved GCC in patients with ON.
Collapse
Affiliation(s)
- Robert M Mallery
- Department of Neurology, Brigham and Women's Hospital, Boston, Massachusetts, United States 2Department of Ophthalmology, Massachusetts Eye and Ear Infirmary, Boston, Massachusetts, United States 3Department of Ophthalmology and Visual Sciences, Universit
| | - Pieter Poolman
- Iowa City VA Center for the Prevention and Treatment of Visual Loss, Iowa City, Iowa, United States
| | - Matthew J Thurtell
- Department of Ophthalmology and Visual Sciences, University of Iowa Hospitals and Clinics, Iowa City, Iowa, United States 4Iowa City VA Center for the Prevention and Treatment of Visual Loss, Iowa City, Iowa, United States
| | - Jui-Kai Wang
- Iowa City VA Center for the Prevention and Treatment of Visual Loss, Iowa City, Iowa, United States 5Department of Electrical and Computer Engineering, University of Iowa, Iowa City, Iowa, United States
| | - Mona K Garvin
- Iowa City VA Center for the Prevention and Treatment of Visual Loss, Iowa City, Iowa, United States 5Department of Electrical and Computer Engineering, University of Iowa, Iowa City, Iowa, United States
| | - Johannes Ledolter
- Iowa City VA Center for the Prevention and Treatment of Visual Loss, Iowa City, Iowa, United States
| | - Randy H Kardon
- Department of Ophthalmology and Visual Sciences, University of Iowa Hospitals and Clinics, Iowa City, Iowa, United States 4Iowa City VA Center for the Prevention and Treatment of Visual Loss, Iowa City, Iowa, United States
| |
Collapse
|
89
|
Alsaih K, Lemaitre G, Rastgoo M, Massich J, Sidibé D, Meriaudeau F. Machine learning techniques for diabetic macular edema (DME) classification on SD-OCT images. Biomed Eng Online 2017; 16:68. [PMID: 28592309 PMCID: PMC5463338 DOI: 10.1186/s12938-017-0352-9] [Citation(s) in RCA: 54] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2016] [Accepted: 05/16/2017] [Indexed: 11/12/2022] Open
Abstract
BACKGROUND Spectral domain optical coherence tomography (OCT) (SD-OCT) is most widely imaging equipment used in ophthalmology to detect diabetic macular edema (DME). Indeed, it offers an accurate visualization of the morphology of the retina as well as the retina layers. METHODS The dataset used in this study has been acquired by the Singapore Eye Research Institute (SERI), using CIRRUS TM (Carl Zeiss Meditec, Inc., Dublin, CA, USA) SD-OCT device. The dataset consists of 32 OCT volumes (16 DME and 16 normal cases). Each volume contains 128 B-scans with resolution of 1024 px × 512 px, resulting in more than 3800 images being processed. All SD-OCT volumes are read and assessed by trained graders and identified as normal or DME cases based on evaluation of retinal thickening, hard exudates, intraretinal cystoid space formation, and subretinal fluid. Within the DME sub-set, a large number of lesions has been selected to create a rather complete and diverse DME dataset. This paper presents an automatic classification framework for SD-OCT volumes in order to identify DME versus normal volumes. In this regard, a generic pipeline including pre-processing, feature detection, feature representation, and classification was investigated. More precisely, extraction of histogram of oriented gradients and local binary pattern (LBP) features within a multiresolution approach is used as well as principal component analysis (PCA) and bag of words (BoW) representations. RESULTS AND CONCLUSION Besides comparing individual and combined features, different representation approaches and different classifiers are evaluated. The best results are obtained for LBP[Formula: see text] vectors while represented and classified using PCA and a linear-support vector machine (SVM), leading to a sensitivity(SE) and specificity (SP) of 87.5 and 87.5%, respectively.
Collapse
Affiliation(s)
- Khaled Alsaih
- LE2I, CNRS, Arts et Métiers, Université Bourgogne Franche-Comté, 12 rue de la Fonderie, Le Creusot, France
- Centre for Intelligent Signal and Imaging Research (CISIR), Electrical & Electronic Engineering Department, Universiti Teknologi PETRONAS, 32610 Seri Iskandar, Malaysia
| | - Guillaume Lemaitre
- LE2I, CNRS, Arts et Métiers, Université Bourgogne Franche-Comté, 12 rue de la Fonderie, Le Creusot, France
| | - Mojdeh Rastgoo
- LE2I, CNRS, Arts et Métiers, Université Bourgogne Franche-Comté, 12 rue de la Fonderie, Le Creusot, France
| | - Joan Massich
- LE2I, CNRS, Arts et Métiers, Université Bourgogne Franche-Comté, 12 rue de la Fonderie, Le Creusot, France
| | - Désiré Sidibé
- LE2I, CNRS, Arts et Métiers, Université Bourgogne Franche-Comté, 12 rue de la Fonderie, Le Creusot, France
| | - Fabrice Meriaudeau
- LE2I, CNRS, Arts et Métiers, Université Bourgogne Franche-Comté, 12 rue de la Fonderie, Le Creusot, France
- Centre for Intelligent Signal and Imaging Research (CISIR), Electrical & Electronic Engineering Department, Universiti Teknologi PETRONAS, 32610 Seri Iskandar, Malaysia
| |
Collapse
|
90
|
Novosel J, Yzer S, Vermeer KA, van Vliet LJ. Segmentation of Locally Varying Numbers of Outer Retinal Layers by a Model Selection Approach. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:1306-1315. [PMID: 28186885 DOI: 10.1109/tmi.2017.2666044] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Extraction of image-based biomarkers, such as the presence, visibility, or thickness of a certain layer, from 3-D optical coherence tomography data provides relevant clinical information. We present a method to simultaneously determine the number of visible layers in the outer retina and segment them. The method is based on a model selection approach with special attention given to the balance between the quality of a fit and model complexity. This will ensure that a more complex model is selected only if this is sufficiently supported by the data. The performance of the method was evaluated on healthy and retinitis pigmentosa (RP) affected eyes. In addition, the reproducibility of automatic method and manual annotations was evaluated on healthy eyes. Good agreement between the segmentation performed manually by a medical doctor and results obtained from the automatic segmentation was found. The mean unsigned deviation for all outer retinal layers in healthy and RP affected eyes varied between 2.6 and 4.9 μm. The reproducibility of the automatic method was similar to the reproducibility of the manual segmentation. Overall, the method provides a flexible and accurate solution for determining the visibility and location of outer retinal layers and could be used as an aid for the disease diagnosis and monitoring.
Collapse
|
91
|
Novosel J, Vermeer KA, de Jong JH, van Vliet LJ. Joint Segmentation of Retinal Layers and Focal Lesions in 3-D OCT Data of Topologically Disrupted Retinas. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:1276-1286. [PMID: 28186886 DOI: 10.1109/tmi.2017.2666045] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
Accurate quantification of retinal structures in 3-D optical coherence tomography data of eyes with pathologies provides clinically relevant information. We present an approach to jointly segment retinal layers and lesions in eyes with topology-disrupting retinal diseases by a loosely coupled level set framework. In the new approach, lesions are modeled as an additional space-variant layer delineated by auxiliary interfaces. Furthermore, the segmentation of interfaces is steered by local differences in the signal between adjacent retinal layers, thereby allowing the approach to handle local intensity variations. The accuracy of the proposed method of both layer and lesion segmentation has been evaluated on eyes affected by central serous retinopathy and age-related macular degeneration. In addition, layer segmentation of the proposed approach was evaluated on eyes without topology-disrupting retinal diseases. Good agreement between the segmentation performed manually by a medical doctor and results obtained from the automatic segmentation was found for all data types. The mean unsigned error for all interfaces varied between 2.3 and 11.9 μm (0.6-3.1 pixels). Furthermore, lesion segmentation showed a Dice coefficient of 0.68 for drusen and 0.89 for fluid pockets. Overall, the method provides a flexible and accurate solution to jointly segment lesions and retinal layers.
Collapse
|
92
|
Zhang J, Yuan W, Liang W, Yu S, Liang Y, Xu Z, Wei Y, Li X. Automatic and robust segmentation of endoscopic OCT images and optical staining. BIOMEDICAL OPTICS EXPRESS 2017; 8:2697-2708. [PMID: 28663899 PMCID: PMC5480506 DOI: 10.1364/boe.8.002697] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/23/2017] [Revised: 04/17/2017] [Accepted: 04/18/2017] [Indexed: 05/03/2023]
Abstract
We report a generic method for automatic segmentation of endoscopic optical coherence tomography (OCT) images. In this method, OCT images are first processed with L1 -L0 norm minimization based de-noising and smoothing algorithms to increase the signal-to-noise ratio (SNR) and enhance the contrast between adjacent layers. The smoothed images are then formulated into cost graphs based on their vertical gradients. After that, tissue-layer segmentation is performed with the shortest path search algorithm. The efficacy and capability of this method are demonstrated by automatically and robustly identifying all five interested layers of guinea pig esophagus from in vivo endoscopic OCT images. Furthermore, thanks to the ultrahigh resolution, high SNR of endoscopic OCT images and the high segmentation accuracy, this method permits in vivo optical staining histology and facilitates quantitative analysis of tissue geometric properties, which can be very useful for studying tissue pathologies and potentially aiding clinical diagnosis in real time.
Collapse
Affiliation(s)
- Jianlin Zhang
- Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu, Sichuan 610209, China
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21205, USA
- These authors contributed equally to this work and should be considered co-first authors
| | - Wu Yuan
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21205, USA
- These authors contributed equally to this work and should be considered co-first authors
| | - Wenxuan Liang
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21205, USA
| | - Shanyong Yu
- Department of Medicine, School of Medicine, Johns Hopkins University, Baltimore, MD 21205, USA
| | - Yanmei Liang
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21205, USA
- Institute of Modern Optics, Nankai University, Tianjin 300071, China
| | - Zhiyong Xu
- Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu, Sichuan 610209, China
| | - Yuxing Wei
- Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu, Sichuan 610209, China
| | - Xingde Li
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21205, USA
| |
Collapse
|
93
|
Wu M, Chen Q, He X, Li P, Fan W, Yuan S, Park H. Automatic Subretinal Fluid Segmentation of Retinal SD-OCT Images With Neurosensory Retinal Detachment Guided by Enface Fundus Imaging. IEEE Trans Biomed Eng 2017; 65:87-95. [PMID: 28436839 DOI: 10.1109/tbme.2017.2695461] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVE Accurate segmentation of neurosensory retinal detachment (NRD) associated subretinal fluid in spectral domain optical coherence tomography (SD-OCT) is vital for the assessment of central serous chorioretinopathy (CSC). A novel two-stage segmentation algorithm was proposed, guided by Enface fundus imaging. METHODS In the first stage, Enface fundus image was segmented using thickness map prior to detecting the fluid-associated abnormalities with diffuse boundaries. In the second stage, the locations of the abnormalities were used to restrict the spatial extent of the fluid region, and a fuzzy level set method with a spatial smoothness constraint was applied to subretinal fluid segmentation in the SD-OCT scans. RESULTS Experimental results from 31 retinal SD-OCT volumes with CSC demonstrate that our method can achieve a true positive volume fraction (TPVF), false positive volume fraction (FPVF), and positive predicative value (PPV) of 94.3%, 0.97%, and 93.6%, respectively, for NRD regions. Our approach can also discriminate NRD-associated subretinal fluid from subretinal pigment epithelium fluid associated with pigment epithelial detachment with a TPVF, FPVF, and PPV of 93.8%, 0.40%, and 90.5%, respectively. CONCLUSION We report a fully automatic method for the segmentation of subretinal fluid. SIGNIFICANCE Our method shows the potential to improve clinical therapy for CSC.
Collapse
|
94
|
Scan-Less Line Field Optical Coherence Tomography, with Automatic Image Segmentation, as a Measurement Tool for Automotive Coatings. APPLIED SCIENCES-BASEL 2017. [DOI: 10.3390/app7040351] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
95
|
Yang J, Liu L, Campbell JP, Huang D, Liu G. Handheld optical coherence tomography angiography. BIOMEDICAL OPTICS EXPRESS 2017; 8:2287-2300. [PMID: 28736672 PMCID: PMC5516829 DOI: 10.1364/boe.8.002287] [Citation(s) in RCA: 35] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/08/2016] [Revised: 02/25/2017] [Accepted: 03/12/2017] [Indexed: 05/03/2023]
Abstract
We developed a handheld optical coherence tomography angiography (OCTA) system using a 100-kHz swept-source laser. The handheld probe weighs 0.4 kg and measures 20.6 × 12.8 × 4.6 cm3. The system has dedicated features for handheld operation. The probe is equipped with a mini iris camera for easy alignment. Real-time display of the en face OCT and cross-sectional OCT images in the system allows accurately locating the imaging target. Fast automatic focusing was achieved by an electrically tunable lens controlled by a golden-section search algorithm. An extended axial imaging range of 6 mm allows easy alignment. A registration algorithm using cross-correlation to register adjacent OCT B-frames with propagation from the central frame was used to effectively minimize motion artifacts in volumetric OCTA images captured in relatively short durations of 1 and 2.1 seconds. 2.5 × 2.5 mm (200 × 200 pixels) and 3.5 × 3.5 mm (300 × 300 pixels) retinal angiograms were demonstrated on two awake adult human subjects without the use of any mydriatic eye drops.
Collapse
|
96
|
Seo S, Lee CE, Jeong JH, Park KH, Kim DM, Jeoung JW. Ganglion cell-inner plexiform layer and retinal nerve fiber layer thickness according to myopia and optic disc area: a quantitative and three-dimensional analysis. BMC Ophthalmol 2017; 17:22. [PMID: 28283025 PMCID: PMC5346227 DOI: 10.1186/s12886-017-0419-1] [Citation(s) in RCA: 63] [Impact Index Per Article: 7.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2016] [Accepted: 03/03/2017] [Indexed: 11/25/2022] Open
Abstract
Background To determine the influences of myopia and optic disc size on ganglion cell-inner plexiform layer (GCIPL) and peripapillary retinal nerve fiber layer (RNFL) thickness profiles obtained by spectral domain optical coherence tomography (OCT). Methods One hundred and sixty-eight eyes of 168 young myopic subjects were recruited and assigned to one of three groups according to their spherical equivalent (SE) values and optic disc area. All underwent Cirrus HD-OCT imaging. The influences of myopia and optic disc size on the GCIPL and RNFL thickness profiles were evaluated by multiple comparisons and linear regression analysis. Three-dimensional surface plots of GCIPL and RNFL thickness corresponding to different combinations of myopia and optic disc size were constructed. Results Each of the quadrant RNFL thicknesses and their overall average were significantly thinner in high myopia compared to low myopia, except for the temporal quadrant (all Ps ≤0.003). The average and all-sectors GCIPL were significantly thinner in high myopia than in moderate- and/or low-myopia (all Ps ≤0.002). The average OCT RNFL thickness was correlated significantly with SE (0.81 μm/diopter, P < 0.001), axial length (-1.44 μm/mm, P < 0.001), and optic disc area (5.35 μm/mm2, P < 0.001) by linear regression analysis. As for the OCT GCIPL parameters, average GCIPL thickness showed a significant correlation with SE (0.84 μm/diopter, P < 0.001) and axial length (-1.65 μm/mm, P < 0.001). There was no significant correlation of average GCIPL thickness with optic disc area. Three-dimensional curves showed that larger optic discs were associated with increased average RNFL thickness and that more-myopic eyes were associated with decreased average GCIPL and RNFL thickness. Conclusion Myopia can significantly affect GCIPL and RNFL thickness profiles, and optic disc size has a significant influence on RNFL thickness. The current OCT maps employed in the evaluation of glaucoma should be analyzed in consideration of refractive status and optic disc size.
Collapse
Affiliation(s)
- Sam Seo
- Department of Ophthalmology, Cheil Eye Hospital, Ayang-ro, dong-gu, Daegu, Korea
| | - Chong Eun Lee
- Department of Ophthalmology, Keimyung University, Dongsan Medical Center, Dongsan-dong, Jung-gu, Daegu, Korea
| | - Jae Hoon Jeong
- Department of Ophthalmology, Konyang University Hospital, Gasuwon-dong, Seo-gu, Daejeon, Korea
| | - Ki Ho Park
- Department of Ophthalmology, Seoul National University Hospital, Seoul National University College of Medicine, 101 Daehak-ro, Jongno-gu, Seoul, 110-744, Korea
| | - Dong Myung Kim
- Department of Ophthalmology, Seoul National University Hospital, Seoul National University College of Medicine, 101 Daehak-ro, Jongno-gu, Seoul, 110-744, Korea
| | - Jin Wook Jeoung
- Department of Ophthalmology, Seoul National University Hospital, Seoul National University College of Medicine, 101 Daehak-ro, Jongno-gu, Seoul, 110-744, Korea.
| |
Collapse
|
97
|
de Sisternes L, Jonna G, Moss J, Marmor MF, Leng T, Rubin DL. Automated intraretinal segmentation of SD-OCT images in normal and age-related macular degeneration eyes. BIOMEDICAL OPTICS EXPRESS 2017; 8:1926-1949. [PMID: 28663874 PMCID: PMC5480589 DOI: 10.1364/boe.8.001926] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2016] [Revised: 02/14/2017] [Accepted: 02/14/2017] [Indexed: 05/21/2023]
Abstract
This work introduces and evaluates an automated intra-retinal segmentation method for spectral-domain optical coherence (SD-OCT) retinal images. While quantitative assessment of retinal features in SD-OCT data is important, manual segmentation is extremely time-consuming and subjective. We address challenges that have hindered prior automated methods, including poor performance with diseased retinas relative to healthy retinas, and data smoothing that obscures image features such as small retinal drusen. Our novel segmentation approach is based on the iterative adaptation of a weighted median process, wherein a three-dimensional weighting function is defined according to image intensity and gradient properties, and a set of smoothness constraints and pre-defined rules are considered. We compared the segmentation results for 9 segmented outlines associated with intra-retinal boundaries to those drawn by hand by two retinal specialists and to those produced by an independent state-of-the-art automated software tool in a set of 42 clinical images (from 14 patients). These images were obtained with a Zeiss Cirrus SD-OCT system, including healthy, early or intermediate AMD, and advanced AMD eyes. As a qualitative evaluation of accuracy, a highly experienced third independent reader blindly rated the quality of the outlines produced by each method. The accuracy and image detail of our method was superior in healthy and early or intermediate AMD eyes (98.15% and 97.78% of results not needing substantial editing) to the automated method we compared against. While the performance was not as good in advanced AMD (68.89%), it was still better than the manual outlines or the comparison method (which failed in such cases). We also tested our method's performance on images acquired with a different SD-OCT manufacturer, collected from a large publicly available data set (114 healthy and 255 AMD eyes), and compared the data quantitatively to reference standard markings of the internal limiting membrane and inner boundary of retinal pigment epithelium, producing a mean unsigned positioning error of 6.04 ± 7.83µm (mean under 2 pixels). Our automated method should be applicable to data from different OCT manufacturers and offers detailed layer segmentations in healthy and AMD eyes.
Collapse
Affiliation(s)
- Luis de Sisternes
- Department of Radiology, Stanford University, Stanford, CA 94305, USA
- Currently with Carl Zeiss Meditec, Inc. Dublin, CA 94568, USA
| | - Gowtham Jonna
- Department of Ophthalmology and Visual Sciences, Albert Einstein College of Medicine, Bronx, NY 10467, USA
| | - Jason Moss
- Retina Institute of California, Pasadena, CA 91105, USA
| | - Michael F Marmor
- Byers Eye Institute at Stanford, Stanford University School of Medicine, Palo Alto, CA 94303, USA
| | - Theodore Leng
- Byers Eye Institute at Stanford, Stanford University School of Medicine, Palo Alto, CA 94303, USA
| | - Daniel L Rubin
- Department of Radiology, Stanford University, Stanford, CA 94305, USA
- Department of Medicine (Biomedical Informatics Research), Stanford University, Stanford, CA 94305, USA
| |
Collapse
|
98
|
Zang P, Gao SS, Hwang TS, Flaxel CJ, Wilson DJ, Morrison JC, Huang D, Li D, Jia Y. Automated boundary detection of the optic disc and layer segmentation of the peripapillary retina in volumetric structural and angiographic optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2017; 8:1306-1318. [PMID: 28663830 PMCID: PMC5480545 DOI: 10.1364/boe.8.001306] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/08/2016] [Revised: 01/25/2017] [Accepted: 01/25/2017] [Indexed: 05/20/2023]
Abstract
To improve optic disc boundary detection and peripapillary retinal layer segmentation, we propose an automated approach for structural and angiographic optical coherence tomography. The algorithm was performed on radial cross-sectional B-scans. The disc boundary was detected by searching for the position of Bruch's membrane opening, and retinal layer boundaries were detected using a dynamic programming-based graph search algorithm on each B-scan without the disc region. A comparison of the disc boundary using our method with that determined by manual delineation showed good accuracy, with an average Dice similarity coefficient ≥0.90 in healthy eyes and eyes with diabetic retinopathy and glaucoma. The layer segmentation accuracy in the same cases was on average less than one pixel (3.13 μm).
Collapse
Affiliation(s)
- Pengxiao Zang
- Casey Eye Institute, Oregon Health & Science University, 3375 SW Terwilliger Blvd, Portland, OR 97239, USA
- Shandong Province Key Laboratory of Medical Physics and Image Processing Technology, Institute of Biomedical Sciences, School of Physics and Electronics, Shandong Normal University, 88 East Wenhua Rd, Jinan, Shandong 250014, China
| | - Simon S Gao
- Casey Eye Institute, Oregon Health & Science University, 3375 SW Terwilliger Blvd, Portland, OR 97239, USA
| | - Thomas S Hwang
- Casey Eye Institute, Oregon Health & Science University, 3375 SW Terwilliger Blvd, Portland, OR 97239, USA
| | - Christina J Flaxel
- Casey Eye Institute, Oregon Health & Science University, 3375 SW Terwilliger Blvd, Portland, OR 97239, USA
| | - David J Wilson
- Casey Eye Institute, Oregon Health & Science University, 3375 SW Terwilliger Blvd, Portland, OR 97239, USA
| | - John C Morrison
- Casey Eye Institute, Oregon Health & Science University, 3375 SW Terwilliger Blvd, Portland, OR 97239, USA
| | - David Huang
- Casey Eye Institute, Oregon Health & Science University, 3375 SW Terwilliger Blvd, Portland, OR 97239, USA
| | - Dengwang Li
- Shandong Province Key Laboratory of Medical Physics and Image Processing Technology, Institute of Biomedical Sciences, School of Physics and Electronics, Shandong Normal University, 88 East Wenhua Rd, Jinan, Shandong 250014, China
| | - Yali Jia
- Casey Eye Institute, Oregon Health & Science University, 3375 SW Terwilliger Blvd, Portland, OR 97239, USA
| |
Collapse
|
99
|
Baghaie A, Yu Z, D'Souza RM. Involuntary eye motion correction in retinal optical coherence tomography: Hardware or software solution? Med Image Anal 2017; 37:129-145. [PMID: 28208100 DOI: 10.1016/j.media.2017.02.002] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2016] [Revised: 01/27/2017] [Accepted: 02/03/2017] [Indexed: 01/05/2023]
Abstract
In this paper, we review state-of-the-art techniques to correct eye motion artifacts in Optical Coherence Tomography (OCT) imaging. The methods for eye motion artifact reduction can be categorized into two major classes: (1) hardware-based techniques and (2) software-based techniques. In the first class, additional hardware is mounted onto the OCT scanner to gather information about the eye motion patterns during OCT data acquisition. This information is later processed and applied to the OCT data for creating an anatomically correct representation of the retina, either in an offline or online manner. In software based techniques, the motion patterns are approximated either by comparing the acquired data to a reference image, or by considering some prior assumptions about the nature of the eye motion. Careful investigations done on the most common methods in the field provides invaluable insight regarding future directions of the research in this area. The challenge in hardware-based techniques lies in the implementation aspects of particular devices. However, the results of these techniques are superior to those obtained from software-based techniques because they are capable of capturing secondary data related to eye motion during OCT acquisition. Software-based techniques on the other hand, achieve moderate success and their performance is highly dependent on the quality of the OCT data in terms of the amount of motion artifacts contained in them. However, they are still relevant to the field since they are the sole class of techniques with the ability to be applied to legacy data acquired using systems that do not have extra hardware to track eye motion.
Collapse
Affiliation(s)
- Ahmadreza Baghaie
- Department of Electrical Engineering, University of Wisconsin-Milwaukee, WI 53211, USA.
| | - Zeyun Yu
- Department of Computer Science, University of Wisconsin-Milwaukee, WI 53211, USA
| | - Roshan M D'Souza
- Department of Mechanical Engineering, University of Wisconsin-Milwaukee, WI 53211, USA
| |
Collapse
|
100
|
Mari JM, Aung T, Cheng CY, Strouthidis NG, Girard MJA. A Digital Staining Algorithm for Optical Coherence Tomography Images of the Optic Nerve Head. Transl Vis Sci Technol 2017; 6:8. [PMID: 28174676 PMCID: PMC5291077 DOI: 10.1167/tvst.6.1.8] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2016] [Accepted: 09/13/2016] [Indexed: 01/26/2023] Open
Abstract
Purpose To digitally stain spectral-domain optical coherence tomography (OCT) images of the optic nerve head (ONH), and highlight either connective or neural tissues. Methods OCT volumes of the ONH were acquired from one eye of 10 healthy subjects. We processed all volumes with adaptive compensation to remove shadows and enhance deep tissue visibility. For each ONH, we identified the four most dissimilar pixel-intensity histograms, each of which was assumed to represent a tissue group. These four histograms formed a vector basis on which we ‘projected' each OCT volume in order to generate four digitally stained volumes P1 to P4. Digital staining was also verified using a digital phantom, and compared with k-means clustering for three and four clusters. Results Digital staining was able to isolate three regions of interest from the proposed phantom. For the ONH, the digitally stained images P1 highlighted mostly connective tissues, as demonstrated through an excellent contrast increase across the anterior lamina cribrosa boundary (3.6 ± 0.6 times). P2 highlighted the nerve fiber layer and the prelamina, P3 the remaining layers of the retina, and P4 the image background. Further, digital staining was able to separate ONH tissue layers that were not well separated by k-means clustering. Conclusion We have described an algorithm that can digitally stain connective and neural tissues in OCT images of the ONH. Translational Relevance Because connective and neural tissues are considerably altered in glaucoma, digital staining of the ONH tissues may be of interest in the clinical management of this pathology.
Collapse
Affiliation(s)
- Jean-Martial Mari
- GePaSud, Université de la Polynésie française, Tahiti, French Polynesia
| | - Tin Aung
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore ; Department of Ophthalmology, YLL School of Medicine, National University of Singapore, Singapore
| | - Ching-Yu Cheng
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore ; Department of Ophthalmology, YLL School of Medicine, National University of Singapore, Singapore ; Ophthalmology and Visual Sciences Academic Clinical Program (Eye ACP), Duke-NUS Medical School, Singapore
| | - Nicholas G Strouthidis
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore ; NIHR Biomedical Research Centre at Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, London, UK ; Discipline of Clinical Ophthalmology and Eye Health, University of Sydney, Sydney, NSW, Australia
| | - Michaël J A Girard
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore ; Ophthalmic Engineering & Innovation Laboratory, Department of Biomedical Engineering, Faculty of Engineering, National University of Singapore, Singapore
| |
Collapse
|