1
|
Rasel RK, Wu F, Chiariglione M, Choi SS, Doble N, Gao XR. Assessing the efficacy of 2D and 3D CNN algorithms in OCT-based glaucoma detection. Sci Rep 2024; 14:11758. [PMID: 38783015 PMCID: PMC11116516 DOI: 10.1038/s41598-024-62411-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Accepted: 05/16/2024] [Indexed: 05/25/2024] Open
Abstract
Glaucoma is a progressive neurodegenerative disease characterized by the gradual degeneration of retinal ganglion cells, leading to irreversible blindness worldwide. Therefore, timely and accurate diagnosis of glaucoma is crucial, enabling early intervention and facilitating effective disease management to mitigate further vision deterioration. The advent of optical coherence tomography (OCT) has marked a transformative era in ophthalmology, offering detailed visualization of the macula and optic nerve head (ONH) regions. In recent years, both 2D and 3D convolutional neural network (CNN) algorithms have been applied to OCT image analysis. While 2D CNNs rely on post-prediction aggregation of all B-scans within OCT volumes, 3D CNNs allow for direct glaucoma prediction from the OCT data. However, in the absence of extensively pre-trained 3D models, the comparative efficacy of 2D and 3D-CNN algorithms in detecting glaucoma from volumetric OCT images remains unclear. Therefore, this study explores the efficacy of glaucoma detection through volumetric OCT images using select state-of-the-art (SOTA) 2D-CNN models, 3D adaptations of these 2D-CNN models with specific weight transfer techniques, and a custom 5-layer 3D-CNN-Encoder algorithm. The performance across two distinct datasets is evaluated, each focusing on the macula and the ONH, to provide a comprehensive understanding of the models' capabilities in identifying glaucoma. Our findings demonstrate that the 2D-CNN algorithm consistently provided robust results compared to their 3D counterparts tested in this study for glaucoma detection, achieving AUC values of 0.960 and 0.943 for the macular and ONH OCT test images, respectively. Given the scarcity of pre-trained 3D models trained on extensive datasets, this comparative analysis underscores the overall utility of 2D and 3D-CNN algorithms in advancing glaucoma diagnostic systems in ophthalmology and highlights the potential of 2D algorithms for volumetric OCT image-based glaucoma detection.
Collapse
Affiliation(s)
- Rafiul Karim Rasel
- Department of Ophthalmology and Visual Sciences, The Ohio State University, Columbus, OH, 43212, USA
| | - Fengze Wu
- Department of Ophthalmology and Visual Sciences, The Ohio State University, Columbus, OH, 43212, USA
- Department of Biomedical Informatics, The Ohio State University, Columbus, OH, 43210, USA
| | - Marion Chiariglione
- Department of Ophthalmology and Visual Sciences, The Ohio State University, Columbus, OH, 43212, USA
| | - Stacey S Choi
- Department of Ophthalmology and Visual Sciences, The Ohio State University, Columbus, OH, 43212, USA
- College of Optometry, The Ohio State University, Columbus, OH, 43210, USA
| | - Nathan Doble
- Department of Ophthalmology and Visual Sciences, The Ohio State University, Columbus, OH, 43212, USA
- College of Optometry, The Ohio State University, Columbus, OH, 43210, USA
| | - Xiaoyi Raymond Gao
- Department of Ophthalmology and Visual Sciences, The Ohio State University, Columbus, OH, 43212, USA.
- Department of Biomedical Informatics, The Ohio State University, Columbus, OH, 43210, USA.
- Division of Human Genetics, The Ohio State University, Columbus, OH, 43210, USA.
| |
Collapse
|
2
|
Liu K, Zhang J. Glaucoma detection model by exploiting multi-region and multi-scan-pattern OCT images with dynamical region score. BIOMEDICAL OPTICS EXPRESS 2024; 15:1370-1392. [PMID: 38495692 PMCID: PMC10942704 DOI: 10.1364/boe.512138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 12/19/2023] [Accepted: 01/12/2024] [Indexed: 03/19/2024]
Abstract
Currently, deep learning-based methods have achieved success in glaucoma detection. However, most models focus on OCT images captured by a single scan pattern within a given region, holding the high risk of the omission of valuable features in the remaining regions or scan patterns. Therefore, we proposed a multi-region and multi-scan-pattern fusion model to address this issue. Our proposed model exploits comprehensive OCT images from three fundus anatomical regions (macular, middle, and optic nerve head regions) being captured by four scan patterns (radial, volume, single-line, and circular scan patterns). Moreover, to enhance the efficacy of integrating features across various scan patterns within a region and multiple regional features, we employed an attention multi-scan fusion module and an attention multi-region fusion module that auto-assign contribution to distinct scan-pattern features and region features adapting to characters of different samples, respectively. To alleviate the absence of available datasets, we have collected a specific dataset (MRMSG-OCT) comprising OCT images captured by four scan patterns from three regions. The experimental results and visualized feature maps both demonstrate that our proposed model achieves superior performance against the single scan-pattern models and single region-based models. Moreover, compared with the average fusion strategy, our proposed fusion modules yield superior performance, particularly reversing the performance degradation observed in some models relying on fixed weights, validating the efficacy of the proposed dynamic region scores adapted to different samples. Moreover, the derived region contribution scores enhance the interpretability of the model and offer an overview of the model's decision-making process, assisting ophthalmologists in prioritizing regions with heightened scores and increasing efficiency in clinical practice.
Collapse
Affiliation(s)
- Kai Liu
- School of Biological Science and Medical Engineering, Beihang University, Beijing, 100083, China
- Beijing Advanced Innovation Centre for Biomedical Engineering, Beihang University, Beijing, 100083, China
- Department of Computer Science, City University of Hong Kong, Hong Kong SAR, 98121, China
| | - Jicong Zhang
- School of Biological Science and Medical Engineering, Beihang University, Beijing, 100083, China
- Beijing Advanced Innovation Centre for Biomedical Engineering, Beihang University, Beijing, 100083, China
- Hefei Innovation Research Institute, Beihang University, Hefei, 230012, China
| |
Collapse
|
3
|
Huang X, Islam MR, Akter S, Ahmed F, Kazami E, Serhan HA, Abd-Alrazaq A, Yousefi S. Artificial intelligence in glaucoma: opportunities, challenges, and future directions. Biomed Eng Online 2023; 22:126. [PMID: 38102597 PMCID: PMC10725017 DOI: 10.1186/s12938-023-01187-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Accepted: 12/01/2023] [Indexed: 12/17/2023] Open
Abstract
Artificial intelligence (AI) has shown excellent diagnostic performance in detecting various complex problems related to many areas of healthcare including ophthalmology. AI diagnostic systems developed from fundus images have become state-of-the-art tools in diagnosing retinal conditions and glaucoma as well as other ocular diseases. However, designing and implementing AI models using large imaging data is challenging. In this study, we review different machine learning (ML) and deep learning (DL) techniques applied to multiple modalities of retinal data, such as fundus images and visual fields for glaucoma detection, progression assessment, staging and so on. We summarize findings and provide several taxonomies to help the reader understand the evolution of conventional and emerging AI models in glaucoma. We discuss opportunities and challenges facing AI application in glaucoma and highlight some key themes from the existing literature that may help to explore future studies. Our goal in this systematic review is to help readers and researchers to understand critical aspects of AI related to glaucoma as well as determine the necessary steps and requirements for the successful development of AI models in glaucoma.
Collapse
Affiliation(s)
- Xiaoqin Huang
- Department of Ophthalmology, University of Tennessee Health Science Center, Memphis, USA
| | - Md Rafiqul Islam
- Business Information Systems, Australian Institute of Higher Education, Sydney, Australia
| | - Shanjita Akter
- School of Computer Science, Taylors University, Subang Jaya, Malaysia
| | - Fuad Ahmed
- Department of Computer Science & Engineering, Islamic University of Technology (IUT), Gazipur, Bangladesh
| | - Ehsan Kazami
- Ophthalmology, General Hospital of Mahabad, Urmia University of Medical Sciences, Urmia, Iran
| | - Hashem Abu Serhan
- Department of Ophthalmology, Hamad Medical Corporations, Doha, Qatar
| | - Alaa Abd-Alrazaq
- AI Center for Precision Health, Weill Cornell Medicine-Qatar, Doha, Qatar
| | - Siamak Yousefi
- Department of Ophthalmology, University of Tennessee Health Science Center, Memphis, USA.
- Department of Genetics, Genomics, and Informatics, University of Tennessee Health Science Center, Memphis, USA.
| |
Collapse
|
4
|
Wang Z, Wang J, Zhang H, Yan C, Wang X, Wen X. Mstnet: method for glaucoma grading based on multimodal feature fusion of spatial relations. Phys Med Biol 2023; 68:245002. [PMID: 37857309 DOI: 10.1088/1361-6560/ad0520] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Accepted: 10/19/2023] [Indexed: 10/21/2023]
Abstract
Objective.The objective of this study is to develop an efficient multimodal learning framework for the classification of glaucoma. Glaucoma is a group of eye diseases that can result in vision loss and blindness, often due to delayed detection and treatment. Fundus images and optical coherence tomography (OCT) images have proven valuable for the diagnosis and management of glaucoma. However, current models that combine features from both modalities often lack efficient spatial relationship modeling.Approach.In this study, we propose an innovative approach to address the classification of glaucoma. We focus on leveraging the features of OCT volumes and harness the capabilities of transformer models to capture long-range spatial relationships. To achieve this, we introduce a 3D transformer model to extract features from OCT volumes, enhancing the model's effectiveness. Additionally, we employ downsampling techniques to enhance model efficiency. We then utilize the spatial feature relationships between OCT volumes and fundus images to fuse the features extracted from both sources.Main results.Our proposed framework has yielded remarkable results, particularly in terms of glaucoma grading performance. We conducted our experiments using the GAMMA dataset, and our approach outperformed traditional feature fusion methods. By effectively modeling spatial relationships and combining OCT volume and fundus map features, our framework achieved outstanding classification results.Significance.This research is of significant importance in the field of glaucoma diagnosis and management. Efficient and accurate glaucoma classification is essential for timely intervention and prevention of vision loss. Our proposed approach, which integrates 3D transformer models, offers a novel way to extract and fuse features from OCT volumes and fundus images, ultimately enhancing the effectiveness of glaucoma classification. This work has the potential to contribute to improved patient care, particularly in the early detection and treatment of glaucoma, thereby reducing the risk of vision impairment and blindness.
Collapse
Affiliation(s)
- Zhizhou Wang
- No. 209, University Street, Yuci District, Jinzhong City, Shanxi Province, People's Republic of China
| | - Jun Wang
- No. 209, University Street, Yuci District, Jinzhong City, Shanxi Province, People's Republic of China
| | - Hongru Zhang
- No. 209, University Street, Yuci District, Jinzhong City, Shanxi Province, People's Republic of China
| | - Chen Yan
- No. 209, University Street, Yuci District, Jinzhong City, Shanxi Province, People's Republic of China
| | - Xingkui Wang
- No. 209, University Street, Yuci District, Jinzhong City, Shanxi Province, People's Republic of China
| | - Xin Wen
- No. 209, University Street, Yuci District, Jinzhong City, Shanxi Province, People's Republic of China
| |
Collapse
|
5
|
Mu H, Li RS, Yin Z, Feng ZL. Value of optical coherence tomography measurement of macular thickness and optic disc parameters for glaucoma screening in patients with high myopia. World J Clin Cases 2023; 11:3187-3194. [PMID: 37274056 PMCID: PMC10237143 DOI: 10.12998/wjcc.v11.i14.3187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Revised: 03/12/2023] [Accepted: 04/12/2023] [Indexed: 05/16/2023] Open
Abstract
BACKGROUND The basic method of glaucoma diagnosis is visual field examination, however, in patients with high myopia, the diagnosis of glaucoma is difficult.
AIM To explore the value of optical coherence tomography (OCT) for measuring optic disc parameters and macular thickness as a screening tool for glaucoma in patients with high myopia.
METHODS Visual values (contrast sensitivity, color vision, and best-corrected visual acuity) in three groups, patients with high myopia in Group A, patients with high myopia and glaucoma in Group B, and patients with high myopia suspicious for glaucoma in Group C, were compared. Optic disc parameters, retinal nerve fiber layer (RNFL) thickness, and ganglion cell layer (GCC) thickness were measured using OCT technology and used to compare the peri-optic disc vascular density of the patients and generate receiver operator characteristic (ROC) test performance curves of the RNFL and GCC for high myopia and glaucoma.
RESULTS Of a total of 98 patients admitted to our hospital from May 2018 to March 2022, totaling 196 eyes in the study, 30 patients with 60 eyes were included in Group A, 33 patients with 66 eyes were included in Group B, and 35 patients with 70 eyes were included in Group C. Data were processed for Groups A and B to analyze the efficacy of RNFL and GCC measures in distinguishing high myopia from high myopia with glaucoma. The area under the ROC curve was greater than 0.7, indicating an acceptable diagnostic value.
CONCLUSION The value of OCT measurement of RNFL and GCC thickness in diagnosing glaucoma in patients with high myopia and suspected glaucoma is worthy of development for clinical use.
Collapse
Affiliation(s)
- Hua Mu
- Department of Ophthalmology, The First Affiliated Hospital of Harbin Medical University, Harbin 150001, Heilongjiang Province, China
| | - Rui-Shu Li
- Department of Ophthalmology, The First Affiliated Hospital of Harbin Medical University, Harbin 150001, Heilongjiang Province, China
| | - Zhen Yin
- Department of Ophthalmology, The First Affiliated Hospital of Harbin Medical University, Harbin 150001, Heilongjiang Province, China
| | - Zhuo-Lei Feng
- Department of Ophthalmology, The First Affiliated Hospital of Harbin Medical University, Harbin 150001, Heilongjiang Province, China
| |
Collapse
|
6
|
Automatic Segmentation of the Retinal Nerve Fiber Layer by Means of Mathematical Morphology and Deformable Models in 2D Optical Coherence Tomography Imaging. SENSORS 2021; 21:s21238027. [PMID: 34884031 PMCID: PMC8659929 DOI: 10.3390/s21238027] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/29/2021] [Revised: 11/17/2021] [Accepted: 11/25/2021] [Indexed: 11/17/2022]
Abstract
Glaucoma is a neurodegenerative disease process that leads to progressive damage of the optic nerve to produce visual impairment and blindness. Spectral-domain OCT technology enables peripapillary circular scans of the retina and the measurement of the thickness of the retinal nerve fiber layer (RNFL) for the assessment of the disease status or progression in glaucoma patients. This paper describes a new approach to segment and measure the retinal nerve fiber layer in peripapillary OCT images. The proposed method consists of two stages. In the first one, morphological operators robustly detect the coarse location of the layer boundaries, despite the speckle noise and diverse artifacts in the OCT image. In the second stage, deformable models are initialized with the results of the previous stage to perform a fine segmentation of the boundaries, providing an accurate measurement of the entire RNFL. The results of the RNFL segmentation were qualitatively assessed by ophthalmologists, and the measurements of the thickness of the RNFL were quantitatively compared with those provided by the OCT inbuilt software as well as the state-of-the-art methods.
Collapse
|