1
|
Singh Parmar UP, Surico PL, Singh RB, Romano F, Salati C, Spadea L, Musa M, Gagliano C, Mori T, Zeppieri M. Künstliche Intelligenz (KI) zur Früherkennung von Netzhauterkrankungen. KOMPASS OPHTHALMOLOGIE 2025:1-8. [DOI: 10.1159/000546000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/30/2025]
Abstract
Künstliche Intelligenz (KI) hat sich zu einem transformativen Werkzeug auf dem Gebiet der Augenheilkunde entwickelt und revolutioniert die Diagnose und Behandlung von Krankheiten. Diese Arbeit gibt einen umfassenden Überblick über KI-Anwendungen bei verschiedenen Netzhauterkrankungen und zeigt ihr Potenzial, die Effizienz von Vorsorgeuntersuchungen zu erhöhen, Frühdiagnosen zu erleichtern und die Patientenergebnisse zu verbessern. Wir erklären die grundlegenden Konzepte der KI, einschließlich des maschinellen Lernens (ML) und des Deep Learning (DL), und deren Anwendung in der Augenheilkunde und heben die Bedeutung von KI-basierten Lösungen bei der Bewältigung der Komplexität und Variabilität von Netzhauterkrankungen hervor. Wir gehen auch auf spezifische Anwendungen der KI im Zusammenhang mit Netzhauterkrankungen wie diabetischer Retinopathie (DR), altersbedingter Makuladegeneration (AMD), makulärer Neovaskularisation, Frühgeborenen-Retinopathie (ROP), retinalem Venenverschluss (RVO), hypertensiver Retinopathie (HR), Retinopathia pigmentosa, Morbus Stargardt, Morbus Best (Best’sche vitelliforme Makuladystrophie) und Sichelzellenretinopathie ein. Wir konzentrieren uns auf die aktuelle Landschaft der KI-Technologien, einschließlich verschiedener KI-Modelle, ihrer Leistungsmetriken und klinischen Implikationen. Darüber hinaus befassen wir uns mit den Herausforderungen und Schwierigkeiten bei der Integration von KI in die klinische Praxis, einschließlich des «Black-Box-Phänomens», der Verzerrungen bei der Darstellung von Daten und der Einschränkungen im Zusammenhang mit der ganzheitlichen Bewertung von Patienten. Abschließend wird die kollaborative Rolle der KI an der Seite des medizinischen Fachpersonals hervorgehoben, wobei ein synergetischer Ansatz für die Erbringung von Gesundheitsdienstleistungen befürwortet wird. Es wird betont, wie wichtig es ist, KI als Ergänzung und nicht als Ersatz für menschliche Expertise einzusetzen, um ihr Potenzial zu maximieren, die Gesundheitsversorgung zu revolutionieren, Ungleichheiten in der Gesundheitsversorgung zu verringern und die Patientenergebnisse in der sich entwickelnden medizinischen Landschaft zu verbessern.
Collapse
|
2
|
Beuse A, Wenzel DA, Spitzer MS, Bartz-Schmidt KU, Schultheiss M, Poli S, Grohmann C. Automated Detection of Central Retinal Artery Occlusion Using OCT Imaging via Explainable Deep Learning. OPHTHALMOLOGY SCIENCE 2025; 5:100630. [PMID: 39669299 PMCID: PMC11634984 DOI: 10.1016/j.xops.2024.100630] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/01/2024] [Revised: 09/23/2024] [Accepted: 10/04/2024] [Indexed: 12/14/2024]
Abstract
Objective To demonstrate the capability of a deep learning model to detect central retinal artery occlusion (CRAO), a retinal pathology with significant clinical urgency, using OCT data. Design Retrospective, external validation study analyzing OCT and clinical baseline data of 2 institutions via deep learning classification analysis. Subjects Patients presenting to the University Medical Center Tübingen and the University Medical Center Hamburg-Eppendorf in Germany. Methods OCT data of patients suffering from CRAO, differential diagnosis with (sub) acute visual loss (central retinal vein occlusion, diabetic macular edema, nonarteritic ischemic optic neuropathy), and from controls were expertly graded and distinguished into 3 groups. Our methodological approach involved a nested multiclass five fold cross-validation classification scheme. Main Outcome Measures Area under the curve (AUC). Results The optimal performance of our algorithm was observed using 30 epochs, complemented by an early stopping mechanism to prevent overfitting. Our model followed a multiclass approach, distinguishing among the 3 different classes: control, CRAO, and differential diagnoses. The evaluation was conducted by the "one vs. all" area under the receiver operating characteristics curve (AUC) method. The results demonstrated AUC of 0.96 (95% confidence interval [CI], ± 0.01); 0.99 (95% CI, ± 0.00); and 0.90 (95% CI, ± 0.03) for each class, respectively. Conclusions Our machine learning algorithm (MLA) exhibited a high AUC, as well as sensitivity and specificity in detecting CRAO and the differential classes, respectively. These findings underscore the potential for deploying MLAs in the identification of less common etiologies within an acute emergency clinical setting. Financial Disclosures Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
Collapse
Affiliation(s)
- Ansgar Beuse
- Department of Ophthalmology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Daniel Alexander Wenzel
- University Eye Hospital, Centre for Ophthalmology, University Hospital Tübingen, Tübingen, Germany
| | - Martin Stephan Spitzer
- Department of Ophthalmology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | | | - Maximilian Schultheiss
- Department of Ophthalmology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Sven Poli
- Department of Neurology and Stroke, University Hospital Tübingen, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, University Hospital Tübingen, Tübingen, Germany
| | - Carsten Grohmann
- Department of Ophthalmology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
3
|
Barbosa G, Carvalho E, Guerra A, Torres-Costa S, Ramião N, Parente MLP, Falcão M. Deep Learning to Distinguish Edema Secondary to Retinal Vein Occlusion and Diabetic Macular Edema: A Multimodal Approach Using OCT and Infrared Imaging. J Clin Med 2025; 14:1008. [PMID: 39941677 PMCID: PMC11818623 DOI: 10.3390/jcm14031008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2024] [Revised: 01/07/2025] [Accepted: 02/01/2025] [Indexed: 02/16/2025] Open
Abstract
Background: Retinal diseases are emerging as a significant health concern, making early detection and prompt treatment crucial to prevent visual impairment. Optical coherence tomography (OCT) is the preferred imaging modality for non-invasive diagnosis. Both diabetic macular edema (DME) and macular edema secondary to retinal vein occlusion (RVO) present an increase in retinal thickness, posing etiologic diagnostic challenges for non-specialists in retinal diseases. The lack of research on deep learning classification of macular edema secondary to RVO using OCT images motivated us to propose a convolutional neural network model for this task. Methods: The VGG-19 network was fine-tuned with a public dataset to classify OCT images. This network was then used to develop three models: unimodal-the input is only the OCT B-scan; multimodal-the inputs are the OCT B-scan and diabetes information, and multi-image-the inputs are the OCT B-scan, the infrared image, and the diabetes information. Seven hundred sixty-six patients from ULS São João were selected, comprising 208 healthy eyes, 207 with macular edema secondary to RVO, 218 with DME, and 200 with other pathologies. The performance metrics include accuracy, precision, recall, F0.5 score, and area under the receiver operating characteristic curve (AUROC). Results: The multi-image model achieved better results, with an accuracy of 95.20%, precision of 95.43%, recall of 95.20%, F0.5-score of 95.32%, F1-score of 95.21%, and AUROC of 99.59% on the classification task between four classes. Conclusions: This study presents a novel method to distinguish macular edema secondary to RVO and DME using diabetes diagnosis, OCT, and infrared images. This research aims to provide a reliable tool for ophthalmologists, improving the accuracy and speed of diagnoses.
Collapse
Affiliation(s)
- Guilherme Barbosa
- INEGI—Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, 4200-465 Porto, Portugal; (A.G.); (N.R.)
| | - Eduardo Carvalho
- INEGI—Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, 4200-465 Porto, Portugal; (A.G.); (N.R.)
| | - Ana Guerra
- INEGI—Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, 4200-465 Porto, Portugal; (A.G.); (N.R.)
| | - Sónia Torres-Costa
- Department of Ophthalmology, CHUSJ—Centro Hospitalar e Universitário de São João, 4200-319 Porto, Portugal; (S.T.-C.); (M.F.)
| | - Nilza Ramião
- INEGI—Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, 4200-465 Porto, Portugal; (A.G.); (N.R.)
| | - Marco L. P. Parente
- Department of Mechanical Engineering, Faculdade de Engenharia, Universidade do Porto, 4200-465 Porto, Portugal;
| | - Manuel Falcão
- Department of Ophthalmology, CHUSJ—Centro Hospitalar e Universitário de São João, 4200-319 Porto, Portugal; (S.T.-C.); (M.F.)
- Department of Surgery and Physiology, Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal
| |
Collapse
|
4
|
Ejaz S, Zia HU, Majeed F, Shafique U, Altamiranda SC, Lipari V, Ashraf I. Fundus image classification using feature concatenation for early diagnosis of retinal disease. Digit Health 2025; 11:20552076251328120. [PMID: 40162178 PMCID: PMC11951903 DOI: 10.1177/20552076251328120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2024] [Accepted: 02/04/2025] [Indexed: 04/02/2025] Open
Abstract
Background Deep learning models assist ophthalmologists in early detection of diseases from retinal images and timely treatment. Aim Owing to robust and accurate results from deep learning models, we aim to use convolutional neural network (CNN) to provide a non-invasive method for early detection of eye diseases. Methodology We used a hybridized CNN with deep learning (DL) based on two separate CNN blocks, to identify multiple Optic Disc Cupping, Diabetic Retinopathy, Media Haze, and Healthy images. We used the RFMiD dataset, which contains various categories of fundus images representing different eye diseases. Data augmenting, resizing, coping, and one-hot encoding are used among other preprocessing techniques to improve the performance of the proposed model. Color fundus images have been analyzed by CNNs to extract relevant features. Two CCN models that extract deep features are trained in parallel. To obtain more noticeable features, the gathered features are further fused utilizing the Canonical Correlation Analysis fusion approach. To assess the effectiveness, we employed eight classification algorithms: Gradient boosting, support vector machines, voting ensemble, medium KNN, Naive Bayes, COARSE- KNN, random forest, and fine KNN. Results With the greatest accuracy of 93.39%, the ensemble learning performed better than the other algorithms. Conclusion The accuracy rates suggest that the deep learning model has learned to distinguish between different eye disease categories and healthy images effectively. It contributes to the field of eye disease detection through the analysis of color fundus images by providing a reliable and efficient diagnostic system.
Collapse
Affiliation(s)
- Sara Ejaz
- Department of Information Technology, University of Gujrat, Gujrat, Pakistan
| | - Hafiz U Zia
- Department of Information Technology, University of Gujrat, Gujrat, Pakistan
| | - Fiaz Majeed
- Department of Information Technology, University of Gujrat, Gujrat, Pakistan
| | - Umair Shafique
- Department of Information Technology, University of Gujrat, Gujrat, Pakistan
| | - Stefania Carvajal Altamiranda
- Universidad Europea del Atlantico, Santander, Spain
- Universidade Internacional do Cuanza, Cuito, Bie, Angola
- Fundacion Universitaria Internacional de Colombia, Bogota, Colombia
| | - Vivian Lipari
- Universidad Europea del Atlantico, Santander, Spain
- Universidad Internacional Iberoamericana, Campeche, Mexico
- Universidad de La Romana, La Romana, Republica Dominicana
| | - Imran Ashraf
- Department of Information and Communication Engineering, Yeungnam University, Gyeongsan South Korea
| |
Collapse
|
5
|
Khosravi P, Huck NA, Shahraki K, Ghafari E, Azimi R, Kim SY, Crouch E, Xie X, Suh DW. External Validation of Deep Learning Models for Classifying Etiology of Retinal Hemorrhage Using Diverse Fundus Photography Datasets. Bioengineering (Basel) 2024; 12:20. [PMID: 39851294 PMCID: PMC11760437 DOI: 10.3390/bioengineering12010020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2024] [Revised: 12/18/2024] [Accepted: 12/26/2024] [Indexed: 01/26/2025] Open
Abstract
Retinal hemorrhage (RH) is a significant clinical finding with various etiologies, necessitating accurate classification for effective management. This study aims to externally validate deep learning (DL) models, specifically FastVit_SA12 and ResNet18, for distinguishing between traumatic and medical causes of RH using diverse fundus photography datasets. A comprehensive dataset was compiled, including private collections from South Korea and Virginia, alongside publicly available datasets such as RFMiD, BRSET, and DeepEyeNet. The models were evaluated on a total of 2661 images, achieving high performance metrics. FastVit_SA12 demonstrated an overall accuracy of 96.99%, with a precision of 0.9935 and recall of 0.9723 for medical cases, while ResNet18 achieved a 94.66% accuracy with a precision of 0.9893. A Grad-CAM analysis revealed that ResNet18 emphasized global vascular patterns, such as arcuate vessels, while FastVit_SA12 focused on clinically relevant areas, including the optic disk and hemorrhagic regions. Medical cases showed localized activations, whereas trauma-related images displayed diffuse patterns across the fundus. Both models exhibited strong sensitivity and specificity, indicating their potential utility in clinical settings for accurate RH diagnosis. This study underscores the importance of external validation in enhancing the reliability and applicability of AI models in ophthalmology, paving the way for improved patient care and outcomes.
Collapse
Affiliation(s)
- Pooya Khosravi
- Department of Ophthalmology, School of Medicine, University of California, Irvine, CA 92697, USA; (P.K.); (N.A.H.); (K.S.); (E.G.); (R.A.)
- Donald Bren School of Information and Computer Sciences, University of California, Irvine, CA 92697, USA;
| | - Nolan A. Huck
- Department of Ophthalmology, School of Medicine, University of California, Irvine, CA 92697, USA; (P.K.); (N.A.H.); (K.S.); (E.G.); (R.A.)
| | - Kourosh Shahraki
- Department of Ophthalmology, School of Medicine, University of California, Irvine, CA 92697, USA; (P.K.); (N.A.H.); (K.S.); (E.G.); (R.A.)
| | - Elina Ghafari
- Department of Ophthalmology, School of Medicine, University of California, Irvine, CA 92697, USA; (P.K.); (N.A.H.); (K.S.); (E.G.); (R.A.)
| | - Reza Azimi
- Department of Ophthalmology, School of Medicine, University of California, Irvine, CA 92697, USA; (P.K.); (N.A.H.); (K.S.); (E.G.); (R.A.)
| | - So Young Kim
- Department of Ophthalmology, Soonchunhyang University College of Medicine, Cheonan, 31151, Republic of Korea;
| | - Eric Crouch
- Department of Ophthalmology, Eastern Virginia Medical School, Norfolk, VA 23507, USA;
| | - Xiaohui Xie
- Donald Bren School of Information and Computer Sciences, University of California, Irvine, CA 92697, USA;
| | - Donny W. Suh
- Department of Ophthalmology, School of Medicine, University of California, Irvine, CA 92697, USA; (P.K.); (N.A.H.); (K.S.); (E.G.); (R.A.)
| |
Collapse
|
6
|
Wei Q, Chen Q, Zhao C, Jiang R. Performance of automated machine learning in detecting fundus diseases based on ophthalmologic B-scan ultrasound images. BMJ Open Ophthalmol 2024; 9:e001873. [PMID: 39663141 PMCID: PMC11647328 DOI: 10.1136/bmjophth-2024-001873] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2024] [Accepted: 11/06/2024] [Indexed: 12/13/2024] Open
Abstract
AIM To evaluate the efficacy of automated machine learning (AutoML) models in detecting fundus diseases using ocular B-scan ultrasound images. METHODS Ophthalmologists annotated two B-scan ultrasound image datasets to develop three AutoML models-single-label, multi-class single-label and multi-label-on the Vertex artificial intelligence (AI) platform. Performance of these models was compared among themselves and against existing bespoke models for binary classification tasks. RESULTS The training set involved 3938 images from 1378 patients, while batch predictions used an additional set of 336 images from 180 patients. The single-label AutoML model, trained on normal and abnormal fundus images, achieved an area under the precision-recall curve (AUPRC) of 0.9943. The multi-class single-label model, focused on single-pathology images, recorded an AUPRC of 0.9617, with performance metrics of these two single-label models proving comparable to those of previously published models. The multi-label model, designed to detect both single and multiple pathologies, posted an AUPRC of 0.9650. Pathology classification AUPRCs for the multi-class single-label model ranged from 0.9277 to 1.0000 and from 0.8780 to 0.9980 for the multi-label model. Batch prediction accuracies ranged from 86.57% to 97.65% for various fundus conditions in the multi-label AutoML model. Statistical analysis demonstrated that the single-label model significantly outperformed the other two models in all evaluated metrics (p<0.05). CONCLUSION AutoML models, developed by clinicians, effectively detected multiple fundus lesions with performance on par with that of deep-learning models crafted by AI specialists. This underscores AutoML's potential to revolutionise ophthalmologic diagnostics, facilitating broader accessibility and application of sophisticated diagnostic technologies.
Collapse
Affiliation(s)
- Qiaoling Wei
- Eye Institute and Department of Ophthalmology, Eye & ENT Hospital, Fudan University, Shanghai, China
- Ocular Trauma Center, Eye & ENT Hospital, Fudan University, Shanghai, China
| | - Qian Chen
- Eye Institute and Department of Ophthalmology, Eye & ENT Hospital, Fudan University, Shanghai, China
| | - Chen Zhao
- Eye Institute and Department of Ophthalmology, Eye & ENT Hospital, Fudan University, Shanghai, China
| | - Rui Jiang
- Eye Institute and Department of Ophthalmology, Eye & ENT Hospital, Fudan University, Shanghai, China
- Ocular Trauma Center, Eye & ENT Hospital, Fudan University, Shanghai, China
| |
Collapse
|
7
|
Wong CYT, O'Byrne C, Taribagil P, Liu T, Antaki F, Keane PA. Comparing code-free and bespoke deep learning approaches in ophthalmology. Graefes Arch Clin Exp Ophthalmol 2024; 262:2785-2798. [PMID: 38446200 PMCID: PMC11377500 DOI: 10.1007/s00417-024-06432-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 02/13/2024] [Accepted: 02/27/2024] [Indexed: 03/07/2024] Open
Abstract
AIM Code-free deep learning (CFDL) allows clinicians without coding expertise to build high-quality artificial intelligence (AI) models without writing code. In this review, we comprehensively review the advantages that CFDL offers over bespoke expert-designed deep learning (DL). As exemplars, we use the following tasks: (1) diabetic retinopathy screening, (2) retinal multi-disease classification, (3) surgical video classification, (4) oculomics and (5) resource management. METHODS We performed a search for studies reporting CFDL applications in ophthalmology in MEDLINE (through PubMed) from inception to June 25, 2023, using the keywords 'autoML' AND 'ophthalmology'. After identifying 5 CFDL studies looking at our target tasks, we performed a subsequent search to find corresponding bespoke DL studies focused on the same tasks. Only English-written articles with full text available were included. Reviews, editorials, protocols and case reports or case series were excluded. We identified ten relevant studies for this review. RESULTS Overall, studies were optimistic towards CFDL's advantages over bespoke DL in the five ophthalmological tasks. However, much of such discussions were identified to be mono-dimensional and had wide applicability gaps. High-quality assessment of better CFDL applicability over bespoke DL warrants a context-specific, weighted assessment of clinician intent, patient acceptance and cost-effectiveness. We conclude that CFDL and bespoke DL are unique in their own assets and are irreplaceable with each other. Their benefits are differentially valued on a case-to-case basis. Future studies are warranted to perform a multidimensional analysis of both techniques and to improve limitations of suboptimal dataset quality, poor applicability implications and non-regulated study designs. CONCLUSION For clinicians without DL expertise and easy access to AI experts, CFDL allows the prototyping of novel clinical AI systems. CFDL models concert with bespoke models, depending on the task at hand. A multidimensional, weighted evaluation of the factors involved in the implementation of those models for a designated task is warranted.
Collapse
Affiliation(s)
- Carolyn Yu Tung Wong
- Institute of Ophthalmology, University College London, 11-43 Bath St, London, EC1V 9EL, UK
- Moorfields Eye Hospital NHS Foundation Trust, London, UK
- Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Ciara O'Byrne
- Institute of Ophthalmology, University College London, 11-43 Bath St, London, EC1V 9EL, UK
- Moorfields Eye Hospital NHS Foundation Trust, London, UK
| | - Priyal Taribagil
- Institute of Ophthalmology, University College London, 11-43 Bath St, London, EC1V 9EL, UK
- Moorfields Eye Hospital NHS Foundation Trust, London, UK
| | - Timing Liu
- Institute of Ophthalmology, University College London, 11-43 Bath St, London, EC1V 9EL, UK
- Moorfields Eye Hospital NHS Foundation Trust, London, UK
| | - Fares Antaki
- Institute of Ophthalmology, University College London, 11-43 Bath St, London, EC1V 9EL, UK
- Moorfields Eye Hospital NHS Foundation Trust, London, UK
- The CHUM School of Artificial Intelligence in Healthcare, Montreal, QC, Canada
| | - Pearse Andrew Keane
- Institute of Ophthalmology, University College London, 11-43 Bath St, London, EC1V 9EL, UK.
- Moorfields Eye Hospital NHS Foundation Trust, London, UK.
- NIHR Moorfields Biomedical Research Centre, London, UK.
| |
Collapse
|
8
|
Inouye K, Petrosyan A, Moskalensky L, Thankam FG. Artificial intelligence in therapeutic management of hyperlipidemic ocular pathology. Exp Eye Res 2024; 245:109954. [PMID: 38838975 DOI: 10.1016/j.exer.2024.109954] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Revised: 04/09/2024] [Accepted: 06/02/2024] [Indexed: 06/07/2024]
Abstract
Hyperlipidemia has many ocular manifestations, the most prevalent being retinal vascular occlusion. Hyperlipidemic lesions and occlusions to the vessels supplying the retina result in permanent blindness, necessitating prompt detection and treatment. Retinal vascular occlusion is diagnosed using different imaging modalities, including optical coherence tomography angiography. These diagnostic techniques obtain images representing the blood flow through the retinal vessels, providing an opportunity for AI to utilize image recognition to detect blockages and abnormalities before patients present with symptoms. AI is already being used as a non-invasive method to detect retinal vascular occlusions and other vascular pathology, as well as predict treatment outcomes. As providers see an increase in patients presenting with new retinal vascular occlusions, the use of AI to detect and treat these conditions has the potential to improve patient outcomes and reduce the financial burden on the healthcare system. This article comprehends the implications of AI in the current management strategies of retinal vascular occlusion (RVO) in hyperlipidemia and the recent developments of AI technology in the management of ocular diseases.
Collapse
Affiliation(s)
- Keiko Inouye
- Department of Translational Research, College of Osteopathic Medicine of the Pacific, Western University of Health Sciences, USA
| | - Aelita Petrosyan
- Department of Translational Research, College of Osteopathic Medicine of the Pacific, Western University of Health Sciences, USA
| | - Liana Moskalensky
- Department of Translational Research, College of Osteopathic Medicine of the Pacific, Western University of Health Sciences, USA
| | - Finosh G Thankam
- Department of Translational Research, College of Osteopathic Medicine of the Pacific, Western University of Health Sciences, USA.
| |
Collapse
|
9
|
Ejaz S, Baig R, Ashraf Z, Alnfiai MM, Alnahari MM, Alotaibi RM. A deep learning framework for the early detection of multi-retinal diseases. PLoS One 2024; 19:e0307317. [PMID: 39052616 PMCID: PMC11271906 DOI: 10.1371/journal.pone.0307317] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2024] [Accepted: 07/02/2024] [Indexed: 07/27/2024] Open
Abstract
Retinal images play a pivotal contribution to the diagnosis of various ocular conditions by ophthalmologists. Extensive research was conducted to enable early detection and timely treatment using deep learning algorithms for retinal fundus images. Quick diagnosis and treatment planning can be facilitated by deep learning models' ability to process images rapidly and deliver outcomes instantly. Our research aims to provide a non-invasive method for early detection and timely eye disease treatment using a Convolutional Neural Network (CNN). We used a dataset Retinal Fundus Multi-disease Image Dataset (RFMiD), which contains various categories of fundus images representing different eye diseases, including Media Haze (MH), Optic Disc Cupping (ODC), Diabetic Retinopathy (DR), and healthy images (WNL). Several pre-processing techniques were applied to improve the model's performance, such as data augmentation, cropping, resizing, dataset splitting, converting images to arrays, and one-hot encoding. CNNs have extracted extract pertinent features from the input color fundus images. These extracted features are employed to make predictive diagnostic decisions. In this article three CNN models were used to perform experiments. The model's performance is assessed utilizing statistical metrics such as accuracy, F1 score, recall, and precision. Based on the results, the developed framework demonstrates promising performance with accuracy rates of up to 89.81% for validation and 88.72% for testing using 12-layer CNN after Data Augmentation. The accuracy rate obtained from 20-layer CNN is 90.34% for validation and 89.59% for testing with Augmented data. The accuracy obtained from 20-layer CNN is greater but this model shows overfitting. These accuracy rates suggested that the deep learning model has learned to distinguish between different eye disease categories and healthy images effectively. This study's contribution lies in providing a reliable and efficient diagnostic system for the simultaneous detection of multiple eye diseases through the analysis of color fundus images.
Collapse
Affiliation(s)
- Sara Ejaz
- Department of Information and Technology, University of Gujrat, Gujrat, Punjab, Pakistan
| | - Raheel Baig
- Department of Computer Science, The University of Chenab, Gujrat, Punjab, Pakistan
| | - Zeeshan Ashraf
- Department of Computer Science, The University of Chenab, Gujrat, Punjab, Pakistan
| | - Mrim M. Alnfiai
- Department of Information Technology, College of Computers and Information Technology, Taif University, Taif, Saudi Arabia
| | - Mona Mohammed Alnahari
- Department of Information Technology, College of Computers and Information Technology, Taif University, Taif, Saudi Arabia
| | - Reemiah Muneer Alotaibi
- Information Technology Department, College of Computer and Information Sciences, Al-Imam Mohammad Ibn Saud Islamic University, Riyadh, Saudi Arabia
| |
Collapse
|
10
|
Wang J, Wang SZ, Qin XL, Chen M, Zhang HM, Liu X, Xiang MJ, Hu JB, Huang HY, Lan CJ. Algorithm of automatic identification of diabetic retinopathy foci based on ultra-widefield scanning laser ophthalmoscopy. Int J Ophthalmol 2024; 17:610-615. [PMID: 38638262 PMCID: PMC10988084 DOI: 10.18240/ijo.2024.04.02] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2023] [Accepted: 01/15/2024] [Indexed: 04/20/2024] Open
Abstract
AIM To propose an algorithm for automatic detection of diabetic retinopathy (DR) lesions based on ultra-widefield scanning laser ophthalmoscopy (SLO). METHODS The algorithm utilized the FasterRCNN (Faster Regions with CNN features)+ResNet50 (Residua Network 50)+FPN (Feature Pyramid Networks) method for detecting hemorrhagic spots, cotton wool spots, exudates, and microaneurysms in DR ultra-widefield SLO. Subimage segmentation combined with a deeper residual network FasterRCNN+ResNet50 was employed for feature extraction to enhance intelligent learning rate. Feature fusion was carried out by the feature pyramid network FPN, which significantly improved lesion detection rates in SLO fundus images. RESULTS By analyzing 1076 ultra-widefield SLO images provided by our hospital, with a resolution of 2600×2048 dpi, the accuracy rates for hemorrhagic spots, cotton wool spots, exudates, and microaneurysms were found to be 87.23%, 83.57%, 86.75%, and 54.94%, respectively. CONCLUSION The proposed algorithm demonstrates intelligent detection of DR lesions in ultra-widefield SLO, providing significant advantages over traditional fundus color imaging intelligent diagnosis algorithms.
Collapse
Affiliation(s)
- Jie Wang
- Aier Eye Hospital (East of Chengdu), Chengdu 610051, Sichuan Province, China
| | - Su-Zhen Wang
- Department of Ophthalmology, Chengdu First People's Hospital, Chengdu 610095, Sichuan Province, China
| | - Xiao-Lin Qin
- Aier Eye Hospital (East of Chengdu), Chengdu 610051, Sichuan Province, China
| | - Meng Chen
- Aier Eye Hospital (East of Chengdu), Chengdu 610051, Sichuan Province, China
| | - Heng-Ming Zhang
- School of Computer and Artificial Intelligence, Southwest Jiaotong University, Chengdu 610097, Sichuan Province, China
| | - Xin Liu
- Aier Eye Hospital (East of Chengdu), Chengdu 610051, Sichuan Province, China
| | - Meng-Jun Xiang
- Aier Eye Hospital (East of Chengdu), Chengdu 610051, Sichuan Province, China
| | - Jian-Bin Hu
- Chengdu Aier Eye Hospital, Chengdu 610041, Sichuan Province, China
| | - Hai-Yu Huang
- School of Computer and Artificial Intelligence, Southwest Jiaotong University, Chengdu 610097, Sichuan Province, China
| | - Chang-Jun Lan
- Aier Eye Hospital (East of Chengdu), Chengdu 610051, Sichuan Province, China
| |
Collapse
|
11
|
Parmar UPS, Surico PL, Singh RB, Romano F, Salati C, Spadea L, Musa M, Gagliano C, Mori T, Zeppieri M. Artificial Intelligence (AI) for Early Diagnosis of Retinal Diseases. MEDICINA (KAUNAS, LITHUANIA) 2024; 60:527. [PMID: 38674173 PMCID: PMC11052176 DOI: 10.3390/medicina60040527] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/27/2024] [Revised: 03/12/2024] [Accepted: 03/21/2024] [Indexed: 04/28/2024]
Abstract
Artificial intelligence (AI) has emerged as a transformative tool in the field of ophthalmology, revolutionizing disease diagnosis and management. This paper provides a comprehensive overview of AI applications in various retinal diseases, highlighting its potential to enhance screening efficiency, facilitate early diagnosis, and improve patient outcomes. Herein, we elucidate the fundamental concepts of AI, including machine learning (ML) and deep learning (DL), and their application in ophthalmology, underscoring the significance of AI-driven solutions in addressing the complexity and variability of retinal diseases. Furthermore, we delve into the specific applications of AI in retinal diseases such as diabetic retinopathy (DR), age-related macular degeneration (AMD), Macular Neovascularization, retinopathy of prematurity (ROP), retinal vein occlusion (RVO), hypertensive retinopathy (HR), Retinitis Pigmentosa, Stargardt disease, best vitelliform macular dystrophy, and sickle cell retinopathy. We focus on the current landscape of AI technologies, including various AI models, their performance metrics, and clinical implications. Furthermore, we aim to address challenges and pitfalls associated with the integration of AI in clinical practice, including the "black box phenomenon", biases in data representation, and limitations in comprehensive patient assessment. In conclusion, this review emphasizes the collaborative role of AI alongside healthcare professionals, advocating for a synergistic approach to healthcare delivery. It highlights the importance of leveraging AI to augment, rather than replace, human expertise, thereby maximizing its potential to revolutionize healthcare delivery, mitigate healthcare disparities, and improve patient outcomes in the evolving landscape of medicine.
Collapse
Affiliation(s)
| | - Pier Luigi Surico
- Massachusetts Eye and Ear, Department of Ophthalmology, Harvard Medical School, Boston, MA 02114, USA
- Department of Ophthalmology, Campus Bio-Medico University, 00128 Rome, Italy
- Fondazione Policlinico Universitario Campus Bio-Medico, 00128 Rome, Italy
| | - Rohan Bir Singh
- Massachusetts Eye and Ear, Department of Ophthalmology, Harvard Medical School, Boston, MA 02114, USA
| | - Francesco Romano
- Massachusetts Eye and Ear, Department of Ophthalmology, Harvard Medical School, Boston, MA 02114, USA
| | - Carlo Salati
- Department of Ophthalmology, University Hospital of Udine, p.le S. Maria della Misericordia 15, 33100 Udine, Italy
| | - Leopoldo Spadea
- Eye Clinic, Policlinico Umberto I, “Sapienza” University of Rome, 00142 Rome, Italy
| | - Mutali Musa
- Department of Optometry, University of Benin, Benin City 300238, Edo State, Nigeria
| | - Caterina Gagliano
- Faculty of Medicine and Surgery, University of Enna “Kore”, Piazza dell’Università, 94100 Enna, Italy
- Eye Clinic, Catania University, San Marco Hospital, Viale Carlo Azeglio Ciampi, 95121 Catania, Italy
| | - Tommaso Mori
- Department of Ophthalmology, Campus Bio-Medico University, 00128 Rome, Italy
- Fondazione Policlinico Universitario Campus Bio-Medico, 00128 Rome, Italy
- Department of Ophthalmology, University of California San Diego, La Jolla, CA 92122, USA
| | - Marco Zeppieri
- Department of Ophthalmology, University Hospital of Udine, p.le S. Maria della Misericordia 15, 33100 Udine, Italy
| |
Collapse
|
12
|
Tang QQ, Yang XG, Wang HQ, Wu DW, Zhang MX. Applications of deep learning for detecting ophthalmic diseases with ultrawide-field fundus images. Int J Ophthalmol 2024; 17:188-200. [PMID: 38239939 PMCID: PMC10754665 DOI: 10.18240/ijo.2024.01.24] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2023] [Accepted: 11/07/2023] [Indexed: 01/22/2024] Open
Abstract
AIM To summarize the application of deep learning in detecting ophthalmic disease with ultrawide-field fundus images and analyze the advantages, limitations, and possible solutions common to all tasks. METHODS We searched three academic databases, including PubMed, Web of Science, and Ovid, with the date of August 2022. We matched and screened according to the target keywords and publication year and retrieved a total of 4358 research papers according to the keywords, of which 23 studies were retrieved on applying deep learning in diagnosing ophthalmic disease with ultrawide-field images. RESULTS Deep learning in ultrawide-field images can detect various ophthalmic diseases and achieve great performance, including diabetic retinopathy, glaucoma, age-related macular degeneration, retinal vein occlusions, retinal detachment, and other peripheral retinal diseases. Compared to fundus images, the ultrawide-field fundus scanning laser ophthalmoscopy enables the capture of the ocular fundus up to 200° in a single exposure, which can observe more areas of the retina. CONCLUSION The combination of ultrawide-field fundus images and artificial intelligence will achieve great performance in diagnosing multiple ophthalmic diseases in the future.
Collapse
Affiliation(s)
- Qing-Qing Tang
- Department of Ophthalmology and Research Laboratory of Macular Disease, West China Hospital, Sichuan University, Chengdu 610041, Sichuan Province, China
| | - Xiang-Gang Yang
- Department of Ophthalmology and Research Laboratory of Macular Disease, West China Hospital, Sichuan University, Chengdu 610041, Sichuan Province, China
| | - Hong-Qiu Wang
- Hong Kong University of Science and Technology (Guangzhou), Guangzhou 511400, Guangdong Province, China
| | - Da-Wen Wu
- Department of Ophthalmology and Research Laboratory of Macular Disease, West China Hospital, Sichuan University, Chengdu 610041, Sichuan Province, China
| | - Mei-Xia Zhang
- Department of Ophthalmology and Research Laboratory of Macular Disease, West China Hospital, Sichuan University, Chengdu 610041, Sichuan Province, China
| |
Collapse
|
13
|
Ji YK, Hua RR, Liu S, Xie CJ, Zhang SC, Yang WH. Intelligent diagnosis of retinal vein occlusion based on color fundus photographs. Int J Ophthalmol 2024; 17:1-6. [PMID: 38239946 PMCID: PMC10754666 DOI: 10.18240/ijo.2024.01.01] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Accepted: 10/17/2023] [Indexed: 01/22/2024] Open
Abstract
AIM To develop an artificial intelligence (AI) diagnosis model based on deep learning (DL) algorithm to diagnose different types of retinal vein occlusion (RVO) by recognizing color fundus photographs (CFPs). METHODS Totally 914 CFPs of healthy people and patients with RVO were collected as experimental data sets, and used to train, verify and test the diagnostic model of RVO. All the images were divided into four categories [normal, central retinal vein occlusion (CRVO), branch retinal vein occlusion (BRVO), and macular retinal vein occlusion (MRVO)] by three fundus disease experts. Swin Transformer was used to build the RVO diagnosis model, and different types of RVO diagnosis experiments were conducted. The model's performance was compared to that of the experts. RESULTS The accuracy of the model in the diagnosis of normal, CRVO, BRVO, and MRVO reached 1.000, 0.978, 0.957, and 0.978; the specificity reached 1.000, 0.986, 0.982, and 0.976; the sensitivity reached 1.000, 0.955, 0.917, and 1.000; the F1-Sore reached 1.000, 0.955 0.943, and 0.887 respectively. In addition, the area under curve of normal, CRVO, BRVO, and MRVO diagnosed by the diagnostic model were 1.000, 0.900, 0.959 and 0.970, respectively. The diagnostic results were highly consistent with those of fundus disease experts, and the diagnostic performance was superior. CONCLUSION The diagnostic model developed in this study can well diagnose different types of RVO, effectively relieve the work pressure of clinicians, and provide help for the follow-up clinical diagnosis and treatment of RVO patients.
Collapse
Affiliation(s)
- Yu-Ke Ji
- Eye Hospital, Nanjing Medical University, Nanjing 210000, Jiangsu Province, China
| | - Rong-Rong Hua
- College of Electronic Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210000, Jiangsu Province, China
| | - Sha Liu
- Eye Hospital, Nanjing Medical University, Nanjing 210000, Jiangsu Province, China
| | - Cui-Juan Xie
- Shenzhen Eye Institute, Shenzhen Eye Hospital, Jinan University, Shenzhen 518000, Guangdong Province, China
| | - Shao-Chong Zhang
- Shenzhen Eye Institute, Shenzhen Eye Hospital, Jinan University, Shenzhen 518000, Guangdong Province, China
| | - Wei-Hua Yang
- Shenzhen Eye Institute, Shenzhen Eye Hospital, Jinan University, Shenzhen 518000, Guangdong Province, China
| |
Collapse
|
14
|
Liu YF, Ji YK, Fei FQ, Chen NM, Zhu ZT, Fei XZ. Research progress in artificial intelligence assisted diabetic retinopathy diagnosis. Int J Ophthalmol 2023; 16:1395-1405. [PMID: 37724288 PMCID: PMC10475636 DOI: 10.18240/ijo.2023.09.05] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Accepted: 06/14/2023] [Indexed: 09/20/2023] Open
Abstract
Diabetic retinopathy (DR) is one of the most common retinal vascular diseases and one of the main causes of blindness worldwide. Early detection and treatment can effectively delay vision decline and even blindness in patients with DR. In recent years, artificial intelligence (AI) models constructed by machine learning and deep learning (DL) algorithms have been widely used in ophthalmology research, especially in diagnosing and treating ophthalmic diseases, particularly DR. Regarding DR, AI has mainly been used in its diagnosis, grading, and lesion recognition and segmentation, and good research and application results have been achieved. This study summarizes the research progress in AI models based on machine learning and DL algorithms for DR diagnosis and discusses some limitations and challenges in AI research.
Collapse
Affiliation(s)
- Yun-Fang Liu
- Department of Ophthalmology, First People's Hospital of Huzhou, Huzhou University, Huzhou 313000, Zhejiang Province, China
| | - Yu-Ke Ji
- Eye Hospital, Nanjing Medical University, Nanjing 210000, Jiangsu Province, China
| | - Fang-Qin Fei
- Department of Endocrinology, First People's Hospital of Huzhou, Huzhou University, Huzhou 313000, Zhejiang Province, China
| | - Nai-Mei Chen
- Department of Ophthalmology, Huai'an Hospital of Huai'an City, Huai'an 223000, Jiangsu Province, China
| | - Zhen-Tao Zhu
- Department of Ophthalmology, Huai'an Hospital of Huai'an City, Huai'an 223000, Jiangsu Province, China
| | - Xing-Zhen Fei
- Department of Endocrinology, First People's Hospital of Huzhou, Huzhou University, Huzhou 313000, Zhejiang Province, China
| |
Collapse
|
15
|
Pham VN, Le DT, Bum J, Kim SH, Song SJ, Choo H. Discriminative-Region Multi-Label Classification of Ultra-Widefield Fundus Images. Bioengineering (Basel) 2023; 10:1048. [PMID: 37760150 PMCID: PMC10525847 DOI: 10.3390/bioengineering10091048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2023] [Revised: 09/01/2023] [Accepted: 09/04/2023] [Indexed: 09/29/2023] Open
Abstract
Ultra-widefield fundus image (UFI) has become a crucial tool for ophthalmologists in diagnosing ocular diseases because of its ability to capture a wide field of the retina. Nevertheless, detecting and classifying multiple diseases within this imaging modality continues to pose a significant challenge for ophthalmologists. An automated disease classification system for UFI can support ophthalmologists in making faster and more precise diagnoses. However, existing works for UFI classification often focus on a single disease or assume each image only contains one disease when tackling multi-disease issues. Furthermore, the distinctive characteristics of each disease are typically not utilized to improve the performance of the classification systems. To address these limitations, we propose a novel approach that leverages disease-specific regions of interest for the multi-label classification of UFI. Our method uses three regions, including the optic disc area, the macula area, and the entire UFI, which serve as the most informative regions for diagnosing one or multiple ocular diseases. Experimental results on a dataset comprising 5930 UFIs with six common ocular diseases showcase that our proposed approach attains exceptional performance, with the area under the receiver operating characteristic curve scores for each class spanning from 95.07% to 99.14%. These results not only surpass existing state-of-the-art methods but also exhibit significant enhancements, with improvements of up to 5.29%. These results demonstrate the potential of our method to provide ophthalmologists with valuable information for early and accurate diagnosis of ocular diseases, ultimately leading to improved patient outcomes.
Collapse
Affiliation(s)
- Van-Nguyen Pham
- Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon 16419, Republic of Korea;
| | - Duc-Tai Le
- College of Computing and Informatics, Sungkyunkwan University, Suwon 16419, Republic of Korea;
| | - Junghyun Bum
- Sungkyun AI Research Institute, Sungkyunkwan University, Suwon 16419, Republic of Korea;
| | - Seong Ho Kim
- Department of Ophthalmology, Kangbuk Samsung Hospital, School of Medicine, Sungkyunkwan University, Seoul 03181, Republic of Korea;
| | - Su Jeong Song
- Department of Ophthalmology, Kangbuk Samsung Hospital, School of Medicine, Sungkyunkwan University, Seoul 03181, Republic of Korea;
- Biomedical Institute for Convergence, Sungkyunkwan University, Suwon 16419, Republic of Korea
| | - Hyunseung Choo
- Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon 16419, Republic of Korea;
- College of Computing and Informatics, Sungkyunkwan University, Suwon 16419, Republic of Korea;
- Department of Superintelligence Engineering, Sungkyunkwan University, Suwon 16419, Republic of Korea
| |
Collapse
|
16
|
Chou YB, Kale AU, Lanzetta P, Aslam T, Barratt J, Danese C, Eldem B, Eter N, Gale R, Korobelnik JF, Kozak I, Li X, Li X, Loewenstein A, Ruamviboonsuk P, Sakamoto T, Ting DS, van Wijngaarden P, Waldstein SM, Wong D, Wu L, Zapata MA, Zarranz-Ventura J. Current status and practical considerations of artificial intelligence use in screening and diagnosing retinal diseases: Vision Academy retinal expert consensus. Curr Opin Ophthalmol 2023; 34:403-413. [PMID: 37326222 PMCID: PMC10399944 DOI: 10.1097/icu.0000000000000979] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
PURPOSE OF REVIEW The application of artificial intelligence (AI) technologies in screening and diagnosing retinal diseases may play an important role in telemedicine and has potential to shape modern healthcare ecosystems, including within ophthalmology. RECENT FINDINGS In this article, we examine the latest publications relevant to AI in retinal disease and discuss the currently available algorithms. We summarize four key requirements underlining the successful application of AI algorithms in real-world practice: processing massive data; practicability of an AI model in ophthalmology; policy compliance and the regulatory environment; and balancing profit and cost when developing and maintaining AI models. SUMMARY The Vision Academy recognizes the advantages and disadvantages of AI-based technologies and gives insightful recommendations for future directions.
Collapse
Affiliation(s)
- Yu-Bai Chou
- Department of Ophthalmology, Taipei Veterans General Hospital
- School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Aditya U. Kale
- Academic Unit of Ophthalmology, Institute of Inflammation & Ageing, College of Medical and Dental Sciences, University of Birmingham, Birmingham, UK
| | - Paolo Lanzetta
- Department of Medicine – Ophthalmology, University of Udine
- Istituto Europeo di Microchirurgia Oculare, Udine, Italy
| | - Tariq Aslam
- Division of Pharmacy and Optometry, Faculty of Biology, Medicine and Health, University of Manchester School of Health Sciences, Manchester, UK
| | - Jane Barratt
- International Federation on Ageing, Toronto, Canada
| | - Carla Danese
- Department of Medicine – Ophthalmology, University of Udine
- Department of Ophthalmology, AP-HP Hôpital Lariboisière, Université Paris Cité, Paris, France
| | - Bora Eldem
- Department of Ophthalmology, Hacettepe University, Ankara, Turkey
| | - Nicole Eter
- Department of Ophthalmology, University of Münster Medical Center, Münster, Germany
| | - Richard Gale
- Department of Ophthalmology, York Teaching Hospital NHS Foundation Trust, York, UK
| | - Jean-François Korobelnik
- Service d’ophtalmologie, CHU Bordeaux
- University of Bordeaux, INSERM, BPH, UMR1219, F-33000 Bordeaux, France
| | - Igor Kozak
- Moorfields Eye Hospital Centre, Abu Dhabi, UAE
| | - Xiaorong Li
- Tianjin Key Laboratory of Retinal Functions and Diseases, Tianjin Branch of National Clinical Research Center for Ocular Disease, Eye Institute and School of Optometry, Tianjin Medical University Eye Hospital, Tianjin
| | - Xiaoxin Li
- Xiamen Eye Center, Xiamen University, Xiamen, China
| | - Anat Loewenstein
- Division of Ophthalmology, Tel Aviv Sourasky Medical Center, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Paisan Ruamviboonsuk
- Department of Ophthalmology, College of Medicine, Rangsit University, Rajavithi Hospital, Bangkok, Thailand
| | - Taiji Sakamoto
- Department of Ophthalmology, Kagoshima University, Kagoshima, Japan
| | - Daniel S.W. Ting
- Singapore National Eye Center, Duke-NUS Medical School, Singapore
| | - Peter van Wijngaarden
- Ophthalmology, Department of Surgery, University of Melbourne, Melbourne, Australia
- Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, Victoria, Australia
| | | | - David Wong
- Unity Health Toronto – St. Michael's Hospital, University of Toronto, Toronto, Canada
| | - Lihteh Wu
- Macula, Vitreous and Retina Associates of Costa Rica, San José, Costa Rica
| | | | | |
Collapse
|
17
|
Ji Y, Ji Y, Liu Y, Zhao Y, Zhang L. Research progress on diagnosing retinal vascular diseases based on artificial intelligence and fundus images. Front Cell Dev Biol 2023; 11:1168327. [PMID: 37056999 PMCID: PMC10086262 DOI: 10.3389/fcell.2023.1168327] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Accepted: 03/20/2023] [Indexed: 03/30/2023] Open
Abstract
As the only blood vessels that can directly be seen in the whole body, pathological changes in retinal vessels are related to the metabolic state of the whole body and many systems, which seriously affect the vision and quality of life of patients. Timely diagnosis and treatment are key to improving vision prognosis. In recent years, with the rapid development of artificial intelligence, the application of artificial intelligence in ophthalmology has become increasingly extensive and in-depth, especially in the field of retinal vascular diseases. Research study results based on artificial intelligence and fundus images are remarkable and provides a great possibility for early diagnosis and treatment. This paper reviews the recent research progress on artificial intelligence in retinal vascular diseases (including diabetic retinopathy, hypertensive retinopathy, retinal vein occlusion, retinopathy of prematurity, and age-related macular degeneration). The limitations and challenges of the research process are also discussed.
Collapse
Affiliation(s)
- Yuke Ji
- The Laboratory of Artificial Intelligence and Bigdata in Ophthalmology, Affiliated Eye Hospital of Nanjing Medical University, Nanjing, China
| | - Yun Ji
- Affiliated Hospital of Shandong University of traditional Chinese Medicine, Jinan, Shandong, China
| | - Yunfang Liu
- Department of Ophthalmology, The First People’s Hospital of Huzhou, Huzhou, Zhejiang, China
| | - Ying Zhao
- Affiliated Hospital of Shandong University of traditional Chinese Medicine, Jinan, Shandong, China
- *Correspondence: Liya Zhang, ; Ying Zhao,
| | - Liya Zhang
- Department of Ophthalmology, The First People’s Hospital of Huzhou, Huzhou, Zhejiang, China
- *Correspondence: Liya Zhang, ; Ying Zhao,
| |
Collapse
|
18
|
Beeche C, Gezer NS, Iyer K, Almetwali O, Yu J, Zhang Y, Dhupar R, Leader JK, Pu J. Assessing retinal vein occlusion based on color fundus photographs using neural understanding network (NUN). Med Phys 2023; 50:449-464. [PMID: 36184848 PMCID: PMC9868057 DOI: 10.1002/mp.16012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2021] [Revised: 09/15/2022] [Accepted: 09/16/2022] [Indexed: 01/26/2023] Open
Abstract
OBJECTIVE To develop and validate a novel deep learning architecture to classify retinal vein occlusion (RVO) on color fundus photographs (CFPs) and reveal the image features contributing to the classification. METHODS The neural understanding network (NUN) is formed by two components: (1) convolutional neural network (CNN)-based feature extraction and (2) graph neural networks (GNN)-based feature understanding. The CNN-based image features were transformed into a graph representation to encode and visualize long-range feature interactions to identify the image regions that significantly contributed to the classification decision. A total of 7062 CFPs were classified into three categories: (1) no vein occlusion ("normal"), (2) central RVO, and (3) branch RVO. The area under the receiver operative characteristic (ROC) curve (AUC) was used as the metric to assess the performance of the trained classification models. RESULTS The AUC, accuracy, sensitivity, and specificity for NUN to classify CFPs as normal, central occlusion, or branch occlusion were 0.975 (± 0.003), 0.911 (± 0.007), 0.983 (± 0.010), and 0.803 (± 0.005), respectively, which outperformed available classical CNN models. CONCLUSION The NUN architecture can provide a better classification performance and a straightforward visualization of the results compared to CNNs.
Collapse
Affiliation(s)
- Cameron Beeche
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Naciye S Gezer
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Kartik Iyer
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Omar Almetwali
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Juezhao Yu
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Yanchun Zhang
- Shaan’xi Eye Hospital, Xi’an, Shaanxi, 710004, China
| | - Rajeev Dhupar
- Department of Cardiothoracic Surgery, University of Pittsburgh, Pittsburgh, PA 15213, USA
- Surgical Services Division, VA Pittsburgh Healthcare System, Pittsburgh, PA 15240
| | - Joseph K. Leader
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Jiantao Pu
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA 15213, USA
| |
Collapse
|
19
|
Vujosevic S, Limoli C, Luzi L, Nucci P. Digital innovations for retinal care in diabetic retinopathy. Acta Diabetol 2022; 59:1521-1530. [PMID: 35962258 PMCID: PMC9374293 DOI: 10.1007/s00592-022-01941-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/03/2022] [Accepted: 07/04/2022] [Indexed: 12/02/2022]
Abstract
AIM The purpose of this review is to examine the applications of novel digital technology domains for the screening and management of patients with diabetic retinopathy (DR). METHODS A PubMed engine search was performed, using the terms "Telemedicine", "Digital health", "Telehealth", "Telescreening", "Artificial intelligence", "Deep learning", "Smartphone", "Triage", "Screening", "Home-based", "Monitoring", "Ophthalmology", "Diabetes", "Diabetic Retinopathy", "Retinal imaging". Full-text English language studies from January 1, 2010, to February 1, 2022, and reference lists were considered for the conceptual framework of this review. RESULTS Diabetes mellitus and its eye complications, including DR, are particularly well suited to digital technologies, providing an ideal model for telehealth initiatives and real-world applications. The current development in the adoption of telemedicine, artificial intelligence and remote monitoring as an alternative to or in addition to traditional forms of care will be discussed. CONCLUSIONS Advances in digital health have created an ecosystem ripe for telemedicine in the field of DR to thrive. Stakeholders and policymakers should adopt a participatory approach to ensure sustained implementation of these technologies after the COVID-19 pandemic. This article belongs to the Topical Collection "Diabetic Eye Disease", managed by Giuseppe Querques.
Collapse
Affiliation(s)
- Stela Vujosevic
- Department of Biomedical, Surgical and Dental Sciences, University of Milan, Milan, Italy.
- Eye Clinic, IRCCS MultiMedica, Via San Vittore 12, 20123, Milan, Italy.
| | - Celeste Limoli
- Eye Clinic, IRCCS MultiMedica, Via San Vittore 12, 20123, Milan, Italy
- University of Milan, Milan, Italy
| | - Livio Luzi
- Department of Biomedical Sciences for Health, University of Milan, Milan, Italy
- Department of Endocrinology, Nutrition and Metabolic Diseases, IRCCS MultiMedica, Milan, Italy
| | - Paolo Nucci
- Department of Biomedical, Surgical and Dental Sciences, University of Milan, Milan, Italy
| |
Collapse
|
20
|
Retinal Glaucoma Public Datasets: What Do We Have and What Is Missing? J Clin Med 2022; 11:jcm11133850. [PMID: 35807135 PMCID: PMC9267177 DOI: 10.3390/jcm11133850] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Revised: 06/29/2022] [Accepted: 06/30/2022] [Indexed: 11/16/2022] Open
Abstract
Public databases for glaucoma studies contain color images of the retina, emphasizing the optic papilla. These databases are intended for research and standardized automated methodologies such as those using deep learning techniques. These techniques are used to solve complex problems in medical imaging, particularly in the automated screening of glaucomatous disease. The development of deep learning techniques has demonstrated potential for implementing protocols for large-scale glaucoma screening in the population, eliminating possible diagnostic doubts among specialists, and benefiting early treatment to delay the onset of blindness. However, the images are obtained by different cameras, in distinct locations, and from various population groups and are centered on multiple parts of the retina. We can also cite the small number of data, the lack of segmentation of the optic papillae, and the excavation. This work is intended to offer contributions to the structure and presentation of public databases used in the automated screening of glaucomatous papillae, adding relevant information from a medical point of view. The gold standard public databases present images with segmentations of the disc and cupping made by experts and division between training and test groups, serving as a reference for use in deep learning architectures. However, the data offered are not interchangeable. The quality and presentation of images are heterogeneous. Moreover, the databases use different criteria for binary classification with and without glaucoma, do not offer simultaneous pictures of the two eyes, and do not contain elements for early diagnosis.
Collapse
|