Deep Learning Models for Segmenting Non-perfusion Area of Color Fundus Photographs in Patients With Branch Retinal Vein Occlusion

Künstliche Intelligenz (KI) zur Früherkennung von Netzhauterkrankungen

Künstliche Intelligenz (KI) hat sich zu einem transformativen Werkzeug auf dem Gebiet der Augenheilkunde entwickelt und revolutioniert die Diagnose und Behandlung von Krankheiten. Diese Arbeit gibt einen umfassenden Überblick über KI-Anwendungen bei verschiedenen Netzhauterkrankungen und zeigt ihr Potenzial, die Effizienz von Vorsorgeuntersuchungen zu erhöhen, Frühdiagnosen zu erleichtern und die Patientenergebnisse zu verbessern. Wir erklären die grundlegenden Konzepte der KI, einschließlich des maschinellen Lernens (ML) und des Deep Learning (DL), und deren Anwendung in der Augenheilkunde und heben die Bedeutung von KI-basierten Lösungen bei der Bewältigung der Komplexität und Variabilität von Netzhauterkrankungen hervor. Wir gehen auch auf spezifische Anwendungen der KI im Zusammenhang mit Netzhauterkrankungen wie diabetischer Retinopathie (DR), altersbedingter Makuladegeneration (AMD), makulärer Neovaskularisation, Frühgeborenen-Retinopathie (ROP), retinalem Venenverschluss (RVO), hypertensiver Retinopathie (HR), Retinopathia pigmentosa, Morbus Stargardt, Morbus Best (Best’sche vitelliforme Makuladystrophie) und Sichelzellenretinopathie ein. Wir konzen­trieren uns auf die aktuelle Landschaft der KI-Technologien, einschließlich verschiedener KI-Modelle, ihrer Leistungsmetriken und klinischen Implikationen. Darüber hinaus befassen wir uns mit den Herausforderungen und Schwierigkeiten bei der Integration von KI in die klinische Praxis, einschließlich des «Black-Box-Phänomens», der Verzerrungen bei der Darstellung von Daten und der Einschränkungen im Zusammenhang mit der ganzheitlichen Bewertung von Patienten. Abschließend wird die kollaborative Rolle der KI an der Seite des medizinischen Fachpersonals hervorgehoben, wobei ein synergetischer Ansatz für die Erbringung von Gesundheitsdienstleistungen befürwortet wird. Es wird betont, wie wichtig es ist, KI als Ergänzung und nicht als Ersatz für menschliche Expertise einzusetzen, um ihr Potenzial zu maximieren, die Gesundheitsversorgung zu revolutionieren, Ungleichheiten in der Gesundheitsversorgung zu verringern und die Patientenergebnisse in der sich entwickelnden medizinischen Landschaft zu verbessern.

A Systematic Review of Advances in AI-Assisted Analysis of Fundus Fluorescein Angiography (FFA) Images: From Detection to Report Generation

Fundus fluorescein angiography (FFA) serves as the current gold standard for visualizing retinal vasculature and detecting various fundus diseases, but its interpretation is labor-intensive and requires much expertise from ophthalmologists. The medical application of artificial intelligence (AI), especially deep learning and machine learning, has revolutionized the field of automatic FFA image analysis, leading to the rapid advancements in AI-assisted lesion detection, diagnosis, and report generation. This review examined studies in PubMed, Web of Science, and Google Scholar databases from January 2019 to August 2024, with a total of 23 articles incorporated. By integrating current research findings, this review highlights crucial breakthroughs in AI-assisted FFA analysis and explores their potential implications for ophthalmic clinical practice. These advances in AI-assisted FFA analysis have shown promising results in improving diagnostic accuracy and workflow efficiency. However, further research is needed to enhance model transparency and ensure robust performance across diverse populations. Challenges such as data privacy and technical infrastructure remain for broader clinical applications.

Wide field imaging biomarkers: A different perspective

Wide field retinal imaging has emerged as a transformative technology over the last few decades, revolutionizing our ability to visualize the intricate landscape of the retina. By capturing expansive retinal areas, these techniques offer a panoramic view going beyond traditional imaging methods. In this review, we explore the significance of retinal imaging-based biomarkers to help diagnose ocular and systemic conditions. We discuss quantitative biomarkers, including ischemic index, nonperfusion area and more, and their application in diabetic retinopathy, central retinal vein occlusion, neurodegenerative diseases, and more. In addition, we outline qualitative biomarkers such as choroidal venous hyperpermeability and intervortex anastomoses. The role of wide field fundus autofluorescence in assessing hereditary retinal diseases is also emphasized. Standardized imaging procedures, professional collaboration, and validation across a range of clinical circumstances are necessary for the effective use of these biomarkers. They have the potential to transform disease identification, risk assessment, and customize therapy.

Prediction of treatment outcome for branch retinal vein occlusion using convolutional neural network-based retinal fluorescein angiography

Deep learning techniques were used in ophthalmology to develop artificial intelligence (AI) models for predicting the short-term effectiveness of anti-VEGF therapy in patients with macular edema secondary to branch retinal vein occlusion (BRVO-ME). 180 BRVO-ME patients underwent pre-treatment FFA scans. After 3 months of ranibizumab injections, CMT measurements were taken at baseline and 1-month intervals. Patients were categorized into good and poor prognosis groups based on macular edema at the 4th month follow-up. FFA-Net, a VGG-based classification network, was trained using FFA images from both groups. Class activation heat maps highlighted important locations. Benchmark models (DesNet-201, MobileNet-V3, ResNet-152, MansNet-75) were compared for training results. Performance metrics included accuracy, sensitivity, specificity, F1 score, and ROC curves. FFA-Net predicted BRVO-ME treatment effect with an accuracy of 88.63% and an F1 score of 0.89, with a sensitivity and specificity of 79.40% and 71.34%, respectively.The AUC of the ROC curve for the FFA-Net model was 0.71. The use of FFA based on deep learning technology has feasibility in predicting the treatment effect of BRVO-ME. The FFA-Net model constructed with the VGG model as the main body has good results in predicting the treatment effect of BRVO-ME. The typing of BRVO in FFA may be an important factor affecting the prognosis.

Retina Fundus Photograph-Based Artificial Intelligence Algorithms in Medicine: A Systematic Review

We conducted a systematic review of research in artificial intelligence (AI) for retinal fundus photographic images. We highlighted the use of various AI algorithms, including deep learning (DL) models, for application in ophthalmic and non-ophthalmic (i.e., systemic) disorders. We found that the use of AI algorithms for the interpretation of retinal images, compared to clinical data and physician experts, represents an innovative solution with demonstrated superior accuracy in identifying many ophthalmic (e.g., diabetic retinopathy (DR), age-related macular degeneration (AMD), optic nerve disorders), and non-ophthalmic disorders (e.g., dementia, cardiovascular disease). There has been a significant amount of clinical and imaging data for this research, leading to the potential incorporation of AI and DL for automated analysis. AI has the potential to transform healthcare by improving accuracy, speed, and workflow, lowering cost, increasing access, reducing mistakes, and transforming healthcare worker education and training.

Retinal Vein Occlusion-Background Knowledge and Foreground Knowledge Prospects-A Review

Thrombosis of retinal veins is one of the most common retinal vascular diseases that may lead to vascular blindness. The latest epidemiological data leave no illusions that the burden on the healthcare system, as impacted by patients with this diagnosis, will increase worldwide. This obliges scientists to search for new therapeutic and diagnostic options. In the 21st century, there has been tremendous progress in retinal imaging techniques, which has facilitated a better understanding of the mechanisms related to the development of retinal vein occlusion (RVO) and its complications, and consequently has enabled the introduction of new treatment methods. Moreover, artificial intelligence (AI) is likely to assist in selecting the best treatment option for patients in the near future. The aim of this comprehensive review is to re-evaluate the old but still relevant data on the RVO and confront them with new studies. The paper will provide a detailed overview of diagnosis, current treatment, prevention, and future therapeutic possibilities regarding RVO, as well as clarifying the mechanism of macular edema in this disease entity.

Deep learning segmentation of non-perfusion area from color fundus images and AI-generated fluorescein angiography

The non-perfusion area (NPA) of the retina is an important indicator in the visual prognosis of patients with branch retinal vein occlusion (BRVO). However, the current evaluation method of NPA, fluorescein angiography (FA), is invasive and burdensome. In this study, we examined the use of deep learning models for detecting NPA in color fundus images, bypassing the need for FA, and we also investigated the utility of synthetic FA generated from color fundus images. The models were evaluated using the Dice score and Monte Carlo dropout uncertainty. We retrospectively collected 403 sets of color fundus and FA images from 319 BRVO patients. We trained three deep learning models on FA, color fundus images, and synthetic FA. As a result, though the FA model achieved the highest score, the other two models also performed comparably. We found no statistical significance in median Dice scores between the models. However, the color fundus model showed significantly higher uncertainty than the other models (p < 0.05). In conclusion, deep learning models can detect NPAs from color fundus images with reasonable accuracy, though with somewhat less prediction stability. Synthetic FA stabilizes the prediction and reduces misleading uncertainty estimates by enhancing image quality.

Artificial Intelligence (AI) for Early Diagnosis of Retinal Diseases

Artificial intelligence (AI) has emerged as a transformative tool in the field of ophthalmology, revolutionizing disease diagnosis and management. This paper provides a comprehensive overview of AI applications in various retinal diseases, highlighting its potential to enhance screening efficiency, facilitate early diagnosis, and improve patient outcomes. Herein, we elucidate the fundamental concepts of AI, including machine learning (ML) and deep learning (DL), and their application in ophthalmology, underscoring the significance of AI-driven solutions in addressing the complexity and variability of retinal diseases. Furthermore, we delve into the specific applications of AI in retinal diseases such as diabetic retinopathy (DR), age-related macular degeneration (AMD), Macular Neovascularization, retinopathy of prematurity (ROP), retinal vein occlusion (RVO), hypertensive retinopathy (HR), Retinitis Pigmentosa, Stargardt disease, best vitelliform macular dystrophy, and sickle cell retinopathy. We focus on the current landscape of AI technologies, including various AI models, their performance metrics, and clinical implications. Furthermore, we aim to address challenges and pitfalls associated with the integration of AI in clinical practice, including the "black box phenomenon", biases in data representation, and limitations in comprehensive patient assessment. In conclusion, this review emphasizes the collaborative role of AI alongside healthcare professionals, advocating for a synergistic approach to healthcare delivery. It highlights the importance of leveraging AI to augment, rather than replace, human expertise, thereby maximizing its potential to revolutionize healthcare delivery, mitigate healthcare disparities, and improve patient outcomes in the evolving landscape of medicine.

Intelligent diagnosis of retinal vein occlusion based on color fundus photographs

AIM

To develop an artificial intelligence (AI) diagnosis model based on deep learning (DL) algorithm to diagnose different types of retinal vein occlusion (RVO) by recognizing color fundus photographs (CFPs).

METHODS

Totally 914 CFPs of healthy people and patients with RVO were collected as experimental data sets, and used to train, verify and test the diagnostic model of RVO. All the images were divided into four categories [normal, central retinal vein occlusion (CRVO), branch retinal vein occlusion (BRVO), and macular retinal vein occlusion (MRVO)] by three fundus disease experts. Swin Transformer was used to build the RVO diagnosis model, and different types of RVO diagnosis experiments were conducted. The model's performance was compared to that of the experts.

RESULTS

The accuracy of the model in the diagnosis of normal, CRVO, BRVO, and MRVO reached 1.000, 0.978, 0.957, and 0.978; the specificity reached 1.000, 0.986, 0.982, and 0.976; the sensitivity reached 1.000, 0.955, 0.917, and 1.000; the F1-Sore reached 1.000, 0.955 0.943, and 0.887 respectively. In addition, the area under curve of normal, CRVO, BRVO, and MRVO diagnosed by the diagnostic model were 1.000, 0.900, 0.959 and 0.970, respectively. The diagnostic results were highly consistent with those of fundus disease experts, and the diagnostic performance was superior.

CONCLUSION

The diagnostic model developed in this study can well diagnose different types of RVO, effectively relieve the work pressure of clinicians, and provide help for the follow-up clinical diagnosis and treatment of RVO patients.

Research progress in artificial intelligence assisted diabetic retinopathy diagnosis

Diabetic retinopathy (DR) is one of the most common retinal vascular diseases and one of the main causes of blindness worldwide. Early detection and treatment can effectively delay vision decline and even blindness in patients with DR. In recent years, artificial intelligence (AI) models constructed by machine learning and deep learning (DL) algorithms have been widely used in ophthalmology research, especially in diagnosing and treating ophthalmic diseases, particularly DR. Regarding DR, AI has mainly been used in its diagnosis, grading, and lesion recognition and segmentation, and good research and application results have been achieved. This study summarizes the research progress in AI models based on machine learning and DL algorithms for DR diagnosis and discusses some limitations and challenges in AI research.

Research progress on diagnosing retinal vascular diseases based on artificial intelligence and fundus images

As the only blood vessels that can directly be seen in the whole body, pathological changes in retinal vessels are related to the metabolic state of the whole body and many systems, which seriously affect the vision and quality of life of patients. Timely diagnosis and treatment are key to improving vision prognosis. In recent years, with the rapid development of artificial intelligence, the application of artificial intelligence in ophthalmology has become increasingly extensive and in-depth, especially in the field of retinal vascular diseases. Research study results based on artificial intelligence and fundus images are remarkable and provides a great possibility for early diagnosis and treatment. This paper reviews the recent research progress on artificial intelligence in retinal vascular diseases (including diabetic retinopathy, hypertensive retinopathy, retinal vein occlusion, retinopathy of prematurity, and age-related macular degeneration). The limitations and challenges of the research process are also discussed.

Advances in artificial intelligence models and algorithms in the field of optometry

The rapid development of computer science over the past few decades has led to unprecedented progress in the field of artificial intelligence (AI). Its wide application in ophthalmology, especially image processing and data analysis, is particularly extensive and its performance excellent. In recent years, AI has been increasingly applied in optometry with remarkable results. This review is a summary of the application progress of different AI models and algorithms used in optometry (for problems such as myopia, strabismus, amblyopia, keratoconus, and intraocular lens) and includes a discussion of the limitations and challenges associated with its application in this field.