Predicting the progression of ophthalmic disease based on slit-lamp images using a deep temporal sequence network

Applications of Artificial Intelligence in Cataract Surgery: A Review

Cataract surgery is one of the most performed procedures worldwide, and cataracts are rising in prevalence in our aging population. With the increasing utilization of artificial intelligence (AI) in the medical field, we aimed to understand the extent of present AI applications in ophthalmic microsurgery, specifically cataract surgery. We conducted a literature search on PubMed and Google Scholar using keywords related to the application of AI in cataract surgery and included relevant articles published since 2010 in our review. The literature search yielded information on AI mechanisms such as machine learning (ML), deep learning (DL), and convolutional neural networks (CNN) as they are being incorporated into pre-operative, intraoperative, and post-operative stages of cataract surgery. AI is currently integrated in the pre-operative stage of cataract surgery to calculate intraocular lens (IOL) power and diagnose cataracts with slit-lamp microscopy and retinal imaging. During the intraoperative stage, AI has been applied to risk calculation, tracking surgical workflow, multimodal imaging data analysis, and instrument location via the use of "smart instruments". AI is also involved in predicting post-operative complications, such as posterior capsular opacification and intraocular lens dislocation, and organizing follow-up patient care. Challenges such as limited imaging dataset availability, unstandardized deep learning analysis metrics, and lack of generalizability to novel datasets currently present obstacles to the enhanced application of AI in cataract surgery. Upon addressing these barriers in upcoming research, AI stands to improve cataract screening accessibility, junior physician training, and identification of surgical complications through future applications of AI in cataract surgery.

Artificial intelligence in the anterior segment of eye diseases

Ophthalmology is a subject that highly depends on imaging examination. Artificial intelligence (AI) technology has great potential in medical imaging analysis, including image diagnosis, classification, grading, guiding treatment and evaluating prognosis. The combination of the two can realize mass screening of grass-roots eye health, making it possible to seek medical treatment in the mode of "first treatment at the grass-roots level, two-way referral, emergency and slow treatment, and linkage between the upper and lower levels". On the basis of summarizing the AI technology carried out by scholars and their teams all over the world in the field of ophthalmology, quite a lot of studies have confirmed that machine learning can assist in diagnosis, grading, providing optimal treatment plans and evaluating prognosis in corneal and conjunctival diseases, ametropia, lens diseases, glaucoma, iris diseases, etc. This paper systematically shows the application and progress of AI technology in common anterior segment ocular diseases, the current limitations, and prospects for the future.

Eye of the future: Unlocking the potential utilization of hydrogels in intraocular lenses

Hydrogels are distinguished by their exceptional ability to absorb and retain large volumes of water within their complex three-dimensional polymer networks, which is advantageous for the development of intraocular lenses (IOLs). Their innate hydrophilicity offers an optimal substrate for the fabrication of IOLs that simulate the natural lens' accommodation, thereby reducing irritation and facilitating healing after surgery. The swelling and water retention characteristics of hydrogels contribute to their notable biocompatibility and versatile mechanical properties. However, the clinical application of hydrogels faces challenges, including managing potential adverse postimplantation effects. Rigorous research is essential to ascertain the safety and effectiveness of hydrogels. This review systematically examines the prospects and constraints of hydrogels as innovative materials for IOLs. Our comprehensive analysis examines their inherent properties, various classification strategies, cross-linking processes, and sensitivity to external stimuli. Additionally, we thoroughly evaluate their interactions with ocular tissues, underscoring the potential for hydrogels to be refined into seamless and biologically integrated visual aids. We also discuss the anticipated technological progress and clinical uses of hydrogels in IOL manufacturing. With ongoing technological advancements, the promise of hydrogels is poised to evolve from concept to clinical reality, marking a significant leap forward in ophthalmology characterized by improved patient comfort, enhanced functionality, and reliable safety.

Guidelines for the application of artificial intelligence in the diagnosis of anterior segment diseases (2023)

The landscape of ophthalmology has observed monumental shifts with the advent of artificial intelligence (AI) technologies. This article is devoted to elaborating on the nuanced application of AI in the diagnostic realm of anterior segment eye diseases, an area ripe with potential yet complex in its imaging characteristics. Historically, AI's entrenchment in ophthalmology was predominantly rooted in the posterior segment. However, the evolution of machine learning paradigms, particularly with the advent of deep learning methodologies, has reframed the focus. When combined with the exponential surge in available electronic image data pertaining to the anterior segment, AI's role in diagnosing corneal, conjunctival, lens, and eyelid pathologies has been solidified and has emerged from the realm of theoretical to practical. In light of this transformative potential, collaborations between the Ophthalmic Imaging and Intelligent Medicine Subcommittee of the China Medical Education Association and the Ophthalmology Committee of the International Translational Medicine Association have been instrumental. These eminent bodies mobilized a consortium of experts to dissect and assimilate advancements from both national and international quarters. Their mandate was not limited to AI's application in anterior segment pathologies like the cornea, conjunctiva, lens, and eyelids, but also ventured into deciphering the existing impediments and envisioning future trajectories. After iterative deliberations, the consensus synthesized herein serves as a touchstone, assisting ophthalmologists in optimally integrating AI into their diagnostic decisions and bolstering clinical research. Through this guideline, we aspire to offer a comprehensive framework, ensuring that clinical decisions are not merely informed but transformed by AI. By building upon existing literature yet maintaining the highest standards of originality, this document stands as a testament to both innovation and academic integrity, in line with the ethos of renowned journals such as Ophthalmology.

Automated artificial intelligence-based system for clinical follow-up of patients with age-related macular degeneration

PURPOSE

In this study, we investigate the potential of a novel artificial intelligence-based system for autonomous follow-up of patients treated for neovascular age-related macular degeneration (AMD).

METHODS

A temporal deep learning model was trained on a data set of 84 489 optical coherence tomography scans from AMD patients to recognize disease activity, and its performance was compared with a published non-temporal model trained on the same data (Acta Ophthalmol, 2021). An autonomous follow-up system was created by augmenting the AI model with deterministic logic to suggest treatment according to the observe-and-plan regimen. To validate the AI-based system, a data set comprising clinical decisions and imaging data from 200 follow-up consultations was collected prospectively. In each case, both the autonomous AI decision and original clinical decision were compared with an expert panel consensus.

RESULTS

The temporal AI model proved superior at detecting disease activity compared with the model without temporal input (area under the curve 0.900 (95% CI 0.894-0.906) and 0.857 (95% CI 0.846-0.867) respectively). The AI-based follow-up system could make an autonomous decision in 73% of the cases, 91.8% of which were in agreement with expert consensus. This was on par with the 87.7% agreement rate between decisions made in the clinic and expert consensus (p = 0.33).

CONCLUSIONS

The proposed autonomous follow-up system was shown to be safe and compliant with expert consensus on par with clinical practice. The system could in the future ease the pressure on public ophthalmology services from an increasing number of AMD patients.

Machine Learning for Cataract Classification/Grading on Ophthalmic Imaging Modalities: A Survey

Cataracts are the leading cause of visual impairment and blindness globally. Over the years, researchers have achieved significant progress in developing state-of-the-art machine learning techniques for automatic cataract classification and grading, aiming to prevent cataracts early and improve clinicians’ diagnosis efficiency. This survey provides a comprehensive survey of recent advances in machine learning techniques for cataract classification/grading based on ophthalmic images. We summarize existing literature from two research directions: conventional machine learning methods and deep learning methods. This survey also provides insights into existing works of both merits and limitations. In addition, we discuss several challenges of automatic cataract classification/grading based on machine learning techniques and present possible solutions to these challenges for future research.

Application of artificial intelligence in cataract management: current and future directions

The rise of artificial intelligence (AI) has brought breakthroughs in many areas of medicine. In ophthalmology, AI has delivered robust results in the screening and detection of diabetic retinopathy, age-related macular degeneration, glaucoma, and retinopathy of prematurity. Cataract management is another field that can benefit from greater AI application. Cataract  is the leading cause of reversible visual impairment with a rising global clinical burden. Improved diagnosis, monitoring, and surgical management are necessary to address this challenge. In addition, patients in large developing countries often suffer from limited access to tertiary care, a problem further exacerbated by the ongoing COVID-19 pandemic. AI on the other hand, can help transform cataract management by improving automation, efficacy and overcoming geographical barriers. First, AI can be applied as a telediagnostic platform to screen and diagnose patients with cataract using slit-lamp and fundus photographs. This utilizes a deep-learning, convolutional neural network (CNN) to detect and classify referable cataracts appropriately. Second, some of the latest intraocular lens formulas have used AI to enhance prediction accuracy, achieving superior postoperative refractive results compared to traditional formulas. Third, AI can be used to augment cataract surgical skill training by identifying different phases of cataract surgery on video and to optimize operating theater workflows by accurately predicting the duration of surgical procedures. Fourth, some AI CNN models are able to effectively predict the progression of posterior capsule opacification and eventual need for YAG laser capsulotomy. These advances in AI could transform cataract management and enable delivery of efficient ophthalmic services. The key challenges include ethical management of data, ensuring data security and privacy, demonstrating clinically acceptable performance, improving the generalizability of AI models across heterogeneous populations, and improving the trust of end-users.

Lens Opacities Classification System III-based artificial intelligence program for automatic cataract grading

PURPOSE

To establish and validate an artificial intelligence (AI)-assisted automatic cataract grading program based on the Lens Opacities Classification System III (LOCSIII).

SETTING

Eye and Ear, Nose, and Throat (EENT) Hospital, Fudan University, Shanghai, China.

DESIGN

AI training.

METHODS

Advanced deep-learning algorithms, including Faster R-CNN and ResNet, were applied to the localization and analysis of the region of interest. An internal dataset from the EENT Hospital of Fudan University and an external dataset from the Pujiang Eye Study were used for AI training, validation, and testing. The datasets were automatically labeled on the AI platform in terms of the capture mode and cataract grading based on the LOCSIII system.

RESULTS

The AI program showed reliable capture mode recognition, grading, and referral capability for nuclear and cortical cataract grading. In the internal and external datasets, 99.4% and 100% of automatic nuclear grading, respectively, had an absolute prediction error of ≤ 1.0, with a satisfactory referral capability (area under the curve [AUC]: 0.983 for the internal dataset; 0.977 for the external dataset). 75.0% (internal dataset) and 93.5% (external dataset) of the automatic cortical grades had an absolute prediction error of ≤ 1.0, with AUCs of 0.855 and 0.795 for referral, respectively. Good consistency was observed between automatic and manual grading when both nuclear and cortical cataracts were evaluated. However, automatic grading of posterior subcapsular cataracts was impractical.

CONCLUSIONS

The AI program proposed in this study shows robust grading and diagnostic performance for both nuclear and cortical cataracts, based on LOCSIII.

Artificial Intelligence in Cornea, Refractive Surgery, and Cataract: Basic Principles, Clinical Applications, and Future Directions

ABSTRACT

Corneal diseases, uncorrected refractive errors, and cataract represent the major causes of blindness globally. The number of refractive surgeries, either cornea- or lens-based, is also on the rise as the demand for perfect vision continues to increase. With the recent advancement and potential promises of artificial intelligence (AI) technologies demonstrated in the realm of ophthalmology, particularly retinal diseases and glaucoma, AI researchers and clinicians are now channeling their focus toward the less explored ophthalmic areas related to the anterior segment of the eye. Conditions that rely on anterior segment imaging modalities, including slit-lamp photography, anterior segment optical coherence tomography, corneal tomography, in vivo confocal microscopy and/or optical biometers, are the most commonly explored areas. These include infectious keratitis, keratoconus, corneal grafts, ocular surface pathologies, preoperative screening before refractive surgery, intraocular lens calculation, and automated refraction, among others. In this review, we aimed to provide a comprehensive update on the utilization of AI in anterior segment diseases, with particular emphasis on the recent advancement in the past few years. In addition, we demystify some of the basic principles and terminologies related to AI, particularly machine learning and deep learning, to help improve the understanding, research and clinical implementation of these AI technologies among the ophthalmologists and vision scientists. As we march toward the era of digital health, guidelines such as CONSORT-AI, SPIRIT-AI, and STARD-AI will play crucial roles in guiding and standardizing the conduct and reporting of AI-related trials, ultimately promoting their potential for clinical translation.

Detection of Fuchs' Uveitis Syndrome From Slit-Lamp Images Using Deep Convolutional Neural Networks in a Chinese Population

Fuchs' uveitis syndrome (FUS) is one of the most under- or misdiagnosed uveitis entities. Many undiagnosed FUS patients are unnecessarily overtreated with anti-inflammatory drugs, which may lead to serious complications. To offer assistance for ophthalmologists in the screening and diagnosis of FUS, we developed seven deep convolutional neural networks (DCNNs) to detect FUS using slit-lamp images. We also proposed a new optimized model with a mixed "attention" module to improve test accuracy. In the same independent set, we compared the performance between these DCNNs and ophthalmologists in detecting FUS. Seven different network models, including Xception, Resnet50, SE-Resnet50, ResNext50, SE-ResNext50, ST-ResNext50, and SET-ResNext50, were used to predict FUS automatically with the area under the receiver operating characteristic curves (AUCs) that ranged from 0.951 to 0.977. Our proposed SET-ResNext50 model (accuracy = 0.930; Precision = 0.918; Recall = 0.923; F1 measure = 0.920) with an AUC of 0.977 consistently outperformed the other networks and outperformed general ophthalmologists by a large margin. Heat-map visualizations of the SET-ResNext50 were provided to identify the target areas in the slit-lamp images. In conclusion, we confirmed that a trained classification method based on DCNNs achieved high effectiveness in distinguishing FUS from other forms of anterior uveitis. The performance of the DCNNs was better than that of general ophthalmologists and could be of value in the diagnosis of FUS.

Glaucoma Detection from Raw SD-OCT Volumes: A Novel Approach Focused on Spatial Dependencies

BACKGROUND AND OBJECTIVE

Glaucoma is the leading cause of blindness worldwide. Many studies based on fundus image and optical coherence tomography (OCT) imaging have been developed in the literature to help ophthalmologists through artificial-intelligence techniques. Currently, 3D spectral-domain optical coherence tomography (SD-OCT) samples have become more important since they could enclose promising information for glaucoma detection. To analyse the hidden knowledge of the 3D scans for glaucoma detection, we have proposed, for the first time, a deep-learning methodology based on leveraging the spatial dependencies of the features extracted from the B-scans.

METHODS

The experiments were performed on a database composed of 176 healthy and 144 glaucomatous SD-OCT volumes centred on the optic nerve head (ONH). The proposed methodology consists of two well-differentiated training stages: a slide-level feature extractor and a volume-based predictive model. The slide-level discriminator is characterised by two new, residual and attention, convolutional modules which are combined via skip-connections with other fine-tuned architectures. Regarding the second stage, we first carried out a data-volume conditioning before extracting the features from the slides of the SD-OCT volumes. Then, Long Short-Term Memory (LSTM) networks were used to combine the recurrent dependencies embedded in the latent space to provide a holistic feature vector, which was generated by the proposed sequential-weighting module (SWM).

RESULTS

The feature extractor reports AUC values higher than 0.93 both in the primary and external test sets. Otherwise, the proposed end-to-end system based on a combination of CNN and LSTM networks achieves an AUC of 0.8847 in the prediction stage, which outperforms other state-of-the-art approaches intended for glaucoma detection. Additionally, Class Activation Maps (CAMs) were computed to highlight the most interesting regions per B-scan when discerning between healthy and glaucomatous eyes from raw SD-OCT volumes.

CONCLUSIONS

The proposed model is able to extract the features from the B-scans of the volumes and combine the information of the latent space to perform a volume-level glaucoma prediction. Our model, which combines residual and attention blocks with a sequential weighting module to refine the LSTM outputs, surpass the results achieved from current state-of-the-art methods focused on 3D deep-learning architectures.

Artificial intelligence for anterior segment diseases: Emerging applications in ophthalmology

With the advancement of computational power, refinement of learning algorithms and architectures, and availability of big data, artificial intelligence (AI) technology, particularly with machine learning and deep learning, is paving the way for 'intelligent' healthcare systems. AI-related research in ophthalmology previously focused on the screening and diagnosis of posterior segment diseases, particularly diabetic retinopathy, age-related macular degeneration and glaucoma. There is now emerging evidence demonstrating the application of AI to the diagnosis and management of a variety of anterior segment conditions. In this review, we provide an overview of AI applications to the anterior segment addressing keratoconus, infectious keratitis, refractive surgery, corneal transplant, adult and paediatric cataracts, angle-closure glaucoma and iris tumour, and highlight important clinical considerations for adoption of AI technologies, potential integration with telemedicine and future directions.

Application of artificial intelligence in anterior segment ophthalmic diseases: diversity and standardization

Artificial intelligence (AI) based on machine learning (ML) and deep learning (DL) techniques has gained tremendous global interest in this era. Recent studies have demonstrated the potential of AI systems to provide improved capability in various tasks, especially in image recognition field. As an image-centric subspecialty, ophthalmology has become one of the frontiers of AI research. Trained on optical coherence tomography, slit-lamp images and even ordinary eye images, AI can achieve robust performance in the detection of glaucoma, corneal arcus and cataracts. Moreover, AI models based on other forms of data also performed satisfactorily. Nevertheless, several challenges with AI application in ophthalmology have also arisen, including standardization of data sets, validation and applicability of AI models, and ethical issues. In this review, we provided a summary of the state-of-the-art AI application in anterior segment ophthalmic diseases, potential challenges in clinical implementation and our prospects.

Application of machine learning in ophthalmic imaging modalities

In clinical ophthalmology, a variety of image-related diagnostic techniques have begun to offer unprecedented insights into eye diseases based on morphological datasets with millions of data points. Artificial intelligence (AI), inspired by the human multilayered neuronal system, has shown astonishing success within some visual and auditory recognition tasks. In these tasks, AI can analyze digital data in a comprehensive, rapid and non-invasive manner. Bioinformatics has become a focus particularly in the field of medical imaging, where it is driven by enhanced computing power and cloud storage, as well as utilization of novel algorithms and generation of data in massive quantities. Machine learning (ML) is an important branch in the field of AI. The overall potential of ML to automatically pinpoint, identify and grade pathological features in ocular diseases will empower ophthalmologists to provide high-quality diagnosis and facilitate personalized health care in the near future. This review offers perspectives on the origin, development, and applications of ML technology, particularly regarding its applications in ophthalmic imaging modalities.