Automated Detection of Glaucoma With Interpretable Machine Learning Using Clinical Data and Multimodal Retinal Images

Convolutional neural network-based classification of glaucoma using optic radiation tissue properties

BACKGROUND

Sensory changes due to aging or disease can impact brain tissue. This study aims to investigate the link between glaucoma, a leading cause of blindness, and alterations in brain connections.

METHODS

We analyzed diffusion MRI measurements of white matter tissue in a large group, consisting of 905 glaucoma patients (aged 49-80) and 5292 healthy individuals (aged 45-80) from the UK Biobank. Confounds due to group differences were mitigated by matching a sub-sample of controls to glaucoma subjects. We compared classification of glaucoma using convolutional neural networks (CNNs) focusing on the optic radiations, which are the primary visual connection to the cortex, against those analyzing non-visual brain connections. As a control, we evaluated the performance of regularized linear regression models.

RESULTS

We showed that CNNs using information from the optic radiations exhibited higher accuracy in classifying subjects with glaucoma when contrasted with CNNs relying on information from non-visual brain connections. Regularized linear regression models were also tested, and showed significantly weaker classification performance. Additionally, the CNN was unable to generalize to the classification of age-group or of age-related macular degeneration.

CONCLUSIONS

Our findings indicate a distinct and potentially non-linear signature of glaucoma in the tissue properties of optic radiations. This study enhances our understanding of how glaucoma affects brain tissue and opens avenues for further research into how diseases that affect sensory input may also affect brain aging.

Explainable machine learning predictions of perceptual sensitivity for retinal prostheses

Objective.Retinal prostheses evoke visual precepts by electrically stimulating functioning cells in the retina. Despite high variance in perceptual thresholds across subjects, among electrodes within a subject, and over time, retinal prosthesis users must undergo 'system fitting', a process performed to calibrate stimulation parameters according to the subject's perceptual thresholds. Although previous work has identified electrode-retina distance and impedance as key factors affecting thresholds, an accurate predictive model is still lacking.Approach.To address these challenges, we (1) fitted machine learning models to a large longitudinal dataset with the goal of predicting individual electrode thresholds and deactivation as a function of stimulus, electrode, and clinical parameters ('predictors') and (2) leveraged explainable artificial intelligence (XAI) to reveal which of these predictors were most important.Main results.Our models accounted for up to 76% of the perceptual threshold response variance and enabled predictions of whether an electrode was deactivated in a given trial with F1 and area under the ROC curve scores of up to 0.732 and 0.911, respectively. Our models identified novel predictors of perceptual sensitivity, including subject age, time since blindness onset, and electrode-fovea distance.Significance.Our results demonstrate that routinely collected clinical measures and a single session of system fitting might be sufficient to inform an XAI-based threshold prediction strategy, which has the potential to transform clinical practice in predicting visual outcomes.

Artificial intelligence in the diagnosis of glaucoma and neurodegenerative diseases

Artificial Intelligence is a rapidly expanding field within computer science that encompasses the emulation of human intelligence by machines. Machine learning and deep learning - two primary data-driven pattern analysis approaches under the umbrella of artificial intelligence - has created considerable interest in the last few decades. The evolution of technology has resulted in a substantial amount of artificial intelligence research on ophthalmic and neurodegenerative disease diagnosis using retinal images. Various artificial intelligence-based techniques have been used for diagnostic purposes, including traditional machine learning, deep learning, and their combinations. Presented here is a review of the literature covering the last 10 years on this topic, discussing the use of artificial intelligence in analysing data from different modalities and their combinations for the diagnosis of glaucoma and neurodegenerative diseases. The performance of published artificial intelligence methods varies due to several factors, yet the results suggest that such methods can potentially facilitate clinical diagnosis. Generally, the accuracy of artificial intelligence-assisted diagnosis ranges from 67-98%, and the area under the sensitivity-specificity curve (AUC) ranges from 0.71-0.98, which outperforms typical human performance of 71.5% accuracy and 0.86 area under the curve. This indicates that artificial intelligence-based tools can provide clinicians with useful information that would assist in providing improved diagnosis. The review suggests that there is room for improvement of existing artificial intelligence-based models using retinal imaging modalities before they are incorporated into clinical practice.

Artificial intelligence in glaucoma: opportunities, challenges, and future directions

Artificial intelligence (AI) has shown excellent diagnostic performance in detecting various complex problems related to many areas of healthcare including ophthalmology. AI diagnostic systems developed from fundus images have become state-of-the-art tools in diagnosing retinal conditions and glaucoma as well as other ocular diseases. However, designing and implementing AI models using large imaging data is challenging. In this study, we review different machine learning (ML) and deep learning (DL) techniques applied to multiple modalities of retinal data, such as fundus images and visual fields for glaucoma detection, progression assessment, staging and so on. We summarize findings and provide several taxonomies to help the reader understand the evolution of conventional and emerging AI models in glaucoma. We discuss opportunities and challenges facing AI application in glaucoma and highlight some key themes from the existing literature that may help to explore future studies. Our goal in this systematic review is to help readers and researchers to understand critical aspects of AI related to glaucoma as well as determine the necessary steps and requirements for the successful development of AI models in glaucoma.

External validation of a deep learning detection system for glaucomatous optic neuropathy: a real-world multicentre study

OBJECTIVES

To conduct an external validation of an automated artificial intelligence (AI) diagnostic system using fundus photographs from a real-life multicentre cohort.

METHODS

We designed external validation in multiple scenarios, consisting of 3049 images from Qilu Hospital of Shandong University in China (QHSDU, validation dataset 1), 7495 images from three other hospitals in China (validation dataset 2), and 516 images from high myopia (HM) population of QHSDU (validation dataset 3). The corresponding sensitivity, specificity and accuracy of this AI diagnostic system to identify glaucomatous optic neuropathy (GON) were calculated.

RESULTS

In validation datasets 1 and 2, the algorithm yielded accuracy of 93.18% and 91.40%, area under the receiver operating curves (AUC) of 95.17% and 96.64%, and significantly higher sensitivity of 91.75% and 91.41%, respectively, compared to manual graders. On the subsets complicated with retinal comorbidities, such as diabetic retinopathy or age-related macular degeneration, in validation datasets 1 and 2, the algorithm achieved accuracy of 87.54% and 93.81%, and AUC of 97.02% and 97.46%, respectively. In validation dataset 3, the algorithm achieved comparable accuracy of 81.98% and AUC of 87.49%, with a sensitivity of 83.61% and specificity of 81.76% on GON recognition specifically in the HM population.

CONCLUSIONS

With acceptable generalization capability across varying levels of image quality, different clinical centres, or certain retinal comorbidities, such as HM, the automatic AI diagnostic system had the potential to provide expert-level glaucoma detection.

Multimodal Deep Learning Classifier for Primary Open Angle Glaucoma Diagnosis Using Wide-Field Optic Nerve Head Cube Scans in Eyes With and Without High Myopia

PRCIS

An optical coherence tomography (OCT)-based multimodal deep learning (DL) classification model, including texture information, is introduced that outperforms single-modal models and multimodal models without texture information for glaucoma diagnosis in eyes with and without high myopia.

BACKGROUND/AIMS

To evaluate the diagnostic accuracy of a multimodal DL classifier using wide OCT optic nerve head cube scans in eyes with and without axial high myopia.

MATERIALS AND METHODS

Three hundred seventy-one primary open angle glaucoma (POAG) eyes and 86 healthy eyes, all without axial high myopia [axial length (AL) ≤ 26 mm] and 92 POAG eyes and 44 healthy eyes, all with axial high myopia (AL > 26 mm) were included. The multimodal DL classifier combined features of 3 individual VGG-16 models: (1) texture-based en face image, (2) retinal nerve fiber layer (RNFL) thickness map image, and (3) confocal scanning laser ophthalmoscope (cSLO) image. Age, AL, and disc area adjusted area under the receiver operating curves were used to compare model accuracy.

RESULTS

Adjusted area under the receiver operating curve for the multimodal DL model was 0.91 (95% CI = 0.87, 0.95). This value was significantly higher than the values of individual models [0.83 (0.79, 0.86) for texture-based en face image; 0.84 (0.81, 0.87) for RNFL thickness map; and 0.68 (0.61, 0.74) for cSLO image; all P ≤ 0.05]. Using only highly myopic eyes, the multimodal DL model showed significantly higher diagnostic accuracy [0.89 (0.86, 0.92)] compared with texture en face image [0.83 (0.78, 0.85)], RNFL [0.85 (0.81, 0.86)] and cSLO image models [0.69 (0.63, 0.76)] (all P ≤ 0.05).

CONCLUSIONS

Combining OCT-based RNFL thickness maps with texture-based en face images showed a better ability to discriminate between healthy and POAG than thickness maps alone, particularly in high axial myopic eyes.

Optic radiations representing different eccentricities age differently

The neural pathways that carry information from the foveal, macular, and peripheral visual fields have distinct biological properties. The optic radiations (OR) carry foveal and peripheral information from the thalamus to the primary visual cortex (V1) through adjacent but separate pathways in the white matter. Here, we perform white matter tractometry using pyAFQ on a large sample of diffusion MRI (dMRI) data from subjects with healthy vision in the U.K. Biobank dataset (UKBB; N = 5382; age 45-81). We use pyAFQ to characterize white matter tissue properties in parts of the OR that transmit information about the foveal, macular, and peripheral visual fields, and to characterize the changes in these tissue properties with age. We find that (1) independent of age there is higher fractional anisotropy, lower mean diffusivity, and higher mean kurtosis in the foveal and macular OR than in peripheral OR, consistent with denser, more organized nerve fiber populations in foveal/parafoveal pathways, and (2) age is associated with increased diffusivity and decreased anisotropy and kurtosis, consistent with decreased density and tissue organization with aging. However, anisotropy in foveal OR decreases faster with age than in peripheral OR, while diffusivity increases faster in peripheral OR, suggesting foveal/peri-foveal OR and peripheral OR differ in how they age.

An interpretable machine learning model for the prevention of contrast-induced nephropathy in patients undergoing lower extremity endovascular interventions for peripheral arterial disease

BACKGROUND

Contrast-induced nephropathy (CIN) is a postprocedural complication associated with increased morbidity and mortality. An important risk factor for development of CIN is renal impairment. Identification of patients at risk for acute renal failure will allow physicians to make appropriate decisions to minimize the incidence of CIN. We developed a machine learning model to stratify risk of acute renal failure that may assist in mitigating risk for CIN in patients with peripheral artery disease (PAD) undergoing endovascular interventions.

METHODS

We utilized the American College of Surgeons National Surgical Quality Improvement Program database to extract clinical and laboratory information associated with 14,444 patients who underwent lower extremity endovascular procedures between 2011 and 2018. Using 11,604 cases from 2011 to 2017 for training and 2840 cases from 2018 for testing, we developed a random forest model to predict risk of 30-day acute renal failure following infra-inguinal endovascular procedures.

RESULTS

Eight variables were identified as contributing optimally to model predictions, the most important being diabetes, preoperative BUN, and claudication. Using these variables, the model achieved an area under the receiver-operating characteristic (AU-ROC) curve of 0.81, accuracy of 0.83, sensitivity of 0.67, and specificity of 0.74. The model performed equally well on white and nonwhite patients (Delong p-value = 0.955) and patients age < 65 and patients age ≥ 65 (Delong p-value = 0.659).

CONCLUSIONS

We develop a model that fairly and accurately stratifies 30-day acute renal failure risk in patients undergoing lower extremity endovascular procedures for PAD. This model may assist in identifying patients who may benefit from strategies to prevent CIN.

Explainable Machine Learning Predictions of Perceptual Sensitivity for Retinal Prostheses

To provide appropriate levels of stimulation, retinal prostheses must be calibrated to an individual's perceptual thresholds ('system fitting'), despite thresholds varying drastically across subjects, across electrodes within a subject, and over time. Although previous work has identified electrode-retina distance and impedance as key factors affecting thresholds, an accurate predictive model is still lacking. To address these challenges, we 1) fitted machine learning (ML) models to a large longitudinal dataset with the goal of predicting individual electrode thresholds and deactivation as a function of stimulus, electrode, and clinical parameters ('predictors') and 2) leveraged explainable artificial intelligence (XAI) to reveal which of these predictors were most important. Our models accounted for up to 77% of the perceptual threshold response variance and enabled predictions of whether an electrode was deactivated in a given trial with F1 and AUC scores of up to 0.740 and 0.913, respectively. Deactivation and threshold models identified novel predictors of perceptual sensitivity, including subject age, time since blindness onset, and electrode-fovea distance. Our results demonstrate that routinely collected clinical measures and a single session of system fitting might be sufficient to inform an XAI-based threshold prediction strategy, which may transform clinical practice in predicting visual outcomes.

Big data in corneal diseases and cataract: Current applications and future directions

The accelerated growth in electronic health records (EHR), Internet-of-Things, mHealth, telemedicine, and artificial intelligence (AI) in the recent years have significantly fuelled the interest and development in big data research. Big data refer to complex datasets that are characterized by the attributes of "5 Vs"-variety, volume, velocity, veracity, and value. Big data analytics research has so far benefitted many fields of medicine, including ophthalmology. The availability of these big data not only allow for comprehensive and timely examinations of the epidemiology, trends, characteristics, outcomes, and prognostic factors of many diseases, but also enable the development of highly accurate AI algorithms in diagnosing a wide range of medical diseases as well as discovering new patterns or associations of diseases that are previously unknown to clinicians and researchers. Within the field of ophthalmology, there is a rapidly expanding pool of large clinical registries, epidemiological studies, omics studies, and biobanks through which big data can be accessed. National corneal transplant registries, genome-wide association studies, national cataract databases, and large ophthalmology-related EHR-based registries (e.g., AAO IRIS Registry) are some of the key resources. In this review, we aim to provide a succinct overview of the availability and clinical applicability of big data in ophthalmology, particularly from the perspective of corneal diseases and cataract, the synergistic potential of big data, AI technologies, internet of things, mHealth, and wearable smart devices, and the potential barriers for realizing the clinical and research potential of big data in this field.

Applications of Artificial Intelligence and Deep Learning in Glaucoma

Diagnosis and detection of progression of glaucoma remains challenging. Artificial intelligence-based tools have the potential to improve and standardize the assessment of glaucoma but development of these algorithms is difficult given the multimodal and variable nature of the diagnosis. Currently, most algorithms are focused on a single imaging modality, specifically screening and diagnosis based on fundus photos or optical coherence tomography images. Use of anterior segment optical coherence tomography and goniophotographs is limited. The majority of algorithms designed for disease progression prediction are based on visual fields. No studies in our literature search assessed the use of artificial intelligence for treatment response prediction and no studies conducted prospective testing of their algorithms. Additional challenges to the development of artificial intelligence-based tools include scarcity of data and a lack of consensus in diagnostic criteria. Although research in the use of artificial intelligence for glaucoma is promising, additional work is needed to develop clinically usable tools.

Asynchronous feature regularization and cross-modal distillation for OCT based glaucoma diagnosis

Glaucoma has become a major cause of vision loss. Early-stage diagnosis of glaucoma is critical for treatment planning to avoid irreversible vision damage. Meanwhile, interpreting the rapidly accumulated medical data from ophthalmic exams is cumbersome and resource-intensive. Therefore, automated methods are highly desired to assist ophthalmologists in achieving fast and accurate glaucoma diagnosis. Deep learning has achieved great successes in diagnosing glaucoma by analyzing data from different kinds of tests, such as peripapillary optical coherence tomography (OCT) and visual field (VF) testing. Nevertheless, applying these developed models to clinical practice is still challenging because of various limiting factors. OCT models present worse glaucoma diagnosis performances compared to those achieved by OCT&VF based models, whereas VF is time-consuming and highly variable, which can restrict the wide employment of OCT&VF models. To this end, we develop a novel deep learning framework that leverages the OCT&VF model to enhance the performance of the OCT model. To transfer the complementary knowledge from the structural and functional assessments to the OCT model, a cross-modal knowledge transfer method is designed by integrating a designed distillation loss and a proposed asynchronous feature regularization (AFR) module. We demonstrate the effectiveness of the proposed method for glaucoma diagnosis by utilizing a public OCT&VF dataset and evaluating it on an external OCT dataset. Our final model with only OCT inputs achieves the accuracy of 87.4% (3.1% absolute improvement) and AUC of 92.3%, which are on par with the OCT&VF joint model. Moreover, results on the external dataset sufficiently indicate the effectiveness and generalization capability of our model.

An overview of artificial intelligence in diabetic retinopathy and other ocular diseases

Artificial intelligence (AI), also known as machine intelligence, is a branch of science that empowers machines using human intelligence. AI refers to the technology of rendering human intelligence through computer programs. From healthcare to the precise prevention, diagnosis, and management of diseases, AI is progressing rapidly in various interdisciplinary fields, including ophthalmology. Ophthalmology is at the forefront of AI in medicine because the diagnosis of ocular diseases heavy reliance on imaging. Recently, deep learning-based AI screening and prediction models have been applied to the most common visual impairment and blindness diseases, including glaucoma, cataract, age-related macular degeneration (ARMD), and diabetic retinopathy (DR). The success of AI in medicine is primarily attributed to the development of deep learning algorithms, which are computational models composed of multiple layers of simulated neurons. These models can learn the representations of data at multiple levels of abstraction. The Inception-v3 algorithm and transfer learning concept have been applied in DR and ARMD to reuse fundus image features learned from natural images (non-medical images) to train an AI system with a fraction of the commonly used training data (<1%). The trained AI system achieved performance comparable to that of human experts in classifying ARMD and diabetic macular edema on optical coherence tomography images. In this study, we highlight the fundamental concepts of AI and its application in these four major ocular diseases and further discuss the current challenges, as well as the prospects in ophthalmology.

An analysis-ready and quality controlled resource for pediatric brain white-matter research

We created a set of resources to enable research based on openly-available diffusion MRI (dMRI) data from the Healthy Brain Network (HBN) study. First, we curated the HBN dMRI data (N = 2747) into the Brain Imaging Data Structure and preprocessed it according to best-practices, including denoising and correcting for motion effects, susceptibility-related distortions, and eddy currents. Preprocessed, analysis-ready data was made openly available. Data quality plays a key role in the analysis of dMRI. To optimize QC and scale it to this large dataset, we trained a neural network through the combination of a small data subset scored by experts and a larger set scored by community scientists. The network performs QC highly concordant with that of experts on a held out set (ROC-AUC = 0.947). A further analysis of the neural network demonstrates that it relies on image features with relevance to QC. Altogether, this work both delivers resources to advance transdiagnostic research in brain connectivity and pediatric mental health, and establishes a novel paradigm for automated QC of large datasets.

Predictive Modeling of Long-Term Glaucoma Progression Based on Initial Ophthalmic Data and Optic Nerve Head Characteristics

Purpose

The purpose of this study was to develop a model, based on initial optic nerve head (ONH) characteristics, predictive of long-term rapid retinal nerve fiber layer (RNFL) thinning in patients with open-angle glaucoma (OAG).

Methods

This study evaluated 712 eyes with OAG that had been followed up for >5 years with annual evaluation of RNFL thickness. Baseline ophthalmic features were incorporated into the machine learning models for prediction of faster RNFL thinning. The model was trained and tested using a random forest (RF) method, and was interpreted using Shapley additive explanations. Factors associated with faster rate of RNFL thinning were statistically evaluated using a decision tree.

Results

The RF model showed that greater lamina cribrosa (LC) curvature, higher intraocular pressure (IOP), visual field mean deviation converging towards −5 dB, and thinner peripapillary choroid at baseline were the four most significant features predicting faster RNFL thinning. Partial interaction between the features showed that larger LC curvature was a strong factor for faster RNFL thinning when it exceeded approximately 12.0. When the LC curvature was ≤12, higher initial IOP and thinner peripapillary choroid played a role in the rapid RNFL thinning. Based on the decision tree, higher IOP (>26.5 mm Hg), greater laminar curvature (>13.95), and thinner peripapillary choroid (≤117.5 µm) were the 3 most important determinants affecting the rate of RNFL thinning.

Conclusions

Baseline ophthalmic data and ONH characteristics of patients with OAG were predictive of eyes at risk of faster progression. Combinations of important characteristics, such as IOP, LC curvature, and choroidal thickness, could stratify eyes into groups with different rates of RNFL thinning.

Translational Relevance

This work lays the foundations for developing prediction models to estimate glaucoma prognosis based on initial ONH characteristics.

The Development and Clinical Application of Innovative Optical Ophthalmic Imaging Techniques

The field of ophthalmic imaging has grown substantially over the last years. Massive improvements in image processing and computer hardware have allowed the emergence of multiple imaging techniques of the eye that can transform patient care. The purpose of this review is to describe the most recent advances in eye imaging and explain how new technologies and imaging methods can be utilized in a clinical setting. The introduction of optical coherence tomography (OCT) was a revolution in eye imaging and has since become the standard of care for a plethora of conditions. Its most recent iterations, OCT angiography, and visible light OCT, as well as imaging modalities, such as fluorescent lifetime imaging ophthalmoscopy, would allow a more thorough evaluation of patients and provide additional information on disease processes. Toward that goal, the application of adaptive optics (AO) and full-field scanning to a variety of eye imaging techniques has further allowed the histologic study of single cells in the retina and anterior segment. Toward the goal of remote eye care and more accessible eye imaging, methods such as handheld OCT devices and imaging through smartphones, have emerged. Finally, incorporating artificial intelligence (AI) in eye images has the potential to become a new milestone for eye imaging while also contributing in social aspects of eye care.

Systematic Bibliometric and Visualized Analysis of Research Hotspots and Trends on the Application of Artificial Intelligence in Ophthalmic Disease Diagnosis

Background: Artificial intelligence (AI) has been used in the research of ophthalmic disease diagnosis, and it may have an impact on medical and ophthalmic practice in the future. This study explores the general application and research frontier of artificial intelligence in ophthalmic disease detection.

Methods: Citation data were downloaded from the Web of Science Core Collection database to evaluate the extent of the application of Artificial intelligence in ophthalmic disease diagnosis in publications from 1 January 2012, to 31 December 2021. This information was analyzed using CiteSpace.5.8. R3 and Vosviewer.

Results: A total of 1,498 publications from 95 areas were examined, of which the United States was determined to be the most influential country in this research field. The largest cluster labeled “Brownian motion” was used prior to the application of AI for ophthalmic diagnosis from 2007 to 2017, and was an active topic during this period. The burst keywords in the period from 2020 to 2021 were system, disease, and model.

Conclusion: The focus of artificial intelligence research in ophthalmic disease diagnosis has transitioned from the development of AI algorithms and the analysis of abnormal eye physiological structure to the investigation of more mature ophthalmic disease diagnosis systems. However, there is a need for further studies in ophthalmology and computer engineering.

Machine learning predicting myopic regression after corneal refractive surgery using preoperative data and fundus photography

PURPOSE

Myopic regression after surgery is the most common long-term complication of refractive surgery, but it is difficult to identify myopic regression without long-term observation. This study aimed to develop machine learning models to identify high-risk patients for refractive regression based on preoperative data and fundus photography.

METHODS

This retrospective study assigned subjects to the training (n = 1606 eyes) and validation (n = 403 eyes) datasets with chronological data splitting. Machine learning models with ResNet50 (for image analysis) and XGBoost (for integration of all variables and fundus photography) were developed based on subjects who underwent corneal refractive surgery. The primary outcome was the predictive performance for the presence of myopic regression at 4 years of follow-up examination postoperatively.

RESULTS

By integrating all factors and fundus photography, the final combined machine learning model showed good performance to predict myopic regression of more than 0.5 D (area under the receiver operating characteristic curve [ROC-AUC], 0.753; 95% confidence interval [CI], 0.710-0.793). The performance of the final model was better than the single ResNet50 model only using fundus photography (ROC-AUC, 0.673; 95% CI, 0.627-0.716). The top-five most important input features were fundus photography, preoperative anterior chamber depth, planned ablation thickness, age, and preoperative central corneal thickness.

CONCLUSION

Our machine learning algorithm provides an efficient strategy to identify high-risk patients with myopic regression without additional labor, cost, and time. Surgeons might benefit from preoperative risk assessment of myopic regression, patient counseling before surgery, and surgical option decisions.

Machine learning approaches for biomolecular, biophysical, and biomaterials research

A fluent conversation with a virtual assistant, person-tailored news feeds, and deep-fake images created within seconds-all those things that have been unthinkable for a long time are now a part of our everyday lives. What these examples have in common is that they are realized by different means of machine learning (ML), a technology that has fundamentally changed many aspects of the modern world. The possibility to process enormous amount of data in multi-hierarchical, digital constructs has paved the way not only for creating intelligent systems but also for obtaining surprising new insight into many scientific problems. However, in the different areas of biosciences, which typically rely heavily on the collection of time-consuming experimental data, applying ML methods is a bit more challenging: Here, difficulties can arise from small datasets and the inherent, broad variability, and complexity associated with studying biological objects and phenomena. In this Review, we give an overview of commonly used ML algorithms (which are often referred to as "machines") and learning strategies as well as their applications in different bio-disciplines such as molecular biology, drug development, biophysics, and biomaterials science. We highlight how selected research questions from those fields were successfully translated into machine readable formats, discuss typical problems that can arise in this context, and provide an overview of how to resolve those encountered difficulties.

Novel technical and privacy-preserving technology for artificial intelligence in ophthalmology

PURPOSE OF REVIEW

The application of artificial intelligence (AI) in medicine and ophthalmology has experienced exponential breakthroughs in recent years in diagnosis, prognosis, and aiding clinical decision-making. The use of digital data has also heralded the need for privacy-preserving technology to protect patient confidentiality and to guard against threats such as adversarial attacks. Hence, this review aims to outline novel AI-based systems for ophthalmology use, privacy-preserving measures, potential challenges, and future directions of each.

RECENT FINDINGS

Several key AI algorithms used to improve disease detection and outcomes include: Data-driven, imagedriven, natural language processing (NLP)-driven, genomics-driven, and multimodality algorithms. However, deep learning systems are susceptible to adversarial attacks, and use of data for training models is associated with privacy concerns. Several data protection methods address these concerns in the form of blockchain technology, federated learning, and generative adversarial networks.

SUMMARY

AI-applications have vast potential to meet many eyecare needs, consequently reducing burden on scarce healthcare resources. A pertinent challenge would be to maintain data privacy and confidentiality while supporting AI endeavors, where data protection methods would need to rapidly evolve with AI technology needs. Ultimately, for AI to succeed in medicine and ophthalmology, a balance would need to be found between innovation and privacy.

A Comprehensive Review of Methods and Equipment for Aiding Automatic Glaucoma Tracking

Glaucoma is a chronic optic neuropathy characterized by irreversible damage to the retinal nerve fiber layer (RNFL), resulting in changes in the visual field (VC). Glaucoma screening is performed through a complete ophthalmological examination, using images of the optic papilla obtained in vivo for the evaluation of glaucomatous characteristics, eye pressure, and visual field. Identifying the glaucomatous papilla is quite important, as optical papillary images are considered the gold standard for tracking. Therefore, this article presents a review of the diagnostic methods used to identify the glaucomatous papilla through technology over the last five years. Based on the analyzed works, the current state-of-the-art methods are identified, the current challenges are analyzed, and the shortcomings of these methods are investigated, especially from the point of view of automation and independence in performing these measurements. Finally, the topics for future work and the challenges that need to be solved are proposed.

Development of the Integrated Glaucoma Risk Index

Various machine-learning schemes have been proposed to diagnose glaucoma. They can classify subjects into ‘normal’ or ‘glaucoma’-positive but cannot determine the severity of the latter. To complement this, researchers have proposed statistical indices for glaucoma risk. However, they are based on a single examination indicator and do not reflect the total severity of glaucoma progression. In this study, we propose an integrated glaucoma risk index (I-GRI) based on the visual field (VF) test, optical coherence tomography (OCT), and intraocular pressure (IOP) test. We extracted important features from the examination data using a machine learning scheme and integrated them into a single measure using a mathematical equation. The proposed index produces a value between 0 and 1; the higher the risk index value, the greater the risk/severity of glaucoma. In the sanity test using test cases, the I-GRI showed a balanced distribution in both glaucoma and normal cases. When we classified glaucoma and normal cases using the I-GRI, we obtained a misclassification rate of 0.07 (7%). The proposed index is useful for diagnosing glaucoma and for detecting its progression.

[Artificial intelligence and glaucoma: A literature review]

In recent years, research in artificial intelligence (AI) has experienced an unprecedented surge in the field of ophthalmology, in particular glaucoma. The diagnosis and follow-up of glaucoma is complex and relies on a body of clinical evidence and ancillary tests. This large amount of information from structural and functional testing of the optic nerve and macula makes glaucoma a particularly appropriate field for the application of AI. In this paper, we will review work using AI in the field of glaucoma, whether for screening, diagnosis or detection of progression. Many AI strategies have shown promising results for glaucoma detection using fundus photography, optical coherence tomography, or automated perimetry. The combination of these imaging modalities increases the performance of AI algorithms, with results comparable to those of humans. We will discuss potential applications as well as obstacles and limitations to the deployment and validation of such models. While there is no doubt that AI has the potential to revolutionize glaucoma management and screening, research in the coming years will need to address unavoidable questions regarding the clinical significance of such results and the explicability of the predictions.

Trustworthy AI: Closing the gap between development and integration of AI systems in ophthalmic practice

An increasing number of artificial intelligence (AI) systems are being proposed in ophthalmology, motivated by the variety and amount of clinical and imaging data, as well as their potential benefits at the different stages of patient care. Despite achieving close or even superior performance to that of experts, there is a critical gap between development and integration of AI systems in ophthalmic practice. This work focuses on the importance of trustworthy AI to close that gap. We identify the main aspects or challenges that need to be considered along the AI design pipeline so as to generate systems that meet the requirements to be deemed trustworthy, including those concerning accuracy, resiliency, reliability, safety, and accountability. We elaborate on mechanisms and considerations to address those aspects or challenges, and define the roles and responsibilities of the different stakeholders involved in AI for ophthalmic care, i.e., AI developers, reading centers, healthcare providers, healthcare institutions, ophthalmological societies and working groups or committees, patients, regulatory bodies, and payers. Generating trustworthy AI is not a responsibility of a sole stakeholder. There is an impending necessity for a collaborative approach where the different stakeholders are represented along the AI design pipeline, from the definition of the intended use to post-market surveillance after regulatory approval. This work contributes to establish such multi-stakeholder interaction and the main action points to be taken so that the potential benefits of AI reach real-world ophthalmic settings.

Comparison of Different Machine Learning Classifiers for Glaucoma Diagnosis Based on Spectralis OCT

Early detection is important in glaucoma management. By using optical coherence tomography (OCT), the subtle structural changes caused by glaucoma can be detected. Though OCT provided abundant parameters for comprehensive information, clinicians may be confused once the results conflict. Machine learning classifiers (MLCs) are good tools for considering numerous parameters and generating reliable diagnoses in glaucoma practice. Here we aim to compare different MLCs based on Spectralis OCT parameters, including circumpapillary retinal nerve fiber layer (cRNFL) thickness, Bruch’s membrane opening-minimum rim width (BMO-MRW), Early Treatment Diabetes Retinopathy Study (ETDRS) macular thickness, and posterior pole asymmetry analysis (PPAA), in discriminating normal from glaucomatous eyes. Five MLCs were proposed, namely conditional inference trees (CIT), logistic model tree (LMT), C5.0 decision tree, random forest (RF), and extreme gradient boosting (XGBoost). Logistic regression (LGR) was used as a benchmark for comparison. RF was shown to be the best model. Ganglion cell layer measurements were the most important predictors in early glaucoma detection and cRNFL measurements were more important as the glaucoma severity increased. The global, temporal, inferior, superotemporal, and inferotemporal sites were relatively influential locations among all parameters. Clinicians should cautiously integrate the Spectralis OCT results into the entire clinical picture when diagnosing glaucoma.

Gaps in standards for integrating artificial intelligence technologies into ophthalmic practice

PURPOSE OF REVIEW

The purpose of this review is to provide an overview of healthcare standards and their relevance to multiple ophthalmic workflows, with a specific emphasis on describing gaps in standards development needed for improved integration of artificial intelligence technologies into ophthalmic practice.

RECENT FINDINGS

Healthcare standards are an essential component of data exchange and critical for clinical practice, research, and public health surveillance activities. Standards enable interoperability between clinical information systems, healthcare information exchange between institutions, and clinical decision support in a complex health information technology ecosystem. There are several gaps in standards in ophthalmology, including relatively low adoption of imaging standards, lack of use cases for integrating apps providing artificial intelligence -based decision support, lack of common data models to harmonize big data repositories, and no standards regarding interfaces and algorithmic outputs.

SUMMARY

These gaps in standards represent opportunities for future work to develop improved data flow between various elements of the digital health ecosystem. This will enable more widespread adoption and integration of artificial intelligence-based tools into clinical practice. Engagement and support from the ophthalmology community for standards development will be important for advancing this work.

Evaluation of Explainable Deep Learning Methods for Ophthalmic Diagnosis

BACKGROUND

The lack of explanations for the decisions made by deep learning algorithms has hampered their acceptance by the clinical community despite highly accurate results on multiple problems. Attribution methods explaining deep learning models have been tested on medical imaging problems. The performance of various attribution methods has been compared for models trained on standard machine learning datasets but not on medical images. In this study, we performed a comparative analysis to determine the method with the best explanations for retinal OCT diagnosis.

METHODS

A well-known deep learning model, Inception-v3 was trained to diagnose 3 retinal diseases - choroidal neovascularization (CNV), diabetic macular edema (DME), and drusen. The explanations from 13 different attribution methods were rated by a panel of 14 clinicians for clinical significance. Feedback was obtained from the clinicians regarding the current and future scope of such methods.

RESULTS

An attribution method based on Taylor series expansion, called Deep Taylor, was rated the highest by clinicians with a median rating of 3.85/5. It was followed by Guided backpropagation (GBP), and SHapley Additive exPlanations (SHAP).

CONCLUSION

Explanations from the top methods were able to highlight the structures for each disease - fluid accumulation for CNV, the boundaries of edema for DME, and bumpy areas of retinal pigment epithelium (RPE) for drusen. The most suitable method for a specific medical diagnosis task may be different from the one considered best for conventional tasks. Overall, there was a high degree of acceptance from the clinicians surveyed in the study.