Deep segmentation of OCTA for evaluation and association of changes of retinal microvasculature with Alzheimer's disease and mild cognitive impairment

Retinal microvascular density and inner thickness in Alzheimer's disease and mild cognitive impairment

Background

Alzheimer's disease (AD) is a major healthcare challenge, with existing diagnostics being costly/infeasible. This study explores retinal biomarkers from optical coherence tomography (OCT) and OCT angiography (OCTA) as a cost-effective and non-invasive solution to differentiate AD, mild cognitive impairment (MCI), and healthy controls (HCs).

Methods

Participants from the CALLIOPE Research Program were classified as "Dem" (AD and early AD), "MCI," and "HCs" using neuropsychological tests and clinical diagnosis by a neurologist. OCT/OCTA examinations were conducted using the RTVue XR 100 Avanti SD-OCT system (VISIONIX), with retinal parameters extracted. Statistical analysis included normality and homogeneity of variance (HOV) tests to select ANOVA methods. Post-hoc analyses utilized Mann-Whitney U, Dunnett, or Tukey-HSD tests based on parameters' normality and HOV. Correlations with age were assessed via Pearson or Spearman tests. A generalized linear model (GLM) using Tweedie regression modeled the relationship between OCT/OCTA parameters and MMSE scores, correcting for age. Another ordinal logistic GLM (OL-GLM) modeled OCT/OCTA parameters against classes, adjusting for multiple confounders.

Results

We analyzed 357 participants: 44 Dem, 139 MCI, and 174 HCs. Significant microvascular density (VD) reductions around the fovea were linked with MCI and Dem compared to HCs. Age-related analysis associated thickness parameters with HCs' old age. Our OL-GLM demonstrated significant thickness/volume reductions in Inner_Retina and Full_Retina layers. Foveal avascular zone (FAZ) area and perimeter were initially not correlated with cognitive decline; however, OL-GLM significantly associated FAZ perimeter enlargement with Dem and MCI groups. Significant average and inferior peripapillary RNFL thinning were linked to Dem and MCI groups.

Conclusion

This is the first study to examine VD changes in G grid sections among Dem, MCI, and HCs. We found a significant association between various VD parameters and cognitive decline. Most macular thickness/volume changes did not correlate with cognitive decline initially; however, our OL-GLM succeeded, highlighting the importance of the confounders' corrections. Our analysis excluded individual retinal layer parameters due to limitations; however, the literature suggests their value. Our study confirmed existing biomarkers' efficacy and uncovered novel retinal parameters for cognitive decline, requiring further validation.

AI-based 3D analysis of retinal vasculature associated with retinal diseases using OCT angiography

Retinal vasculature is the only vascular system in the human body that can be observed in a non-invasive manner, with a phenotype associated with a wide range of ocular, cerebral, and cardiovascular diseases. OCT and OCT angiography (OCTA) provide powerful imaging methods to visualize the three-dimensional morphological and functional information of the retina. In this study, based on OCT and OCTA multimodal inputs, a multitask convolutional neural network model was built to realize 3D segmentation of retinal blood vessels and disease classification for different retinal diseases, overcoming the limitations of existing methods that can only perform 2D analysis of OCTA. Two hundred thirty sets of OCT and OCTA data from 109 patients, including 138,000 cross-sectional images in normal and diseased eyes (age-related macular degeneration, retinal vein occlusion, and central serous chorioretinopathy), were collected from four commercial OCT systems for model training, validation, and testing. Experimental results verified that the proposed method was able to achieve a DICE coefficient of 0.956 for 3D segmentation of blood vessels and an accuracy of 91.49% for disease classification, and further enabled us to evaluate the 3D reconstruction of retinal vessels, explore the interlayer connections of superficial and deep vasculatures, and reveal the 3D quantitative vessel characteristics in different retinal diseases.

Early detection of dementia through retinal imaging and trustworthy AI

Alzheimer's disease (AD) is a global healthcare challenge lacking a simple and affordable detection method. We propose a novel deep learning framework, Eye-AD, to detect Early-onset Alzheimer's Disease (EOAD) and Mild Cognitive Impairment (MCI) using OCTA images of retinal microvasculature and choriocapillaris. Eye-AD employs a multilevel graph representation to analyze intra- and inter-instance relationships in retinal layers. Using 5751 OCTA images from 1671 participants in a multi-center study, our model demonstrated superior performance in EOAD (internal data: AUC = 0.9355, external data: AUC = 0.9007) and MCI detection (internal data: AUC = 0.8630, external data: AUC = 0.8037). Furthermore, we explored the associations between retinal structural biomarkers in OCTA images and EOAD/MCI, and the results align well with the conclusions drawn from our deep learning interpretability analysis. Our findings provide further evidence that retinal OCTA imaging, coupled with artificial intelligence, will serve as a rapid, noninvasive, and affordable dementia detection.

Longitudinal Assessment of Retinal Microvasculature in Preclinical Alzheimer's Disease

Purpose

To investigate if changes in vessel density (VD) and the foveal avascular zone (FAZ) occur in the preclinical phase of Alzheimer's disease (pAD) over time.

Methods

Optical coherence tomography angiography (OCTA) was used to image VD and FAZ at baseline and for a follow-up period of 2 years. Positron emission tomography (PET) was used to determine the amyloid beta (Aβ) status of participants.

Results

The VD and FAZ of 148 participants (54% female) were analyzed at baseline and follow-up (mean time between measurements, 2.24 ± 0.35 years). The mean age of the participants was 68.3 ± 6.0 years at baseline and 70.3 ± 5.9 years at follow-up. Participants were divided into three groups: control group, participants who had negative Aβ status at both measurements (Aβ-, n = 116); converter group, participants who transitioned from negative to positive between baseline and follow-up (Aβ-+, n = 18); and participants who were consistently positive at both visits (Aβ++, n = 14). The VD of both Aβ+ groups demonstrated non-significant increases over time in both macula and optic nerve head (ONH) regions. The Aβ- group was found to be significantly higher in both ONH and macular regions. The VD of the Aβ++ group was significantly higher in the macula inner and outer rings compared to the Aβ-+ and Aβ- groups. No significant change was found in FAZ values over time.

Conclusions

Alterations in VD seem to manifest already in pAD, exhibiting distinct variations between the ONH and macula. Further longitudinal studies with a longer follow-up design and known amyloid pathology should be undertaken to validate these observations.

A Novel Single-Sample Retinal Vessel Segmentation Method Based on Grey Relational Analysis

Accurate segmentation of retinal vessels is of great significance for computer-aided diagnosis and treatment of many diseases. Due to the limited number of retinal vessel samples and the scarcity of labeled samples, and since grey theory excels in handling problems of "few data, poor information", this paper proposes a novel grey relational-based method for retinal vessel segmentation. Firstly, a noise-adaptive discrimination filtering algorithm based on grey relational analysis (NADF-GRA) is designed to enhance the image. Secondly, a threshold segmentation model based on grey relational analysis (TS-GRA) is designed to segment the enhanced vessel image. Finally, a post-processing stage involving hole filling and removal of isolated pixels is applied to obtain the final segmentation output. The performance of the proposed method is evaluated using multiple different measurement metrics on publicly available digital retinal DRIVE, STARE and HRF datasets. Experimental analysis showed that the average accuracy and specificity on the DRIVE dataset were 96.03% and 98.51%. The mean accuracy and specificity on the STARE dataset were 95.46% and 97.85%. Precision, F1-score, and Jaccard index on the HRF dataset all demonstrated high-performance levels. The method proposed in this paper is superior to the current mainstream methods.

Deep Learning Models for the Screening of Cognitive Impairment Using Multimodal Fundus Images

OBJECTIVE

We aimed to develop a deep learning system capable of identifying subjects with cognitive impairment quickly and easily based on multimodal ocular images.

DESIGN

Cross sectional study.

SUBJECTS

Participants of Beijing Eye Study 2011 and patients attending Beijing Tongren Eye Center and Beijing Tongren Hospital Physical Examination Center.

METHODS

We trained and validated a deep learning algorithm to assess cognitive impairment using retrospectively collected data from the Beijing Eye Study 2011. Cognitive impairment was defined as a Mini-Mental State Examination score < 24. Based on fundus photographs and OCT images, we developed 5 models based on the following sets of images: macula-centered fundus photographs, optic disc-centered fundus photographs, fundus photographs of both fields, OCT images, and fundus photographs of both fields with OCT (multimodal). The performance of the models was evaluated and compared in an external validation data set, which was collected from patients attending Beijing Tongren Eye Center and Beijing Tongren Hospital Physical Examination Center.

MAIN OUTCOME MEASURES

Area under the curve (AUC).

RESULTS

A total of 9424 retinal photographs and 4712 OCT images were used to develop the model. The external validation sets from each center included 1180 fundus photographs and 590 OCT images. Model comparison revealed that the multimodal performed best, achieving an AUC of 0.820 in the internal validation set, 0.786 in external validation set 1, and 0.784 in external validation set 2. We evaluated the performance of the multi-model in different sexes and different age groups; there were no significant differences. The heatmap analysis showed that signals around the optic disc in fundus photographs and the retina and choroid around the macular and optic disc regions in OCT images were used by the multimodal to identify participants with cognitive impairment.

CONCLUSIONS

Fundus photographs and OCT can provide valuable information on cognitive function. Multimodal models provide richer information compared with single-mode models. Deep learning algorithms based on multimodal retinal images may be capable of screening cognitive impairment. This technique has potential value for broader implementation in community-based screening or clinic settings.

FINANCIAL DISCLOSURE(S)

Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Computational Retinal Microvascular Biomarkers from an OCTA Image in Clinical Investigation

Retinal structural and functional changes in humans can be manifestations of different physiological or pathological conditions. Retinal imaging is the only way to directly inspect blood vessels and their pathological changes throughout the whole body non-invasively. Various quantitative analysis metrics have been used to measure the abnormalities of retinal microvasculature in the context of different retinal, cerebral and systemic disorders. Recently developed optical coherence tomography angiography (OCTA) is a non-invasive imaging tool that allows high-resolution three-dimensional mapping of the retinal microvasculature. The identification of retinal biomarkers from OCTA images could facilitate clinical investigation in various scenarios. We provide a framework for extracting computational retinal microvasculature biomarkers (CRMBs) from OCTA images through a knowledge-driven computerized automatic analytical system. Our method allows for improved identification of the foveal avascular zone (FAZ) and introduces a novel definition of vessel dispersion in the macular region. Furthermore, retinal large vessels and capillaries of the superficial and deep plexus can be differentiated, correlating with retinal pathology. The diagnostic value of OCTA CRMBs was demonstrated by a cross-sectional study with 30 healthy subjects and 43 retinal vein occlusion (RVO) patients, which identified strong correlations between OCTA CRMBs and retinal function in RVO patients. These OCTA CRMBs generated through this "all-in-one" pipeline may provide clinicians with insights about disease severity, treatment response and prognosis, aiding in the management and early detection of various disorders.

Optical Coherence Tomography Angiography: Revolutionizing Clinical Diagnostics and Treatment in Central Nervous System Disease

Optical coherence tomography angiography (OCTA), as a new generation of non-invasive and efficient fundus imaging technology, can provide non-invasive assessment of vascular lesions in the retina and choroid. In terms of anatomy and development, the retina is referred to as an extension of the central nervous system (CNS). CNS diseases are closely related to changes in fundus structure and blood vessels, and direct visualization of fundus structure and blood vessels provides an effective "window" for CNS research. This has important practical significance for identifying the characteristic changes of various CNS diseases on OCTA in the future, and plays a key role in promoting early screening, diagnosis, and monitoring of disease progression in CNS diseases. This article reviews relevant fundus studies by comparing and summarizing the unique advantages and existing limitations of OCTA in various CNS disease patients, in order to demonstrate the clinical significance of OCTA in the diagnosis and treatment of CNS diseases.

Wavelet scattering transform application in classification of retinal abnormalities using OCT images

To assist ophthalmologists in diagnosing retinal abnormalities, Computer Aided Diagnosis has played a significant role. In this paper, a particular Convolutional Neural Network based on Wavelet Scattering Transform (WST) is used to detect one to four retinal abnormalities from Optical Coherence Tomography (OCT) images. Predefined wavelet filters in this network decrease the computation complexity and processing time compared to deep learning methods. We use two layers of the WST network to obtain a direct and efficient model. WST generates a sparse representation of the images which is translation-invariant and stable concerning local deformations. Next, a Principal Component Analysis classifies the extracted features. We evaluate the model using four publicly available datasets to have a comprehensive comparison with the literature. The accuracies of classifying the OCT images of the OCTID dataset into two and five classes were [Formula: see text] and [Formula: see text], respectively. We achieved an accuracy of [Formula: see text] in detecting Diabetic Macular Edema from Normal ones using the TOPCON device-based dataset. Heidelberg and Duke datasets contain DME, Age-related Macular Degeneration, and Normal classes, in which we achieved accuracy of [Formula: see text] and [Formula: see text], respectively. A comparison of our results with the state-of-the-art models shows that our model outperforms these models for some assessments or achieves nearly the best results reported so far while having a much smaller computational complexity.

Relationships between quantitative retinal microvascular characteristics and cognitive function based on automated artificial intelligence measurements

Introduction: The purpose of this study is to assess the relationship between retinal vascular characteristics and cognitive function using artificial intelligence techniques to obtain fully automated quantitative measurements of retinal vascular morphological parameters. Methods: A deep learning-based semantic segmentation network ResNet101-UNet was used to construct a vascular segmentation model for fully automated quantitative measurement of retinal vascular parameters on fundus photographs. Retinal photographs centered on the optic disc of 3107 participants (aged 50-93 years) from the Beijing Eye Study 2011, a population-based cross-sectional study, were analyzed. The main parameters included the retinal vascular branching angle, vascular fractal dimension, vascular diameter, vascular tortuosity, and vascular density. Cognitive function was assessed using the Mini-Mental State Examination (MMSE). Results: The results showed that the mean MMSE score was 26.34 ± 3.64 (median: 27; range: 2-30). Among the participants, 414 (13.3%) were classified as having cognitive impairment (MMSE score < 24), 296 (9.5%) were classified as mild cognitive impairment (MMSE: 19-23), 98 (3.2%) were classified as moderate cognitive impairment (MMSE: 10-18), and 20 (0.6%) were classified as severe cognitive impairment (MMSE < 10). Compared with the normal cognitive function group, the retinal venular average diameter was significantly larger (p = 0.013), and the retinal vascular fractal dimension and vascular density were significantly smaller (both p < 0.001) in the mild cognitive impairment group. The retinal arteriole-to-venular ratio (p = 0.003) and vascular fractal dimension (p = 0.033) were significantly decreased in the severe cognitive impairment group compared to the mild cognitive impairment group. In the multivariate analysis, better cognition (i.e., higher MMSE score) was significantly associated with higher retinal vascular fractal dimension (b = 0.134, p = 0.043) and higher retinal vascular density (b = 0.152, p = 0.023) after adjustment for age, best corrected visual acuity (BCVA) (logMAR) and education level. Discussion: In conclusion, our findings derived from an artificial intelligence-based fully automated retinal vascular parameter measurement method showed that several retinal vascular morphological parameters were correlated with cognitive impairment. The decrease in retinal vascular fractal dimension and decreased vascular density may serve as candidate biomarkers for early identification of cognitive impairment. The observed reduction in the retinal arteriole-to-venular ratio occurs in the late stages of cognitive impairment.

Diagnosing Systemic Disorders with AI Algorithms Based on Ocular Images

The advent of artificial intelligence (AI), especially the state-of-the-art deep learning frameworks, has begun a silent revolution in all medical subfields, including ophthalmology. Due to their specific microvascular and neural structures, the eyes are anatomically associated with the rest of the body. Hence, ocular image-based AI technology may be a useful alternative or additional screening strategy for systemic diseases, especially where resources are scarce. This review summarizes the current applications of AI related to the prediction of systemic diseases from multimodal ocular images, including cardiovascular diseases, dementia, chronic kidney diseases, and anemia. Finally, we also discuss the current predicaments and future directions of these applications.

Association of retinal microvascular abnormalities and neuromyelitis optica spectrum disorders with optical coherence tomography angiography

Introduction

Neuromyelitis optica spectrum disorders (NMOSD) are autoimmune central nervous system diseases characterized by the immune system's abnormal attack on glial cells and neurons. Optic neuritis (ON) is one of the indicators of NMOSD, often starting unilaterally and potentially affecting both eyes later in the disease progression, leading to visual impairment. Optical coherence tomography angiography (OCTA) has the potential to aid in the early diagnosis of NMOSD by examining ophthalmic imaging and may offer a window for disease prevention.

Methods

In this study, we collected OCTA images from 22 NMOSD patients (44 images) and 25 healthy individuals (50 images) to investigate retinal microvascular changes in NMOSD. We employed effective retinal microvascular segmentation and foveal avascular zone (FAZ) segmentation techniques to extract key OCTA structures for biomarker analysis. A total of 12 microvascular features were extracted using specifically designed methods based on the segmentation results. The OCTA images of NMOSD patients were classified into two groups: optic neuritis (ON) and non-optic neuritis (non-ON). Each group was compared separately with a healthy control (HC) group.

Results

Statistical analysis revealed that the non-ON group displayed shape changes in the deep layer of the retina, specifically in the FAZ. However, there were no significant microvascular differences between the non-ON group and the HC group. In contrast, the ON group exhibited microvascular degeneration in both superficial and deep retinal layers. Sub-regional analysis revealed that pathological variations predominantly occurred on the side affected by ON, particularly within the internal ring near the FAZ.

Discussion

The findings of this study highlight the potential of OCTA in evaluating retinal microvascular changes associated with NMOSD. The shape alterations observed in the FAZ of the non-ON group suggest localized vascular abnormalities. In the ON group, microvascular degeneration in both superficial and deep retinal layers indicates more extensive vascular damage. Sub-regional analysis further emphasizes the impact of optic neuritis on pathological variations, particularly near the FAZ's internal ring.

Conclusion

This study provides insights into the retinal microvascular changes associated with NMOSD using OCTA imaging. The identified biomarkers and observed alterations may contribute to the early diagnosis and monitoring of NMOSD, potentially offering a time window for intervention and prevention of disease progression.