An enhanced OCT image captioning system to assist ophthalmologists in detecting and classifying eye diseases

Deep Learning Applications to Classification and Detection of Age-Related Macular Degeneration on Optical Coherence Tomography Imaging: A Review

Age-related macular degeneration (AMD) is one of the leading causes of blindness in the elderly, more commonly in developed countries. Optical coherence tomography (OCT) is a non-invasive imaging device widely used for the diagnosis and management of AMD. Deep learning (DL) uses multilayered artificial neural networks (NN) for feature extraction, and is the cutting-edge technique for medical image analysis for diagnostic and prognostication purposes. Application of DL models to OCT image analysis has garnered significant interest in recent years. In this review, we aimed to summarize studies focusing on DL models used in classification and detection of AMD. Additionally, we provide a brief introduction to other DL applications in AMD, such as segmentation, prediction/prognostication, and models trained on multimodal imaging.

A Study on the Correlation Between Age-Related Macular Degeneration and Alzheimer's Disease Based on the Application of Artificial Neural Network

Age-related Macular Degeneration (AMD) is a kind of irreversible vision loss or disease caused by retinal pigment epithelial cells and neuroretinal degeneration, which has become the main cause of vision loss and blindness of the elderly over 65 years old in developed countries. The main clinical manifestations are cognitive decline, mental symptoms and behavioral disorders, and the gradual decline of daily living ability. In this paper, a feature extraction method of electroencephalogram (EEG) signal based on multi-spectral image fusion of multi-brain regions is proposed based on artificial neural network (ANN). In this method, the brain is divided into several different brain regions, and the EEG signals of different brain regions are transformed into several multispectral images by combining with the multispectral image transformation method. Using Alzheimer's disease (AD) classification algorithm, the depth residual network model pre-trained in ImageNet was transferred to sMRI data set for fine adjustment, instead of training a brand-new model from scratch. The results show that the proposed method solves the problem of few available medical image samples and shortens the training time of ANN model.

Identifying the Retinal Layers Linked to Human Contrast Sensitivity Via Deep Learning

Purpose

Luminance contrast is the fundamental building block of human spatial vision. Therefore contrast sensitivity, the reciprocal of contrast threshold required for target detection, has been a barometer of human visual function. Although retinal ganglion cells (RGCs) are known to be involved in contrast coding, it still remains unknown whether the retinal layers containing RGCs are linked to a person's contrast sensitivity (e.g., Pelli-Robson contrast sensitivity) and, if so, to what extent the retinal layers are related to behavioral contrast sensitivity. Thus the current study aims to identify the retinal layers and features critical for predicting a person's contrast sensitivity via deep learning.

Methods

Data were collected from 225 subjects including individuals with either glaucoma, age-related macular degeneration, or normal vision. A deep convolutional neural network trained to predict a person's Pelli-Robson contrast sensitivity from structural retinal images measured with optical coherence tomography was used. Then, activation maps that represent the critical features learned by the network for the output prediction were computed.

Results

The thickness of both ganglion cell and inner plexiform layers, reflecting RGC counts, were found to be significantly correlated with contrast sensitivity (r = 0.26 ∼ 0.58, Ps < 0.001 for different eccentricities). Importantly, the results showed that retinal layers containing RGCs were the critical features the network uses to predict a person's contrast sensitivity (an average R2 = 0.36 ± 0.10).

Conclusions

The findings confirmed the structure and function relationship for contrast sensitivity while highlighting the role of RGC density for human contrast sensitivity.