Relationship Induced Multi-Template Learning for Diagnosis of Alzheimer's Disease and Mild Cognitive Impairment

Sparse Graph Representation Learning Based on Reinforcement Learning for Personalized Mild Cognitive Impairment (MCI) Diagnosis

Resting-state functional magnetic resonance imaging (rs-fMRI) has gained attention as a reliable technique for investigating the intrinsic function patterns of the brain. It facilitates the extraction of functional connectivity networks (FCNs) that capture synchronized activity patterns among regions of interest (ROIs). Analyzing FCNs enables the identification of distinctive connectivity patterns associated with mild cognitive impairment (MCI). For MCI diagnosis, various sparse representation techniques have been introduced, including statistical- and deep learning-based methods. However, these methods face limitations due to their reliance on supervised learning schemes, which restrict the exploration necessary for probing novel solutions. To overcome such limitation, prior work has incorporated reinforcement learning (RL) to dynamically select ROIs, but effective exploration remains challenging due to the vast search space during training. To tackle this issue, in this study, we propose an advanced RL-based framework that utilizes a divide-and-conquer approach to decompose the FCN construction task into smaller sub-problems in a subject-specific manner, enabling efficient exploration under each sub-problem condition. Additionally, we leverage the learned value function to determine the sparsity level of FCNs, considering individual characteristics of FCNs. We validate the effectiveness of our proposed framework by demonstrating its superior performance in MCI diagnosis on publicly available cohort datasets.

Connectional-style-guided contextual representation learning for brain disease diagnosis

Structural magnetic resonance imaging (sMRI) has shown great clinical value and has been widely used in deep learning (DL) based computer-aided brain disease diagnosis. Previous DL-based approaches focused on local shapes and textures in brain sMRI that may be significant only within a particular domain. The learned representations are likely to contain spurious information and have poor generalization ability in other diseases and datasets. To facilitate capturing meaningful and robust features, it is necessary to first comprehensively understand the intrinsic pattern of the brain that is not restricted within a single data/task domain. Considering that the brain is a complex connectome of interlinked neurons, the connectional properties in the brain have strong biological significance, which is shared across multiple domains and covers most pathological information. In this work, we propose a connectional style contextual representation learning model (CS-CRL) to capture the intrinsic pattern of the brain, used for multiple brain disease diagnosis. Specifically, it has a vision transformer (ViT) encoder and leverages mask reconstruction as the proxy task and Gram matrices to guide the representation of connectional information. It facilitates the capture of global context and the aggregation of features with biological plausibility. The results indicate that CS-CRL achieves superior accuracy in multiple brain disease diagnosis tasks across six datasets and three diseases and outperforms state-of-the-art models. Furthermore, we demonstrate that CS-CRL captures more brain-network-like properties, and better aggregates features, is easier to optimize, and is more robust to noise, which explains its superiority in theory.

Adversarial Learning for MRI Reconstruction and Classification of Cognitively Impaired Individuals

Game theory-inspired deep learning using a generative adversarial network provides an environment to competitively interact and accomplish a goal. In the context of medical imaging, most work has focused on achieving single tasks such as improving image resolution, segmenting images, and correcting motion artifacts. We developed a dual-objective adversarial learning framework that simultaneously 1) reconstructs higher quality brain magnetic resonance images (MRIs) that 2) retain disease-specific imaging features critical for predicting progression from mild cognitive impairment (MCI) to Alzheimer's disease (AD). We obtained 3-Tesla, T1-weighted brain MRIs of participants from the Alzheimer's Disease Neuroimaging Initiative (ADNI, N=342) and the National Alzheimer's Coordinating Center (NACC, N = 190) datasets. We simulated MRIs with missing data by removing 50% of sagittal slices from the original scans (i.e., diced scans). The generator was trained to reconstruct brain MRIs using the diced scans as input. We introduced a classifier into the GAN architecture to discriminate between stable (i.e., sMCI) and progressive MCI (i.e., pMCI) based on the generated images to facilitate encoding of disease-related information during reconstruction. The framework was trained using ADNI data and externally validated on NACC data. In the NACC cohort, generated images had better image quality than the diced scans (Structural similarity (SSIM) index: 0.553 ± 0.116 versus 0.348 ± 0.108). Furthermore, a classifier utilizing the generated images distinguished pMCI from sMCI more accurately than with the diced scans (F1-score: 0.634 ± 0.019 versus 0.573 ± 0.028). Competitive deep learning has potential to facilitate disease-oriented image reconstruction in those at risk of developing Alzheimer's disease.

Which neuroimaging and fluid biomarkers method is better in theranostic of Alzheimer's disease? An umbrella review

Biomarkers are measured to evaluate physiological and pathological processes as well as responses to a therapeutic intervention. Biomarkers can be classified as diagnostic, prognostic, predictor, clinical, and therapeutic. In Alzheimer's disease (AD), multiple biomarkers have been reported so far. Nevertheless, finding a specific biomarker in AD remains a major challenge. Three databases, including PubMed, Web of Science, and Scopus were selected with the keywords of Alzheimer's disease, neuroimaging, biomarker, and blood. The results were finalized with 49 potential CSF/blood and 35 neuroimaging biomarkers. To distinguish normal from AD patients, amyloid-beta42 (Aβ42), plasma glial fibrillary acidic protein (GFAP), and neurofilament light (NFL) as potential biomarkers in cerebrospinal fluid (CSF) as well as the serum could be detected. Nevertheless, most of the biomarkers fairly change in the CSF during AD, listed as kallikrein 6, virus-like particles (VLP-1), galectin-3 (Gal-3), and synaptotagmin-1 (Syt-1). From the neuroimaging aspect, atrophy is an accepted biomarker for the neuropathologic progression of AD. In addition, Magnetic resonance spectroscopy (MRS), diffusion weighted imaging (DWI), diffusion tensor imaging (DTI), tractography (DTT), positron emission tomography (PET), and functional magnetic resonance imaging (fMRI), can be used to detect AD. Using neuroimaging and CSF/blood biomarkers, in combination with artificial intelligence, it is possible to obtain information on prognosis and follow-up on the different stages of AD. Hence physicians could select the suitable therapy to attenuate disease symptoms and follow up on the efficiency of the prescribed drug.

Multi-Template Meta-Information Regularized Network for Alzheimer's Disease Diagnosis Using Structural MRI

Structural magnetic resonance imaging (sMRI) has been widely applied in computer-aided Alzheimer's disease (AD) diagnosis, owing to its capabilities in providing detailed brain morphometric patterns and anatomical features in vivo. Although previous works have validated the effectiveness of incorporating metadata (e.g., age, gender, and educational years) for sMRI-based AD diagnosis, existing methods solely paid attention to metadata-associated correlation to AD (e.g., gender bias in AD prevalence) or confounding effects (e.g., the issue of normal aging and metadata-related heterogeneity). Hence, it is difficult to fully excavate the influence of metadata on AD diagnosis. To address these issues, we constructed a novel Multi-template Meta-information Regularized Network (MMRN) for AD diagnosis. Specifically, considering diagnostic variation resulting from different spatial transformations onto different brain templates, we first regarded different transformations as data augmentation for self-supervised learning after template selection. Since the confounding effects may arise from excessive attention to meta-information owing to its correlation with AD, we then designed the modules of weakly supervised meta-information learning and mutual information minimization to learn and disentangle meta-information from learned class-related representations, which accounts for meta-information regularization for disease diagnosis. We have evaluated our proposed MMRN on two public multi-center cohorts, including the Alzheimer's Disease Neuroimaging Initiative (ADNI) with 1,950 subjects and the National Alzheimer's Coordinating Center (NACC) with 1,163 subjects. The experimental results have shown that our proposed method outperformed the state-of-the-art approaches in both tasks of AD diagnosis, mild cognitive impairment (MCI) conversion prediction, and normal control (NC) vs. MCI vs. AD classification.

Spectral Graph Neural Network-Based Multi-Atlas Brain Network Fusion for Major Depressive Disorder Diagnosis

Major Depressive Disorder (MDD) imposes a substantial burden within the healthcare domain, impacting millions of individuals worldwide. Functional Magnetic Resonance Imaging (fMRI) has emerged as a promising tool for the objective diagnosis of MDD, enabling the investigation of functional connectivity patterns in the brain associated with this disorder. However, most existing methods focus on a single brain atlas, which limits their ability to capture the complex, multi-scale nature of functional brain networks. To address these limitations, we propose a novel multi-atlas fusion method that incorporates early and late fusion in a unified framework. Our method introduces the concept of the holistic Functional Connectivity Network (FCN), which captures both intra-atlas relationships within individual atlases and inter-regional relationships between atlases with different brain parcellation scales. This comprehensive representation enables the identification of potential disease-related patterns associated with MDD in the early stage of our framework. Moreover, by decoding the holistic FCN from various perspectives through multiple spectral Graph Convolutional Neural Networks and fusing their results with decision-level ensembles, we further improve the performance of MDD diagnosis. Our approach is easily implemented with minimal modifications to existing model structures and demonstrates a robust performance across different baseline models. Our method, evaluated on public resting-state fMRI datasets, surpasses the current multi-atlas fusion methods, enhancing the accuracy of MDD diagnosis. The proposed novel multi-atlas fusion framework provides a more reliable MDD diagnostic technique. Experimental results show our approach outperforms both single- and multi-atlas-based methods, demonstrating its effectiveness in advancing MDD diagnosis.

Deep Fusion of Multi-Template Using Spatio-Temporal Weighted Multi-Hypergraph Convolutional Networks for Brain Disease Analysis

Conventional functional connectivity network (FCN) based on resting-state fMRI (rs-fMRI) can only reflect the relationship between pairwise brain regions. Thus, the hyper-connectivity network (HCN) has been widely used to reveal high-order interactions among multiple brain regions. However, existing HCN models are essentially spatial HCN, which reflect the spatial relevance of multiple brain regions, but ignore the temporal correlation among multiple time points. Furthermore, the majority of HCN construction and learning frameworks are limited to using a single template, while the multi-template carries richer information. To address these issues, we first employ multiple templates to parcellate the rs-fMRI into different brain regions. Then, based on the multi-template data, we propose a spatio-temporal weighted HCN (STW-HCN) to capture more comprehensive high-order temporal and spatial properties of brain activity. Next, a novel deep fusion model of multi-template called spatio-temporal weighted multi-hypergraph convolutional network (STW-MHGCN) is proposed to fuse the STW-HCN of multiple templates, which extracts the deep interrelation information between different templates. Finally, we evaluate our method on the ADNI-2 and ABIDE-I datasets for mild cognitive impairment (MCI) and autism spectrum disorder (ASD) analysis. Experimental results demonstrate that the proposed method is superior to the state-of-the-art approaches in MCI and ASD classification, and the abnormal spatio-temporal hyper-edges discovered by our method have significant significance for the brain abnormalities analysis of MCI and ASD.

A radiomics-based brain network in T1 images: construction, attributes, and applications

T1 image is a widely collected imaging sequence in various neuroimaging datasets, but it is rarely used to construct an individual-level brain network. In this study, a novel individualized radiomics-based structural similarity network was proposed from T1 images. In detail, it used voxel-based morphometry to obtain the preprocessed gray matter images, and radiomic features were then extracted on each region of interest in Brainnetome atlas, and an individualized radiomics-based structural similarity network was finally built using the correlational values of radiomic features between any pair of regions of interest. After that, the network characteristics of individualized radiomics-based structural similarity network were assessed, including graph theory attributes, test-retest reliability, and individual identification ability (fingerprinting). At last, two representative applications for individualized radiomics-based structural similarity network, namely mild cognitive impairment subtype discrimination and fluid intelligence prediction, were exemplified and compared with some other networks on large open-source datasets. The results revealed that the individualized radiomics-based structural similarity network displays remarkable network characteristics and exhibits advantageous performances in mild cognitive impairment subtype discrimination and fluid intelligence prediction. In summary, the individualized radiomics-based structural similarity network provides a distinctive, reliable, and informative individualized structural brain network, which can be combined with other networks such as resting-state functional connectivity for various phenotypic and clinical applications.

Early Diagnosing and Transformation Prediction of Alzheimer's Disease Using Multi-Scaled Self-Attention Network on Structural MRI Images with Occlusion Sensitivity Analysis

BACKGROUND

Structural magnetic resonance imaging (sMRI) is vital for early Alzheimer's disease (AD) diagnosis, though confirming specific biomarkers remains challenging. Our proposed Multi-Scale Self-Attention Network (MUSAN) enhances classification of cognitively normal (CN) and AD individuals, distinguishing stable (sMCI) from progressive mild cognitive impairment (pMCI).

OBJECTIVE

This study leverages AD structural atrophy properties to achieve precise AD classification, combining different scales of brain region features. The ultimate goal is an interpretable algorithm for this method.

METHODS

The MUSAN takes whole-brain sMRI as input, enabling automatic extraction of brain region features and modeling of correlations between different scales of brain regions, and achieves personalized disease interpretation of brain regions. Furthermore, we also employed an occlusion sensitivity algorithm to localize and visualize brain regions sensitive to disease.

RESULTS

Our method is applied to ADNI-1, ADNI-2, and ADNI-3, and achieves high performance on the classification of CN from AD with accuracy (0.93), specificity (0.82), sensitivity (0.96), and area under curve (AUC) (0.95), as well as notable performance on the distinguish of sMCI from pMCI with accuracy (0.85), specificity (0.84), sensitivity (0.74), and AUC (0.86). Our sensitivity masking algorithm identified key regions in distinguishing CN from AD: hippocampus, amygdala, and vermis. Moreover, cingulum, pallidum, and inferior frontal gyrus are crucial for sMCI and pMCI discrimination. These discoveries align with existing literature, confirming the dependability of our model in AD research.

CONCLUSION

Our method provides an effective AD diagnostic and conversion prediction method. The occlusion sensitivity algorithm enhances deep learning interpretability, bolstering AD research reliability.

Deep Bayesian Quantization for Supervised Neuroimage Search

Neuroimage retrieval plays a crucial role in providing physicians with access to previous similar cases, which is essential for case-based reasoning and evidence-based medicine. Due to low computation and storage costs, hashing-based search techniques have been widely adopted for establishing image retrieval systems. However, these methods often suffer from nonnegligible quantization loss, which can degrade the overall search performance. To address this issue, this paper presents a compact coding solution namely Deep Bayesian Quantization (DBQ), which focuses on deep compact quantization that can estimate continuous neuroimage representations and achieve superior performance over existing hashing solutions. Specifically, DBQ seamlessly combines the deep representation learning and the representation compact quantization within a novel Bayesian learning framework, where a proxy embedding-based likelihood function is developed to alleviate the sampling issue for traditional similarity supervision. Additionally, a Gaussian prior is employed to reduce the quantization losses. By utilizing pre-computed lookup tables, the proposed DBQ can enable efficient and effective similarity search. Extensive experiments conducted on 2, 008 structural MRI scans from three benchmark neuroimage datasets demonstrate that our method outperforms previous state-of-the-arts.

Personalized Functional Connectivity Based Spatio-Temporal Aggregated Attention Network for MCI Identification

Functional connectivity (FC) networks deri- ved from resting-state magnetic resonance image (rs-fMRI) are effective biomarkers for identifying mild cognitive impairment (MCI) patients. However, most FC identification methods simply extract features from group-averaged brain templates, and neglect inter-subject functional variations. Furthermore, the existing methods generally concentrate on spatial correlation among brain regions, resulting in the inefficient capture of the fMRI temporal features. To address these limitations, we propose a novel personalized functional connectivity based dual-branch graph neural network with spatio-temporal aggregated attention (PFC-DBGNN-STAA) for MCI identification. Specifically, a personalized functional connectivity (PFC) template is firstly constructed to align 213 functional regions across samples and generate discriminative individualized FC features. Secondly, a dual-branch graph neural network (DBGNN) is conducted by aggregating features from the individual- and group-level templates with the cross-template FC, which is beneficial to improve the feature discrimination by considering dependency between templates. Finally, a spatio-temporal aggregated attention (STAA) module is investigated to capture the spatial and dynamic relationships between functional regions, which solves the limitation of insufficient temporal information utilization. We evaluate our proposed method on 442 samples from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database, and achieve the accuracies of 90.1%, 90.3%, 83.3% for normal control (NC) vs. early MCI (EMCI), EMCI vs. late MCI (LMCI), and NC vs. EMCI vs. LMCI classification tasks, respectively, indicating that our method boosts MCI identification performance and outperforms state-of-the-art methods.

Vision transformers for the prediction of mild cognitive impairment to Alzheimer's disease progression using mid-sagittal sMRI

Background

Alzheimer's disease (AD) is one of the most common causes of neurodegenerative disease affecting over 50 million people worldwide. However, most AD diagnosis occurs in the moderate to late stage, which means that the optimal time for treatment has already passed. Mild cognitive impairment (MCI) is an intermediate state between cognitively normal people and AD patients. Therefore, the accurate prediction in the conversion process of MCI to AD may allow patients to start preventive intervention to slow the progression of the disease. Nowadays, neuroimaging techniques have been developed and are used to determine AD-related structural biomarkers. Deep learning approaches have rapidly become a key methodology applied to these techniques to find biomarkers.

Methods

In this study, we aimed to investigate an MCI-to-AD prediction method using Vision Transformers (ViT) to structural magnetic resonance images (sMRI). The Alzheimer's Disease Neuroimaging Initiative (ADNI) database containing 598 MCI subjects was used to predict MCI subjects' progression to AD. There are three main objectives in our study: (i) to propose an MRI-based Vision Transformers approach for MCI to AD progression classification, (ii) to evaluate the performance of different ViT architectures to obtain the most advisable one, and (iii) to visualize the brain region mostly affect the prediction of deep learning approach to MCI progression.

Results

Our method achieved state-of-the-art classification performance in terms of accuracy (83.27%), specificity (85.07%), and sensitivity (81.48%) compared with a set of conventional methods. Next, we visualized the brain regions that mostly contribute to the prediction of MCI progression for interpretability of the proposed model. The discriminative pathological locations include the thalamus, medial frontal, and occipital-corroborating the reliability of our model.

Conclusion

In conclusion, our methods provide an effective and accurate technique for the prediction of MCI conversion to AD. The results obtained in this study outperform previous reports using the ADNI collection, and it suggests that sMRI-based ViT could be efficiently applied with a considerable potential benefit for AD patient management. The brain regions mostly contributing to prediction, in conjunction with the identified anatomical features, will support the building of a robust solution for other neurodegenerative diseases in future.

Diagnosis of Alzheimer's disease using hypergraph p-Laplacian regularized multi-task feature learning

Multimodal data-based classification methods have been widely used in the diagnosis of Alzheimer's disease (AD) and have achieved better performance than single-modal-based methods. However, most classification methods based on multimodal data tend to consider only the correlation between different modal data and ignore the inherent non-linear higher-order relationships between similar data, which can improve the robustness of the model. Therefore, this study proposes a hypergraph p-Laplacian regularized multi-task feature selection (HpMTFS) method for AD classification. Specifically, feature selection for each modal data is considered as a distinct task and the common features of multimodal data are extracted jointly by group-sparsity regularizer. In particular, two regularization terms are introduced in this study, namely (1) a hypergraph p-Laplacian regularization term to retain higher-order structural information for similar data, and (2) a Frobenius norm regularization term to improve the noise immunity of the model. Finally, using a multi-kernel support vector machine to fuse multimodal features and perform the final classification. We used baseline sMRI, FDG-PET, and AV-45 PET imaging data from 528 subjects in the Alzheimer's Disease Neuroimaging Initiative (ADNI) to evaluate our approach. Experimental results show that our HpMTFS method outperforms existing multimodal-based classification methods.

Conventional machine learning and deep learning in Alzheimer's disease diagnosis using neuroimaging: A review

Alzheimer's disease (AD) is a neurodegenerative disorder that causes memory degradation and cognitive function impairment in elderly people. The irreversible and devastating cognitive decline brings large burdens on patients and society. So far, there is no effective treatment that can cure AD, but the process of early-stage AD can slow down. Early and accurate detection is critical for treatment. In recent years, deep-learning-based approaches have achieved great success in Alzheimer's disease diagnosis. The main objective of this paper is to review some popular conventional machine learning methods used for the classification and prediction of AD using Magnetic Resonance Imaging (MRI). The methods reviewed in this paper include support vector machine (SVM), random forest (RF), convolutional neural network (CNN), autoencoder, deep learning, and transformer. This paper also reviews pervasively used feature extractors and different types of input forms of convolutional neural network. At last, this review discusses challenges such as class imbalance and data leakage. It also discusses the trade-offs and suggestions about pre-processing techniques, deep learning, conventional machine learning methods, new techniques, and input type selection.

Efficient optimization based thresholding technique for analysis of alzheimer MRIs

Purpose study: Alzheimer is a type of dementia that usually affects older adults by creating memory loss due to damaged brain cells. The damaged brain cells lead to shrinkage in the size of the brain and it is very difficult to extract the grey matter (GM) and white matter (WM). The segmentation of GM and WM is a challenging task due to its homogeneous nature between the neighborhood tissues. In this proposed system, an attempt has been made to extract GM and WM tissues using optimization-based segmentation techniques.Materials and methods: The optimization method is considered for the classification of normal and alzheimer disease (ad) through magnetic resonance images (mri) using a modified cuckoo search algorithm. Gray Level Co-Occurrence Matrix (GLCM) features are calculated from the extracted GM and WM. Principal Component Analysis (PCA) is adopted for selecting the best features from the GLCM features. Support Vector Machine (SVM) is a classifier which is used to classify the normal and abnormal images. Results: The proposed optimization algorithm provides most promising and efficient level of image segmentation compared to fuzzy c means (fcm), otsu, particle swarm optimization (pso) and cuckoo search (cs). The modified cuckoo yields high accuracy of 96%, sensitivity of 97% and specificity of 94% than other methods due to its powerful searching potential for the proper identification of gray and WM tissues.Conclusions: The results of the classification process proved the effectiveness of the proposed technique in identifying alzheimer affected patients due to its very strong optimization ability. The proposed pipeline helps to diagnose early detection of AD and better assessment of the neuroprotective effect of a therapy.

A review on Alzheimer's disease classification from normal controls and mild cognitive impairment using structural MR images

Alzheimer's disease (AD) is an irreversible neurodegenerative brain disorder that degrades the memory and cognitive ability in elderly people. The main reason for memory loss and reduction in cognitive ability is the structural changes in the brain that occur due to neuronal loss. These structural changes are most conspicuous in the hippocampus, cortex, and grey matter and can be assessed by using neuroimaging techniques viz. Positron Emission Tomography (PET), structural Magnetic Resonance Imaging (MRI) and functional MRI (fMRI), etc. Out of these neuroimaging techniques, structural MRI has evolved as the best technique as it indicates the best soft tissue contrast and high spatial resolution which is important for AD detection. Currently, the focus of researchers is on predicting the conversion of Mild Cognitive Impairment (MCI) into AD. MCI represents the transition state between expected cognitive changes with normal aging and Alzheimer's disease. Not every MCI patient progresses into Alzheimer's disease. MCI can develop into stable MCI (sMCI, patients are called non-converters) or into progressive MCI (pMCI, patients are diagnosed as MCI converters). This paper discusses the prognosis of MCI to AD conversion and presents a review of structural MRI-based studies for AD detection. AD detection framework includes feature extraction, feature selection, and classification process. This paper reviews the studies for AD detection based on different feature extraction methods and machine learning algorithms for classification. The performance of various feature extraction methods has been compared and it has been observed that the wavelet transform-based feature extraction method would give promising results for AD classification. The present study indicates that researchers are successful in classifying AD from Normal Controls (N_rmC) but, it still requires a lot of work to be done for MCI/ N_rmC and MCI/AD, which would help in detecting AD at its early stage.

A multimodal fusion method for Alzheimer's disease based on DCT convolutional sparse representation

Introduction

The medical information contained in magnetic resonance imaging (MRI) and positron emission tomography (PET) has driven the development of intelligent diagnosis of Alzheimer's disease (AD) and multimodal medical imaging. To solve the problems of severe energy loss, low contrast of fused images and spatial inconsistency in the traditional multimodal medical image fusion methods based on sparse representation. A multimodal fusion algorithm for Alzheimer' s disease based on the discrete cosine transform (DCT) convolutional sparse representation is proposed.

Methods

The algorithm first performs a multi-scale DCT decomposition of the source medical images and uses the sub-images of different scales as training images, respectively. Different sparse coefficients are obtained by optimally solving the sub-dictionaries at different scales using alternating directional multiplication method (ADMM). Secondly, the coefficients of high-frequency and low-frequency subimages are inverse DCTed using an improved L1 parametric rule combined with improved spatial frequency novel sum-modified SF (NMSF) to obtain the final fused images.

Results and discussion

Through extensive experimental results, we show that our proposed method has good performance in contrast enhancement, texture and contour information retention.

Ensemble of convolutional neural networks and multilayer perceptron for the diagnosis of mild cognitive impairment and Alzheimer's disease

BACKGROUND

Structural magnetic resonance imaging (sMRI) can provide morphological information about the structure and function of the brain in the same scanning process. It has been widely used in the diagnosis of Alzheimer's disease (AD) and mild cognitive impairment (MCI).

PURPOSE

To capture the anatomical changes in the brain caused by AD/MCI, deep learning-based MRI image analysis methods have been proposed in recent years. However, it is observed that the performance of most existing methods is limited as they only construct a single type of deep network and ignore the significance of other clinical information.

METHODS

To make up for these defects, an ensemble framework that incorporates three types of dedicatedly-designed convolutional neural networks (CNNs) and a multilayer perceptron (MLP) network is proposed, where three CNNs with entropy-based multi-instance learning pooling layers have more reliable feature selection abilities. The dedicatedly-designed base classifiers can make use of the heterogeneous data, and empower the framework with enhanced diversity and robustness. In particular, to consider the interactions among the base classifiers, a novel multi-head self-attention voting scheme is designed. Moreover, considering the chance that MCI can be transformed to AD, the proposed framework is designed to diagnose AD and predict MCI conversion simultaneously, with the aid of the transfer learning technique.

RESULTS

For performance evaluation and comparison, extensive experiments are conducted on the public dataset of the Alzheimer's Disease Neuroimaging Initiative (ADNI). The results show that the proposed ensemble framework provides superior performance under most of the evaluation metrics. Especially, the proposed framework achieves state-of-the-art diagnostic accuracy (98.61% for the AD diagnosis task, and 84.49% for the MCI conversion prediction task).

CONCLUSIONS

These promising results demonstrate the proposed ensemble framework can accurately diagnose AD patients and predict the conversion of MCI patients, which has the potential of clinical practice for diagnosing AD and MCI.

Alzheimer's disease diagnosis via multimodal feature fusion

Alzheimer's disease (AD) is the most common neurodegenerative disorder in the elderly. Early diagnosis of AD plays a vital role in slowing down the progress of AD because there is no effective drug to treat the disease. Some deep learning models have recently been presented for AD diagnosis and have more satisfactory performance than classic machine learning methods. Nevertheless, most of the existing computer-aided diagnostic models used neuroimaging features for diagnosis, ignoring patients' clinical and biological information. This makes the AD diagnosis inaccurate. In this study, we propose a novel multimodal feature transformation and fusion model for AD diagnosis. The feature transformation aims to avoid the difference in feature dimensions between different modal data and further mine the significant features for AD diagnosis. A geometric algebra-based feature extension method is proposed to obtain different levels of high-dimensional features from patients' clinical and personal biological data. Then, an influence degree-based feature filtration algorithm is proposed to filtrate those features that have no apparent guiding significance for AD diagnosis. Finally, an ANN (Artificial Neural Network)-based framework is designed to fuse transformed features with neuroimaging features extracted by CNN (Convolutional Neural Network) for AD diagnosis. The more in-depth feature mining of patients' clinical information and biological information can significantly improve the performance of computer-aided AD diagnosis. The experiments are obtained on the ADNI dataset. Our proposed model can converge faster and achieves 96.2% accuracy in AD diagnostic task and 87.4% accuracy in MCI (Mild Cognitive Impairment) diagnostic task. Compared with other methods, our proposed approach has an excellent performance in AD diagnosis and surpasses SOTA (state-of-the-art) methods. Therefore, our model can provide more reasonable suggestions for clinicians to diagnose and treat disease.

Alzheimer's disease: a scoping review of biomarker research and development for effective disease diagnosis

INTRODUCTION

Alzheimer's disease (AD) is regarded as the foremost reason for neurodegeneration that prominently affects the geriatric population. Characterized by extracellular accumulation of amyloid-beta (Aβ), intracellular aggregation of hyperphosphorylated tau (p-tau), and neuronal degeneration that causes impairment of memory and cognition. Amyloid/tau/neurodegeneration (ATN) classification is utilized for research purposes and involves amyloid, tau, and neuronal injury staging through MRI, PET scanning, and CSF protein concentration estimations. CSF sampling is invasive, and MRI and PET scanning requires sophisticated radiological facilities which limit its widespread diagnostic use. ATN classification lacks effectiveness in preclinical AD.

AREAS COVERED

This publication intends to collate and review the existing biomarker profile and the current research and development of a new arsenal of biomarkers for AD pathology from different biological samples, microRNA (miRNA), proteomics, metabolomics, artificial intelligence, and machine learning for AD screening, diagnosis, prognosis, and monitoring of AD treatments.

EXPERT OPINION

It is an accepted observation that AD-related pathological changes occur over a long period of time before the first symptoms are observed providing ample opportunity for detection of biological alterations in various biological samples that can aid in early diagnosis and modify treatment outcomes.

Multiview Feature Learning With Multiatlas-Based Functional Connectivity Networks for MCI Diagnosis

Functional connectivity (FC) networks built from resting-state functional magnetic resonance imaging (rs-fMRI) has shown promising results for the diagnosis of Alzheimer's disease and its prodromal stage, that is, mild cognitive impairment (MCI). FC is usually estimated as a temporal correlation of regional mean rs-fMRI signals between any pair of brain regions, and these regions are traditionally parcellated with a particular brain atlas. Most existing studies have adopted a predefined brain atlas for all subjects. However, the constructed FC networks inevitably ignore the potentially important subject-specific information, particularly, the subject-specific brain parcellation. Similar to the drawback of the "single view" (versus the "multiview" learning) in medical image-based classification, FC networks constructed based on a single atlas may not be sufficient to reveal the underlying complicated differences between normal controls and disease-affected patients due to the potential bias from that particular atlas. In this study, we propose a multiview feature learning method with multiatlas-based FC networks to improve MCI diagnosis. Specifically, a three-step transformation is implemented to generate multiple individually specified atlases from the standard automated anatomical labeling template, from which a set of atlas exemplars is selected. Multiple FC networks are constructed based on these preselected atlas exemplars, providing multiple views of the FC network-based feature representations for each subject. We then devise a multitask learning algorithm for joint feature selection from the constructed multiple FC networks. The selected features are jointly fed into a support vector machine classifier for multiatlas-based MCI diagnosis. Extensive experimental comparisons are carried out between the proposed method and other competing approaches, including the traditional single-atlas-based method. The results indicate that our method significantly improves the MCI classification, demonstrating its promise in the brain connectome-based individualized diagnosis of brain diseases.

Multi-task multi-level feature adversarial network for joint Alzheimer’s disease diagnosis and atrophy localization using sMRI

Capitalizing on structural magnetic resonance imaging (sMRI), existing deep learning methods (especially convolutional neural networks, CNNs) have been widely and successfully applied to computer-aided diagnosis of Alzheimer’s disease (AD) and its prodromal stage (i.e. mild cognitive impairment, MCI). But considering the generalization capability of the obtained model trained on limited number of samples, we construct a multi-task multi-level feature adversarial network (M2FAN) for joint diagnosis and atrophy localization using baseline sMRI. Specifically, the linear-aligned T1 MR images were first processed by a lightweight CNN backbone to capture the shared intermediate feature representations, which were then branched into a global subnet for preliminary dementia diagnosis and a multi instance learning network for brain atrophy localization in multi-task learning manner. As the global discriminative information captured by the global subnet might be unstable for disease diagnosis, we further designed a module of multi-level feature adversarial learning that accounts for regularization to make global features robust against the adversarial perturbation synthesized by the local/instance features to improve the diagnostic performance. Our proposed method was evaluated on three public datasets (i.e. ADNI-1, ADNI-2, and AIBL), demonstrating competitive performance compared with several state-of-the-art methods in both tasks of AD diagnosis and MCI conversion prediction.

Enhanced Fuzzy Elephant Herding Optimization-Based OTSU Segmentation and Deep Learning for Alzheimer’s Disease Diagnosis

Several neurological illnesses and diseased sites have been studied, along with the anatomical framework of the brain, using structural MRI (sMRI). It is critical to diagnose Alzheimer’s disease (AD) patients in a timely manner to implement preventative treatments. The segmentation of brain anatomy and categorization of AD have received increased attention since they can deliver good findings spanning a vast range of information. The first research gap considered in this work is the real-time efficiency of OTSU segmentation, which is not high, despite its simplicity and good accuracy. A second issue is that feature extraction could be automated by implementing deep learning techniques. To improve picture segmentation’s real-timeliness, enhanced fuzzy elephant herding optimization (EFEHO) was used for OTSU segmentation, and named EFEHO-OTSU. The main contribution of this work is twofold. One is utilizing EFEHO in the recommended technique to seek the optimal segmentation threshold for the OTSU method. Second, dual attention multi-instance deep learning network (DA-MIDL) is recommended for the timely diagnosis of AD and its prodromal phase, mild cognitive impairment (MCI). Tests show that this technique converges faster and takes less time than the classic OTSU approach without reducing segmentation performance. This study develops a valuable tool for quick picture segmentation with good real-time efficiency. Compared to numerous conventional techniques, the suggested study attains improved categorization performance regarding accuracy and transferability.

Attention-Guided Hybrid Network for Dementia Diagnosis With Structural MR Images

Deep-learning methods (especially convolutional neural networks) using structural magnetic resonance imaging (sMRI) data have been successfully applied to computer-aided diagnosis (CAD) of Alzheimer's disease (AD) and its prodromal stage [i.e., mild cognitive impairment (MCI)]. As it is practically challenging to capture local and subtle disease-associated abnormalities directly from the whole-brain sMRI, most of those deep-learning approaches empirically preselect disease-associated sMRI brain regions for model construction. Considering that such isolated selection of potentially informative brain locations might be suboptimal, very few methods have been proposed to perform disease-associated discriminative region localization and disease diagnosis in a unified deep-learning framework. However, those methods based on task-oriented discriminative localization still suffer from two common limitations, that is: 1) identified brain locations are strictly consistent across all subjects, which ignores the unique anatomical characteristics of each brain and 2) only limited local regions/patches are used for model training, which does not fully utilize the global structural information provided by the whole-brain sMRI. In this article, we propose an attention-guided deep-learning framework to extract multilevel discriminative sMRI features for dementia diagnosis. Specifically, we first design a backbone fully convolutional network to automatically localize the discriminative brain regions in a weakly supervised manner. Using the identified disease-related regions as spatial attention guidance, we further develop a hybrid network to jointly learn and fuse multilevel sMRI features for CAD model construction. Our proposed method was evaluated on three public datasets (i.e., ADNI-1, ADNI-2, and AIBL), showing superior performance compared with several state-of-the-art methods in both tasks of AD diagnosis and MCI conversion prediction.

Analysis of Hippocampus Evolution Patterns and Prediction of Conversion in Mild Cognitive Impairment Using Multivariate Morphometry Statistics

Background: Mild cognitive impairment (MCI), which is generally regarded as the prodromal stage of Alzheimer’s disease (AD), is associated with morphological changes in brain structures, particularly the hippocampus. However, the indicators for characterizing the deformation of hippocampus in conventional methods are not precise enough and ignore the evolution information with the course of disease. Objective: The purpose of this study was to investigate the temporal evolution pattern of MCI and predict the conversion of MCI to AD by using the multivariate morphometry statistics (MMS) as fine features. Methods: First, we extracted MMS features from MRI scans of 64 MCI converters (MCIc), 81 MCI patients who remained stable (MCIs), and 90 healthy controls (HC). To make full use of the time information, the dynamic MMS (DMMS) features were defined. Then, the areas with significant differences between pairs of the three groups were analyzed using statistical methods and the atrophy/expansion were identified by comparing the metrics. In parallel, patch selection, sparse coding, dictionary learning and maximum pooling were used for the dimensionality reduction and the ensemble classifier GentleBoost was used to classify MCIc and MCIs. Results: The longitudinal analysis revealed that the atrophy of both MCIc and MCIs mainly distributed in dorsal CA1, then spread to subiculum and other regions gradually, while the atrophy area of MCIc was larger and more significant. And the introduction of longitudinal information promoted the accuracy to 91.76% for conversion prediction. Conclusion: The dynamic information of hippocampus holds a huge potential for understanding the pathology of MCI.

MRI-based Alzheimer's disease prediction via distilling the knowledge in multi-modal data

Mild cognitive impairment (MCI) conversion prediction, i.e., identifying MCI patients of high risks converting to Alzheimer's disease (AD), is essential for preventing or slowing the progression of AD. Although previous studies have shown that the fusion of multi-modal data can effectively improve the prediction accuracy, their applications are largely restricted by the limited availability or high cost of multi-modal data. Building an effective prediction model using only magnetic resonance imaging (MRI) remains a challenging research topic. In this work, we propose a multi-modal multi-instance distillation scheme, which aims to distill the knowledge learned from multi-modal data to an MRI-based network for MCI conversion prediction. In contrast to existing distillation algorithms, the proposed multi-instance probabilities demonstrate a superior capability of representing the complicated atrophy distributions, and can guide the MRI-based network to better explore the input MRI. To our best knowledge, this is the first study that attempts to improve an MRI-based prediction model by leveraging extra supervision distilled from multi-modal information. Experiments demonstrate the advantage of our framework, suggesting its potentials in the data-limited clinical settings.

Multi-Method Analysis of Medical Records and MRI Images for Early Diagnosis of Dementia and Alzheimer’s Disease Based on Deep Learning and Hybrid Methods

Dementia and Alzheimer’s disease are caused by neurodegeneration and poor communication between neurons in the brain. So far, no effective medications have been discovered for dementia and Alzheimer’s disease. Thus, early diagnosis is necessary to avoid the development of these diseases. In this study, efficient machine learning algorithms were assessed to evaluate the Open Access Series of Imaging Studies (OASIS) dataset for dementia diagnosis. Two CNN models (AlexNet and ResNet-50) and hybrid techniques between deep learning and machine learning (AlexNet+SVM and ResNet-50+SVM) were also evaluated for the diagnosis of Alzheimer’s disease. For the OASIS dataset, we balanced the dataset, replaced the missing values, and applied the t-Distributed Stochastic Neighbour Embedding algorithm (t-SNE) to represent the high-dimensional data in the low-dimensional space. All of the machine learning algorithms, namely, Support Vector Machine (SVM), Decision Tree, Random Forest and K Nearest Neighbours (KNN), achieved high performance for diagnosing dementia. The random forest algorithm achieved an overall accuracy of 94% and precision, recall and F1 scores of 93%, 98% and 96%, respectively. The second dataset, the MRI image dataset, was evaluated by AlexNet and ResNet-50 models and AlexNet+SVM and ResNet-50+SVM hybrid techniques. All models achieved high performance, but the performance of the hybrid methods between deep learning and machine learning was better than that of the deep learning models. The AlexNet+SVM hybrid model achieved accuracy, sensitivity, specificity and AUC scores of 94.8%, 93%, 97.75% and 99.70%, respectively.

A parallel attention-augmented bilinear network for early magnetic resonance imaging-based diagnosis of Alzheimer's disease

Structural magnetic resonance imaging (sMRI) can capture the spatial patterns of brain atrophy in Alzheimer's disease (AD) and incipient dementia. Recently, many sMRI‐based deep learning methods have been developed for AD diagnosis. Some of these methods utilize neural networks to extract high‐level representations on the basis of handcrafted features, while others attempt to learn useful features from brain regions proposed by a separate module. However, these methods require considerable manual engineering. Their stepwise training procedures would introduce cascading errors. Here, we propose the parallel attention‐augmented bilinear network, a novel deep learning framework for AD diagnosis. Based on a 3D convolutional neural network, the framework directly learns both global and local features from sMRI scans without any prior knowledge. The framework is lightweight and suitable for end‐to‐end training. We evaluate the framework on two public datasets (ADNI‐1 and ADNI‐2) containing 1,340 subjects. On both the AD classification and mild cognitive impairment conversion prediction tasks, our framework achieves competitive results. Furthermore, we generate heat maps that highlight discriminative areas for visual interpretation. Experiments demonstrate the effectiveness of the proposed framework when medical priors are unavailable or the computing resources are limited. The proposed framework is general for 3D medical image analysis with both efficiency and interpretability.

Diagnosis of obsessive-compulsive disorder via spatial similarity-aware learning and fused deep polynomial network

Obsessive-compulsive disorder (OCD) is a type of hereditary mental illness, which seriously affect the normal life of the patients. Sparse learning has been widely used in detecting brain diseases objectively by removing redundant information and retaining monitor valuable biological characteristics from the brain functional connectivity network (BFCN). However, most existing methods ignore the relationship between brain regions in each subject. To solve this problem, this paper proposes a spatial similarity-aware learning (SSL) model to build BFCNs. Specifically, we embrace the spatial relationship between adjacent or bilaterally symmetric brain regions via a smoothing regularization term in the model. We develop a novel fused deep polynomial network (FDPN) model to further learn the powerful information and attempt to solve the problem of curse of dimensionality using BFCN features. In the FDPN model, we stack a multi-layer deep polynomial network (DPN) and integrate the features from multiple output layers via the weighting mechanism. In this way, the FDPN method not only can identify the high-level informative features of BFCN but also can solve the problem of curse of dimensionality. A novel framework is proposed to detect OCD and unaffected first-degree relatives (UFDRs), which combines deep learning and traditional machine learning methods. We validate our algorithm in the resting-state functional magnetic resonance imaging (rs-fMRI) dataset collected by the local hospital and achieve promising performance.

Machine learning methods for predicting progression from mild cognitive impairment to Alzheimer's disease dementia: a systematic review

BACKGROUND

An increase in lifespan in our society is a double-edged sword that entails a growing number of patients with neurocognitive disorders, Alzheimer's disease being the most prevalent. Advances in medical imaging and computational power enable new methods for the early detection of neurocognitive disorders with the goal of preventing or reducing cognitive decline. Computer-aided image analysis and early detection of changes in cognition is a promising approach for patients with mild cognitive impairment, sometimes a prodromal stage of Alzheimer's disease dementia.

METHODS

We conducted a systematic review following PRISMA guidelines of studies where machine learning was applied to neuroimaging data in order to predict whether patients with mild cognitive impairment might develop Alzheimer's disease dementia or remain stable. After removing duplicates, we screened 452 studies and selected 116 for qualitative analysis.

RESULTS

Most studies used magnetic resonance image (MRI) and positron emission tomography (PET) data but also magnetoencephalography. The datasets were mainly extracted from the Alzheimer's disease neuroimaging initiative (ADNI) database with some exceptions. Regarding the algorithms used, the most common was support vector machine with a mean accuracy of 75.4%, but convolutional neural networks achieved a higher mean accuracy of 78.5%. Studies combining MRI and PET achieved overall better classification accuracy than studies that only used one neuroimaging technique. In general, the more complex models such as those based on deep learning, combined with multimodal and multidimensional data (neuroimaging, clinical, cognitive, genetic, and behavioral) achieved the best performance.

CONCLUSIONS

Although the performance of the different methods still has room for improvement, the results are promising and this methodology has a great potential as a support tool for clinicians and healthcare professionals.

Multi-auxiliary domain transfer learning for diagnosis of MCI conversion

In the early stage of Alzheimer's disease (AD), mild cognitive impairment (MCI) has a higher risk of progression to AD, so the prediction of whether an MCI subject will progress to AD (known as progressive MCI, PMCI) or not (known as stable MCI, SMCI) within a certain period is particularly important in practice. It is known that such a task could benefit from jointly learning-related auxiliary tasks such as differentiating AD from PMCI or PMCI from normal control (NC) in order to take full advantage of their shared commonality. However, few existing methods along this line fully consider the correlations between the target and auxiliary tasks according to the clinical practice of AD pathology for diagnosis. To deal with this problem, in this paper, treating each task domain as a different one, we borrow the idea from transfer learning and propose a novel multi-auxiliary domain transfer learning (MaDTL) method, which explicitly utilizes the correlations between the target domain (task) and multi-auxiliary domains (tasks) according to the clinical practice. Specifically, the proposed MaDTL method incorporates two key modules. The first one is a multi-auxiliary domain transfer-based feature selection (MaDTFS) model, which can select a discriminative feature subset shared by the target domain and the multi-auxiliary domains. In the MaDTFS model, to combine more training data from multi-auxiliary domains and simultaneously suppress the negative effects resulting from the irrelevant parts of multi-auxiliary domains, we proposed a sparse group correlation Lasso that includes a proposed group correlation Lasso penalty (i.e., [Formula: see text]) and a proposed correlation Lasso penalty (i.e., [Formula: see text]). The second module in MaDTL is a multi-auxiliary domain transfer-based classification (MaDTC) model that improves the voting with linear weighting-based ensemble learning. This model extends the constraints of the linear weighting method so that it can simultaneously combine training data from multi-auxiliary domains and achieve a robust classifier by minimizing negative effects from the irrelevant part of multi-auxiliary domains. Experimental results on 409 subjects from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database with the baseline magnetic resonance imaging (MRI) and cerebrospinal fluid (CSF) data validate the effectiveness of the proposed method by significantly improving the classification accuracy to 80.37% for the identification of MCI-to-AD conversion, outperforming the state-of-the-art methods.

Dual Attention Multi-Instance Deep Learning for Alzheimer's Disease Diagnosis With Structural MRI

Structural magnetic resonance imaging (sMRI) is widely used for the brain neurological disease diagnosis, which could reflect the variations of brain. However, due to the local brain atrophy, only a few regions in sMRI scans have obvious structural changes, which are highly correlative with pathological features. Hence, the key challenge of sMRI-based brain disease diagnosis is to enhance the identification of discriminative features. To address this issue, we propose a dual attention multi-instance deep learning network (DA-MIDL) for the early diagnosis of Alzheimer's disease (AD) and its prodromal stage mild cognitive impairment (MCI). Specifically, DA-MIDL consists of three primary components: 1) the Patch-Nets with spatial attention blocks for extracting discriminative features within each sMRI patch whilst enhancing the features of abnormally changed micro-structures in the cerebrum, 2) an attention multi-instance learning (MIL) pooling operation for balancing the relative contribution of each patch and yield a global different weighted representation for the whole brain structure, and 3) an attention-aware global classifier for further learning the integral features and making the AD-related classification decisions. Our proposed DA-MIDL model is evaluated on the baseline sMRI scans of 1689 subjects from two independent datasets (i.e., ADNI and AIBL). The experimental results show that our DA-MIDL model can identify discriminative pathological locations and achieve better classification performance in terms of accuracy and generalizability, compared with several state-of-the-art methods.

Feature level-based group lasso method for amnestic mild cognitive impairment diagnosis

BACKGROUND AND OBJECTIVE

Previous studies have indicated that brain morphological measures change in patients with amnestic mild cognitive impairment (aMCI). However, most existing classification methods cannot take full advantage of these measures. In this study, we improve traditional multitask learning framework by fully considering the relevance among related tasks and supplementary information from other unrelated tasks at the same time.

METHODS

We propose a feature level-based group lasso (FL-GL) method in which a feature represents the average value of each ROI for each measure. First, we design a correlation matrix in which each row represents the relationship among different measures for each ROI. And this matrix is used to guide the feature selection based on a group lasso framework. Then, we train specific support vector machine (SVM) classifiers with the selected features for each measure. Finally, a weighted voting strategy is applied to combine these classifiers for a final prediction of aMCI from normal control (NC).

RESULTS

We use the leave-one-out cross-validation strategy to verify our method on two datasets, the Xuan Wu Hospital dataset and the ADNI dataset. Compared with the traditional method, the results show that the classification accuracies can be improved by 6.12 and 4.92% with the FL-GL method on the two datasets.

CONCLUSIONS

The results of an ablation study indicated that feature level-based group sparsity term was the core of our method. So, considering correlation at the feature level could improve the traditional multitask learning framework and our FL-GL method obtained better classification performance of patients with MCI and NCs.

Learning Brain Functional Networks with Latent Temporal Dependency for MCI Identification

AbstractResting-state functional magnetic resonance imaging (rs-fMRI) has become a popular non-invasive way of diagnosing neurological disorders or their early stages by probing functional connectivity between different brain regions of interest (ROIs) across subjects. In the past decades, researchers have proposed many methods to estimate brain functional networks (BFNs) based on blood-oxygen-level-dependent (BOLD) signals captured by rs-fMRI. However, most of the existing methods estimate BFNs under the assumption that signals are independently sampled, which ignores the temporal dependency and sequential order of different time points (or volumes). To address this problem, in this paper, we first propose a novel BFN estimation model by introducing a latent variable to control the sequence of volumes for encoding the temporal dependency and sequential information of signals into the estimated BFNs. Then, we develop an efficient learning algorithm to solve the proposed model by the alternating optimization scheme. To verify the effectiveness of the proposed method, the estimated BFNs are used to identify subjects with mild cognitive impairment (MCIs) from normal controls (NCs). Experimental results show that our method outperforms the baseline methods in the sense of classification performance.

Alzheimer's disease diagnosis framework from incomplete multimodal data using convolutional neural networks

Alzheimer's disease (AD) is a severe irreversible neurodegenerative disease that has great sufferings on patients and eventually leads to death. Early detection of AD and its prodromal stage, mild cognitive impairment (MCI) which can be either stable (sMCI) or progressive (pMCI), is highly desirable for effective treatment planning and tailoring therapy. Recent studies recommended using multimodal data fusion of genetic (single nucleotide polymorphisms, SNPs) and neuroimaging data (magnetic resonance imaging (MRI) and positron emission tomography (PET)) to discriminate AD/MCI from normal control (NC) subjects. However, missing multimodal data in the cohort under study is inevitable. In addition, data heterogeneity between phenotypes and genotypes biomarkers makes learning capability of the models more challenging. Also, the current studies mainly focus on identifying brain disease classification and ignoring the regression task. Furthermore, they utilize multistage for predicting the brain disease progression. To address these issues, we propose a novel multimodal neuroimaging and genetic data fusion for joint classification and clinical score regression tasks using the maximum number of available samples in one unified framework using convolutional neural network (CNN). Specifically, we initially perform a technique based on linear interpolation to fill the missing features for each incomplete sample. Then, we learn the neuroimaging features from MRI, PET, and SNPs using CNN to alleviate the heterogeneity among genotype and phenotype data. Meanwhile, the high learned features from each modality are combined for jointly identifying brain diseases and predicting clinical scores. To validate the performance of the proposed method, we test our method on 805 subjects from Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset. Also, we verify the similarity between the synthetic and real data using statistical analysis. Moreover, the experimental results demonstrate that the proposed method can yield better performance in both classification and regression tasks. Specifically, our proposed method achieves accuracy of 98.22%, 93.11%, and 97.35% for NC vs. AD, NC vs. sMCI, and NC vs. pMCI, respectively. On the other hand, our method attains the lowest root mean square error and the highest correlation coefficient for different clinical scores regression tasks compared with the state-of-the-art methods.

Supervised Multidimensional Scaling and its Application in MRI-Based Individual Age Predictions

It has been a popular trend to decode individuals' demographic and cognitive variables based on MRI. Features extracted from MRI data are usually of high dimensionality, and dimensionality reduction (DR) is an effective way to deal with these high-dimensional features. Despite many supervised DR techniques for classification purposes, there is still a lack of supervised DR techniques for regression purposes. In this study, we advanced a novel supervised DR technique for regression purposes, namely, supervised multidimensional scaling (SMDS). The implementation of SMDS includes two steps: (1) evaluating pairwise distances among entities based on their labels and constructing a new space through a distance-preserving projection; (2) establishing an explicit linear relationship between the feature space and the new space. Based on this linear relationship, DR for test entities can be performed. We evaluated the performance of SMDS first on a synthetic dataset, and the results indicate that (1) SMDS is relatively robust to Gaussian noise existing in the features and labels; (2) the dimensionality of the new space exerts negligible influences upon SMDS; and (3) when the sample size is small, the performance of SMDS deteriorates with the increase of feature dimension. When applied to features extracted from resting state fMRI data for individual age predictions, SMDS was observed to outperform classic DR techniques, including principal component analysis, locally linear embedding and multidimensional scaling (MDS). Hopefully, SMDS can be widely used in studies on MRI-based predictions. Furthermore, novel supervised DR techniques for regression purposes can easily be developed by replacing MDS with other nonlinear DR techniques.

Hyper-graph based sparse canonical correlation analysis for the diagnosis of Alzheimer's disease from multi-dimensional genomic data

The effective and accurate diagnosis of Alzheimer's disease (AD), especially in the early stage (i.e., mild cognitive impairment (MCI)) remains a big challenge in AD research. So far, multiple biomarkers have been associated with AD diagnosis and progression. However, most of the existing research only utilized single modality data for diagnostic biomarker identification, which did not take the advantages of multi-modal data that provide comprehensive and complementary information at multiple levels into consideration. In this paper, we integrate multi-modal genomic data from postmortem AD brains (i.e., mRNA, miRNA and epigenomic data) and propose a hyper-graph based sparse canonical correlation analysis (HGSCCA) method to extract the most correlated multi-modal biomarkers associated with AD and MCI. Specifically, our model utilizes the sparse canonical correlation analysis framework (SCCA), which aims at finding the best linear projections for each input modality so that the strongest correlation within the selected features of multi-dimensional genomic data can be captured. In addition, with the consideration of high-order relationships among different subjects, we also introduce a hyper-graph-based regularization term that will lead to the selection of more discriminative biomarkers. To evaluate the effectiveness of the proposed method, we conduct the experiments on the well-known AD cohort study, The Religious Orders Study and Memory and Aging Project (ROSMAP) dataset, and the results show that our method can not only identify meaningful biomarkers for the diagnosis AD disease, but also achieve superior classification performance than the comparing methods.

Artificial intelligence in neurodegenerative diseases: A review of available tools with a focus on machine learning techniques

Neurodegenerative diseases have shown an increasing incidence in the older population in recent years. A significant amount of research has been conducted to characterize these diseases. Computational methods, and particularly machine learning techniques, are now very useful tools in helping and improving the diagnosis as well as the disease monitoring process. In this paper, we provide an in-depth review on existing computational approaches used in the whole neurodegenerative spectrum, namely for Alzheimer's, Parkinson's, and Huntington's Diseases, Amyotrophic Lateral Sclerosis, and Multiple System Atrophy. We propose a taxonomy of the specific clinical features, and of the existing computational methods. We provide a detailed analysis of the various modalities and decision systems employed for each disease. We identify and present the sleep disorders which are present in various diseases and which represent an important asset for onset detection. We overview the existing data set resources and evaluation metrics. Finally, we identify current remaining open challenges and discuss future perspectives.

Light-weight cross-view hierarchical fusion network for joint localization and identification in Alzheimer's disease with adaptive instance-declined pruning

Magnetic resonance imaging (MRI) has been widely used in assessing development of Alzheimer's disease (AD) by providing structural information of disease-associated regions (e.g. atrophic regions). In this paper, we propose a light-weight cross-view hierarchical fusion network (CvHF-net), consisting of local patch and global subject subnets, for joint localization and identification of the discriminative local patches and regions in the whole brain MRI, upon which feature representations are then jointly learned and fused to construct hierarchical classification models for AD diagnosis. Firstly, based on the extracted class-discriminative 3D patches, we employ the local patch subnets to utilize multiple 2D views to represent 3D patches by using an attention-aware hierarchical fusion structure in a divide-and-conquer manner. Since different local patches are with various abilities in AD identification, the global subject subnet is developed to bias the allocation of available resources towards the most informative parts among these local patches to obtain global information for AD identification. Besides, an instance declined pruning algorithm is embedded in the CvHF-net for adaptively selecting most discriminant patches in a task-driven manner. The proposed method was evaluated on the AD Neuroimaging Initiative dataset and the experimental results show that our proposed method can achieve good performance on AD diagnosis.

Modeling dynamic characteristics of brain functional connectivity networks using resting-state functional MRI

Dynamic network analysis using resting-state functional magnetic resonance imaging (rs-fMRI) provides a great insight into fundamentally dynamic characteristics of human brains, thus providing an efficient solution to automated brain disease identification. Previous studies usually pay less attention to evolution of global network structures over time in each brain's rs-fMRI time series, and also treat network-based feature extraction and classifier training as two separate tasks. To address these issues, we propose a temporal dynamics learning (TDL) method for network-based brain disease identification using rs-fMRI time-series data, through which network feature extraction and classifier training are integrated into the unified framework. Specifically, we first partition rs-fMRI time series into a sequence of segments using overlapping sliding windows, and then construct longitudinally ordered functional connectivity networks. To model the global temporal evolution patterns of these successive networks, we introduce a group-fused Lasso regularizer in our TDL framework, while the specific network architecture is induced by an ℓ₁-norm regularizer. Besides, we develop an efficient optimization algorithm to solve the proposed objective function via the Alternating Direction Method of Multipliers (ADMM). Compared with previous studies, the proposed TDL model can not only explicitly model the evolving connectivity patterns of global networks over time, but also capture unique characteristics of each network defined at each segment. We evaluate our TDL on three real autism spectrum disorder (ASD) datasets with rs-fMRI data, achieving superior results in ASD identification compared with several state-of-the-art methods.

A Mutual Multi-Scale Triplet Graph Convolutional Network for Classification of Brain Disorders Using Functional or Structural Connectivity

Brain connectivity alterations associated with mental disorders have been widely reported in both functional MRI (fMRI) and diffusion MRI (dMRI). However, extracting useful information from the vast amount of information afforded by brain networks remains a great challenge. Capturing network topology, graph convolutional networks (GCNs) have demonstrated to be superior in learning network representations tailored for identifying specific brain disorders. Existing graph construction techniques generally rely on a specific brain parcellation to define regions-of-interest (ROIs) to construct networks, often limiting the analysis into a single spatial scale. In addition, most methods focus on the pairwise relationships between the ROIs and ignore high-order associations between subjects. In this letter, we propose a mutual multi-scale triplet graph convolutional network (MMTGCN) to analyze functional and structural connectivity for brain disorder diagnosis. We first employ several templates with different scales of ROI parcellation to construct coarse-to-fine brain connectivity networks for each subject. Then, a triplet GCN (TGCN) module is developed to learn functional/structural representations of brain connectivity networks at each scale, with the triplet relationship among subjects explicitly incorporated into the learning process. Finally, we propose a template mutual learning strategy to train different scale TGCNs collaboratively for disease classification. Experimental results on 1,160 subjects from three datasets with fMRI or dMRI data demonstrate that our MMTGCN outperforms several state-of-the-art methods in identifying three types of brain disorders.

High-Order Laplacian Regularized Low-Rank Representation for Multimodal Dementia Diagnosis

Multimodal heterogeneous data, such as structural magnetic resonance imaging (MRI), positron emission tomography (PET), and cerebrospinal fluid (CSF), are effective in improving the performance of automated dementia diagnosis by providing complementary information on degenerated brain disorders, such as Alzheimer's prodromal stage, i.e., mild cognitive impairment. Effectively integrating multimodal data has remained a challenging problem, especially when these heterogeneous data are incomplete due to poor data quality and patient dropout. Besides, multimodal data usually contain noise information caused by different scanners or imaging protocols. The existing methods usually fail to well handle these heterogeneous and noisy multimodal data for automated brain dementia diagnosis. To this end, we propose a high-order Laplacian regularized low-rank representation method for dementia diagnosis using block-wise missing multimodal data. The proposed method was evaluated on 805 subjects (with incomplete MRI, PET, and CSF data) from the real Alzheimer's Disease Neuroimaging Initiative (ADNI) cohort. Experimental results suggest the effectiveness of our method in three tasks of brain disease classification, compared with the state-of-the-art methods.

Deep Bayesian Hashing With Center Prior for Multi-Modal Neuroimage Retrieval

Multi-modal neuroimage retrieval has greatly facilitated the efficiency and accuracy of decision making in clinical practice by providing physicians with previous cases (with visually similar neuroimages) and corresponding treatment records. However, existing methods for image retrieval usually fail when applied directly to multi-modal neuroimage databases, since neuroimages generally have smaller inter-class variation and larger inter-modal discrepancy compared to natural images. To this end, we propose a deep Bayesian hash learning framework, called CenterHash, which can map multi-modal data into a shared Hamming space and learn discriminative hash codes from imbalanced multi-modal neuroimages. The key idea to tackle the small inter-class variation and large inter-modal discrepancy is to learn a common center representation for similar neuroimages from different modalities and encourage hash codes to be explicitly close to their corresponding center representations. Specifically, we measure the similarity between hash codes and their corresponding center representations and treat it as a center prior in the proposed Bayesian learning framework. A weighted contrastive likelihood loss function is also developed to facilitate hash learning from imbalanced neuroimage pairs. Comprehensive empirical evidence shows that our method can generate effective hash codes and yield state-of-the-art performance in cross-modal retrieval on three multi-modal neuroimage datasets.

PET Imaging of Tau Pathology and Amyloid-β, and MRI for Alzheimer's Disease Feature Fusion and Multimodal Classification

BACKGROUND

Machine learning is a promising tool for biomarker-based diagnosis of Alzheimer's disease (AD). Performing multimodal feature selection and studying the interaction between biological and clinical AD can help to improve the performance of the diagnosis models.

OBJECTIVE

This study aims to formulate a feature ranking metric based on the mutual information index to assess the relevance and redundancy of regional biomarkers and improve the AD classification accuracy.

METHODS

From the Alzheimer's Disease Neuroimaging Initiative (ADNI), 722 participants with three modalities, including florbetapir-PET, flortaucipir-PET, and MRI, were studied. The multivariate mutual information metric was utilized to capture the redundancy and complementarity of the predictors and develop a feature ranking approach. This was followed by evaluating the capability of single-modal and multimodal biomarkers in predicting the cognitive stage.

RESULTS

Although amyloid-β deposition is an earlier event in the disease trajectory, tau PET with feature selection yielded a higher early-stage classification F1-score (65.4%) compared to amyloid-β PET (63.3%) and MRI (63.2%). The SVC multimodal scenario with feature selection improved the F1-score to 70.0% and 71.8% for the early and late-stage, respectively. When age and risk factors were included, the scores improved by 2 to 4%. The Amyloid-Tau-Neurodegeneration [AT(N)] framework helped to interpret the classification results for different biomarker categories.

CONCLUSION

The results underscore the utility of a novel feature selection approach to reduce the dimensionality of multimodal datasets and enhance model performance. The AT(N) biomarker framework can help to explore the misclassified cases by revealing the relationship between neuropathological biomarkers and cognition.

Multi-Regression based supervised sample selection for predicting baby connectome evolution trajectory from neonatal timepoint

The connectional map of the baby brain undergoes dramatic changes over the first year of postnatal development, which makes its mapping a challenging task, let alone learning how to predict its evolution. Currently, learning models for predicting brain connectomic developmental trajectories remain broadly absent despite their great potential in spotting atypical neurodevelopmental disorders early. This is most likely due to the scarcity and often incompleteness of longitudinal infant neuroimaging studies for training such models. In this paper, we propose the first approach for progressively predicting longitudinal development of brain networks during the postnatal period solely from a baseline connectome around birth. To this end, a supervised multi-regression sample selection strategy is designed to learn how to identify the best set of neighbors of a testing baseline connectome to eventually predict its evolution trajectory at follow-up timepoints. However, given that the training dataset may have missing samples (connectomes) at certain timepoints, this may affect the training of the predictive model. To overcome this problem, we perform a low-rank tensor completion based on a robust principal component analysis to impute the missing training connectomes by linearly approximating similar complete training networks. In the prediction step, our sample selection strategy aims to preserve spatiotemporal relationships between consecutive timepoints. Therefore, the proposed method learns how to identify the set of the local closest neighbors to a target network by training an ensemble of bidirectional regressors leveraging temporal dependency between consecutive timepoints with a recall to the baseline observations to progressively predict the evolution of a testing network over time. Our method achieves the best prediction results and better captures the dynamic changes of each brain connectome over time in comparison to its ablated versions using leave-one-out cross-validation strategy.