1
|
Jomeiri A, Navin AH, Shamsi M. Longitudinal MRI analysis using a hybrid DenseNet-BiLSTM method for Alzheimer's disease prediction. Behav Brain Res 2024; 463:114900. [PMID: 38341100 DOI: 10.1016/j.bbr.2024.114900] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2023] [Revised: 12/16/2023] [Accepted: 02/06/2024] [Indexed: 02/12/2024]
Abstract
Alzheimer's disease is a progressive neurological disorder characterized by brain atrophy and cell death, leading to cognitive decline and impaired functioning. Previous research has primarily focused on using cross-sectional data for Alzheimer's disease identification, but analyzing longitudinal sequential MR images is crucial for improved diagnostic accuracy and understanding disease progression. However, existing deep learning models face challenges in learning spatial and temporal features from such data. To address these challenges, this study presents a novel hybrid DenseNet-BiLSTM method for Alzheimer's disease prediction using longitudinal MRI analysis. The proposed framework combines Convolutional DenseNet for spatial information extraction and joined BiLSTM layers for capturing temporal characteristics and relationships between longitudinal images at different time points. This approach overcomes issues like overfitting, vanishing gradients, and incomplete patient data. We evaluated the model on 684 longitudinal MRI images from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database, including normal controls, individuals with mild cognitive impairment, and Alzheimer's disease patients. The results demonstrate high classification accuracy, with 95.28% for AD/CN, 88.19% for NC/MCI, 83.51% for sMCI/pMCI, and 92.14% for MCI/AD. These findings highlight the substantial improvement in Alzheimer's disease diagnosis achieved through the utilization of longitudinal MRI images. The contributions of this study lie in both the deep learning and medical domains. In the deep learning domain, our hybrid framework effectively learns spatial and temporal features from longitudinal data, addressing the challenges associated with multi-dimensional and sequential time series data. In the medical domain, our study emphasizes the importance of analyzing baseline and longitudinal MR images for accurate diagnosis and understanding disease progression.
Collapse
Affiliation(s)
- Alireza Jomeiri
- Department of Computer Engineering, Qom Branch, Islamic Azad University, Qom, Iran
| | - Ahmad Habibizad Navin
- Department of Computer Engineering, Tabriz Branch, Islamic Azad University, Tabriz, Iran.
| | - Mahboubeh Shamsi
- Department of Engineering, Qom University of Technology, Qom, Iran
| |
Collapse
|
2
|
Arvidsson I, Strandberg O, Palmqvist S, Stomrud E, Cullen N, Janelidze S, Tideman P, Heyden A, Åström K, Hansson O, Mattsson-Carlgren N. Comparing a pre-defined versus deep learning approach for extracting brain atrophy patterns to predict cognitive decline due to Alzheimer's disease in patients with mild cognitive symptoms. Alzheimers Res Ther 2024; 16:61. [PMID: 38504336 PMCID: PMC10949809 DOI: 10.1186/s13195-024-01428-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Accepted: 03/10/2024] [Indexed: 03/21/2024]
Abstract
BACKGROUND Predicting future Alzheimer's disease (AD)-related cognitive decline among individuals with subjective cognitive decline (SCD) or mild cognitive impairment (MCI) is an important task for healthcare. Structural brain imaging as measured by magnetic resonance imaging (MRI) could potentially contribute when making such predictions. It is unclear if the predictive performance of MRI can be improved using entire brain images in deep learning (DL) models compared to using pre-defined brain regions. METHODS A cohort of 332 individuals with SCD/MCI were included from the Swedish BioFINDER-1 study. The goal was to predict longitudinal SCD/MCI-to-AD dementia progression and change in Mini-Mental State Examination (MMSE) over four years. Four models were evaluated using different predictors: (1) clinical data only, including demographics, cognitive tests and APOE ε4 status, (2) clinical data plus hippocampal volume, (3) clinical data plus all regional MRI gray matter volumes (N = 68) extracted using FreeSurfer software, (4) a DL model trained using multi-task learning with MRI images, Jacobian determinant images and baseline cognition as input. A double cross-validation scheme, with five test folds and for each of those ten validation folds, was used. External evaluation was performed on part of the ADNI dataset, including 108 patients. Mann-Whitney U-test was used to determine statistically significant differences in performance, with p-values less than 0.05 considered significant. RESULTS In the BioFINDER cohort, 109 patients (33%) progressed to AD dementia. The performance of the clinical data model for prediction of progression to AD dementia was area under the curve (AUC) = 0.85 and four-year cognitive decline was R2 = 0.14. The performance was improved for both outcomes when adding hippocampal volume (AUC = 0.86, R2 = 0.16). Adding FreeSurfer brain regions improved prediction of four-year cognitive decline but not progression to AD (AUC = 0.83, R2 = 0.17), while the DL model worsened the performance for both outcomes (AUC = 0.84, R2 = 0.08). A sensitivity analysis showed that the Jacobian determinant image was more informative than the MRI image, but that performance was maximized when both were included. In the external evaluation cohort from ADNI, 23 patients (21%) progressed to AD dementia. The results for predicted progression to AD dementia were similar to the results for the BioFINDER test data, while the performance for the cognitive decline was deteriorated. CONCLUSIONS The DL model did not significantly improve the prediction of clinical disease progression in AD, compared to regression models with a single pre-defined brain region.
Collapse
Affiliation(s)
- Ida Arvidsson
- Centre for Mathematical Sciences, Lund University, Lund, Sweden.
| | - Olof Strandberg
- Clinical Memory Research Unit, Department of Clinical Sciences, Malmö, Lund University, Lund, Sweden
| | - Sebastian Palmqvist
- Clinical Memory Research Unit, Department of Clinical Sciences, Malmö, Lund University, Lund, Sweden
- Memory Clinic, Skåne University Hospital, Malmö, Sweden
| | - Erik Stomrud
- Clinical Memory Research Unit, Department of Clinical Sciences, Malmö, Lund University, Lund, Sweden
- Memory Clinic, Skåne University Hospital, Malmö, Sweden
| | - Nicholas Cullen
- Clinical Memory Research Unit, Department of Clinical Sciences, Malmö, Lund University, Lund, Sweden
| | - Shorena Janelidze
- Clinical Memory Research Unit, Department of Clinical Sciences, Malmö, Lund University, Lund, Sweden
| | - Pontus Tideman
- Clinical Memory Research Unit, Department of Clinical Sciences, Malmö, Lund University, Lund, Sweden
- Memory Clinic, Skåne University Hospital, Malmö, Sweden
| | - Anders Heyden
- Centre for Mathematical Sciences, Lund University, Lund, Sweden
| | - Karl Åström
- Centre for Mathematical Sciences, Lund University, Lund, Sweden
| | - Oskar Hansson
- Clinical Memory Research Unit, Department of Clinical Sciences, Malmö, Lund University, Lund, Sweden
- Memory Clinic, Skåne University Hospital, Malmö, Sweden
| | - Niklas Mattsson-Carlgren
- Clinical Memory Research Unit, Department of Clinical Sciences, Malmö, Lund University, Lund, Sweden.
- Wallenberg Center for Molecular Medicine, Lund University, Lund, Sweden.
- Department of Neurology, Skåne University Hospital, Lund, Sweden.
| |
Collapse
|
3
|
Cheng J, Wang H, Wei S, Mei J, Liu F, Zhang G. Alzheimer's disease prediction algorithm based on de-correlation constraint and multi-modal feature interaction. Comput Biol Med 2024; 170:108000. [PMID: 38232453 DOI: 10.1016/j.compbiomed.2024.108000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Revised: 12/25/2023] [Accepted: 01/13/2024] [Indexed: 01/19/2024]
Abstract
Alzheimer's disease (AD) is a neurodegenerative disease characterized by various pathological changes. Utilizing multimodal data from Fluorodeoxyglucose positron emission tomography(FDG-PET) and Magnetic Resonance Imaging(MRI) of the brain can offer comprehensive information about the lesions from different perspectives and improve the accuracy of prediction. However, there are significant differences in the feature space of multimodal data. Commonly, the simple concatenation of multimodal features can cause the model to struggle in distinguishing and utilizing the complementary information between different modalities, thus affecting the accuracy of predictions. Therefore, we propose an AD prediction model based on de-correlation constraint and multi-modal feature interaction. This model consists of the following three parts: (1) The feature extractor employs residual connections and attention mechanisms to capture distinctive lesion features from FDG-PET and MRI data within their respective modalities. (2) The de-correlation constraint function enhances the model's capacity to extract complementary information from different modalities by reducing the feature similarity between them. (3) The mutual attention feature fusion module interacts with the features within and between modalities to enhance the modal-specific features and adaptively adjust the weights of these features based on information from other modalities. The experimental results on ADNI database demonstrate that the proposed model achieves a prediction accuracy of 86.79% for AD, MCI and NC, which is higher than the existing multi-modal AD prediction models.
Collapse
Affiliation(s)
- Jiayuan Cheng
- Anhui Provincial International Joint Research Center for Advanced Technology in Medical Imaging, Anhui University, Hefei, China; School of Computer Science and Technology, Anhui University, Hefei, China
| | - Huabin Wang
- Anhui Provincial International Joint Research Center for Advanced Technology in Medical Imaging, Anhui University, Hefei, China; School of Computer Science and Technology, Anhui University, Hefei, China.
| | - Shicheng Wei
- School of Mathematics, Physics and Computing, University of Southern Queensland, Toowoomba, Australia
| | - Jiahao Mei
- Anhui Provincial International Joint Research Center for Advanced Technology in Medical Imaging, Anhui University, Hefei, China; School of Computer Science and Technology, Anhui University, Hefei, China
| | - Fei Liu
- School of Engineering, Monash University Malaysia, Kuala Lumpur, Malaysia
| | - Gong Zhang
- Anhui Provincial International Joint Research Center for Advanced Technology in Medical Imaging, Anhui University, Hefei, China; Hubei Key Laboratory of Intelligent Conveying Technology and Device, Hubei Polytechnic University, Huangshi, China
| |
Collapse
|
4
|
Fathi S, Ahmadi A, Dehnad A, Almasi-Dooghaee M, Sadegh M. A Deep Learning-Based Ensemble Method for Early Diagnosis of Alzheimer's Disease using MRI Images. Neuroinformatics 2024; 22:89-105. [PMID: 38042764 PMCID: PMC10917836 DOI: 10.1007/s12021-023-09646-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/16/2023] [Indexed: 12/04/2023]
Abstract
Recently, the early diagnosis of Alzheimer's disease has gained major attention due to the growing prevalence of the disease and the resulting costs imposed on individuals and society. The main objective of this study was to propose an ensemble method based on deep learning for the early diagnosis of AD using MRI images. The methodology of this study consisted of collecting the dataset, preprocessing, creating the individual and ensemble models, evaluating the models based on ADNI data, and validating the trained model based on the local dataset. The proposed method was an ensemble approach selected through a comparative analysis of various ensemble scenarios. Finally, the six best individual CNN-based classifiers were selected to combine and constitute the ensemble model. The evaluation showed an accuracy rate of 98.57, 96.37, 94.22, 99.83, 93.88, and 93.92 for NC/AD, NC/EMCI, EMCI/LMCI, LMCI/AD, four-way and three-way classification groups, respectively. The validation results on the local dataset revealed an accuracy of 88.46 for three-way classification. Our performance results were higher than most reviewed studies and comparable with others. Although comparative analysis showed superior results of ensemble methods against individual architectures, there were no significant differences among various ensemble approaches. The validation results revealed the low performance of individual models in practice. In contrast, the ensemble method showed promising results. However, further studies on various and larger datasets are required to validate the generalizability of the model.
Collapse
Affiliation(s)
- Sina Fathi
- Department of Health Information Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Ali Ahmadi
- Surrey Business School, University of Surrey, Guildford Surrey, GU2 7XH, UK.
| | - Afsaneh Dehnad
- School of Health Management and Information Sciences, Iran University of Medical Sciences, Tehran, Iran
| | - Mostafa Almasi-Dooghaee
- Neurology Department, Firoozgar Hospital, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| | - Melika Sadegh
- Neurology Department, Firoozgar Hospital, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
5
|
O'Connell S, Cannon DM, Broin PÓ. Predictive modelling of brain disorders with magnetic resonance imaging: A systematic review of modelling practices, transparency, and interpretability in the use of convolutional neural networks. Hum Brain Mapp 2023; 44:6561-6574. [PMID: 37909364 PMCID: PMC10681646 DOI: 10.1002/hbm.26521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Revised: 09/28/2023] [Accepted: 10/10/2023] [Indexed: 11/03/2023] Open
Abstract
Brain disorders comprise several psychiatric and neurological disorders which can be characterized by impaired cognition, mood alteration, psychosis, depressive episodes, and neurodegeneration. Clinical diagnoses primarily rely on a combination of life history information and questionnaires, with a distinct lack of discriminative biomarkers in use for psychiatric disorders. Symptoms across brain conditions are associated with functional alterations of cognitive and emotional processes, which can correlate with anatomical variation; structural magnetic resonance imaging (MRI) data of the brain are therefore an important focus of research, particularly for predictive modelling. With the advent of large MRI data consortia (such as the Alzheimer's Disease Neuroimaging Initiative) facilitating a greater number of MRI-based classification studies, convolutional neural networks (CNNs)-deep learning models well suited to image processing tasks-have become increasingly popular for research into brain conditions. This has resulted in a myriad of studies reporting impressive predictive performances, demonstrating the potential clinical value of deep learning systems. However, methodologies can vary widely across studies, making them difficult to compare and/or reproduce, potentially limiting their clinical application. Here, we conduct a qualitative systematic literature review of 55 studies carrying out CNN-based predictive modelling of brain disorders using MRI data and evaluate them based on three principles-modelling practices, transparency, and interpretability. We propose several recommendations to enhance the potential for the integration of CNNs into clinical care.
Collapse
Affiliation(s)
- Shane O'Connell
- School of Mathematical and Statistical Sciences, College of Science and EngineeringUniversity of GalwayGalwayIreland
| | - Dara M. Cannon
- Clinical Neuroimaging Laboratory, Galway Neuroscience Centre, College of MedicineNursing and Health SciencesUniversity of GalwayGalwayIreland
| | - Pilib Ó. Broin
- School of Mathematical and Statistical Sciences, College of Science and EngineeringUniversity of GalwayGalwayIreland
| |
Collapse
|
6
|
Bolla G, Berente DB, Andrássy A, Zsuffa JA, Hidasi Z, Csibri E, Csukly G, Kamondi A, Kiss M, Horvath AA. Comparison of the diagnostic accuracy of resting-state fMRI driven machine learning algorithms in the detection of mild cognitive impairment. Sci Rep 2023; 13:22285. [PMID: 38097674 PMCID: PMC10721802 DOI: 10.1038/s41598-023-49461-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Accepted: 12/08/2023] [Indexed: 12/17/2023] Open
Abstract
Mild cognitive impairment (MCI) is a potential therapeutic window in the prevention of dementia; however, automated detection of early cognitive deterioration is an unresolved issue. The aim of our study was to compare various classification approaches to differentiate MCI patients from healthy controls, based on rs-fMRI data, using machine learning (ML) algorithms. Own dataset (from two centers) and ADNI database were used during the analysis. Three fMRI parameters were applied in five feature selection algorithms: local correlation, intrinsic connectivity, and fractional amplitude of low frequency fluctuations. Support vector machine (SVM) and random forest (RF) methods were applied for classification. We achieved a relatively wide range of 78-87% accuracy for the various feature selection methods with SVM combining the three rs-fMRI parameters. In the ADNI datasets case we can also see even 90% accuracy scores. RF provided a more harmonized result among the feature selection algorithms in both datasets with 80-84% accuracy for our local and 74-82% for the ADNI database. Despite some lower performance metrics of some algorithms, most of the results were positive and could be seen in two unrelated datasets which increase the validity of our methods. Our results highlight the potential of ML-based fMRI applications for automated diagnostic techniques to recognize MCI patients.
Collapse
Affiliation(s)
- Gergo Bolla
- Neurocognitive Research Center, National Institute of Mental Health, Neurology and Neurosurgery, Budapest, Hungary
- School of PhD Studies, Semmelweis University, Budapest, Hungary
| | - Dalida Borbala Berente
- Neurocognitive Research Center, National Institute of Mental Health, Neurology and Neurosurgery, Budapest, Hungary
- School of PhD Studies, Semmelweis University, Budapest, Hungary
| | - Anita Andrássy
- Neurocognitive Research Center, National Institute of Mental Health, Neurology and Neurosurgery, Budapest, Hungary
| | - Janos Andras Zsuffa
- Neurocognitive Research Center, National Institute of Mental Health, Neurology and Neurosurgery, Budapest, Hungary
- Department of Family Medicine, Semmelweis University, Budapest, Hungary
| | - Zoltan Hidasi
- Department of Psychiatry and Psychotherapy, Semmelweis University, Budapest, Hungary
| | - Eva Csibri
- Department of Psychiatry and Psychotherapy, Semmelweis University, Budapest, Hungary
| | - Gabor Csukly
- Neurocognitive Research Center, National Institute of Mental Health, Neurology and Neurosurgery, Budapest, Hungary
- Department of Psychiatry and Psychotherapy, Semmelweis University, Budapest, Hungary
| | - Anita Kamondi
- Neurocognitive Research Center, National Institute of Mental Health, Neurology and Neurosurgery, Budapest, Hungary
- Department of Neurology, Semmelweis University, Budapest, Hungary
| | - Mate Kiss
- Siemens Healthcare, Budapest, Hungary
| | - Andras Attila Horvath
- Department of Anatomy Histology and Embryology, Semmelweis University, Budapest, Hungary.
| |
Collapse
|
7
|
Borchert RJ, Azevedo T, Badhwar A, Bernal J, Betts M, Bruffaerts R, Burkhart MC, Dewachter I, Gellersen HM, Low A, Lourida I, Machado L, Madan CR, Malpetti M, Mejia J, Michopoulou S, Muñoz-Neira C, Pepys J, Peres M, Phillips V, Ramanan S, Tamburin S, Tantiangco HM, Thakur L, Tomassini A, Vipin A, Tang E, Newby D, Ranson JM, Llewellyn DJ, Veldsman M, Rittman T. Artificial intelligence for diagnostic and prognostic neuroimaging in dementia: A systematic review. Alzheimers Dement 2023; 19:5885-5904. [PMID: 37563912 DOI: 10.1002/alz.13412] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 05/18/2023] [Accepted: 06/02/2023] [Indexed: 08/12/2023]
Abstract
INTRODUCTION Artificial intelligence (AI) and neuroimaging offer new opportunities for diagnosis and prognosis of dementia. METHODS We systematically reviewed studies reporting AI for neuroimaging in diagnosis and/or prognosis of cognitive neurodegenerative diseases. RESULTS A total of 255 studies were identified. Most studies relied on the Alzheimer's Disease Neuroimaging Initiative dataset. Algorithmic classifiers were the most commonly used AI method (48%) and discriminative models performed best for differentiating Alzheimer's disease from controls. The accuracy of algorithms varied with the patient cohort, imaging modalities, and stratifiers used. Few studies performed validation in an independent cohort. DISCUSSION The literature has several methodological limitations including lack of sufficient algorithm development descriptions and standard definitions. We make recommendations to improve model validation including addressing key clinical questions, providing sufficient description of AI methods and validating findings in independent datasets. Collaborative approaches between experts in AI and medicine will help achieve the promising potential of AI tools in practice. HIGHLIGHTS There has been a rapid expansion in the use of machine learning for diagnosis and prognosis in neurodegenerative disease Most studies (71%) relied on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset with no other individual dataset used more than five times There has been a recent rise in the use of more complex discriminative models (e.g., neural networks) that performed better than other classifiers for classification of AD vs healthy controls We make recommendations to address methodological considerations, addressing key clinical questions, and validation We also make recommendations for the field more broadly to standardize outcome measures, address gaps in the literature, and monitor sources of bias.
Collapse
Affiliation(s)
- Robin J Borchert
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
- Department of Radiology, University of Cambridge, Cambridge, UK
| | - Tiago Azevedo
- Department of Computer Science and Technology, University of Cambridge, Cambridge, UK
| | - AmanPreet Badhwar
- Department of Pharmacology and Physiology, University of Montreal, Montreal, Canada
- Centre de recherche de l'Institut Universitaire de Gériatrie (CRIUGM), Montreal, Canada
| | - Jose Bernal
- Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, UK
- Institute of Cognitive Neurology and Dementia Research, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
- German Center for Neurodegenerative Diseases (DZNE), Magdeburg, Germany
| | - Matthew Betts
- Institute of Cognitive Neurology and Dementia Research, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
- German Center for Neurodegenerative Diseases (DZNE), Magdeburg, Germany
- Center for Behavioral Brain Sciences, University of Magdeburg, Magdeburg, Germany
| | - Rose Bruffaerts
- Computational Neurology, Experimental Neurobiology Unit, Department of Biomedical Sciences, University of Antwerp, Antwerp, Belgium
- Biomedical Research Institute, Hasselt University, Diepenbeek, Belgium
| | | | - Ilse Dewachter
- Biomedical Research Institute, Hasselt University, Diepenbeek, Belgium
| | - Helena M Gellersen
- German Center for Neurodegenerative Diseases (DZNE), Magdeburg, Germany
- Department of Psychology, University of Cambridge, Cambridge, UK
| | - Audrey Low
- Department of Psychiatry, University of Cambridge, Cambridge, UK
| | | | - Luiza Machado
- Department of Biochemistry, Universidade Federal do Rio Grande do Sul, Porto Alegre, Brazil
| | | | - Maura Malpetti
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
| | - Jhony Mejia
- Department of Biomedical Engineering, Universidad de Los Andes, Bogotá, Colombia
| | - Sofia Michopoulou
- Imaging Physics, University Hospital Southampton NHS Foundation Trust, Southampton, UK
| | - Carlos Muñoz-Neira
- Research into Memory, Brain sciences and dementia Group (ReMemBr Group), Translational Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
- Artificial Intelligence & Computational Neuroscience Group (AICN Group), Sheffield Institute for Translational Neuroscience (SITraN), Department of Neuroscience, University of Sheffield, Sheffield, UK
| | - Jack Pepys
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy
| | - Marion Peres
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
| | | | - Siddharth Ramanan
- Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
| | - Stefano Tamburin
- Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Verona, Italy
| | | | - Lokendra Thakur
- Division of Genetics and Genomics, Boston Children's Hospital, Harvard Medical School, Boston, Massachusetts, USA
- Broad Institute of MIT and Harvard, Cambridge, UK
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Alessandro Tomassini
- Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
| | | | - Eugene Tang
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Danielle Newby
- Department of Psychiatry, University of Oxford, Oxford, UK
| | | | - David J Llewellyn
- University of Exeter Medical School, Exeter, UK
- Alan Turing Institute, London, UK
| | - Michele Veldsman
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Timothy Rittman
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
| |
Collapse
|
8
|
Alwuthaynani MM, Abdallah ZS, Santos-Rodriguez R. A robust class decomposition-based approach for detecting Alzheimer's progression. Exp Biol Med (Maywood) 2023; 248:2514-2525. [PMID: 38059336 PMCID: PMC10854473 DOI: 10.1177/15353702231211880] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2023] [Revised: 10/17/2023] [Accepted: 02/28/2023] [Indexed: 12/08/2023] Open
Abstract
Computer-aided diagnosis of Alzheimer's disease (AD) is a rapidly growing field with the possibility to be utilized in practice. Deep learning has received much attention in detecting AD from structural magnetic resonance imaging (sMRI). However, training a convolutional neural network from scratch is problematic because it requires a lot of annotated data and additional computational time. Transfer learning can offer a promising and practical solution by transferring information learned from other image recognition tasks to medical image classification. Another issue is the dataset distribution's irregularities. A common classification issue in datasets is a class imbalance, where the distribution of samples among the classes is biased. For example, a dataset may contain more instances of some classes than others. Class imbalance is challenging because most machine learning algorithms assume that each class should have an equal number of samples. Models consequently perform poorly in prediction. Class decomposition can address this problem by making learning a dataset's class boundaries easier. Motivated by these approaches, we propose a class decomposition transfer learning (CDTL) approach that employs VGG19, AlexNet, and an entropy-based technique to detect AD from sMRI. This study aims to assess the robustness of the CDTL approach in detecting the cognitive decline of AD using data from various ADNI cohorts to determine whether comparable classification accuracy for the two or more cohorts would be obtained. Furthermore, the proposed model achieved state-of-the-art performance in predicting mild cognitive impairment (MCI)-to-AD conversion with an accuracy of 91.45%.
Collapse
Affiliation(s)
- Maha M Alwuthaynani
- University of Bristol, Bristol BS8 1TH, UK
- College of Computer Science & Information Systems, Najran University, Najran 61441, Saudi Arabia
| | | | | |
Collapse
|
9
|
Arvidsson I, Strandberg O, Palmqvist S, Stomrud E, Cullen N, Janelidze S, Tideman P, Heyden A, Åström K, Hansson O, Mattsson-Carlgren N. Comparing a pre-defined versus deep learning approach for extracting brain atrophy patterns to predict cognitive decline due to Alzheimer's disease in patients with mild cognitive symptoms. RESEARCH SQUARE 2023:rs.3.rs-3569391. [PMID: 37986841 PMCID: PMC10659533 DOI: 10.21203/rs.3.rs-3569391/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/22/2023]
Abstract
Background Predicting future Alzheimer's disease (AD)-related cognitive decline among individuals with subjective cognitive decline (SCD) or mild cognitive impairment (MCI) is an important task for healthcare. Structural brain imaging as measured by magnetic resonance imaging (MRI) could potentially contribute when making such predictions. It is unclear if the predictive performance of MRI can be improved using entire brain images in deep learning (DL) models compared to using pre-defined brain regions. Methods A cohort of 332 individuals with SCD/MCI were included from the Swedish BioFINDER-1 study. The goal was to predict longitudinal SCD/MCI-to-AD dementia progression and change in Mini-Mental State Examination (MMSE) over four years. Four models were evaluated using different predictors: 1) clinical data only, including demographics, cognitive tests and APOE e4 status, 2) clinical data plus hippocampal volume, 3) clinical data plus all regional MRI gray matter volumes (N=68) extracted using FreeSurfer software, 4) a DL model trained using multi-task learning with MRI images, Jacobian determinant images and baseline cognition as input. Models were developed on 80% of subjects (N=267) and tested on the remaining 20% (N=65). Mann-Whitney U-test was used to determine statistically significant differences in performance, with p-values less than 0.05 considered significant. Results In the test set, 21 patients (32.3%) progressed to AD dementia. The performance of the clinical data model for prediction of progression to AD dementia was area under the curve (AUC)=0.87 and four-year cognitive decline was R2=0.17. The performance was significantly improved for both outcomes when adding hippocampal volume (AUC=0.91, R2=0.26, p-values <0.05) or FreeSurfer brain regions (AUC=0.90, R2=0.27, p-values <0.05). Conversely, the DL model did not show any significant difference from the clinical data model (AUC=0.86, R2=0.13). A sensitivity analysis showed that the Jacobian determinant image was more informative than the MRI image, but that performance was maximized when both were included. Conclusions The DL model did not significantly improve the prediction of clinical disease progression in AD, compared to regression models with a single pre-defined brain region.
Collapse
|
10
|
Parsapoor M. AI-based assessments of speech and language impairments in dementia. Alzheimers Dement 2023; 19:4675-4687. [PMID: 37578167 DOI: 10.1002/alz.13395] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2022] [Revised: 06/03/2023] [Accepted: 06/05/2023] [Indexed: 08/15/2023]
Abstract
Recent advancements in the artificial intelligence (AI) domain have revolutionized the early detection of cognitive impairments associated with dementia. This has motivated clinicians to use AI-powered dementia detection systems, particularly systems developed based on individuals' and patients' speech and language, for a quick and accurate identification of patients with dementia. This paper reviews articles about developing assessment tools using machine learning and deep learning algorithms trained by vocal and textual datasets.
Collapse
Affiliation(s)
- Mahboobeh Parsapoor
- Centre de Recherche Informatique de Montréal: CRIM, Montreal, Quebec, Canada
| |
Collapse
|
11
|
Yamada S, Otani T, Ii S, Kawano H, Nozaki K, Wada S, Oshima M, Watanabe Y. Aging-related volume changes in the brain and cerebrospinal fluid using artificial intelligence-automated segmentation. Eur Radiol 2023; 33:7099-7112. [PMID: 37060450 PMCID: PMC10511609 DOI: 10.1007/s00330-023-09632-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Revised: 02/01/2023] [Accepted: 02/17/2023] [Indexed: 04/16/2023]
Abstract
OBJECTIVES To verify the reliability of the volumes automatically segmented using a new artificial intelligence (AI)-based application and evaluate changes in the brain and CSF volume with healthy aging. METHODS The intracranial spaces were automatically segmented in the 21 brain subregions and 5 CSF subregions using the AI-based application on the 3D T1-weighted images in healthy volunteers aged > 20 years. Additionally, the automatically segmented volumes of the total ventricles and subarachnoid spaces were compared with the manually segmented volumes of those extracted from 3D T2-weighted images using the intra-class correlation and Bland-Altman analysis. RESULTS In this study, 133 healthy volunteers aged 21-92 years were included. The mean intra-class correlations between the automatically and manually segmented volumes of the total ventricles and subarachnoid spaces were 0.986 and 0.882, respectively. The increase in the CSF volume was estimated to be approximately 30 mL (2%) per decade from 265 mL (18.7%) in the 20s to 488 mL (33.7%) in ages above 80 years; however, the increase in the volume of total ventricles was approximately 20 mL (< 2%) until the 60s and increased in ages above 60 years. CONCLUSIONS This study confirmed the reliability of the CSF volumes using the AI-based auto-segmentation application. The intracranial CSF volume increased linearly because of the brain volume reduction with aging; however, the ventricular volume did not change until the age of 60 years and above and then gradually increased. This finding could help elucidate the pathogenesis of chronic hydrocephalus in adults. KEY POINTS • The brain and CSF spaces were automatically segmented using an artificial intelligence-based application. • The total subarachnoid spaces increased linearly with aging, whereas the total ventricle volume was around 20 mL (< 2%) until the 60s and increased in ages above 60 years. • The cortical gray matter gradually decreases with aging, whereas the subcortical gray matter maintains its volume, and the cerebral white matter increases slightly until the 40s and begins to decrease from the 50s.
Collapse
Affiliation(s)
- Shigeki Yamada
- Department of Neurosurgery, Nagoya City University Graduate School of Medical Science, 1 Kawasumi, Mizuho-cho, Mizuho-ku, NagoyaNagoya, Aichi, 467-8601, Japan.
- Interfaculty Initiative in Information Studies / Institute of Industrial Science, The University of Tokyo, Tokyo, Japan.
- Department of Neurosurgery, Shiga University of Medical Science, Ōtsu, Shiga, Japan.
| | - Tomohiro Otani
- Department of Mechanical Science and Bioengineering, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Satoshi Ii
- Faculty of System Design, Tokyo Metropolitan University, Hachioji, Tokyo, Japan
| | - Hiroto Kawano
- Department of Neurosurgery, Shiga University of Medical Science, Ōtsu, Shiga, Japan
| | - Kazuhiko Nozaki
- Department of Neurosurgery, Shiga University of Medical Science, Ōtsu, Shiga, Japan
| | - Shigeo Wada
- Department of Mechanical Science and Bioengineering, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Marie Oshima
- Interfaculty Initiative in Information Studies / Institute of Industrial Science, The University of Tokyo, Tokyo, Japan
| | - Yoshiyuki Watanabe
- Department of Radiology, Shiga University of Medical Science, Ōtsu, Shiga, Japan
| |
Collapse
|
12
|
Mohamed AA, Marques O. Diagnostic Efficacy and Clinical Relevance of Artificial Intelligence in Detecting Cognitive Decline. Cureus 2023; 15:e47004. [PMID: 37965412 PMCID: PMC10641267 DOI: 10.7759/cureus.47004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/13/2023] [Indexed: 11/16/2023] Open
Abstract
Cognitive impairment is an age-associated disorder of increasing prevalence as the aging population continues to grow. Classified based on the level of cognitive decline, memory, function, and capacity to conduct activities of daily living, cognitive impairment ranges from mild cognitive impairment to dementia. When considering the insidious nature of the etiologies responsible for varying degrees of cognitive impairment, early diagnosis may provide a clinical benefit through the facilitation of early treatment. Typical diagnosis relies heavily on evaluation in a primary care setting. However, there is evidence that other diagnostic tools may aid in an earlier diagnosis of the different underlying pathologies responsible for cognitive impairment. Artificial intelligence represents a new intersecting field with healthcare that may aid in the early detection of neurodegenerative disorders. When assessing the role of AI in detecting cognitive decline, it is important to consider both the diagnostic efficacy of AI algorithms and the clinical relevance and impact of early interventions as a result of early detection. Thus, this review highlights promising investigations and developments in the space of artificial intelligence and healthcare and their potential to impact patient outcomes.
Collapse
Affiliation(s)
- Ali A Mohamed
- Neurological Surgery, Charles E. Schmidt College of Medicine, Florida Atlantic University, Boca Raton, USA
- Electrical Engineering and Computer Science, Florida Atlantic University, Boca Raton, USA
| | - Oge Marques
- Biomedical Sciences, Charles E. Schmidt College of Medicine, Florida Atlantic University, Boca Raton, USA
- Electrical Engineering and Computer Science, Florida Atlantic University, Boca Raton, USA
| |
Collapse
|
13
|
Saleh H, Amer E, Abuhmed T, Ali A, Al-Fuqaha A, El-Sappagh S. Computer aided progression detection model based on optimized deep LSTM ensemble model and the fusion of multivariate time series data. Sci Rep 2023; 13:16336. [PMID: 37770490 PMCID: PMC10539296 DOI: 10.1038/s41598-023-42796-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Accepted: 09/14/2023] [Indexed: 09/30/2023] Open
Abstract
Alzheimer's disease (AD) is the most common form of dementia. Early and accurate detection of AD is crucial to plan for disease modifying therapies that could prevent or delay the conversion to sever stages of the disease. As a chronic disease, patient's multivariate time series data including neuroimaging, genetics, cognitive scores, and neuropsychological battery provides a complete profile about patient's status. This data has been used to build machine learning and deep learning (DL) models for the early detection of the disease. However, these models still have limited performance and are not stable enough to be trusted in real medical settings. Literature shows that DL models outperform classical machine learning models, but ensemble learning has proven to achieve better results than standalone models. This study proposes a novel deep stacking framework which combines multiple DL models to accurately predict AD at an early stage. The study uses long short-term memory (LSTM) models as base models over patient's multivariate time series data to learn the deep longitudinal features. Each base LSTM classifier has been optimized using the Bayesian optimizer using different feature sets. As a result, the final optimized ensembled model employed heterogeneous base models that are trained on heterogeneous data. The performance of the resulting ensemble model has been explored using a cohort of 685 patients from the University of Washington's National Alzheimer's Coordinating Center dataset. Compared to the classical machine learning models and base LSTM classifiers, the proposed ensemble model achieves the highest testing results (i.e., 82.02, 82.25, 82.02, and 82.12 for accuracy, precision, recall, and F1-score, respectively). The resulting model enhances the performance of the state-of-the-art literature, and it could be used to build an accurate clinical decision support tool that can assist domain experts for AD progression detection.
Collapse
Affiliation(s)
- Hager Saleh
- Faculty of Computers and Artificial Intelligence, South Valley University, Hurghada, Egypt
| | - Eslam Amer
- Communications and Information Technology, The Institute of Electronics, Queen's University of Belfast, Belfast, UK
| | - Tamer Abuhmed
- Information Laboratory (InfoLab), College of Computing and Informatics, Sungkyunkwan University, Seoul, Suwon, 16419, South Korea.
| | - Amjad Ali
- Information and Computing Technology (ICT) Division, College of Science and Engineering (CSE), Hamad Bin Khalifa University, Doha, Qatar
| | - Ala Al-Fuqaha
- Information and Computing Technology (ICT) Division, College of Science and Engineering (CSE), Hamad Bin Khalifa University, Doha, Qatar
| | - Shaker El-Sappagh
- Information Laboratory (InfoLab), College of Computing and Informatics, Sungkyunkwan University, Seoul, Suwon, 16419, South Korea.
- Faculty of Computer Science and Engineering, Galala University, Suez, 435611, Egypt.
- Faculty of Computers and Artificial Intelligence, Benha University, Banha, 13518, Egypt.
| |
Collapse
|
14
|
Chakari-Khiavi F, Mirzaie A, Khalilzadeh B, Yousefi H, Abolhasan R, Kamrani A, Pourakbari R, Shahpasand K, Yousefi M, Rashidi MR. Application of Pt@ZIF-8 nanocomposite-based electrochemical biosensor for sensitive diagnosis of tau protein in Alzheimer's disease patients. Sci Rep 2023; 13:16163. [PMID: 37758805 PMCID: PMC10533502 DOI: 10.1038/s41598-023-43180-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Accepted: 09/20/2023] [Indexed: 09/29/2023] Open
Abstract
Alzheimer's disease (AD) is a progressive brain disorder characterized by the ongoing decline of brain functions. Studies have revealed the detrimental effects of hyperphosphorylated tau (p-tau) protein fibrils in AD pathogenesis, highlighting the importance of this factor in the early-stage detection of AD conditions. We designed an electrochemical immunosensor for quantitative detection of the cis conformation of the p-tau protein (cis-p-tau) employing platinum nanoparticles (Pt NPs) supported on zeolitic imidazolate frameworks (ZIF) for modifying the glassy carbon electrode (GCE) surface. Under optimum conditions, the immunosensor selectively and sensitively detected cis-p-tau within the broad linear range of 1 fg mL-1 to 10 ng mL-1 and the low limit of detection (LOD) of 1 fg mL-1 with desired reproducibility and stability. Furthermore, the fabricated immunosensor's performance was examined for the cis-p-tau analysis in the serum of AD patients, indicating its accuracy and feasibility for real-sample analysis. Notably, this is the first application of Pt@ZIF-8 nanocomposite in fabricating a valid immunosensor for selective cis-p-tau detection, even in the presence of trans-p-tau. It is worth mentioning that the enzyme-linked immunosorbent assay (ELISA) reference technique is not able to evaluate pico- or femtomolar concentrations of cis-p-tau, making the fabricated immunosensor superior for early-stage measurement and screening of AD.
Collapse
Affiliation(s)
- Forough Chakari-Khiavi
- Department of Medicinal Chemistry, Faculty of Pharmacy, Tabriz University of Medical Sciences, PO Box: 6446-14155, Tabriz, Iran
- Student Research Committee, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Arezoo Mirzaie
- Pharmaceutical Analysis Research Center, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Balal Khalilzadeh
- Stem Cell Research Center (SCRC), Tabriz University of Medical Sciences, Tabriz, 51664-14766, Iran.
- Hematology and Oncology Research Center, Tabriz University of Medical Sciences, Tabriz, Iran.
| | - Hadi Yousefi
- Department of Basic Medical Sciences, Khoy University of Medical Sciences, Khoy, Iran
| | - Rozita Abolhasan
- Department of Immunology, Faculty of Medical Sciences, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Amin Kamrani
- Department of Immunology, Faculty of Medical Sciences, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Ramin Pourakbari
- Department of Immunology, Faculty of Medical Sciences, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Koorosh Shahpasand
- Department of Stem Cells and Developmental Biology, Cell Science Research Center, Royan Institute for Stem Cell Biology and Technology, Academic Center for Education, Culture and Research (ACECR), Tehran, 1665659911, Iran
| | - Mehdi Yousefi
- Stem Cell Research Center (SCRC), Tabriz University of Medical Sciences, Tabriz, 51664-14766, Iran
| | - Mohammad-Reza Rashidi
- Department of Medicinal Chemistry, Faculty of Pharmacy, Tabriz University of Medical Sciences, PO Box: 6446-14155, Tabriz, Iran.
- Research Center for Pharmaceutical Nanotechnology (RCPN), Tabriz University of Medical Sciences, Tabriz, Iran.
| |
Collapse
|
15
|
Cao G, Zhang M, Wang Y, Zhang J, Han Y, Xu X, Huang J, Kang G. End-to-end automatic pathology localization for Alzheimer's disease diagnosis using structural MRI. Comput Biol Med 2023; 163:107110. [PMID: 37321102 DOI: 10.1016/j.compbiomed.2023.107110] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2023] [Revised: 05/18/2023] [Accepted: 05/30/2023] [Indexed: 06/17/2023]
Abstract
Structural magnetic resonance imaging (sMRI) is an essential part of the clinical assessment of patients at risk of Alzheimer dementia. One key challenge in sMRI-based computer-aided dementia diagnosis is to localize local pathological regions for discriminative feature learning. Existing solutions predominantly depend on generating saliency maps for pathology localization and handle the localization task independently of the dementia diagnosis task, leading to a complex multi-stage training pipeline that is hard to optimize with weakly-supervised sMRI-level annotations. In this work, we aim to simplify the pathology localization task and construct an end-to-end automatic localization framework (AutoLoc) for Alzheimer's disease diagnosis. To this end, we first present an efficient pathology localization paradigm that directly predicts the coordinate of the most disease-related region in each sMRI slice. Then, we approximate the non-differentiable patch-cropping operation with the bilinear interpolation technique, which eliminates the barrier to gradient backpropagation and thus enables the joint optimization of localization and diagnosis tasks. Extensive experiments on commonly used ADNI and AIBL datasets demonstrate the superiority of our method. Especially, we achieve 93.38% and 81.12% accuracy on Alzheimer's disease classification and mild cognitive impairment conversion prediction tasks, respectively. Several important brain regions, such as rostral hippocampus and globus pallidus, are identified to be highly associated with Alzheimer's disease.
Collapse
Affiliation(s)
- Gongpeng Cao
- Key Laboratory of Universal Wireless Communications, Ministry of Education, Beijing University of Posts and Telecommunications, No. 10 Xitucheng Road, Haidian District, Beijing, 100876, China
| | - Manli Zhang
- Key Laboratory of Universal Wireless Communications, Ministry of Education, Beijing University of Posts and Telecommunications, No. 10 Xitucheng Road, Haidian District, Beijing, 100876, China
| | - Yiping Wang
- Key Laboratory of Universal Wireless Communications, Ministry of Education, Beijing University of Posts and Telecommunications, No. 10 Xitucheng Road, Haidian District, Beijing, 100876, China
| | - Jing Zhang
- Key Laboratory of Universal Wireless Communications, Ministry of Education, Beijing University of Posts and Telecommunications, No. 10 Xitucheng Road, Haidian District, Beijing, 100876, China
| | - Ying Han
- Department of Neurology, Xuanwu Hospital of Capital Medical University, No. 45 Changchun Street, Xicheng District, Beijing, 100053, China
| | - Xin Xu
- Department of Neurosurgery, Chinese PLA General Hospital, No. 28 Fuxing Road, Haidian District, Beijing, 100853, China
| | - Jinguo Huang
- Key Laboratory of Universal Wireless Communications, Ministry of Education, Beijing University of Posts and Telecommunications, No. 10 Xitucheng Road, Haidian District, Beijing, 100876, China.
| | - Guixia Kang
- Key Laboratory of Universal Wireless Communications, Ministry of Education, Beijing University of Posts and Telecommunications, No. 10 Xitucheng Road, Haidian District, Beijing, 100876, China.
| |
Collapse
|
16
|
Wen J, Li Y, Fang M, Zhu L, Feng DD, Li P. Fine-Grained and Multiple Classification for Alzheimer's Disease With Wavelet Convolution Unit Network. IEEE Trans Biomed Eng 2023; 70:2592-2603. [PMID: 37030751 DOI: 10.1109/tbme.2023.3256042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/19/2023]
Abstract
In this article, we propose a novel wavelet convolution unit for the image-oriented neural network to integrate wavelet analysis with a vanilla convolution operator to extract deep abstract features more efficiently. On one hand, in order to acquire non-local receptive fields and avoid information loss, we define a new convolution operation by composing a traditional convolution function and approximate and detailed representations after single-scale wavelet decomposition of source images. On the other hand, multi-scale wavelet decomposition is introduced to obtain more comprehensive multi-scale feature information. Then, we fuse all these cross-scale features to improve the problem of inaccurate localization of singular points. Given the novel wavelet convolution unit, we further design a network based on it for fine-grained Alzheimer's disease classifications (i.e., Alzheimer's disease, Normal controls, early mild cognitive impairment, late mild cognitive impairment). Up to now, only a few methods have studied one or several fine-grained classifications, and even fewer methods can achieve both fine-grained and multi-class classifications. We adopt the novel network and diffuse tensor images to achieve fine-grained classifications, which achieved state-of-the-art accuracy for all eight kinds of fine-grained classifications, up to 97.30%, 95.78%, 95.00%, 94.00%, 97.89%, 95.71%, 95.07%, 93.79%. In order to build a reference standard for Alzheimer's disease classifications, we actually implemented all twelve coarse-grained and fine-grained classifications. The results show that the proposed method achieves solidly high accuracy for them. Its classification ability greatly exceeds any kind of existing Alzheimer's disease classification method.
Collapse
|
17
|
Azevedo T, Bethlehem RAI, Whiteside DJ, Swaddiwudhipong N, Rowe JB, Lió P, Rittman T. Identifying healthy individuals with Alzheimer's disease neuroimaging phenotypes in the UK Biobank. COMMUNICATIONS MEDICINE 2023; 3:100. [PMID: 37474615 PMCID: PMC10359360 DOI: 10.1038/s43856-023-00313-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2022] [Accepted: 06/05/2023] [Indexed: 07/22/2023] Open
Abstract
BACKGROUND Identifying prediagnostic neurodegenerative disease is a critical issue in neurodegenerative disease research, and Alzheimer's disease (AD) in particular, to identify populations suitable for preventive and early disease-modifying trials. Evidence from genetic and other studies suggests the neurodegeneration of Alzheimer's disease measured by brain atrophy starts many years before diagnosis, but it is unclear whether these changes can be used to reliably detect prediagnostic sporadic disease. METHODS We trained a Bayesian machine learning neural network model to generate a neuroimaging phenotype and AD score representing the probability of AD using structural MRI data in the Alzheimer's Disease Neuroimaging Initiative (ADNI) Cohort (cut-off 0.5, AUC 0.92, PPV 0.90, NPV 0.93). We go on to validate the model in an independent real-world dataset of the National Alzheimer's Coordinating Centre (AUC 0.74, PPV 0.65, NPV 0.80) and demonstrate the correlation of the AD-score with cognitive scores in those with an AD-score above 0.5. We then apply the model to a healthy population in the UK Biobank study to identify a cohort at risk for Alzheimer's disease. RESULTS We show that the cohort with a neuroimaging Alzheimer's phenotype has a cognitive profile in keeping with Alzheimer's disease, with strong evidence for poorer fluid intelligence, and some evidence of poorer numeric memory, reaction time, working memory, and prospective memory. We found some evidence in the AD-score positive cohort for modifiable risk factors of hypertension and smoking. CONCLUSIONS This approach demonstrates the feasibility of using AI methods to identify a potentially prediagnostic population at high risk for developing sporadic Alzheimer's disease.
Collapse
Affiliation(s)
- Tiago Azevedo
- Department of Computer Science and Technology, University of Cambridge, Cambridge, UK
| | - Richard A I Bethlehem
- Brain Mapping Unit, Department of Psychiatry, University of Cambridge, Cambridge, UK
- Autism Research Centre, Department of Psychiatry, University of Cambridge, Cambridge, UK
| | - David J Whiteside
- Department of Clinical Neurosciences and Cambridge University Hospitals NHS Trust, University of Cambridge, Cambridge, UK
| | - Nol Swaddiwudhipong
- Department of Clinical Neurosciences and Cambridge University Hospitals NHS Trust, University of Cambridge, Cambridge, UK
| | - James B Rowe
- Department of Clinical Neurosciences and Cambridge University Hospitals NHS Trust, University of Cambridge, Cambridge, UK
| | - Pietro Lió
- Department of Computer Science and Technology, University of Cambridge, Cambridge, UK
| | - Timothy Rittman
- Department of Clinical Neurosciences and Cambridge University Hospitals NHS Trust, University of Cambridge, Cambridge, UK.
| |
Collapse
|
18
|
Arya AD, Verma SS, Chakarabarti P, Chakrabarti T, Elngar AA, Kamali AM, Nami M. A systematic review on machine learning and deep learning techniques in the effective diagnosis of Alzheimer's disease. Brain Inform 2023; 10:17. [PMID: 37450224 PMCID: PMC10349019 DOI: 10.1186/s40708-023-00195-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Accepted: 06/02/2023] [Indexed: 07/18/2023] Open
Abstract
Alzheimer's disease (AD) is a brain-related disease in which the condition of the patient gets worse with time. AD is not a curable disease by any medication. It is impossible to halt the death of brain cells, but with the help of medication, the effects of AD can be delayed. As not all MCI patients will suffer from AD, it is required to accurately diagnose whether a mild cognitive impaired (MCI) patient will convert to AD (namely MCI converter MCI-C) or not (namely MCI non-converter MCI-NC), during early diagnosis. There are two modalities, positron emission tomography (PET) and magnetic resonance image (MRI), used by a physician for the diagnosis of Alzheimer's disease. Machine learning and deep learning perform exceptionally well in the field of computer vision where there is a requirement to extract information from high-dimensional data. Researchers use deep learning models in the field of medicine for diagnosis, prognosis, and even to predict the future health of the patient under medication. This study is a systematic review of publications using machine learning and deep learning methods for early classification of normal cognitive (NC) and Alzheimer's disease (AD).This study is an effort to provide the details of the two most commonly used modalities PET and MRI for the identification of AD, and to evaluate the performance of both modalities while working with different classifiers.
Collapse
Affiliation(s)
| | | | | | | | - Ahmed A. Elngar
- Faculty of Computers and Artificial Intelligence, Beni-Suef University, Beni-Suef, 62511 Egypt
| | - Ali-Mohammad Kamali
- Department of Neuroscience, School of Advanced Medical Sciences and Technologies, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Mohammad Nami
- Cognitive Neuropsychology Unit, Department of Social Sciences, Canadian University Dubai, Dubai, UAE
| |
Collapse
|
19
|
Alyoubi EH, Moria KM, Alghamdi JS, Tayeb HO. An Optimized Deep Learning Model for Predicting Mild Cognitive Impairment Using Structural MRI. SENSORS (BASEL, SWITZERLAND) 2023; 23:5648. [PMID: 37420812 DOI: 10.3390/s23125648] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Revised: 06/05/2023] [Accepted: 06/10/2023] [Indexed: 07/09/2023]
Abstract
Early diagnosis of mild cognitive impairment (MCI) with magnetic resonance imaging (MRI) has been shown to positively affect patients' lives. To save time and costs associated with clinical investigation, deep learning approaches have been used widely to predict MCI. This study proposes optimized deep learning models for differentiating between MCI and normal control samples. In previous studies, the hippocampus region located in the brain is used extensively to diagnose MCI. The entorhinal cortex is a promising area for diagnosing MCI since severe atrophy is observed when diagnosing the disease before the shrinkage of the hippocampus. Due to the small size of the entorhinal cortex area relative to the hippocampus, limited research has been conducted on the entorhinal cortex brain region for predicting MCI. This study involves the construction of a dataset containing only the entorhinal cortex area to implement the classification system. To extract the features of the entorhinal cortex area, three different neural network architectures are optimized independently: VGG16, Inception-V3, and ResNet50. The best outcomes were achieved utilizing the convolution neural network classifier and the Inception-V3 architecture for feature extraction, with accuracy, sensitivity, specificity, and area under the curve scores of 70%, 90%, 54%, and 69%, respectively. Furthermore, the model has an acceptable balance between precision and recall, achieving an F1 score of 73%. The results of this study validate the effectiveness of our approach in predicting MCI and may contribute to diagnosing MCI through MRI.
Collapse
Affiliation(s)
- Esraa H Alyoubi
- Department of Computer Science, College of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Kawthar M Moria
- Department of Computer Science, College of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Jamaan S Alghamdi
- Department of Diagnostic Radiology, Faculty of Applied Medical Sciences, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Haythum O Tayeb
- The Neuroscience Research Unit, Faculty of Medicine, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| |
Collapse
|
20
|
Kang W, Lin L, Sun S, Wu S. Three-round learning strategy based on 3D deep convolutional GANs for Alzheimer's disease staging. Sci Rep 2023; 13:5750. [PMID: 37029214 PMCID: PMC10081988 DOI: 10.1038/s41598-023-33055-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Accepted: 04/06/2023] [Indexed: 04/09/2023] Open
Abstract
Accurately diagnosing of Alzheimer's disease (AD) and its early stages is critical for prompt treatment or potential intervention to delay the the disease's progression. Convolutional neural networks (CNNs) models have shown promising results in structural MRI (sMRI)-based diagnosis, but their performance, particularly for 3D models, is constrained by the lack of labeled training samples. To address the overfitting problem brought on by the insufficient training sample size, we propose a three-round learning strategy that combines transfer learning with generative adversarial learning. In the first round, a 3D Deep Convolutional Generative Adversarial Networks (DCGAN) model was trained with all available sMRI data to learn the common feature of sMRI through unsupervised generative adversarial learning. The second round involved transferring and fine-tuning, and the pre-trained discriminator (D) of the DCGAN learned more specific features for the classification task between AD and cognitively normal (CN). In the final round, the weights learned in the AD versus CN classification task were transferred to the MCI diagnosis. By highlighting brain regions with high prediction weights using 3D Grad-CAM, we further enhanced the model's interpretability. The proposed model achieved accuracies of 92.8%, 78.1%, and 76.4% in the classifications of AD versus CN, AD versus MCI, and MCI versus CN, respectively. The experimental results show that our proposed model avoids overfitting brought on by a paucity of sMRI data and enables the early detection of AD.
Collapse
Affiliation(s)
- Wenjie Kang
- Beijing International Platform for Scientific and Technological Cooperation, Department of Biomedical Engineering, Faculty of Environment and Life Sciences, Beijing University of Technology, Beijing, 100124, China
| | - Lan Lin
- Beijing International Platform for Scientific and Technological Cooperation, Department of Biomedical Engineering, Faculty of Environment and Life Sciences, Beijing University of Technology, Beijing, 100124, China.
| | - Shen Sun
- Beijing International Platform for Scientific and Technological Cooperation, Department of Biomedical Engineering, Faculty of Environment and Life Sciences, Beijing University of Technology, Beijing, 100124, China
| | - Shuicai Wu
- Beijing International Platform for Scientific and Technological Cooperation, Department of Biomedical Engineering, Faculty of Environment and Life Sciences, Beijing University of Technology, Beijing, 100124, China
| |
Collapse
|
21
|
Li H, Tan Y, Miao J, Liang P, Gong J, He H, Jiao Y, Zhang F, Xing Y, Wu D. Attention-based and micro designed EfficientNetB2 for diagnosis of Alzheimer’s disease. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104571] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/19/2023]
|
22
|
Liu F, Wang H, Liang SN, Jin Z, Wei S, Li X. MPS-FFA: A multiplane and multiscale feature fusion attention network for Alzheimer's disease prediction with structural MRI. Comput Biol Med 2023; 157:106790. [PMID: 36958239 DOI: 10.1016/j.compbiomed.2023.106790] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2022] [Revised: 02/13/2023] [Accepted: 03/11/2023] [Indexed: 03/17/2023]
Abstract
Structural magnetic resonance imaging (sMRI) is a popular technique that is widely applied in Alzheimer's disease (AD) diagnosis. However, only a few structural atrophy areas in sMRI scans are highly associated with AD. The degree of atrophy in patients' brain tissues and the distribution of lesion areas differ among patients. Therefore, a key challenge in sMRI-based AD diagnosis is identifying discriminating atrophy features. Hence, we propose a multiplane and multiscale feature-level fusion attention (MPS-FFA) model. The model has three components, (1) A feature encoder uses a multiscale feature extractor with hybrid attention layers to simultaneously capture and fuse multiple pathological features in the sagittal, coronal, and axial planes. (2) A global attention classifier combines clinical scores and two global attention layers to evaluate the feature impact scores and balance the relative contributions of different feature blocks. (3) A feature similarity discriminator minimizes the feature similarities among heterogeneous labels to enhance the ability of the network to discriminate atrophy features. The MPS-FFA model provides improved interpretability for identifying discriminating features using feature visualization. The experimental results on the baseline sMRI scans from two databases confirm the effectiveness (e.g., accuracy and generalizability) of our method in locating pathological locations. The source code is available at https://github.com/LiuFei-AHU/MPSFFA.
Collapse
Affiliation(s)
- Fei Liu
- Anhui Provincial International Joint Research Center for Advanced Technology in Medical Imaging, Anhui University, Hefei, China; School of Computer Science and Technology, Anhui University, Hefei, China
| | - Huabin Wang
- Anhui Provincial International Joint Research Center for Advanced Technology in Medical Imaging, Anhui University, Hefei, China; School of Computer Science and Technology, Anhui University, Hefei, China.
| | - Shiuan-Ni Liang
- School of Engineering, Monash University Malaysia, Kuala Lumpur, Malaysia
| | - Zhe Jin
- Anhui Provincial International Joint Research Center for Advanced Technology in Medical Imaging, Anhui University, Hefei, China
| | - Shicheng Wei
- Anhui Provincial International Joint Research Center for Advanced Technology in Medical Imaging, Anhui University, Hefei, China
| | - Xuejun Li
- Anhui Provincial International Joint Research Center for Advanced Technology in Medical Imaging, Anhui University, Hefei, China; School of Computer Science and Technology, Anhui University, Hefei, China
| | | |
Collapse
|
23
|
Illakiya T, Karthik R. Automatic Detection of Alzheimer's Disease using Deep Learning Models and Neuro-Imaging: Current Trends and Future Perspectives. Neuroinformatics 2023; 21:339-364. [PMID: 36884142 DOI: 10.1007/s12021-023-09625-7] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/16/2023] [Indexed: 03/09/2023]
Abstract
Deep learning algorithms have a huge influence on tackling research issues in the field of medical image processing. It acts as a vital aid for the radiologists in producing accurate results toward effective disease diagnosis. The objective of this research is to highlight the importance of deep learning models in the detection of Alzheimer's Disease (AD). The main objective of this research is to analyze different deep learning methods used for detecting AD. This study examines 103 research articles published in various research databases. These articles have been selected based on specific criteria to find the most relevant findings in the field of AD detection. The review was carried out based on deep learning techniques such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and Transfer Learning (TL). To propose accurate methods for the detection, segmentation, and severity grading of AD, the radiological features need to be examined in greater depth. This review attempts to analyze different deep learning methods applied for AD detection using neuroimaging modalities like Positron Emission Tomography (PET), Magnetic Resonance Imaging (MRI), etc. The focus of this review is restricted to deep learning works based on radiological imaging data for AD detection. There are a few works that have utilized other biomarkers to understand the effect of AD. Also, articles published in English were alone considered for analysis. This work concludes by highlighting the key research issues towards effective AD detection. Though several methods have yielded promising results in AD detection, the progression from Mild Cognitive Impairment (MCI) to AD need to be analyzed in greater depth using DL models.
Collapse
Affiliation(s)
- T Illakiya
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - R Karthik
- Centre for Cyber Physical Systems, School of Electronics Engineering, Vellore Institute of Technology, Chennai, India.
| |
Collapse
|
24
|
Divya R, Shantha Selva Kumari R. Detection of Alzheimer’s disease from temporal lobe grey matter slices using 3D CNN. THE IMAGING SCIENCE JOURNAL 2023. [DOI: 10.1080/13682199.2023.2173548] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2023]
Affiliation(s)
- R. Divya
- Department of Electronics and Communication Engineering, Mepco Schlenk Engineering College, Sivakasi, India
| | - R. Shantha Selva Kumari
- Department of Electronics and Communication Engineering, Mepco Schlenk Engineering College, Sivakasi, India
| | | |
Collapse
|
25
|
Nguyen HD, Clément M, Mansencal B, Coupé P. Towards better interpretable and generalizable AD detection using collective artificial intelligence. Comput Med Imaging Graph 2023; 104:102171. [PMID: 36640484 DOI: 10.1016/j.compmedimag.2022.102171] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Revised: 12/24/2022] [Accepted: 12/24/2022] [Indexed: 01/03/2023]
Abstract
Alzheimer's Disease is the most common cause of dementia. Accurate diagnosis and prognosis of this disease are essential to design an appropriate treatment plan, increasing the life expectancy of the patient. Intense research has been conducted on the use of machine learning to identify Alzheimer's Disease from neuroimaging data, such as structural magnetic resonance imaging. In recent years, advances of deep learning in computer vision suggest a new research direction for this problem. Current deep learning-based approaches in this field, however, have a number of drawbacks, including the interpretability of model decisions, a lack of generalizability information and a lower performance compared to traditional machine learning techniques. In this paper, we design a two-stage framework to overcome these limitations. In the first stage, an ensemble of 125 U-Nets is used to grade the input image, producing a 3D map that reflects the disease severity at voxel-level. This map can help to localize abnormal brain areas caused by the disease. In the second stage, we model a graph per individual using the generated grading map and other information about the subject. We propose to use a graph convolutional neural network classifier for the final classification. As a result, our framework demonstrates comparative performance to the state-of-the-art methods in different datasets for both diagnosis and prognosis. We also demonstrate that the use of a large ensemble of U-Nets offers a better generalization capacity for our framework.
Collapse
Affiliation(s)
- Huy-Dung Nguyen
- Univ. Bordeaux, CNRS, Bordeaux INP, LaBRI, UMR 5800, 33400 Talence, France.
| | - Michaël Clément
- Univ. Bordeaux, CNRS, Bordeaux INP, LaBRI, UMR 5800, 33400 Talence, France
| | - Boris Mansencal
- Univ. Bordeaux, CNRS, Bordeaux INP, LaBRI, UMR 5800, 33400 Talence, France
| | - Pierrick Coupé
- Univ. Bordeaux, CNRS, Bordeaux INP, LaBRI, UMR 5800, 33400 Talence, France
| |
Collapse
|
26
|
Chakraborty D, Zhuang Z, Xue H, Fiecas MB, Shen X, Pan W. Deep Learning-Based Feature Extraction with MRI Data in Neuroimaging Genetics for Alzheimer's Disease. Genes (Basel) 2023; 14:626. [PMID: 36980898 PMCID: PMC10047952 DOI: 10.3390/genes14030626] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Revised: 02/27/2023] [Accepted: 02/27/2023] [Indexed: 03/06/2023] Open
Abstract
The prognosis and treatment of patients suffering from Alzheimer's disease (AD) have been among the most important and challenging problems over the last few decades. To better understand the mechanism of AD, it is of great interest to identify genetic variants associated with brain atrophy. Commonly, in these analyses, neuroimaging features are extracted based on one of many possible brain atlases with FreeSurf and other popular software; this, however, may cause the loss of important information due to our incomplete knowledge about brain function embedded in these suboptimal atlases. To address the issue, we propose convolutional neural network (CNN) models applied to three-dimensional MRI data for the whole brain or multiple, divided brain regions to perform completely data-driven and automatic feature extraction. These image-derived features are then used as endophenotypes in genome-wide association studies (GWASs) to identify associated genetic variants. When we applied this method to ADNI data, we identified several associated SNPs that have been previously shown to be related to several neurodegenerative/mental disorders, such as AD, depression, and schizophrenia.
Collapse
Affiliation(s)
- Dipnil Chakraborty
- Division of Biostatistics, School of Public Health, University of Minnesota, Minneapolis, MN 55455, USA
| | - Zhong Zhuang
- Department of Electrical and Computer Engineering, University of Minnesota, Minneapolis, MN 55455, USA
| | - Haoran Xue
- Division of Biostatistics, School of Public Health, University of Minnesota, Minneapolis, MN 55455, USA
| | - Mark B. Fiecas
- Division of Biostatistics, School of Public Health, University of Minnesota, Minneapolis, MN 55455, USA
| | - Xiatong Shen
- School of Statistics, University of Minnesota, Minneapolis, MN 55455, USA
| | - Wei Pan
- Division of Biostatistics, School of Public Health, University of Minnesota, Minneapolis, MN 55455, USA
| |
Collapse
|
27
|
Xu X, Lin L, Sun S, Wu S. A review of the application of three-dimensional convolutional neural networks for the diagnosis of Alzheimer's disease using neuroimaging. Rev Neurosci 2023:revneuro-2022-0122. [PMID: 36729918 DOI: 10.1515/revneuro-2022-0122] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Accepted: 01/02/2023] [Indexed: 02/03/2023]
Abstract
Alzheimer's disease (AD) is a degenerative disorder that leads to progressive, irreversible cognitive decline. To obtain an accurate and timely diagnosis and detect AD at an early stage, numerous approaches based on convolutional neural networks (CNNs) using neuroimaging data have been proposed. Because 3D CNNs can extract more spatial discrimination information than 2D CNNs, they have emerged as a promising research direction in the diagnosis of AD. The aim of this article is to present the current state of the art in the diagnosis of AD using 3D CNN models and neuroimaging modalities, focusing on the 3D CNN architectures and classification methods used, and to highlight potential future research topics. To give the reader a better overview of the content mentioned in this review, we briefly introduce the commonly used imaging datasets and the fundamentals of CNN architectures. Then we carefully analyzed the existing studies on AD diagnosis, which are divided into two levels according to their inputs: 3D subject-level CNNs and 3D patch-level CNNs, highlighting their contributions and significance in the field. In addition, this review discusses the key findings and challenges from the studies and highlights the lessons learned as a roadmap for future research. Finally, we summarize the paper by presenting some major findings, identifying open research challenges, and pointing out future research directions.
Collapse
Affiliation(s)
- Xinze Xu
- Intelligent Physiological Measurement and Clinical Translation, Beijing International Platform for Scientific and Technological Cooperation, Department of Biomedical Engineering, Faculty of Environment and Life Sciences, Beijing University of Technology, Beijing 100124, China
| | - Lan Lin
- Intelligent Physiological Measurement and Clinical Translation, Beijing International Platform for Scientific and Technological Cooperation, Department of Biomedical Engineering, Faculty of Environment and Life Sciences, Beijing University of Technology, Beijing 100124, China
| | - Shen Sun
- Intelligent Physiological Measurement and Clinical Translation, Beijing International Platform for Scientific and Technological Cooperation, Department of Biomedical Engineering, Faculty of Environment and Life Sciences, Beijing University of Technology, Beijing 100124, China
| | - Shuicai Wu
- Intelligent Physiological Measurement and Clinical Translation, Beijing International Platform for Scientific and Technological Cooperation, Department of Biomedical Engineering, Faculty of Environment and Life Sciences, Beijing University of Technology, Beijing 100124, China
| |
Collapse
|
28
|
Pan D, Zeng A, Yang B, Lai G, Hu B, Song X, Jiang T. Deep Learning for Brain MRI Confirms Patterned Pathological Progression in Alzheimer's Disease. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023; 10:e2204717. [PMID: 36575159 PMCID: PMC9951348 DOI: 10.1002/advs.202204717] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/17/2022] [Revised: 11/29/2022] [Indexed: 06/17/2023]
Abstract
Deep learning (DL) on brain magnetic resonance imaging (MRI) data has shown excellent performance in differentiating individuals with Alzheimer's disease (AD). However, the value of DL in detecting progressive structural MRI (sMRI) abnormalities linked to AD pathology has yet to be established. In this study, an interpretable DL algorithm named the Ensemble of 3-dimensional convolutional neural network (Ensemble 3DCNN) with enhanced parsing techniques is proposed to investigate the longitudinal trajectories of whole-brain sMRI changes denoting AD onset and progression. A set of 2369 T1-weighted images from the multi-centre Alzheimer's Disease Neuroimaging Initiative and Open Access Series of Imaging Studies cohorts are applied to model derivation, validation, testing, and pattern analysis. An Ensemble-3DCNN-based P-score is generated, based on which multiple brain regions, including amygdala, insular, parahippocampal, and temporal gyrus, exhibit early and connected progressive neurodegeneration. Complex individual variability in the sMRI is also observed. This study combining non-invasive sMRI and interpretable DL in detecting patterned sMRI changes confirmed AD pathological progression, shedding new light on predicting AD progression using whole-brain sMRI.
Collapse
Affiliation(s)
- Dan Pan
- School of Electronics and InformationGuangdong Polytechnic Normal UniversityGuangzhou510665China
| | - An Zeng
- Faculty of Computers, Guangdong University of TechnologyGuangzhou510006China
| | - Baoyao Yang
- Faculty of Computers, Guangdong University of TechnologyGuangzhou510006China
| | - Gangyong Lai
- Faculty of Computers, Guangdong University of TechnologyGuangzhou510006China
| | - Bing Hu
- Department of RadiologyThe Third Affiliated Hospital of SUN Yat‐sen UniversityGuangzhou510630China
| | - Xiaowei Song
- Clinical Research CentreSurrey Memorial HospitalFraser HealthSurreyBritish ColumbiaV3V 1Z2Canada
| | - Tianzi Jiang
- Brainnetome Center & National Laboratory of Pattern RecognitionInstitute of AutomationChinese Academy of SciencesBeijing100190China
| | | |
Collapse
|
29
|
Khan R, Akbar S, Mehmood A, Shahid F, Munir K, Ilyas N, Asif M, Zheng Z. A transfer learning approach for multiclass classification of Alzheimer's disease using MRI images. Front Neurosci 2023; 16:1050777. [PMID: 36699527 PMCID: PMC9869687 DOI: 10.3389/fnins.2022.1050777] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 12/05/2022] [Indexed: 01/11/2023] Open
Abstract
Alzheimer's is an acute degenerative disease affecting the elderly population all over the world. The detection of disease at an early stage in the absence of a large-scale annotated dataset is crucial to the clinical treatment for the prevention and early detection of Alzheimer's disease (AD). In this study, we propose a transfer learning base approach to classify various stages of AD. The proposed model can distinguish between normal control (NC), early mild cognitive impairment (EMCI), late mild cognitive impairment (LMCI), and AD. In this regard, we apply tissue segmentation to extract the gray matter from the MRI scans obtained from the Alzheimer's Disease National Initiative (ADNI) database. We utilize this gray matter to tune the pre-trained VGG architecture while freezing the features of the ImageNet database. It is achieved through the addition of a layer with step-wise freezing of the existing blocks in the network. It not only assists transfer learning but also contributes to learning new features efficiently. Extensive experiments are conducted and results demonstrate the superiority of the proposed approach.
Collapse
Affiliation(s)
- Rizwan Khan
- Department of Computer Science and Mathematics, Zhejiang Normal University, Jinhua, China,*Correspondence: Rizwan Khan ✉
| | - Saeed Akbar
- School of Computer Science, Huazhong University of Science and Technology, Wuhan, China
| | - Atif Mehmood
- Division of Biomedical Imaging, Department of Biomedical Engineering and Health Systems, KTH Royal Institute of Technology, Stockholm, Sweden,Department of Computer Science, National University of Modern Languages, Islamabad, Pakistan
| | - Farah Shahid
- Department of Computer Science, University of Agriculture, Sub Campus Burewala-Vehari, Faisalabad, Pakistan
| | - Khushboo Munir
- Department of Radiology and Diagnostic Imaging, University of Alberta, Edmonton, AB, Canada
| | - Naveed Ilyas
- Department of Physics, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
| | - M. Asif
- Department of Radiology, Emory Brain Health Center-Neurosurgery, School of Medicine, Emory University, Atlanta, GA, United States
| | - Zhonglong Zheng
- Department of Computer Science and Mathematics, Zhejiang Normal University, Jinhua, China,Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua, China
| |
Collapse
|
30
|
Francis A, Pandian IA, Anitha J. A boon to aged society: Early diagnosis of Alzheimer's disease-An opinion. Front Public Health 2022; 10:1076472. [PMID: 36530651 PMCID: PMC9751990 DOI: 10.3389/fpubh.2022.1076472] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2022] [Accepted: 11/14/2022] [Indexed: 12/04/2022] Open
Affiliation(s)
- Ambily Francis
- Department of Electronics and Communication Engineering, Karunya Institute of Technology and Sciences, Coimbatore, India,Department of Electronics and Communication Engineering, Sahrdaya College of Engineering and Technology, Kodakara, India
| | - Immanuel Alex Pandian
- Department of Electronics and Communication Engineering, Karunya Institute of Technology and Sciences, Coimbatore, India
| | - J. Anitha
- Department of Computer Science and Engineering, Karunya Institute of Technology and Sciences, Coimbatore, India,*Correspondence: J. Anitha
| |
Collapse
|
31
|
Liu S, Masurkar AV, Rusinek H, Chen J, Zhang B, Zhu W, Fernandez-Granda C, Razavian N. Generalizable deep learning model for early Alzheimer's disease detection from structural MRIs. Sci Rep 2022; 12:17106. [PMID: 36253382 PMCID: PMC9576679 DOI: 10.1038/s41598-022-20674-x] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Accepted: 09/16/2022] [Indexed: 01/25/2023] Open
Abstract
Early diagnosis of Alzheimer's disease plays a pivotal role in patient care and clinical trials. In this study, we have developed a new approach based on 3D deep convolutional neural networks to accurately differentiate mild Alzheimer's disease dementia from mild cognitive impairment and cognitively normal individuals using structural MRIs. For comparison, we have built a reference model based on the volumes and thickness of previously reported brain regions that are known to be implicated in disease progression. We validate both models on an internal held-out cohort from The Alzheimer's Disease Neuroimaging Initiative (ADNI) and on an external independent cohort from The National Alzheimer's Coordinating Center (NACC). The deep-learning model is accurate, achieved an area-under-the-curve (AUC) of 85.12 when distinguishing between cognitive normal subjects and subjects with either MCI or mild Alzheimer's dementia. In the more challenging task of detecting MCI, it achieves an AUC of 62.45. It is also significantly faster than the volume/thickness model in which the volumes and thickness need to be extracted beforehand. The model can also be used to forecast progression: subjects with mild cognitive impairment misclassified as having mild Alzheimer's disease dementia by the model were faster to progress to dementia over time. An analysis of the features learned by the proposed model shows that it relies on a wide range of regions associated with Alzheimer's disease. These findings suggest that deep neural networks can automatically learn to identify imaging biomarkers that are predictive of Alzheimer's disease, and leverage them to achieve accurate early detection of the disease.
Collapse
Affiliation(s)
- Sheng Liu
- Center for Data Science, NYU, 60 Fifth Avenue, 5th Floor, New York, NY, 10011, USA
| | - Arjun V Masurkar
- Center for Cognitive Neurology, Department of Neurology, NYU Grossman School of Medicine, 60 Fifth Avenue, 5th Floor, New York, NY, 10011, USA
- Neuroscience Institute, NYU Grossman School of Medicine, 145 E 32nd St #2, New York, NY, 10016, USA
| | - Henry Rusinek
- Department of Radiology, NYU Grossman School of Medicine, 660 First Avenue, New York, NY, 10016, USA
- Department of Psychiatry, NYU Grossman School of Medicine, 227 East 30th St, 6th Floor, New York, NY, 10016, USA
| | - Jingyun Chen
- Center for Cognitive Neurology, Department of Neurology, NYU Grossman School of Medicine, 60 Fifth Avenue, 5th Floor, New York, NY, 10011, USA
- Department of Radiology, NYU Grossman School of Medicine, 660 First Avenue, New York, NY, 10016, USA
| | - Ben Zhang
- Department of Radiology, NYU Grossman School of Medicine, 660 First Avenue, New York, NY, 10016, USA
| | - Weicheng Zhu
- Center for Data Science, NYU, 60 Fifth Avenue, 5th Floor, New York, NY, 10011, USA
| | - Carlos Fernandez-Granda
- Center for Data Science, NYU, 60 Fifth Avenue, 5th Floor, New York, NY, 10011, USA.
- Courant Institute of Mathematical Sciences, NYU, 251 Mercer St # 801, New York, NY, 10012, USA.
| | - Narges Razavian
- Center for Data Science, NYU, 60 Fifth Avenue, 5th Floor, New York, NY, 10011, USA.
- Center for Cognitive Neurology, Department of Neurology, NYU Grossman School of Medicine, 60 Fifth Avenue, 5th Floor, New York, NY, 10011, USA.
- Department of Radiology, NYU Grossman School of Medicine, 660 First Avenue, New York, NY, 10016, USA.
- Department of Population Health, NYU Grossman School of Medicine, 227 East 30th street 639, New York, NY, 10016, USA.
| |
Collapse
|
32
|
Noella RSN, Priyadarshini J. Diagnosis of Alzheimer’s, Parkinson’s disease and frontotemporal dementia using a generative adversarial deep convolutional neural network. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07750-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
33
|
Merone M, D'Addario SL, Mirino P, Bertino F, Guariglia C, Ventura R, Capirchio A, Baldassarre G, Silvetti M, Caligiore D. A multi-expert ensemble system for predicting Alzheimer transition using clinical features. Brain Inform 2022; 9:20. [PMID: 36056985 PMCID: PMC9440971 DOI: 10.1186/s40708-022-00168-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Accepted: 05/16/2022] [Indexed: 11/18/2022] Open
Abstract
Alzheimer’s disease (AD) diagnosis often requires invasive examinations (e.g., liquor analyses), expensive tools (e.g., brain imaging) and highly specialized personnel. The diagnosis commonly is established when the disorder has already caused severe brain damage, and the clinical signs begin to be apparent. Instead, accessible and low-cost approaches for early identification of subjects at high risk for developing AD years before they show overt symptoms are fundamental to provide a critical time window for more effective clinical management, treatment, and care planning. This article proposes an ensemble-based machine learning algorithm for predicting AD development within 9 years from first overt signs and using just five clinical features that are easily detectable with neuropsychological tests. The validation of the system involved both healthy individuals and mild cognitive impairment (MCI) patients drawn from the ADNI open dataset, at variance with previous studies that considered only MCI. The system shows higher levels of balanced accuracy, negative predictive value, and specificity than other similar solutions. These results represent a further important step to build a preventive fast-screening machine-learning-based tool to be used as a part of routine healthcare screenings.
Collapse
Affiliation(s)
- Mario Merone
- Unit of Computer Systems and Bioinformatics, Department of Engineering, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo 21, 00128, Rome, Italy
| | - Sebastian Luca D'Addario
- Department of Psychology, Sapienza University, Piazzale Aldo Moro 5, 00185, Rome, Italy.,Computational and Translational Neuroscience Laboratory, Institute of Cognitive Sciences and Technologies, National Research Council (CTNLab-ISTC-CNR), Via San Martino della Battaglia 44, 00185, Rome, Italy.,IRCCS Fondazione Santa Lucia, Via Ardeatina, 306 and Via Del Fosso di Fiorano, 64, 00143, Rome, Italy
| | - Pierandrea Mirino
- Department of Psychology, Sapienza University, Piazzale Aldo Moro 5, 00185, Rome, Italy.,Computational and Translational Neuroscience Laboratory, Institute of Cognitive Sciences and Technologies, National Research Council (CTNLab-ISTC-CNR), Via San Martino della Battaglia 44, 00185, Rome, Italy.,AI2Life s.r.l., Innovative Start-Up, ISTC-CNR Spin-Off, Via Sebino 32, 00199, Rome, Italy
| | - Francesca Bertino
- Computational and Translational Neuroscience Laboratory, Institute of Cognitive Sciences and Technologies, National Research Council (CTNLab-ISTC-CNR), Via San Martino della Battaglia 44, 00185, Rome, Italy
| | - Cecilia Guariglia
- Department of Psychology, Sapienza University, Piazzale Aldo Moro 5, 00185, Rome, Italy.,IRCCS Fondazione Santa Lucia, Via Ardeatina, 306 and Via Del Fosso di Fiorano, 64, 00143, Rome, Italy
| | - Rossella Ventura
- Department of Psychology, Sapienza University, Piazzale Aldo Moro 5, 00185, Rome, Italy.,IRCCS Fondazione Santa Lucia, Via Ardeatina, 306 and Via Del Fosso di Fiorano, 64, 00143, Rome, Italy
| | - Adriano Capirchio
- AI2Life s.r.l., Innovative Start-Up, ISTC-CNR Spin-Off, Via Sebino 32, 00199, Rome, Italy
| | - Gianluca Baldassarre
- AI2Life s.r.l., Innovative Start-Up, ISTC-CNR Spin-Off, Via Sebino 32, 00199, Rome, Italy.,Laboratory of Embodied Natural and Artificial Intelligence, Institute of Cognitive Sciences and Technologies, National Research Council (LENAI-ISTC-CNR), Via San Martino della Battaglia 44, 00185, Rome, Italy
| | - Massimo Silvetti
- Computational and Translational Neuroscience Laboratory, Institute of Cognitive Sciences and Technologies, National Research Council (CTNLab-ISTC-CNR), Via San Martino della Battaglia 44, 00185, Rome, Italy
| | - Daniele Caligiore
- Computational and Translational Neuroscience Laboratory, Institute of Cognitive Sciences and Technologies, National Research Council (CTNLab-ISTC-CNR), Via San Martino della Battaglia 44, 00185, Rome, Italy. .,AI2Life s.r.l., Innovative Start-Up, ISTC-CNR Spin-Off, Via Sebino 32, 00199, Rome, Italy.
| |
Collapse
|
34
|
Alorfi NM. Public Awareness of Alzheimer’s Disease: A Cross-Sectional Study from Saudi Arabia. Int J Gen Med 2022; 15:7535-7546. [PMID: 36199585 PMCID: PMC9527696 DOI: 10.2147/ijgm.s373447] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Accepted: 08/12/2022] [Indexed: 12/04/2022] Open
Abstract
Background Alzheimer’s disease is considered the most common neurodegenerative and progressive illness. It is also a common type of dementia characterized by brain atrophy, neuronal tissue loss, and the formation of amyloid plaques. Mild memory loss is a commonly expected start of the disease, which can progress to loss of capacity to carry on a conversation and react to certain situations. Objective This study aimed to measure knowledge about Alzheimer’s disease in Saudi Arabia through the use of the Alzheimer’s Disease Knowledge Scale (ADKS) and measure the association between the ADKS with relevant demographic variables. Methods A pre-validated questionnaire containing 30 questions was distributed electronically to anyone older than 18 years old living in Saudi Arabia. Items regarding socio-demographic characteristics and the Alzheimer’s Disease Knowledge Scale (ADKS) were also included. Results Participants did not have a high enough mean score to be regarded as appropriately knowledgeable (mean = 17.35). Higher knowledge scores on Life impact, Risk factors, Assessment and diagnosis, Caregiving, Treatment and management, and ADKS were associated with the female gender. Higher knowledge of caregiving was associated with a postgraduate academic qualification. Higher knowledge on Assessment and Diagnosis was associated with higher age. Higher knowledge on risk factors was associated with having relatives diagnosed with Alzheimer’s disease. Higher knowledge on life impact was associated with having newspaper and journal articles as the source of medical information. Conclusion National awareness campaigns for the community and continuing education courses for caregivers must be placed to aid in increasing awareness regarding Alzheimer’s disease.
Collapse
Affiliation(s)
- Nasser M Alorfi
- Department of Pharmacology and Toxicology, College of Pharmacy, Umm Al-Qura University, Makkah, Saudi Arabia
- Correspondence: Nasser M Alorfi, Department of Pharmacology and Toxicology, College of Pharmacy, Umm Al-Qura University, Makkah, Saudi Arabia, Tel +966500644261, Email
| |
Collapse
|
35
|
Battineni G, Chintalapudi N, Hossain MA, Losco G, Ruocco C, Sagaro GG, Traini E, Nittari G, Amenta F. Artificial Intelligence Models in the Diagnosis of Adult-Onset Dementia Disorders: A Review. Bioengineering (Basel) 2022; 9:bioengineering9080370. [PMID: 36004895 PMCID: PMC9405227 DOI: 10.3390/bioengineering9080370] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 07/25/2022] [Accepted: 08/02/2022] [Indexed: 11/16/2022] Open
Abstract
Background: The progressive aging of populations, primarily in the industrialized western world, is accompanied by the increased incidence of several non-transmittable diseases, including neurodegenerative diseases and adult-onset dementia disorders. To stimulate adequate interventions, including treatment and preventive measures, an early, accurate diagnosis is necessary. Conventional magnetic resonance imaging (MRI) represents a technique quite common for the diagnosis of neurological disorders. Increasing evidence indicates that the association of artificial intelligence (AI) approaches with MRI is particularly useful for improving the diagnostic accuracy of different dementia types. Objectives: In this work, we have systematically reviewed the characteristics of AI algorithms in the early detection of adult-onset dementia disorders, and also discussed its performance metrics. Methods: A document search was conducted with three databases, namely PubMed (Medline), Web of Science, and Scopus. The search was limited to the articles published after 2006 and in English only. The screening of the articles was performed using quality criteria based on the Newcastle–Ottawa Scale (NOS) rating. Only papers with an NOS score 7 were considered for further review. Results: The document search produced a count of 1876 articles and, because of duplication, 1195 papers were not considered. Multiple screenings were performed to assess quality criteria, which yielded 29 studies. All the selected articles were further grouped based on different attributes, including study type, type of AI model used in the identification of dementia, performance metrics, and data type. Conclusions: The most common adult-onset dementia disorders occurring were Alzheimer’s disease and vascular dementia. AI techniques associated with MRI resulted in increased diagnostic accuracy ranging from 73.3% to 99%. These findings suggest that AI should be associated with conventional MRI techniques to obtain a precise and early diagnosis of dementia disorders occurring in old age.
Collapse
Affiliation(s)
- Gopi Battineni
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy
- Correspondence: ; Tel.: +39-3331728206
| | - Nalini Chintalapudi
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy
| | - Mohammad Amran Hossain
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy
| | - Giuseppe Losco
- School of Architecture and Design, University of Camerino, 63100 Ascoli Piceno, Italy
| | - Ciro Ruocco
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy
| | - Getu Gamo Sagaro
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy
| | - Enea Traini
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy
| | - Giulio Nittari
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy
| | - Francesco Amenta
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy
| |
Collapse
|
36
|
Matsubara K, Ibaraki M, Kinoshita T. DeepPVC: prediction of a partial volume-corrected map for brain positron emission tomography studies via a deep convolutional neural network. EJNMMI Phys 2022; 9:50. [PMID: 35907100 PMCID: PMC9339068 DOI: 10.1186/s40658-022-00478-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2021] [Accepted: 07/20/2022] [Indexed: 12/04/2022] Open
Abstract
Background Partial volume correction with anatomical magnetic resonance (MR) images (MR-PVC) is useful for accurately quantifying tracer uptake on brain positron emission tomography (PET) images. However, MR segmentation processes for MR-PVC are time-consuming and prevent the widespread clinical use of MR-PVC. Here, we aimed to develop a deep learning model to directly predict PV-corrected maps from PET and MR images, ultimately improving the MR-PVC throughput. Methods We used MR T1-weighted and [11C]PiB PET images as input data from 192 participants from the Alzheimer’s Disease Neuroimaging Initiative database. We calculated PV-corrected maps as the training target using the region-based voxel-wise PVC method. Two-dimensional U-Net model was trained and validated by sixfold cross-validation with the dataset from the 156 participants, and then tested using MR T1-weighted and [11C]PiB PET images from 36 participants acquired at sites other than the training dataset. We calculated the structural similarity index (SSIM) of the PV-corrected maps and intraclass correlation (ICC) of the PV-corrected standardized uptake value between the region-based voxel-wise (RBV) PVC and deepPVC as indicators for validation and testing. Results A high SSIM (0.884 ± 0.021) and ICC (0.921 ± 0.042) were observed in the validation and test data (SSIM, 0.876 ± 0.028; ICC, 0.894 ± 0.051). The computation time required to predict a PV-corrected map for a participant (48 s without a graphics processing unit) was much shorter than that for the RBV PVC and MR segmentation processes. Conclusion These results suggest that the deepPVC model directly predicts PV-corrected maps from MR and PET images and improves the throughput of MR-PVC by skipping the MR segmentation processes. Supplementary Information The online version contains supplementary material available at 10.1186/s40658-022-00478-8.
Collapse
Affiliation(s)
- Keisuke Matsubara
- Department of Management Science and Engineering, Faculty of System Science and Technology, Akita Prefectural University, 84-4 Aza Ebinokuchi Tsuchiya, Yurihonjo, 015-0055, Japan. .,Department of Radiology and Nuclear Medicine, Research Institute for Brain and Blood Vessels, Akita Cerebrospinal and Cardiovascular Center, Akita, 010-0874, Japan.
| | - Masanobu Ibaraki
- Department of Radiology and Nuclear Medicine, Research Institute for Brain and Blood Vessels, Akita Cerebrospinal and Cardiovascular Center, Akita, 010-0874, Japan
| | - Toshibumi Kinoshita
- Department of Radiology and Nuclear Medicine, Research Institute for Brain and Blood Vessels, Akita Cerebrospinal and Cardiovascular Center, Akita, 010-0874, Japan
| | | |
Collapse
|
37
|
Leming M, Das S, Im H. Construction of a confounder-free clinical MRI dataset in the Mass General Brigham system for classification of Alzheimer's disease. Artif Intell Med 2022; 129:102309. [DOI: 10.1016/j.artmed.2022.102309] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Revised: 02/21/2022] [Accepted: 04/16/2022] [Indexed: 11/29/2022]
|
38
|
Fathi S, Ahmadi M, Dehnad A. Early diagnosis of Alzheimer's disease based on deep learning: A systematic review. Comput Biol Med 2022; 146:105634. [DOI: 10.1016/j.compbiomed.2022.105634] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2022] [Revised: 04/25/2022] [Accepted: 04/25/2022] [Indexed: 11/03/2022]
|
39
|
Chen Z, Mo X, Chen R, Feng P, Li H. A Reparametrized CNN Model to Distinguish Alzheimer's Disease Applying Multiple Morphological Metrics and Deep Semantic Features From Structural MRI. Front Aging Neurosci 2022; 14:856391. [PMID: 35721011 PMCID: PMC9204294 DOI: 10.3389/fnagi.2022.856391] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Accepted: 04/11/2022] [Indexed: 11/17/2022] Open
Abstract
It is of potential clinical value to improve the accuracy of Alzheimer's disease (AD) recognition using structural MRI. We proposed a reparametrized convolutional neural network (Re-CNN) to discriminate AD from NC by applying morphological metrics and deep semantic features. The deep semantic features were extracted through Re-CNN on structural MRI. Considering the high redundancy in deep semantic features, we constrained the similarity of the features and retained the most distinguishing features utilizing the reparametrized module. The Re-CNN model was trained in an end-to-end manner on structural MRI from the ADNI dataset and tested on structural MRI from the AIBL dataset. Our proposed model achieves better performance over some existing structural MRI-based AD recognition models. The experimental results show that morphological metrics along with the constrained deep semantic features can relatively improve AD recognition performance. Our code is available at: https://github.com/czp19940707/Re-CNN.
Collapse
|
40
|
Prediction of Medical Conditions Using Machine Learning Approaches: Alzheimer’s Case Study. MATHEMATICS 2022. [DOI: 10.3390/math10101767] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Alzheimer’s Disease (AD) is a highly prevalent condition and most of the people suffering from it receive the diagnosis late in the process. The diagnosis is currently established following an evaluation of the protein biomarkers in cerebrospinal fluid (CSF), brain imaging, cognitive tests, and the medical history of the individuals. While diagnostic tools based on CSF collections are invasive, the tools used for acquiring brain scans are expensive. Taking these into account, an early predictive system, based on Artificial Intelligence (AI) approaches, targeting the diagnosis of this condition, as well as the identification of lead biomarkers becomes an important research direction. In this survey, we review the state-of-the-art research on machine learning (ML) techniques used for the detection of AD and Mild Cognitive Impairment (MCI). We attempt to identify the most accurate and efficient diagnostic approaches, which employ ML techniques and therefore, the ones most suitable to be used in practice. Research is still ongoing to determine the best biomarkers for the task of AD classification. At the beginning of this survey, after an introductory part, we enumerate several available resources, which can be used to build ML models targeting the diagnosis and classification of AD, as well as their main characteristics. After that, we discuss the candidate markers which were used to build AI models with the best results in terms of diagnostic accuracy, as well as their limitations.
Collapse
|
41
|
Doyen S, Dadario NB. 12 Plagues of AI in Healthcare: A Practical Guide to Current Issues With Using Machine Learning in a Medical Context. Front Digit Health 2022; 4:765406. [PMID: 35592460 PMCID: PMC9110785 DOI: 10.3389/fdgth.2022.765406] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2021] [Accepted: 04/11/2022] [Indexed: 12/23/2022] Open
Abstract
The healthcare field has long been promised a number of exciting and powerful applications of Artificial Intelligence (AI) to improve the quality and delivery of health care services. AI techniques, such as machine learning (ML), have proven the ability to model enormous amounts of complex data and biological phenomena in ways only imaginable with human abilities alone. As such, medical professionals, data scientists, and Big Tech companies alike have all invested substantial time, effort, and funding into these technologies with hopes that AI systems will provide rigorous and systematic interpretations of large amounts of data that can be leveraged to augment clinical judgments in real time. However, despite not being newly introduced, AI-based medical devices have more than often been limited in their true clinical impact that was originally promised or that which is likely capable, such as during the current COVID-19 pandemic. There are several common pitfalls for these technologies that if not prospectively managed or adjusted in real-time, will continue to hinder their performance in high stakes environments outside of the lab in which they were created. To address these concerns, we outline and discuss many of the problems that future developers will likely face that contribute to these failures. Specifically, we examine the field under four lenses: approach, data, method and operation. If we continue to prospectively address and manage these concerns with reliable solutions and appropriate system processes in place, then we as a field may further optimize the clinical applicability and adoption of medical based AI technology moving forward.
Collapse
Affiliation(s)
- Stephane Doyen
- Omniscient Neurotechnology, Sydney, NSW, Australia
- *Correspondence: Stephane Doyen
| | - Nicholas B. Dadario
- Robert Wood Johnson Medical School, Rutgers University, New Brunswick, New Jersey, NJ, United States
| |
Collapse
|
42
|
Frizzell TO, Glashutter M, Liu CC, Zeng A, Pan D, Hajra SG, D’Arcy RC, Song X. Artificial intelligence in brain MRI analysis of Alzheimer's disease over the past 12 years: A systematic review. Ageing Res Rev 2022; 77:101614. [PMID: 35358720 DOI: 10.1016/j.arr.2022.101614] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2021] [Revised: 03/02/2022] [Accepted: 03/24/2022] [Indexed: 12/17/2022]
Abstract
INTRODUCTION Multiple structural brain changes in Alzheimer's disease (AD) and mild cognitive impairment (MCI) have been revealed on magnetic resonance imaging (MRI). There is a fast-growing effort in applying artificial intelligence (AI) to analyze these data. Here, we review and evaluate the AI studies in brain MRI analysis with synthesis. METHODS A systematic review of the literature, spanning the years from 2009 to 2020, was completed using the PubMed database. AI studies using MRI imaging to investigate normal aging, mild cognitive impairment, and AD-dementia were retrieved for review. Bias assessment was completed using the PROBAST criteria. RESULTS 97 relevant studies were included in the review. The studies were typically focused on the classification of AD, MCI, and normal aging (71% of the reported studies) and the prediction of MCI conversion to AD (25%). The best performance was achieved by using the deep learning-based convolution neural network algorithms (weighted average accuracy 89%), in contrast to 76-86% using Logistic Regression, Support Vector Machines, and other AI methods. DISCUSSION The synthesized evidence is paramount to developing sophisticated AI approaches to reliably capture and quantify multiple subtle MRI changes in the whole brain that exemplify the complexity and heterogeneity of AD and brain aging.
Collapse
|
43
|
Early Detection of Alzheimer’s Disease using Bottleneck Transformers. INTERNATIONAL JOURNAL OF INTELLIGENT INFORMATION TECHNOLOGIES 2022. [DOI: 10.4018/ijiit.296268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Early detection of Alzheimer’s Disease (AD) and its prodromal state, Mild Cognitive Impairment (MCI), is crucial for providing suitable treatment and preventing the disease from progressing. It can also aid researchers and clinicians to identify early biomarkers and minister new treatments that have been a subject of extensive research. The application of deep learning techniques on structural Magnetic Resonance Imaging (MRI) has shown promising results in diagnosing the disease. In this research, we intend to introduce a novel approach of using an ensemble of the self-attention-based Bottleneck Transformers with a sharpness aware minimizer for early detection of Alzheimer’s Disease. The proposed approach has been tested on the widely accepted ADNI dataset and evaluated using accuracy, precision, recall, F1 score, and ROC-AUC score as the performance metrics.
Collapse
|
44
|
Deepa N, Chokkalingam S. Optimization of VGG16 utilizing the Arithmetic Optimization Algorithm for early detection of Alzheimer’s disease. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103455] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
45
|
Machine Learning and Image Processing Enabled Evolutionary Framework for Brain MRI Analysis for Alzheimer’s Disease Detection. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:5261942. [PMID: 35419043 PMCID: PMC8995544 DOI: 10.1155/2022/5261942] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Revised: 02/27/2022] [Accepted: 03/08/2022] [Indexed: 11/29/2022]
Abstract
Alzheimer's disease is characterized by the presence of abnormal protein bundles in the brain tissue, but experts are not yet sure what is causing the condition. To find a cure or aversion, researchers need to know more than just that there are protein differences from the usual; they also need to know how these brain nerves form so that a remedy may be discovered. Machine learning is the study of computational approaches for enhancing performance on a specific task through the process of learning. This article presents an Alzheimer's disease detection framework consisting of image denoising of an MRI input data set using an adaptive mean filter, preprocessing using histogram equalization, and feature extraction by Haar wavelet transform. Classification is performed using LS-SVM-RBF, SVM, KNN, and random forest classifier. An adaptive mean filter removes noise from the existing MRI images. Image quality is enhanced by histogram equalization. Experimental results are compared using parameters such as accuracy, sensitivity, specificity, precision, and recall.
Collapse
|
46
|
Logan R, Dubel-Haag J, Schcolnicov N, Miller SJ. Novel Genetic Signatures Associated With Sporadic Amyotrophic Lateral Sclerosis. Front Genet 2022; 13:851496. [PMID: 35401706 PMCID: PMC8986983 DOI: 10.3389/fgene.2022.851496] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2022] [Accepted: 02/14/2022] [Indexed: 12/11/2022] Open
Abstract
Amyotrophic Lateral Sclerosis (ALS) is a complex polygenetic neurodegenerative disorder. Establishing a diagnosis for ALS is a challenging and lengthy process. By the time a diagnosis is made, the lifespan prognosis is only about two to 5 years. Genetic testing can be critical in assessing a patient’s risk for ALS, provided they have one of the known familial genes. However, the vast majority of ALS cases are sporadic and have no known associated genetic signatures. Our analysis of the whole genome sequencing data from ALS patients and healthy controls from the Answer ALS Consortium has uncovered twenty-three novel mutations in twenty-two protein-coding genes associated with sporadic ALS cases. The results show the majority of patients with the sporadic form of ALS have at least one or more mutation(s) in the 22 genes we have identified with probabilities of developing ALS ranging from 25–99%, depending on the number of mutations a patient has among the identified genes. Moreover, we have identified a subset of the ALS cohort that has >17 mutations in the 22 identified. In this case, a patient with this mutation profile has a 99% chance of developing ALS and could be classified as being at high risk for the disease. These genetic biomarkers can be used as an early ALS disease diagnostic tool with a rapid and non-invasive technique.
Collapse
Affiliation(s)
- Robert Logan
- Pluripotent Diagnostics Corp, Colorado Springs, CO, United States
- Department of Biology, Eastern Nazarene College, Quincy, MA, United States
| | | | | | - Sean J. Miller
- Pluripotent Diagnostics Corp, Colorado Springs, CO, United States
- *Correspondence: Sean J. Miller,
| |
Collapse
|
47
|
Lu P, Hu L, Zhang N, Liang H, Tian T, Lu L. A Two-Stage Model for Predicting Mild Cognitive Impairment to Alzheimer's Disease Conversion. Front Aging Neurosci 2022; 14:826622. [PMID: 35386114 PMCID: PMC8979209 DOI: 10.3389/fnagi.2022.826622] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Accepted: 02/17/2022] [Indexed: 12/21/2022] Open
Abstract
Early detection of Alzheimer's disease (AD), such as predicting development from mild cognitive impairment (MCI) to AD, is critical for slowing disease progression and increasing quality of life. Although deep learning is a promising technique for structural MRI-based diagnosis, the paucity of training samples limits its power, especially for three-dimensional (3D) models. To this end, we propose a two-stage model combining both transfer learning and contrastive learning that can achieve high accuracy of MRI-based early AD diagnosis even when the sample numbers are restricted. Specifically, a 3D CNN model was pretrained using publicly available medical image data to learn common medical features, and contrastive learning was further utilized to learn more specific features of MCI images. The two-stage model outperformed each benchmark method. Compared with the previous studies, we show that our model achieves superior performance in progressive MCI patients with an accuracy of 0.82 and AUC of 0.84. We further enhance the interpretability of the model by using 3D Grad-CAM, which highlights brain regions with high-predictive weights. Brain regions, including the hippocampus, temporal, and precuneus, are associated with the classification of MCI, which is supported by the various types of literature. Our model provides a novel model to avoid overfitting because of a lack of medical data and enable the early detection of AD.
Collapse
Affiliation(s)
- Peixin Lu
- School of Information Management, Wuhan University, Wuhan, China
| | - Lianting Hu
- Medical Big Data Center, Guangdong Provincial People’s Hospital, Guangzhou, China
- Guangdong Cardiovascular Institute, Guangdong Provincial People’s Hospital, Guangzhou, China
| | - Ning Zhang
- School of Business, Qingdao University, Qingdao, China
| | - Huiying Liang
- Medical Big Data Center, Guangdong Provincial People’s Hospital, Guangzhou, China
- Guangdong Cardiovascular Institute, Guangdong Provincial People’s Hospital, Guangzhou, China
| | - Tao Tian
- The First Division of Psychiatry, Jingmen No. 2 People’s Hospital, Jingmen, China
| | - Long Lu
- School of Information Management, Wuhan University, Wuhan, China
| |
Collapse
|
48
|
Abstract
Deep Neural Networks have offered numerous innovative solutions to brain-related diseases including Alzheimer’s. However, there are still a few standpoints in terms of diagnosis and planning that can be transformed via quantum Machine Learning (QML). In this study, we present a hybrid classical–quantum machine learning model for the detection of Alzheimer’s using 6400 labeled MRI scans with two classes. Hybrid classical–quantum transfer learning is used, which makes it possible to optimally pre-process complex and high-dimensional data. Classical neural networks extract high-dimensional features and embed informative feature vectors into a quantum processor. We use resnet34 to extract features from the image and feed a 512-feature vector to our quantum variational circuit (QVC) to generate a four-feature vector for precise decision boundaries. Adam optimizer is used to exploit the adaptive learning rate corresponding to each parameter based on first- and second-order gradients. Furthermore, to validate the model, different quantum simulators (PennyLane, qiskit.aer and qiskit.basicaer) are used for the detection of the demented and non-demented images. The learning rate is set to 10−4 for and optimized quantum depth of six layers, resulting in a training accuracy of 99.1% and a classification accuracy of 97.2% for 20 epochs. The hybrid classical–quantum network significantly outperformed the classical network, as the classification accuracy achieved by the classical transfer learning model was 92%. Thus, a hybrid transfer-learning model is used for binary detection, in which a quantum circuit improves the performance of a pre-trained ResNet34 architecture. Therefore, this work offers a method for selecting an optimal approach for detecting Alzheimer’s disease. The proposed model not only allows for the automated detection of Alzheimer’s but would also speed up the process significantly in clinical settings.
Collapse
|
49
|
Li R, Wang X, Lawler K, Garg S, Bai Q, Alty J. Applications of Artificial Intelligence to aid detection of dementia: a scoping review on current capabilities and future directions. J Biomed Inform 2022; 127:104030. [DOI: 10.1016/j.jbi.2022.104030] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Revised: 01/21/2022] [Accepted: 02/12/2022] [Indexed: 12/17/2022]
|
50
|
Bento M, Fantini I, Park J, Rittner L, Frayne R. Deep Learning in Large and Multi-Site Structural Brain MR Imaging Datasets. Front Neuroinform 2022; 15:805669. [PMID: 35126080 PMCID: PMC8811356 DOI: 10.3389/fninf.2021.805669] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2021] [Accepted: 12/27/2021] [Indexed: 12/22/2022] Open
Abstract
Large, multi-site, heterogeneous brain imaging datasets are increasingly required for the training, validation, and testing of advanced deep learning (DL)-based automated tools, including structural magnetic resonance (MR) image-based diagnostic and treatment monitoring approaches. When assembling a number of smaller datasets to form a larger dataset, understanding the underlying variability between different acquisition and processing protocols across the aggregated dataset (termed “batch effects”) is critical. The presence of variation in the training dataset is important as it more closely reflects the true underlying data distribution and, thus, may enhance the overall generalizability of the tool. However, the impact of batch effects must be carefully evaluated in order to avoid undesirable effects that, for example, may reduce performance measures. Batch effects can result from many sources, including differences in acquisition equipment, imaging technique and parameters, as well as applied processing methodologies. Their impact, both beneficial and adversarial, must be considered when developing tools to ensure that their outputs are related to the proposed clinical or research question (i.e., actual disease-related or pathological changes) and are not simply due to the peculiarities of underlying batch effects in the aggregated dataset. We reviewed applications of DL in structural brain MR imaging that aggregated images from neuroimaging datasets, typically acquired at multiple sites. We examined datasets containing both healthy control participants and patients that were acquired using varying acquisition protocols. First, we discussed issues around Data Access and enumerated the key characteristics of some commonly used publicly available brain datasets. Then we reviewed methods for correcting batch effects by exploring the two main classes of approaches: Data Harmonization that uses data standardization, quality control protocols or other similar algorithms and procedures to explicitly understand and minimize unwanted batch effects; and Domain Adaptation that develops DL tools that implicitly handle the batch effects by using approaches to achieve reliable and robust results. In this narrative review, we highlighted the advantages and disadvantages of both classes of DL approaches, and described key challenges to be addressed in future studies.
Collapse
Affiliation(s)
- Mariana Bento
- Electrical and Software Engineering, Schulich School of Engineering, University of Calgary, Calgary, AB, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
- Calgary Image Processing and Analysis Centre, Foothills Medical Centre, Calgary, AB, Canada
- *Correspondence: Mariana Bento
| | - Irene Fantini
- School of Electrical and Computer Engineering, University of Campinas, Campinas, Brazil
| | - Justin Park
- Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
- Calgary Image Processing and Analysis Centre, Foothills Medical Centre, Calgary, AB, Canada
- Radiology and Clinical Neurosciences, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
| | - Leticia Rittner
- School of Electrical and Computer Engineering, University of Campinas, Campinas, Brazil
| | - Richard Frayne
- Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
- Calgary Image Processing and Analysis Centre, Foothills Medical Centre, Calgary, AB, Canada
- Radiology and Clinical Neurosciences, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
- Seaman Family MR Research Centre, Foothills Medical Centre, Calgary, AB, Canada
| |
Collapse
|