1
|
Li C, Gao Z, Chen X, Zheng X, Zhang X, Lin CY. Ensemble network using oblique coronal MRI for Alzheimer's disease diagnosis. Neuroimage 2025; 310:121151. [PMID: 40147601 DOI: 10.1016/j.neuroimage.2025.121151] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2024] [Revised: 03/13/2025] [Accepted: 03/14/2025] [Indexed: 03/29/2025] Open
Abstract
Alzheimer's disease (AD) is a primary degenerative brain disorder commonly found in the elderly, Mild cognitive impairment (MCI) can be considered a transitional stage from normal aging to Alzheimer's disease. Therefore, distinguishing between normal aging and disease-induced neurofunctional impairments is crucial in clinical treatment. Although deep learning methods have been widely applied in Alzheimer's diagnosis, the varying data formats used by different methods limited their clinical applicability. In this study, based on the ADNI dataset and previous clinical diagnostic experience, we propose a method using oblique coronal MRI to assist in diagnosis. We developed an algorithm to extract oblique coronal slices from 3D MRI data and used these slices to train classification networks. To achieve subject-wise classification based on 2D slices, rather than image-wise classification, we employed ensemble learning methods. This approach fused classification results from different modality images or different positions of the same modality images, constructing a more reliable ensemble classification model. The experiments introduced various decision fusion and feature fusion schemes, demonstrating the potential of oblique coronal MRI slices in assisting diagnosis. Notably, the weighted voting from decision fusion strategy trained on oblique coronal slices achieved accuracy rates of 97.5% for CN vs. AD, 100% for CN vs. MCI, and 94.83% for MCI vs. AD across the three classification tasks.
Collapse
Affiliation(s)
- Cunhao Li
- Key Laboratory of Optoelectronic Science and Technology for Medicine, Ministry of Education, Fujian Provincial Key Laboratory of Photonics Technology, Fujian Provincial Engineering Technology Research Center of Photoelectric Sensing Application, College of Photonic and Electronic Engineering, Fujian Normal University, Fuzhou, China
| | - Zhongjian Gao
- School of mechanical and electrical engineering, Sanming University, Sanming, China
| | - Xiaomei Chen
- Department of Ophthalmology, Fujian Provincial Hospital North Branch, Fujian Provincial Geriatric Hospital, Fuzhou, China
| | - Xuqiang Zheng
- Department of Medical Imaging, Fujian Provincial Hospital North Branch, Fujian Provincial Geriatric Hospital, Fuzhou, China
| | - Xiaoman Zhang
- Key Laboratory of Optoelectronic Science and Technology for Medicine, Ministry of Education, Fujian Provincial Key Laboratory of Photonics Technology, Fujian Provincial Engineering Technology Research Center of Photoelectric Sensing Application, College of Photonic and Electronic Engineering, Fujian Normal University, Fuzhou, China.
| | - Chih-Yang Lin
- Department of Mechanical Engineering, National Central University, Taoyuan, Taiwan.
| |
Collapse
|
2
|
Dominguez-Gortaire J, Ruiz A, Porto-Pazos AB, Rodriguez-Yanez S, Cedron F. Alzheimer's Disease: Exploring Pathophysiological Hypotheses and the Role of Machine Learning in Drug Discovery. Int J Mol Sci 2025; 26:1004. [PMID: 39940772 PMCID: PMC11816687 DOI: 10.3390/ijms26031004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2024] [Revised: 01/19/2025] [Accepted: 01/21/2025] [Indexed: 02/16/2025] Open
Abstract
Alzheimer's disease (AD) is a major neurodegenerative dementia, with its complex pathophysiology challenging current treatments. Recent advancements have shifted the focus from the traditionally dominant amyloid hypothesis toward a multifactorial understanding of the disease. Emerging evidence suggests that while amyloid-beta (Aβ) accumulation is central to AD, it may not be the primary driver but rather part of a broader pathogenic process. Novel hypotheses have been proposed, including the role of tau protein abnormalities, mitochondrial dysfunction, and chronic neuroinflammation. Additionally, the gut-brain axis and epigenetic modifications have gained attention as potential contributors to AD progression. The limitations of existing therapies underscore the need for innovative strategies. This study explores the integration of machine learning (ML) in drug discovery to accelerate the identification of novel targets and drug candidates. ML offers the ability to navigate AD's complexity, enabling rapid analysis of extensive datasets and optimizing clinical trial design. The synergy between these themes presents a promising future for more effective AD treatments.
Collapse
Affiliation(s)
- Jose Dominguez-Gortaire
- Department of Computer Science and Information Technologies, Faculty of Computer Science, Universidade da Coruña, 15071 A Coruña, Spain; (J.D.-G.)
- Faculty of Biological Sciences, Universidad Central del Ecuador, Quito 170136, Ecuador
- Faculty of Odontology, UTE University, Quito 170902, Ecuador
| | - Alejandra Ruiz
- Faculty of Medical Sciences, Universidad Central del Ecuador, Quito 170136, Ecuador
| | - Ana Belen Porto-Pazos
- Department of Computer Science and Information Technologies, Faculty of Computer Science, Universidade da Coruña, 15071 A Coruña, Spain; (J.D.-G.)
- CITIC—Research Center of Information and Communication Technologies, Universidade da Coruña, 15008 A Coruña, Spain
| | - Santiago Rodriguez-Yanez
- Department of Computer Science and Information Technologies, Faculty of Computer Science, Universidade da Coruña, 15071 A Coruña, Spain; (J.D.-G.)
- CITEEC—Center for Technological Innovation in Construction and Civil Engineering, Universidade da Coruña, 15008 A Coruña, Spain
| | - Francisco Cedron
- Department of Computer Science and Information Technologies, Faculty of Computer Science, Universidade da Coruña, 15071 A Coruña, Spain; (J.D.-G.)
- CITIC—Research Center of Information and Communication Technologies, Universidade da Coruña, 15008 A Coruña, Spain
| |
Collapse
|
3
|
Shen G, Ye F, Cheng W, Li Q. A modified deep learning method for Alzheimer's disease detection based on the facial submicroscopic features in mice. Biomed Eng Online 2024; 23:109. [PMID: 39482695 PMCID: PMC11526719 DOI: 10.1186/s12938-024-01305-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2024] [Accepted: 10/25/2024] [Indexed: 11/03/2024] Open
Abstract
Alzheimer's disease (AD) is a chronic disease among people aged 65 and older. As the aging population continues to grow at a rapid pace, AD has emerged as a pressing public health issue globally. Early detection of the disease is important, because increasing evidence has illustrated that early diagnosis holds the key to effective treatment of AD. In this work, we developed and refined a multi-layer cyclic Residual convolutional neural network model, specifically tailored to identify AD-related submicroscopic characteristics in the facial images of mice. Our experiments involved classifying the mice into two distinct groups: a normal control group and an AD group. Compared with the other deep learning models, the proposed model achieved a better detection performance in the dataset of the mouse experiment. The accuracy, sensitivity, specificity and precision for AD identification with our proposed model were as high as 99.78%, 100%, 99.65% and 99.44%, respectively. Moreover, the heat maps of AD correlation in the facial images of the mice were acquired with the class activation mapping algorithm. It was proven that the facial images contained AD-related submicroscopic features. Consequently, through our mouse experiments, we validated the feasibility and accuracy of utilizing a facial image-based deep learning model for AD identification. Therefore, the present study suggests the potential of using facial images for AD detection in humans through deep learning-based methods.
Collapse
Affiliation(s)
- Guosheng Shen
- Institute of Modern Physics, Chinese Academy of Sciences, 509 Nanchang Road, Lanzhou, 730000, Gansu Province, China
- Key Laboratory of Basic Research On Heavy Ion Radiation Application in Medicine, Lanzhou, 730000, Gansu Province, China
- Key Laboratory of Heavy Ion Radiation Biology and Medicine of Chinese Academy of Sciences, Lanzhou, 730000, China
- University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Fei Ye
- Institute of Modern Physics, Chinese Academy of Sciences, 509 Nanchang Road, Lanzhou, 730000, Gansu Province, China
- Key Laboratory of Basic Research On Heavy Ion Radiation Application in Medicine, Lanzhou, 730000, Gansu Province, China
- Key Laboratory of Heavy Ion Radiation Biology and Medicine of Chinese Academy of Sciences, Lanzhou, 730000, China
- University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Wei Cheng
- Institute of Modern Physics, Chinese Academy of Sciences, 509 Nanchang Road, Lanzhou, 730000, Gansu Province, China
- Key Laboratory of Basic Research On Heavy Ion Radiation Application in Medicine, Lanzhou, 730000, Gansu Province, China
- Key Laboratory of Heavy Ion Radiation Biology and Medicine of Chinese Academy of Sciences, Lanzhou, 730000, China
- University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Qiang Li
- Institute of Modern Physics, Chinese Academy of Sciences, 509 Nanchang Road, Lanzhou, 730000, Gansu Province, China.
- Key Laboratory of Basic Research On Heavy Ion Radiation Application in Medicine, Lanzhou, 730000, Gansu Province, China.
- Key Laboratory of Heavy Ion Radiation Biology and Medicine of Chinese Academy of Sciences, Lanzhou, 730000, China.
- University of Chinese Academy of Sciences, Beijing, 100049, China.
| |
Collapse
|
4
|
Kiran A, Alsaadi M, Dutta AK, Raparthi M, Soni M, Alsubai S, Byeon H, Kulkarni MH, Asenso E. Bio-inspired deep learning-personalized ensemble Alzheimer's diagnosis model for mental well-being. SLAS Technol 2024; 29:100161. [PMID: 38901762 DOI: 10.1016/j.slast.2024.100161] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2024] [Revised: 05/18/2024] [Accepted: 06/18/2024] [Indexed: 06/22/2024]
Abstract
Most classification models for Alzheimer's Diagnosis (AD) do not have specific strategies for individual input samples, leading to the problem of easily overlooking personalized differences between samples. This research introduces a customized dynamically ensemble convolution neural network (PDECNN), which is able to build a specific integration strategy based on the distinctiveness of the sample. In this paper, we propose a personalized dynamic ensemble alzheimer's Diagnosis classification model. This model will dynamically modify the deteriorated brain areas of interest depending on various samples since it can adjust to variations in the degeneration of sample brain areas. In clinical problems, the PDECNN model has additional diagnostic importance since it can identify sample-specific degraded brain areas based on input samples. This model considers the variability of brain region degeneration levels between input samples, evaluates the degree of degeneration of specific brain regions using an attention mechanism, and selects and integrates brain region features based on the degree of degeneration. Furthermore, by redesigning the classification accuracy performance, we respectively improve it by 4 %, 11 %, and 8 %. Moreover, the degraded brain regions identified by the model show high consistency with the clinical manifestations of AD.
Collapse
Affiliation(s)
- Ajmeera Kiran
- Dept. of Computer Science and Engineering, MLR Institute of Technology, Dundigal, Hyderabad, Telangana, 500043, India
| | - Mahmood Alsaadi
- Department of computer science, Al-Maarif University College, Al Anbar, 31001, Iraq
| | - Ashit Kumar Dutta
- Department of Computer Science and Information Systems, College of Applied Sciences, AlMaarefa University, Ad Diriyah, Riyadh, 13713, Kingdom of Saudi Arabia
| | - Mohan Raparthi
- Software Engineer, alphabet Life Science, Dallas Texas, 75063, US
| | - Mukesh Soni
- Department of CSE, University Centre for Research & Development, Chandigarh University, Mohali, Punjab 140413, India
| | - Shtwai Alsubai
- Department of Computer Science, College of Computer Engineering and Sciences in Al-Kharj, Prince Sattam bin Abdulaziz University, P.O. Box 151, Al-Kharj 11942, Saudi Arabia
| | - Haewon Byeon
- Department of AI and Software, Inje University, Gimhae 50834, Republic of Korea
| | | | - Evans Asenso
- Department of Agricultural Engineering, School of Engineering Sciences, University of Ghana, Accra, Ghana.
| |
Collapse
|
5
|
Ganesan P, Ramesh GP, Falkowski-Gilski P, Falkowska-Gilska B. Detection of Alzheimer's disease using Otsu thresholding with tunicate swarm algorithm and deep belief network. Front Physiol 2024; 15:1380459. [PMID: 39045216 PMCID: PMC11263168 DOI: 10.3389/fphys.2024.1380459] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2024] [Accepted: 06/10/2024] [Indexed: 07/25/2024] Open
Abstract
Introduction: Alzheimer's Disease (AD) is a degenerative brain disorder characterized by cognitive and memory dysfunctions. The early detection of AD is necessary to reduce the mortality rate through slowing down its progression. The prevention and detection of AD is the emerging research topic for many researchers. The structural Magnetic Resonance Imaging (sMRI) is an extensively used imaging technique in detection of AD, because it efficiently reflects the brain variations. Methods: Machine learning and deep learning models are widely applied on sMRI images for AD detection to accelerate the diagnosis process and to assist clinicians for timely treatment. In this article, an effective automated framework is implemented for early detection of AD. At first, the Region of Interest (RoI) is segmented from the acquired sMRI images by employing Otsu thresholding method with Tunicate Swarm Algorithm (TSA). The TSA finds the optimal segmentation threshold value for Otsu thresholding method. Then, the vectors are extracted from the RoI by applying Local Binary Pattern (LBP) and Local Directional Pattern variance (LDPv) descriptors. At last, the extracted vectors are passed to Deep Belief Networks (DBN) for image classification. Results and Discussion: The proposed framework achieves supreme classification accuracy of 99.80% and 99.92% on the Alzheimer's Disease Neuroimaging Initiative (ADNI) and Australian Imaging, Biomarker and Lifestyle flagship work of ageing (AIBL) datasets, which is higher than the conventional detection models.
Collapse
Affiliation(s)
- Praveena Ganesan
- Department of Electronics and Communication Engineering, St. Peter’s Institute of Higher Education and Research, Chennai, India
| | - G. P. Ramesh
- Department of Electronics and Communication Engineering, St. Peter’s Institute of Higher Education and Research, Chennai, India
| | | | | |
Collapse
|
6
|
Gu Z, He X, Yu P, Jia W, Yang X, Peng G, Hu P, Chen S, Chen H, Lin Y. Automatic quantitative stroke severity assessment based on Chinese clinical named entity recognition with domain-adaptive pre-trained large language model. Artif Intell Med 2024; 150:102822. [PMID: 38553162 DOI: 10.1016/j.artmed.2024.102822] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Revised: 01/28/2024] [Accepted: 02/21/2024] [Indexed: 04/02/2024]
Abstract
BACKGROUND Stroke is a prevalent disease with a significant global impact. Effective assessment of stroke severity is vital for an accurate diagnosis, appropriate treatment, and optimal clinical outcomes. The National Institutes of Health Stroke Scale (NIHSS) is a widely used scale for quantitatively assessing stroke severity. However, the current manual scoring of NIHSS is labor-intensive, time-consuming, and sometimes unreliable. Applying artificial intelligence (AI) techniques to automate the quantitative assessment of stroke on vast amounts of electronic health records (EHRs) has attracted much interest. OBJECTIVE This study aims to develop an automatic, quantitative stroke severity assessment framework through automating the entire NIHSS scoring process on Chinese clinical EHRs. METHODS Our approach consists of two major parts: Chinese clinical named entity recognition (CNER) with a domain-adaptive pre-trained large language model (LLM) and automated NIHSS scoring. To build a high-performing CNER model, we first construct a stroke-specific, densely annotated dataset "Chinese Stroke Clinical Records" (CSCR) from EHRs provided by our partner hospital, based on a stroke ontology that defines semantically related entities for stroke assessment. We then pre-train a Chinese clinical LLM coined "CliRoberta" through domain-adaptive transfer learning and construct a deep learning-based CNER model that can accurately extract entities directly from Chinese EHRs. Finally, an automated, end-to-end NIHSS scoring pipeline is proposed by mapping the extracted entities to relevant NIHSS items and values, to quantitatively assess the stroke severity. RESULTS Results obtained on a benchmark dataset CCKS2019 and our newly created CSCR dataset demonstrate the superior performance of our domain-adaptive pre-trained LLM and the CNER model, compared with the existing benchmark LLMs and CNER models. The high F1 score of 0.990 ensures the reliability of our model in accurately extracting the entities for the subsequent automatic NIHSS scoring. Subsequently, our automated, end-to-end NIHSS scoring approach achieved excellent inter-rater agreement (0.823) and intraclass consistency (0.986) with the ground truth and significantly reduced the processing time from minutes to a few seconds. CONCLUSION Our proposed automatic and quantitative framework for assessing stroke severity demonstrates exceptional performance and reliability through directly scoring the NIHSS from diagnostic notes in Chinese clinical EHRs. Moreover, this study also contributes a new clinical dataset, a pre-trained clinical LLM, and an effective deep learning-based CNER model. The deployment of these advanced algorithms can improve the accuracy and efficiency of clinical assessment, and help improve the quality, affordability and productivity of healthcare services.
Collapse
Affiliation(s)
- Zhanzhong Gu
- School of Electrical and Data Engineering, University of Technology Sydney, NSW, 2007, Australia.
| | - Xiangjian He
- School of Electrical and Data Engineering, University of Technology Sydney, NSW, 2007, Australia; School of Computer Science, University of Nottingham Ningbo China, Ningbo, China
| | - Ping Yu
- School of Computing and Information Technology, University of Wollongong, NSW, 2522, Australia
| | - Wenjing Jia
- School of Electrical and Data Engineering, University of Technology Sydney, NSW, 2007, Australia
| | - Xiguang Yang
- School of Electrical and Data Engineering, University of Technology Sydney, NSW, 2007, Australia
| | - Gang Peng
- Intergenepharm Pty Ltd, Sydney, NSW, 2000, Australia
| | - Penghui Hu
- Department of Oncology, The First Affiliated Hospital of Jinan University, Guangzhou, China
| | - Shiyan Chen
- Department of Neurology, The First Affiliated Hospital of Fujian Medical University, Fuzhou, China
| | - Hongjie Chen
- Department of Traditional Chinese Medicine, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Yiguang Lin
- Department of Traditional Chinese Medicine, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China; Department of Immuno-Oncology, The First Affiliated Hospital of Guangdong Pharmaceutical University, China; School of Life Sciences, University of Technology Sydney, NSW, 2007, Australia
| |
Collapse
|
7
|
Gravina M, García-Pedrero A, Gonzalo-Martín C, Sansone C, Soda P. Multi input-Multi output 3D CNN for dementia severity assessment with incomplete multimodal data. Artif Intell Med 2024; 149:102774. [PMID: 38462278 DOI: 10.1016/j.artmed.2024.102774] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Revised: 12/08/2023] [Accepted: 01/14/2024] [Indexed: 03/12/2024]
Abstract
Alzheimer's Disease is the most common cause of dementia, whose progression spans in different stages, from very mild cognitive impairment to mild and severe conditions. In clinical trials, Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) are mostly used for the early diagnosis of neurodegenerative disorders since they provide volumetric and metabolic function information of the brain, respectively. In recent years, Deep Learning (DL) has been employed in medical imaging with promising results. Moreover, the use of the deep neural networks, especially Convolutional Neural Networks (CNNs), has also enabled the development of DL-based solutions in domains characterized by the need of leveraging information coming from multiple data sources, raising the Multimodal Deep Learning (MDL). In this paper, we conduct a systematic analysis of MDL approaches for dementia severity assessment exploiting MRI and PET scans. We propose a Multi Input-Multi Output 3D CNN whose training iterations change according to the characteristic of the input as it is able to handle incomplete acquisitions, in which one image modality is missed. Experiments performed on OASIS-3 dataset show the satisfactory results of the implemented network, which outperforms approaches exploiting both single image modality and different MDL fusion techniques.
Collapse
Affiliation(s)
- Michela Gravina
- Department of Electrical Engineering and Information Technology, University of Naples Federico II, Napoli, 80125, Italy
| | - Angel García-Pedrero
- Department of Computer Architecture and Technology, Universidad Politécnica de Madrid, Boadilla del Monte, 28660, Madrid, Spain; Center for Biomedical Technology, Campus de Montegancedo, Universidad Politécnica de Madrid, Pozuelo de Alarcón, 28233, Madrid, Spain
| | - Consuelo Gonzalo-Martín
- Department of Computer Architecture and Technology, Universidad Politécnica de Madrid, Boadilla del Monte, 28660, Madrid, Spain; Center for Biomedical Technology, Campus de Montegancedo, Universidad Politécnica de Madrid, Pozuelo de Alarcón, 28233, Madrid, Spain.
| | - Carlo Sansone
- Department of Electrical Engineering and Information Technology, University of Naples Federico II, Napoli, 80125, Italy
| | - Paolo Soda
- Department of Engineering, Unit of Computer Systems and Bioinformatics, University of Rome Campus Bio-Medico, Roma, 00128, Italy; Department of Diagnostics and Intervention, Radiation Physics, Biomedical Engineering, Umeå University, 90187, Umeå, Sweden
| |
Collapse
|
8
|
El-Assy AM, Amer HM, Ibrahim HM, Mohamed MA. A novel CNN architecture for accurate early detection and classification of Alzheimer's disease using MRI data. Sci Rep 2024; 14:3463. [PMID: 38342924 PMCID: PMC10859371 DOI: 10.1038/s41598-024-53733-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 02/04/2024] [Indexed: 02/13/2024] Open
Abstract
Alzheimer's disease (AD) is a debilitating neurodegenerative disorder that requires accurate diagnosis for effective management and treatment. In this article, we propose an architecture for a convolutional neural network (CNN) that utilizes magnetic resonance imaging (MRI) data from the Alzheimer's disease Neuroimaging Initiative (ADNI) dataset to categorize AD. The network employs two separate CNN models, each with distinct filter sizes and pooling layers, which are concatenated in a classification layer. The multi-class problem is addressed across three, four, and five categories. The proposed CNN architecture achieves exceptional accuracies of 99.43%, 99.57%, and 99.13%, respectively. These high accuracies demonstrate the efficacy of the network in capturing and discerning relevant features from MRI images, enabling precise classification of AD subtypes and stages. The network architecture leverages the hierarchical nature of convolutional layers, pooling layers, and fully connected layers to extract both local and global patterns from the data, facilitating accurate discrimination between different AD categories. Accurate classification of AD carries significant clinical implications, including early detection, personalized treatment planning, disease monitoring, and prognostic assessment. The reported accuracy underscores the potential of the proposed CNN architecture to assist medical professionals and researchers in making precise and informed judgments regarding AD patients.
Collapse
Affiliation(s)
- A M El-Assy
- Electronics and Communications Engineering Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt.
| | - Hanan M Amer
- Electronics and Communications Engineering Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| | - H M Ibrahim
- Communication and Electronics Engineering Department, Nile Higher Institute for Engineering and Technology-IEEE Com Society Member, Mansoura, Egypt
| | - M A Mohamed
- Electronics and Communications Engineering Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| |
Collapse
|
9
|
Khan AA, Mahendran RK, Perumal K, Faheem M. Dual-3DM 3AD: Mixed Transformer Based Semantic Segmentation and Triplet Pre-Processing for Early Multi-Class Alzheimer's Diagnosis. IEEE Trans Neural Syst Rehabil Eng 2024; 32:696-707. [PMID: 38261494 DOI: 10.1109/tnsre.2024.3357723] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2024]
Abstract
Alzheimer's Disease (AD) is a widespread, chronic, irreversible, and degenerative condition, and its early detection during the prodromal stage is of utmost importance. Typically, AD studies rely on single data modalities, such as MRI or PET, for making predictions. Nevertheless, combining metabolic and structural data can offer a comprehensive perspective on AD staging analysis. To address this goal, this paper introduces an innovative multi-modal fusion-based approach named as Dual-3DM3-AD. This model is proposed for an accurate and early Alzheimer's diagnosis by considering both MRI and PET image scans. Initially, we pre-process both images in terms of noise reduction, skull stripping and 3D image conversion using Quaternion Non-local Means Denoising Algorithm (QNLM), Morphology function and Block Divider Model (BDM), respectively, which enhances the image quality. Furthermore, we have adapted Mixed-transformer with Furthered U-Net for performing semantic segmentation and minimizing complexity. Dual-3DM3-AD model is consisted of multi-scale feature extraction module for extracting appropriate features from both segmented images. The extracted features are then aggregated using Densely Connected Feature Aggregator Module (DCFAM) to utilize both features. Finally, a multi-head attention mechanism is adapted for feature dimensionality reduction, and then the softmax layer is applied for multi-class Alzheimer's diagnosis. The proposed Dual-3DM3-AD model is compared with several baseline approaches with the help of several performance metrics. The final results unveil that the proposed work achieves 98% of accuracy, 97.8% of sensitivity, 97.5% of specificity, 98.2% of f-measure, and better ROC curves, which outperforms other existing models in multi-class Alzheimer's diagnosis.
Collapse
|
10
|
Munshi RM. Novel ensemble learning approach with SVM-imputed ADASYN features for enhanced cervical cancer prediction. PLoS One 2024; 19:e0296107. [PMID: 38198475 PMCID: PMC10781159 DOI: 10.1371/journal.pone.0296107] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2023] [Accepted: 12/06/2023] [Indexed: 01/12/2024] Open
Abstract
Cervical cancer remains a leading cause of female mortality, particularly in developing regions, underscoring the critical need for early detection and intervention guided by skilled medical professionals. While Pap smear images serve as valuable diagnostic tools, many available datasets for automated cervical cancer detection contain missing data, posing challenges for machine learning models' efficacy. To address these hurdles, this study presents an automated system adept at managing missing information using ADASYN characteristics, resulting in exceptional accuracy. The proposed methodology integrates a voting classifier model harnessing the predictive capacity of three distinct machine learning models. It further incorporates SVM Imputer and ADASYN up-sampled features to mitigate missing value concerns, while leveraging CNN-generated features to augment the model's capabilities. Notably, this model achieves remarkable performance metrics, boasting a 99.99% accuracy, precision, recall, and F1 score. A comprehensive comparative analysis evaluates the proposed model against various machine learning algorithms across four scenarios: original dataset usage, SVM imputation, ADASYN feature utilization, and CNN-generated features. Results indicate the superior efficacy of the proposed model over existing state-of-the-art techniques. This research not only introduces a novel approach but also offers actionable suggestions for refining automated cervical cancer detection systems. Its impact extends to benefiting medical practitioners by enabling earlier detection and improved patient care. Furthermore, the study's findings have substantial societal implications, potentially reducing the burden of cervical cancer through enhanced diagnostic accuracy and timely intervention.
Collapse
Affiliation(s)
- Raafat M. Munshi
- Department of Medical Laboratory Technology (MLT), Faculty of Applied Medical Sciences, King Abdulaziz University, Rabigh, Saudi Arabia
| |
Collapse
|
11
|
Zhang L, Wang L, Liu T, Zhu D. Disease2Vec: Encoding Alzheimer's progression via disease embedding tree. Pharmacol Res 2024; 199:107038. [PMID: 38072216 PMCID: PMC11334056 DOI: 10.1016/j.phrs.2023.107038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/22/2023] [Revised: 11/06/2023] [Accepted: 12/07/2023] [Indexed: 12/17/2023]
Abstract
For decades, a variety of predictive approaches have been proposed and evaluated in terms of their prediction capability for Alzheimer's Disease (AD) and its precursor - mild cognitive impairment (MCI). Most of them focused on prediction or identification of statistical differences among different clinical groups or phases, especially in the context of binary or multi-class classification. The continuous nature of AD development and transition states between successive AD related stages have been typically overlooked. Though a few progression models of AD have been studied recently, they were mainly designed to determine and compare the order of specific biomarkers. How to effectively predict the individual patient's status within a wide spectrum of continuous AD progression has been largely understudied. In this work, we developed a novel learning-based embedding framework to encode the intrinsic relations among AD related clinical stages by a set of meaningful embedding vectors in the latent space (Disease2Vec). We named this process as disease embedding. By Disease2Vec, our framework generates a disease embedding tree (DETree) which effectively represents different clinical stages as a tree trajectory reflecting AD progression and thus can be used to predict clinical status by projecting individuals onto this continuous trajectory. Through this model, DETree can not only perform efficient and accurate prediction for patients at any stages of AD development (across five fine-grained clinical groups instead of typical two groups), but also provide richer status information by examining the projecting locations within a wide and continuous AD progression process. (Code will be available: https://github.com/qidianzl/Disease2Vec.).
Collapse
Affiliation(s)
- Lu Zhang
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX, USA
| | - Li Wang
- Department of Mathematics, The University of Texas at Arlington, Arlington, TX, USA
| | - Tianming Liu
- Department of Computer Science, The University of Georgia, Athens, GA, USA
| | - Dajiang Zhu
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX, USA.
| |
Collapse
|
12
|
Rana MM, Islam MM, Talukder MA, Uddin MA, Aryal S, Alotaibi N, Alyami SA, Hasan KF, Moni MA. A robust and clinically applicable deep learning model for early detection of Alzheimer's. IET IMAGE PROCESSING 2023; 17:3959-3975. [DOI: 10.1049/ipr2.12910] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Accepted: 08/06/2023] [Indexed: 12/30/2024]
Abstract
AbstractAlzheimer's disease, often known as dementia, is a severe neurodegenerative disorder that causes irreversible memory loss by destroying brain cells. People die because there is no specific treatment for this disease. Alzheimer's is most common among seniors 65 years and older. However, the progress of this disease can be reduced if it can be diagnosed earlier. Recently, artificial intelligence has instilled hope in the diagnosis of Alzheimer's disease by performing sophisticated analyses on extensive patient datasets, enabling the identification of subtle patterns that may elude human experts. Researchers have investigated various deep learning and machine learning models to diagnose this disease at an early stage using image datasets. In this paper, a new Deep learning (DL) methodology is proposed, where MRI images are fed into the model after applying various pre‐processing techniques. The proposed Alzheimer's disease detection approach adopts transfer learning for multi‐class classification using brain MRIs. The MRI Images are classified into four categories: mild dementia (MD), moderate dementia (MOD), very mild dementia (VMD), and non‐dementia (ND). The model is implemented and extensive performance analysis is performed. The finding shows that the model obtains 97.31% accuracy. The model outperforms the state‐of‐the‐art models in terms of accuracy, precision, recall, and F‐score.
Collapse
Affiliation(s)
- Md Masud Rana
- Department of Computer Science and Engineering Jagannath University Dhaka Bangladesh
| | - Md Manowarul Islam
- Department of Computer Science and Engineering Jagannath University Dhaka Bangladesh
| | - Md. Alamin Talukder
- Department of Computer Science and Engineering Jagannath University Dhaka Bangladesh
| | - Md Ashraf Uddin
- School of Information Technology Deakin University Geelong Waurn Ponds Campus Australia
| | - Sunil Aryal
- School of Information Technology Deakin University Geelong Waurn Ponds Campus Australia
| | - Naif Alotaibi
- Department of Mathematics and Statistics Faculty of Science Imam Mohammad Ibn Saud Islamic University (IMSIU) Riyadh Saudi Arabia
| | - Salem A. Alyami
- Department of Mathematics and Statistics Faculty of Science Imam Mohammad Ibn Saud Islamic University (IMSIU) Riyadh Saudi Arabia
| | - Khondokar Fida Hasan
- School of Professional Studies University of New South Wales Canberra ACT Australia
| | - Mohammad Ali Moni
- AI and Cyber Futures Institute Charles Stuart University Bathurst NSW Australia
| |
Collapse
|
13
|
Liu S, Zheng Y, Li H, Pan M, Fang Z, Liu M, Qiao Y, Pan N, Jia W, Ge X. Improving Alzheimer Diagnoses With An Interpretable Deep Learning Framework: Including Neuropsychiatric Symptoms. Neuroscience 2023; 531:86-98. [PMID: 37709003 DOI: 10.1016/j.neuroscience.2023.09.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2023] [Revised: 08/31/2023] [Accepted: 09/07/2023] [Indexed: 09/16/2023]
Abstract
Alzheimer's disease (AD) is a prevalent neurodegenerative disorder characterized by the progressive cognitive decline. Among the various clinical symptoms, neuropsychiatric symptoms (NPS) commonly occur during the course of AD. Previous researches have demonstrated a strong association between NPS and severity of AD, while the research methods are not sufficiently intuitive. Here, we report a hybrid deep learning framework for AD diagnosis using multimodal inputs such as structural MRI, behavioral scores, age, and gender information. The framework uses a 3D convolutional neural network to automatically extract features from MRI. The imaging features are passed to the Principal Component Analysis for dimensionality reduction, which fuse with non-imaging information to improve the diagnosis of AD. According to the experimental results, our model achieves an accuracy of 0.91 and an area under the curve of 0.97 in the task of classifying AD and cognitively normal individuals. SHapley Additive exPlanations are used to visually exhibit the contribution of specific NPS in the proposed model. Among all behavioral symptoms, apathy plays a particularly important role in the diagnosis of AD, which can be considered a valuable factor in further studies, as well as clinical trials.
Collapse
Affiliation(s)
- Shujuan Liu
- School of Information Science and Engineering, Shandong Normal University, Shandong, China
| | - Yuanjie Zheng
- School of Information Science and Engineering, Shandong Normal University, Shandong, China
| | - Hongzhuang Li
- School of Information Science and Engineering, Shandong Normal University, Shandong, China
| | - Minmin Pan
- School of Information Science and Engineering, Shandong Normal University, Shandong, China
| | - Zhicong Fang
- School of Information Science and Engineering, Shandong Normal University, Shandong, China
| | - Mengting Liu
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, China
| | - Yuchuan Qiao
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China
| | - Ningning Pan
- School of Information Science and Engineering, Shandong Normal University, Shandong, China
| | - Weikuan Jia
- School of Information Science and Engineering, Shandong Normal University, Shandong, China
| | - Xinting Ge
- School of Information Science and Engineering, Shandong Normal University, Shandong, China.
| |
Collapse
|
14
|
Tu Y, Lin S, Qiao J, Zhang P, Hao K. Diagnosis of Alzheimer's Disease Based on Accelerated Mirror Descent Optimization and a Three-Dimensional Aggregated Residual Network. SENSORS (BASEL, SWITZERLAND) 2023; 23:8708. [PMID: 37960407 PMCID: PMC10648418 DOI: 10.3390/s23218708] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Revised: 10/23/2023] [Accepted: 10/24/2023] [Indexed: 11/15/2023]
Abstract
Alzheimer's disease (AD), a neuropsychiatric disorder, continually arises in the elderly. To date, no targeted medications have been developed for AD. Early and fast diagnosis of AD plays a pivotal role in identifying potential AD patients, enabling timely medical interventions, and mitigating disease progression. Computer-aided diagnosis (CAD) becomes possible with the burgeoning of deep learning. However, the existing CAD models for processing 3D Alzheimer's disease images usually have the problems of slow convergence, disappearance of gradient, and falling into local optimum. This makes the training of 3D diagnosis models need a lot of time, and the accuracy is often poor. In this paper, a novel 3D aggregated residual network with accelerated mirror descent optimization is proposed for diagnosing AD. First, a novel unbiased subgradient accelerated mirror descent (SAMD) optimization algorithm is proposed to speed up diagnosis network training. By optimizing the nonlinear projection process, our proposed algorithm can avoid the occurrence of the local optimum in the non-Euclidean distance metric. The most notable aspect is that, to the best of our knowledge, this is the pioneering attempt to optimize the AD diagnosis training process by improving the optimization algorithm. Then, we provide a rigorous proof of the SAMD's convergence, and the convergence of SAMD is better than any existing gradient descent algorithms. Finally, we use our proposed SAMD algorithm to train our proposed 3D aggregated residual network architecture (ARCNN). We employed the ADNI dataset to train ARCNN diagnostic models separately for the AD vs. NC task and the sMCI vs. pMCI task, followed by testing to evaluate the disease diagnostic outcomes. The results reveal that the accuracy can be improved in diagnosing AD, and the training speed can be accelerated. Our proposed method achieves 95.4% accuracy in AD diagnosis and 79.9% accuracy in MCI diagnosis; the best results contrasted with several state-of-the-art diagnosis methods. In addition, our proposed SAMD algorithm can save about 19% of the convergence time on average in the AD diagnosis model compared with the gradient descent algorithms, which is very momentous in clinic.
Collapse
Affiliation(s)
| | - Shukuan Lin
- Department of Computer Science and Engineering, Northeastern University, Shenyang 110819, China
| | | | | | | |
Collapse
|
15
|
Aberathne I, Kulasiri D, Samarasinghe S. Detection of Alzheimer's disease onset using MRI and PET neuroimaging: longitudinal data analysis and machine learning. Neural Regen Res 2023; 18:2134-2140. [PMID: 37056120 PMCID: PMC10328296 DOI: 10.4103/1673-5374.367840] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Revised: 12/08/2022] [Accepted: 01/12/2023] [Indexed: 02/17/2023] Open
Abstract
The scientists are dedicated to studying the detection of Alzheimer's disease onset to find a cure, or at the very least, medication that can slow the progression of the disease. This article explores the effectiveness of longitudinal data analysis, artificial intelligence, and machine learning approaches based on magnetic resonance imaging and positron emission tomography neuroimaging modalities for progression estimation and the detection of Alzheimer's disease onset. The significance of feature extraction in highly complex neuroimaging data, identification of vulnerable brain regions, and the determination of the threshold values for plaques, tangles, and neurodegeneration of these regions will extensively be evaluated. Developing automated methods to improve the aforementioned research areas would enable specialists to determine the progression of the disease and find the link between the biomarkers and more accurate detection of Alzheimer's disease onset.
Collapse
Affiliation(s)
- Iroshan Aberathne
- Centre for Advanced Computational Solutions (C-fACS), Lincoln University, Christchurch, New Zealand
| | - Don Kulasiri
- Centre for Advanced Computational Solutions (C-fACS), Lincoln University, Christchurch, New Zealand
| | - Sandhya Samarasinghe
- Centre for Advanced Computational Solutions (C-fACS), Lincoln University, Christchurch, New Zealand
| |
Collapse
|
16
|
Zhang J, He X, Liu Y, Cai Q, Chen H, Qing L. Multi-modal cross-attention network for Alzheimer's disease diagnosis with multi-modality data. Comput Biol Med 2023; 162:107050. [PMID: 37269680 DOI: 10.1016/j.compbiomed.2023.107050] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2022] [Revised: 04/26/2023] [Accepted: 05/03/2023] [Indexed: 06/05/2023]
Abstract
Alzheimer's disease (AD) is a neurodegenerative disorder, the most common cause of dementia, so the accurate diagnosis of AD and its prodromal stage mild cognitive impairment (MCI) is significant. Recent studies have demonstrated that multiple neuroimaging and biological measures contain complementary information for diagnosis. Many existing multi-modal models based on deep learning simply concatenate each modality's features despite substantial differences in representation spaces. In this paper, we propose a novel multi-modal cross-attention AD diagnosis (MCAD) framework to learn the interaction between modalities for better playing their complementary roles for AD diagnosis with multi-modal data including structural magnetic resonance imaging (sMRI), fluorodeoxyglucose-positron emission tomography (FDG-PET) and cerebrospinal fluid (CSF) biomarkers. Specifically, the imaging and non-imaging representations are learned by the image encoder based on cascaded dilated convolutions and CSF encoder, respectively. Then, a multi-modal interaction module is introduced, which takes advantage of cross-modal attention to integrate imaging and non-imaging information and reinforce relationships between these modalities. Moreover, an extensive objective function is designed to reduce the discrepancy between modalities for effectively fusing the features of multi-modal data, which could further improve the diagnosis performance. We evaluate the effectiveness of our proposed method on the ADNI dataset, and the extensive experiments demonstrate that our MCAD achieves superior performance for multiple AD-related classification tasks, compared to several competing methods. Also, we investigate the importance of cross-attention and the contribution of each modality to the diagnostics performance. The experimental results demonstrate that combining multi-modality data via cross-attention is helpful for accurate AD diagnosis.
Collapse
Affiliation(s)
- Jin Zhang
- College of Electronics and Information Engineering, Sichuan University, Chengdu, Sichuan, 610065, China
| | - Xiaohai He
- College of Electronics and Information Engineering, Sichuan University, Chengdu, Sichuan, 610065, China.
| | - Yan Liu
- Department of Neurology, The Affiliated Hospital of Southwest Jiaotong University, The Third People's Hospital of Chengdu, Chengdu, Sichuan, 610031, China
| | - Qingyan Cai
- Department of Geriatric Medicine, The Fourth People's Hospital of Chengdu, Chengdu, Sichuan, 610036, China
| | - Honggang Chen
- College of Electronics and Information Engineering, Sichuan University, Chengdu, Sichuan, 610065, China
| | - Linbo Qing
- College of Electronics and Information Engineering, Sichuan University, Chengdu, Sichuan, 610065, China
| |
Collapse
|
17
|
Ghosh T, Palash MIA, Yousuf MA, Hamid MA, Monowar MM, Alassafi MO. A Robust Distributed Deep Learning Approach to Detect Alzheimer’s Disease from MRI Images. MATHEMATICS 2023; 11:2633. [DOI: 10.3390/math11122633] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/24/2025]
Abstract
Alzheimer’s disease has become a major concern in the healthcare domain as it is growing rapidly. Much research has been conducted to detect it from MRI images through various deep learning approaches.However, the problems of the availability of medical data and preserving the privacy of patients still exists. To mitigate this issue in Alzheimer’s disease detection, we implement the federated approach, which is found to be more efficient, robust, and consistent compared with the conventional approach. For this, we need deep excavation on various orientations of MRI images and transfer learning architectures. Then, we utilize two publicly available datasets (OASIS and ADNI) and design various cases to evaluate the performance of the federated approach. The federated approach achieves better accuracy and sensitivity compared with the conventional approaches in most of the cases. Moreover, the robustness of the proposed approach is also found to be better than the conventional approach. In our federated approach, MobileNet, a low-cost transfer learning architecture, achieves the highest 95.24%, 81.94%, and 83.97% accuracy in the OASIS, ADNI, and merged (ADNI + OASIS) test sets, which is much higher than the achieved performance in the conventional approach. Furthermore, in the proposed approach, only the weights of the model are shared, which keeps the original MRI images in their respective hospital or institutions, preserving privacy in the healthcare domain.
Collapse
Affiliation(s)
- Tapotosh Ghosh
- Department of Computer Science and Engineering, United International University, Dhaka 1212, Bangladesh
| | - Md Istakiak Adnan Palash
- Department of Information and Communication Technology, Bangladesh University of Professionals, Dhaka 1216, Bangladesh
| | - Mohammad Abu Yousuf
- Institute of Information Technology, Jahangirnagar University, Savar 1342, Bangladesh
| | - Md. Abdul Hamid
- Department of Information Technology, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Muhammad Mostafa Monowar
- Department of Information Technology, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Madini O. Alassafi
- Department of Information Technology, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| |
Collapse
|
18
|
Pallawi S, Singh DK. Study of Alzheimer’s disease brain impairment and methods for its early diagnosis: a comprehensive survey. INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL 2023; 12:7. [DOI: 10.1007/s13735-023-00271-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Revised: 02/10/2023] [Accepted: 02/15/2023] [Indexed: 01/03/2025]
|
19
|
Lo CM, Lai KL. Deep learning-based assessment of knee septic arthritis using transformer features in sonographic modalities. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 237:107575. [PMID: 37148635 DOI: 10.1016/j.cmpb.2023.107575] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Revised: 02/21/2023] [Accepted: 05/02/2023] [Indexed: 05/08/2023]
Abstract
PURPOSE Septic arthritis is an infectious disease. Conventionally, the diagnosis of septic arthritis can only be based on the identification of causal pathogens taken from synovial fluid, synovium or blood samples. However, the cultures require several days for the isolation of pathogens. A rapid assessment performed through computer-aided diagnosis (CAD) would bring timely treatment. METHODS A total of 214 non-septic arthritis and 64 septic arthritis images generated by gray-scale (GS) and Power Doppler (PD) ultrasound modalities were collected for the experiment. A deep learning-based vision transformer (ViT) with pre-trained parameters were used for image feature extraction. The extracted features were then combined in machine learning classifiers with ten-fold cross validation in order to evaluate the abilities of septic arthritis classification. RESULTS Using a support vector machine, GS and PD features can achieve an accuracy rate of 86% and 91%, with the area under the receiver operating characteristic curves (AUCs) being 0.90 and 0.92, respectively. The best accuracy (92%) and best AUC (0.92) was obtained by combining both feature sets. CONCLUSIONS This is the first CAD system based on a deep learning approach for the diagnosis of septic arthritis as seen on knee ultrasound images. Using pre-trained ViT, both the accuracy and computation costs improved more than they had through convolutional neural networks. Additionally, automatically combining GS and PD generates a higher accuracy to better assist the physician's observations, thus providing a timely evaluation of septic arthritis.
Collapse
Affiliation(s)
- Chung-Ming Lo
- Graduate Institute of Library, Information and Archival Studies, National Chengchi University, Taipei, Taiwan
| | - Kuo-Lung Lai
- Division of Allergy, Immunology and Rheumatology, Department of Internal Medicine, Taichung Veterans General Hospital, Taichung, Taiwan; Department of Post-Baccalaureate Medicine, College of Medicine, National Chung Hsing University, Taichung, Taiwan.
| |
Collapse
|
20
|
El-Sappagh S, Alonso-Moral JM, Abuhmed T, Ali F, Bugarín-Diz A. Trustworthy artificial intelligence in Alzheimer’s disease: state of the art, opportunities, and challenges. Artif Intell Rev 2023. [DOI: 10.1007/s10462-023-10415-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/28/2023]
|
21
|
Illakiya T, Karthik R. Automatic Detection of Alzheimer's Disease using Deep Learning Models and Neuro-Imaging: Current Trends and Future Perspectives. Neuroinformatics 2023; 21:339-364. [PMID: 36884142 DOI: 10.1007/s12021-023-09625-7] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/16/2023] [Indexed: 03/09/2023]
Abstract
Deep learning algorithms have a huge influence on tackling research issues in the field of medical image processing. It acts as a vital aid for the radiologists in producing accurate results toward effective disease diagnosis. The objective of this research is to highlight the importance of deep learning models in the detection of Alzheimer's Disease (AD). The main objective of this research is to analyze different deep learning methods used for detecting AD. This study examines 103 research articles published in various research databases. These articles have been selected based on specific criteria to find the most relevant findings in the field of AD detection. The review was carried out based on deep learning techniques such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and Transfer Learning (TL). To propose accurate methods for the detection, segmentation, and severity grading of AD, the radiological features need to be examined in greater depth. This review attempts to analyze different deep learning methods applied for AD detection using neuroimaging modalities like Positron Emission Tomography (PET), Magnetic Resonance Imaging (MRI), etc. The focus of this review is restricted to deep learning works based on radiological imaging data for AD detection. There are a few works that have utilized other biomarkers to understand the effect of AD. Also, articles published in English were alone considered for analysis. This work concludes by highlighting the key research issues towards effective AD detection. Though several methods have yielded promising results in AD detection, the progression from Mild Cognitive Impairment (MCI) to AD need to be analyzed in greater depth using DL models.
Collapse
Affiliation(s)
- T Illakiya
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - R Karthik
- Centre for Cyber Physical Systems, School of Electronics Engineering, Vellore Institute of Technology, Chennai, India.
| |
Collapse
|
22
|
Haulath K, Mohamed Basheer KP. TT self-weighted Deep-AD 3-Net: An AD stage and risk prediction. INTERNATIONAL JOURNAL OF HEALTHCARE MANAGEMENT 2023. [DOI: 10.1080/20479700.2023.2175414] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/10/2023]
Affiliation(s)
- K. Haulath
- Department of Computer Science, EMEA College of Arts and Science, Kondotty, India
| | | |
Collapse
|
23
|
Balasundaram A, Srinivasan S, Prasad A, Malik J, Kumar A. Hippocampus Segmentation-Based Alzheimer's Disease Diagnosis and Classification of MRI Images. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2023; 48:1-17. [PMID: 36619218 PMCID: PMC9810248 DOI: 10.1007/s13369-022-07538-2] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/04/2022] [Accepted: 12/12/2022] [Indexed: 01/05/2023]
Abstract
Alzheimer's disease represents a neurological condition characterized by steady cognitive decline and eventual memory loss due to the death of brain cells. It is one of the most prominent dementia types observed in patients and which hence underlines the imminent need for potential methods to diagnose the disease early on. This work considers a novel approach by utilizing a reduced version of one of the datasets used in this work to achieve a considerably accurate prediction while also enabling quicker training. It leverages image segmentation to isolate the hippocampus region from brain MRI images and then strikes a comparison between models trained on the segmented portions and models trained on complete images. This research uses two datasets-4 classes of images from Kaggle and a popular OASIS 2 MRI and demographic dataset. A deep learning-based approach was adopted to train the Kaggle dataset to perform severity classification, and the hippocampus region segmented from a reduced version of the OASIS dataset was trained on supervised and ensemble learning algorithms to detect Alzheimer's disease. The metric used for the assessment of model performance is classification accuracy. A comparative analysis between the proposed approach and existing work was also performed, and it was observed that the proposed approach is effective in the early diagnosis of Alzheimer's disease.
Collapse
Affiliation(s)
- A. Balasundaram
- School of Computer Science and Engineering, Center for Cyber Physical Systems, Vellore Institute of Technology, Chennai, Tamil Nadu India
| | - Sruthi Srinivasan
- School of Computer Science and Engineering, Vellore Institute of Technology (VIT), Chennai, Tamil Nadu India
| | - A. Prasad
- School of Computer Science and Engineering, Vellore Institute of Technology (VIT), Chennai, Tamil Nadu India
| | - Jahan Malik
- School of Computer Science and Engineering, Vellore Institute of Technology (VIT), Chennai, Tamil Nadu India
| | - Ayush Kumar
- School of Computer Science and Engineering, Vellore Institute of Technology (VIT), Chennai, Tamil Nadu India
| |
Collapse
|
24
|
Deng X, Zhang J, Liu R, Liu K. Classifying ASD based on time-series fMRI using spatial-temporal transformer. Comput Biol Med 2022; 151:106320. [PMID: 36442277 DOI: 10.1016/j.compbiomed.2022.106320] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Revised: 10/11/2022] [Accepted: 11/14/2022] [Indexed: 11/18/2022]
Abstract
As the prevalence of autism spectrum disorder (ASD) increases globally, more and more patients need to receive timely diagnosis and treatment to alleviate their suffering. However, the current diagnosis method of ASD still adopts the subjective symptom-based criteria through clinical observation, which is time-consuming and costly. In recent years, functional magnetic resonance imaging (fMRI) neuroimaging techniques have emerged to facilitate the identification of potential biomarkers for diagnosing ASD. In this study, we developed a deep learning framework named spatial-temporal Transformer (ST-Transformer) to distinguish ASD subjects from typical controls based on fMRI data. Specifically, a linear spatial-temporal multi-headed attention unit is proposed to obtain the spatial and temporal representation of fMRI data. Moreover, a Gaussian GAN-based data balancing method is introduced to solve the data unbalance problem in real-world ASD datasets for subtype ASD diagnosis. Our proposed ST-Transformer is evaluated on a large cohort of subjects from two independent datasets (ABIDE I and ABIDE II) and achieves robust accuracies of 71.0% and 70.6%, respectively. Compared with state-of-the-art methods, our results demonstrate competitive performance in ASD diagnosis.
Collapse
Affiliation(s)
- Xin Deng
- The Key Laboratory of Data Engineering and Visual Computing, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China
| | - Jiahao Zhang
- The Key Laboratory of Data Engineering and Visual Computing, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China
| | - Rui Liu
- Department of Computer Science, City University of Hong Kong, 999077, Hong Kong, China.
| | - Ke Liu
- The Key Laboratory of Data Engineering and Visual Computing, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China
| |
Collapse
|
25
|
Celard P, Iglesias EL, Sorribes-Fdez JM, Romero R, Vieira AS, Borrajo L. A survey on deep learning applied to medical images: from simple artificial neural networks to generative models. Neural Comput Appl 2022; 35:2291-2323. [PMID: 36373133 PMCID: PMC9638354 DOI: 10.1007/s00521-022-07953-4] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Accepted: 10/12/2022] [Indexed: 11/06/2022]
Abstract
Deep learning techniques, in particular generative models, have taken on great importance in medical image analysis. This paper surveys fundamental deep learning concepts related to medical image generation. It provides concise overviews of studies which use some of the latest state-of-the-art models from last years applied to medical images of different injured body areas or organs that have a disease associated with (e.g., brain tumor and COVID-19 lungs pneumonia). The motivation for this study is to offer a comprehensive overview of artificial neural networks (NNs) and deep generative models in medical imaging, so more groups and authors that are not familiar with deep learning take into consideration its use in medicine works. We review the use of generative models, such as generative adversarial networks and variational autoencoders, as techniques to achieve semantic segmentation, data augmentation, and better classification algorithms, among other purposes. In addition, a collection of widely used public medical datasets containing magnetic resonance (MR) images, computed tomography (CT) scans, and common pictures is presented. Finally, we feature a summary of the current state of generative models in medical image including key features, current challenges, and future research paths.
Collapse
Affiliation(s)
- P. Celard
- Computer Science Department, Universidade de Vigo, Escuela Superior de Ingeniería Informática, Campus Universitario As Lagoas, 32004 Ourense, Spain
- CINBIO - Biomedical Research Centre, Universidade de Vigo, Campus Universitario Lagoas-Marcosende, 36310 Vigo, Spain
- SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Vigo, Spain
| | - E. L. Iglesias
- Computer Science Department, Universidade de Vigo, Escuela Superior de Ingeniería Informática, Campus Universitario As Lagoas, 32004 Ourense, Spain
- CINBIO - Biomedical Research Centre, Universidade de Vigo, Campus Universitario Lagoas-Marcosende, 36310 Vigo, Spain
- SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Vigo, Spain
| | - J. M. Sorribes-Fdez
- Computer Science Department, Universidade de Vigo, Escuela Superior de Ingeniería Informática, Campus Universitario As Lagoas, 32004 Ourense, Spain
- CINBIO - Biomedical Research Centre, Universidade de Vigo, Campus Universitario Lagoas-Marcosende, 36310 Vigo, Spain
- SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Vigo, Spain
| | - R. Romero
- Computer Science Department, Universidade de Vigo, Escuela Superior de Ingeniería Informática, Campus Universitario As Lagoas, 32004 Ourense, Spain
- CINBIO - Biomedical Research Centre, Universidade de Vigo, Campus Universitario Lagoas-Marcosende, 36310 Vigo, Spain
- SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Vigo, Spain
| | - A. Seara Vieira
- Computer Science Department, Universidade de Vigo, Escuela Superior de Ingeniería Informática, Campus Universitario As Lagoas, 32004 Ourense, Spain
- CINBIO - Biomedical Research Centre, Universidade de Vigo, Campus Universitario Lagoas-Marcosende, 36310 Vigo, Spain
- SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Vigo, Spain
| | - L. Borrajo
- Computer Science Department, Universidade de Vigo, Escuela Superior de Ingeniería Informática, Campus Universitario As Lagoas, 32004 Ourense, Spain
- CINBIO - Biomedical Research Centre, Universidade de Vigo, Campus Universitario Lagoas-Marcosende, 36310 Vigo, Spain
- SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Vigo, Spain
| |
Collapse
|
26
|
Veluppal A, sadhukhan D, gopinath V, swaminathan R. Differentiation of Alzheimer conditions in brain MR images using bidimensional multiscale entropy-based texture analysis of lateral ventricles. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103974] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
27
|
García-Gutierrez F, Díaz-Álvarez J, Matias-Guiu JA, Pytel V, Matías-Guiu J, Cabrera-Martín MN, Ayala JL. GA-MADRID: design and validation of a machine learning tool for the diagnosis of Alzheimer’s disease and frontotemporal dementia using genetic algorithms. Med Biol Eng Comput 2022; 60:2737-2756. [PMID: 35852735 PMCID: PMC9365756 DOI: 10.1007/s11517-022-02630-z] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2022] [Accepted: 06/29/2022] [Indexed: 01/03/2023]
Abstract
AbstractArtificial Intelligence aids early diagnosis and development of new treatments, which is key to slow down the progress of the diseases, which to date have no cure. The patients’ evaluation is carried out through diagnostic techniques such as clinical assessments neuroimaging techniques, which provide high-dimensionality data. In this work, a computational tool is presented that deals with the data provided by the clinical diagnostic techniques. This is a Python-based framework implemented with a modular design and fully extendable. It integrates (i) data processing and management of missing values and outliers; (ii) implementation of an evolutionary feature engineering approach, developed as a Python package, called PyWinEA using Mono-objective and Multi-objetive Genetic Algorithms (NSGAII); (iii) a module for designing predictive models based on a wide range of machine learning algorithms; (iv) a multiclass decision stage based on evolutionary grammars and Bayesian networks. Developed under the eXplainable Artificial Intelligence and open science perspective, this framework provides promising advances and opens the door to the understanding of neurodegenerative diseases from a data-centric point of view. In this work, we have successfully evaluated the potential of the framework for early and automated diagnosis with neuroimages and neurocognitive assessments from patients with Alzheimer’s disease (AD) and frontotemporal dementia (FTD).
Graphical abstract
Collapse
Affiliation(s)
- Fernando García-Gutierrez
- Departments of Neurology, Hospital Clinico San Carlos, San Carlos Research Health Institute (IdISSC), Universidad Complutense, Madrid, Spain
| | - Josefa Díaz-Álvarez
- Department of Computer Architecture and Communications, Centro Universitario de Mérida, Universidad de Extremadura, Mérida, Spain
| | - Jordi A. Matias-Guiu
- Departments of Neurology, Hospital Clinico San Carlos, San Carlos Research Health Institute (IdISSC), Universidad Complutense, Madrid, Spain
| | - Vanesa Pytel
- Departments of Neurology, Hospital Clinico San Carlos, San Carlos Research Health Institute (IdISSC), Universidad Complutense, Madrid, Spain
| | - Jorge Matías-Guiu
- Departments of Neurology, Hospital Clinico San Carlos, San Carlos Research Health Institute (IdISSC), Universidad Complutense, Madrid, Spain
| | - María Nieves Cabrera-Martín
- Departments of Neurology, Hospital Clinico San Carlos, San Carlos Research Health Institute (IdISSC), Universidad Complutense, Madrid, Spain
| | - José L. Ayala
- Department of Computer Architecture and Automation, Universidad Complutense, Madrid, Spain
| |
Collapse
|
28
|
Akyol K. Automatic classification of brain magnetic resonance images with hypercolumn deep features and machine learning. Phys Eng Sci Med 2022; 45:935-947. [PMID: 35997926 DOI: 10.1007/s13246-022-01166-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2021] [Accepted: 07/24/2022] [Indexed: 11/26/2022]
Abstract
Brain tumours are life-threatening and their early detection is very important in a patient's life. At the present time, magnetic resonance imaging is one of the methods used for detecting brain tumours. Expert decision support systems serve specialist physicians to make more accurate diagnoses by minimizing the errors arising from their subjective opinions in real clinical settings. The model proposed in this study detects important keypoints and then extracts hypercolumn deep features of these keypoints from some convolutional layers of VGG16. Finally, Random Forest and Logistic Regression classifiers are fed with a set of these features. Random Forest classifier offered the best performance with 94.51% accuracy, 91.61% sensitivity, 8.39% false-negative rate, 97.42% specificity, and 97.29% precision using fivefold cross-validation in this study. Consequently, it is thought that the proposed model could contribute to field experts by integrating it into computer-aided brain magnetic resonance imaging diagnosis systems.
Collapse
Affiliation(s)
- Kemal Akyol
- Department of Computer Engineering, Kastamonu University, Kastamonu, Turkey.
| |
Collapse
|
29
|
End-to-End Deep Learning Architectures Using 3D Neuroimaging Biomarkers for Early Alzheimer’s Diagnosis. MATHEMATICS 2022. [DOI: 10.3390/math10152575] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/07/2022]
Abstract
This study uses magnetic resonance imaging (MRI) data to propose end-to-end learning implementing volumetric convolutional neural network (CNN) models for two binary classification tasks: Alzheimer’s disease (AD) vs. cognitively normal (CN) and stable mild cognitive impairment (sMCI) vs. AD. The baseline MP-RAGE T1 MR images of 245 AD patients and 229 with sMCI were obtained from the ADNI dataset, whereas 245 T1 MR images of CN people were obtained from the IXI dataset. All of the images were preprocessed in four steps: N4 bias field correction, denoising, brain extraction, and registration. End-to-end-learning-based deep CNNs were used to discern between different phases of AD. Eight CNN-based architectures were implemented and assessed. The DenseNet264 excelled in both types of classification, with 82.5% accuracy and 87.63% AUC for training and 81.03% accuracy for testing relating to the sMCI vs. AD and 100% accuracy and 100% AUC for training and 99.56% accuracy for testing relating to the AD vs. CN. Deep learning approaches based on CNN and end-to-end learning offer a strong tool for examining minute but complex properties in MR images which could aid in the early detection and prediction of Alzheimer’s disease in clinical settings.
Collapse
|
30
|
Tu Y, Lin S, Qiao J, Zhuang Y, Zhang P. Alzheimer's disease diagnosis via multimodal feature fusion. Comput Biol Med 2022; 148:105901. [PMID: 35908497 DOI: 10.1016/j.compbiomed.2022.105901] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2022] [Revised: 06/26/2022] [Accepted: 07/16/2022] [Indexed: 11/19/2022]
Abstract
Alzheimer's disease (AD) is the most common neurodegenerative disorder in the elderly. Early diagnosis of AD plays a vital role in slowing down the progress of AD because there is no effective drug to treat the disease. Some deep learning models have recently been presented for AD diagnosis and have more satisfactory performance than classic machine learning methods. Nevertheless, most of the existing computer-aided diagnostic models used neuroimaging features for diagnosis, ignoring patients' clinical and biological information. This makes the AD diagnosis inaccurate. In this study, we propose a novel multimodal feature transformation and fusion model for AD diagnosis. The feature transformation aims to avoid the difference in feature dimensions between different modal data and further mine the significant features for AD diagnosis. A geometric algebra-based feature extension method is proposed to obtain different levels of high-dimensional features from patients' clinical and personal biological data. Then, an influence degree-based feature filtration algorithm is proposed to filtrate those features that have no apparent guiding significance for AD diagnosis. Finally, an ANN (Artificial Neural Network)-based framework is designed to fuse transformed features with neuroimaging features extracted by CNN (Convolutional Neural Network) for AD diagnosis. The more in-depth feature mining of patients' clinical information and biological information can significantly improve the performance of computer-aided AD diagnosis. The experiments are obtained on the ADNI dataset. Our proposed model can converge faster and achieves 96.2% accuracy in AD diagnostic task and 87.4% accuracy in MCI (Mild Cognitive Impairment) diagnostic task. Compared with other methods, our proposed approach has an excellent performance in AD diagnosis and surpasses SOTA (state-of-the-art) methods. Therefore, our model can provide more reasonable suggestions for clinicians to diagnose and treat disease.
Collapse
Affiliation(s)
- Yue Tu
- School of Computer Science and Engineering, Northeastern University, Shenyang, China
| | - Shukuan Lin
- School of Computer Science and Engineering, Northeastern University, Shenyang, China.
| | - Jianzhong Qiao
- School of Computer Science and Engineering, Northeastern University, Shenyang, China.
| | - Yilin Zhuang
- School of Computer Science and Engineering, Northeastern University, Shenyang, China
| | - Peng Zhang
- School of Computer Science and Engineering, Northeastern University, Shenyang, China
| |
Collapse
|
31
|
Baghdadi NA, Malki A, Balaha HM, Badawy M, Elhosseini M. A 3C-TL-GTO: Alzheimer Automatic Accurate Classification Using Transfer Learning and Artificial Gorilla Troops Optimizer. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22114250. [PMID: 35684871 PMCID: PMC9185328 DOI: 10.3390/s22114250] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/10/2022] [Revised: 05/24/2022] [Accepted: 05/28/2022] [Indexed: 05/10/2023]
Abstract
Alzheimer's disease (AD) is a chronic disease that affects the elderly. There are many different types of dementia, but Alzheimer's disease is one of the leading causes of death. AD is a chronic brain disorder that leads to problems with language, disorientation, mood swings, bodily functions, memory loss, cognitive decline, mood or personality changes, and ultimately death due to dementia. Unfortunately, no cure has yet been developed for it, and it has no known causes. Clinically, imaging tools can aid in the diagnosis, and deep learning has recently emerged as an important component of these tools. Deep learning requires little or no image preprocessing and can infer an optimal data representation from raw images without prior feature selection. As a result, they produce a more objective and less biased process. The performance of a convolutional neural network (CNN) is primarily affected by the hyperparameters chosen and the dataset used. A deep learning model for classifying Alzheimer's patients has been developed using transfer learning and optimized by Gorilla Troops for early diagnosis. This study proposes the A3C-TL-GTO framework for MRI image classification and AD detection. The A3C-TL-GTO is an empirical quantitative framework for accurate and automatic AD classification, developed and evaluated with the Alzheimer's Dataset (four classes of images) and the Alzheimer's Disease Neuroimaging Initiative (ADNI). The proposed framework reduces the bias and variability of preprocessing steps and hyperparameters optimization to the classifier model and dataset used. Our strategy, evaluated on MRIs, is easily adaptable to other imaging methods. According to our findings, the proposed framework was an excellent instrument for this task, with a significant potential advantage for patient care. The ADNI dataset, an online dataset on Alzheimer's disease, was used to obtain magnetic resonance imaging (MR) brain images. The experimental results demonstrate that the proposed framework achieves 96.65% accuracy for the Alzheimer's Dataset and 96.25% accuracy for the ADNI dataset. Moreover, a better performance in terms of accuracy is demonstrated over other state-of-the-art approaches.
Collapse
Affiliation(s)
- Nadiah A. Baghdadi
- College of Nursing, Princess Nourah Bint Abdulrahman University, Riyadh 11671, Saudi Arabia;
| | - Amer Malki
- College of Computer Science and Engineering, Taibah University, Yanbu 46421, Saudi Arabia; (A.M.); (M.E.)
| | - Hossam Magdy Balaha
- Computers and Control Systems Engineering Department, Faculty of Engineering, Mansoura University, Mansoura 35516, Egypt;
| | - Mahmoud Badawy
- Computers and Control Systems Engineering Department, Faculty of Engineering, Mansoura University, Mansoura 35516, Egypt;
- Correspondence:
| | - Mostafa Elhosseini
- College of Computer Science and Engineering, Taibah University, Yanbu 46421, Saudi Arabia; (A.M.); (M.E.)
- Computers and Control Systems Engineering Department, Faculty of Engineering, Mansoura University, Mansoura 35516, Egypt;
| |
Collapse
|
32
|
Deepa N, Chokkalingam S. Optimization of VGG16 utilizing the Arithmetic Optimization Algorithm for early detection of Alzheimer’s disease. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103455] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
33
|
Odusami M, Maskeliūnas R, Damaševičius R. An Intelligent System for Early Recognition of Alzheimer's Disease Using Neuroimaging. SENSORS (BASEL, SWITZERLAND) 2022; 22:740. [PMID: 35161486 PMCID: PMC8839926 DOI: 10.3390/s22030740] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/24/2021] [Revised: 01/14/2022] [Accepted: 01/17/2022] [Indexed: 05/08/2023]
Abstract
Alzheimer's disease (AD) is a neurodegenerative disease that affects brain cells, and mild cognitive impairment (MCI) has been defined as the early phase that describes the onset of AD. Early detection of MCI can be used to save patient brain cells from further damage and direct additional medical treatment to prevent its progression. Lately, the use of deep learning for the early identification of AD has generated a lot of interest. However, one of the limitations of such algorithms is their inability to identify changes in the functional connectivity in the functional brain network of patients with MCI. In this paper, we attempt to elucidate this issue with randomized concatenated deep features obtained from two pre-trained models, which simultaneously learn deep features from brain functional networks from magnetic resonance imaging (MRI) images. We experimented with ResNet18 and DenseNet201 to perform the task of AD multiclass classification. A gradient class activation map was used to mark the discriminating region of the image for the proposed model prediction. Accuracy, precision, and recall were used to assess the performance of the proposed system. The experimental analysis showed that the proposed model was able to achieve 98.86% accuracy, 98.94% precision, and 98.89% recall in multiclass classification. The findings indicate that advanced deep learning with MRI images can be used to classify and predict neurodegenerative brain diseases such as AD.
Collapse
Affiliation(s)
- Modupe Odusami
- Department of Multimedia Engineering, Kaunas University of Technology, 51368 Kaunas, Lithuania; (M.O.); (R.M.)
| | - Rytis Maskeliūnas
- Department of Multimedia Engineering, Kaunas University of Technology, 51368 Kaunas, Lithuania; (M.O.); (R.M.)
| | - Robertas Damaševičius
- Department of Software Engineering, Kaunas University of Technology, 51368 Kaunas, Lithuania
| |
Collapse
|
34
|
Qiao H, Chen L, Zhu F. Ranking convolutional neural network for Alzheimer's disease mini-mental state examination prediction at multiple time-points. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 213:106503. [PMID: 34798407 DOI: 10.1016/j.cmpb.2021.106503] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Accepted: 10/22/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND AND OBJECTIVE Alzheimer's disease (AD) is a fatal neurodegenerative disease. Predicting Mini-mental state examination (MMSE) based on magnetic resonance imaging (MRI) plays an important role in monitoring the progress of AD. Existing machine learning based methods cast MMSE prediction as a single metric regression problem simply and ignore the relationship between subjects with various scores. METHODS In this study, we proposed a ranking convolutional neural network (rankCNN) to address the prediction of MMSE through muti-classification. Specifically, we use a 3D convolutional neural network with sharing weights to extract the feature from MRI, followed by multiple sub-networks which transform the cognitive regression into a series of simpler binary classification. In addition, we further use a ranking layer to measure the ranking information between samples to strengthen the ability of the classification by extracting more discriminative features. RESULTS We evaluated the proposed model on ADNI-1 and ADNI-2 datasets with a total of 1,569 subjects. The Root Mean Squared Error (RMSE) of our proposed model at baseline is 2.238 and 2.434 on ADNI-1 and ADNI-2, respectively. Extensive experimental results on ADNI-1 and ADNI-2 datasets demonstrate that our proposed model is superior to several state-of-the-art methods at both baseline and future MMSE prediction of subjects. CONCLUSION This paper provides a new method that can effectively predict the MMSE at baseline and future time points using baseline MRI, making it possible to use MRI for accurate early diagnosis of AD. The source code is freely available at https://github.com/fengduqianhe/ADrankCNN-master.
Collapse
Affiliation(s)
- Hezhe Qiao
- Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing 400714, China; University of Chinese Academy of Sciences, Beijing 100049, China.
| | - Lin Chen
- Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing 400714, China.
| | - Fan Zhu
- Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing 400714, China.
| |
Collapse
|
35
|
Kaplan E, Dogan S, Tuncer T, Baygin M, Altunisik E. Feed-forward LPQNet based Automatic Alzheimer's Disease Detection Model. Comput Biol Med 2021; 137:104828. [PMID: 34507154 DOI: 10.1016/j.compbiomed.2021.104828] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Revised: 08/16/2021] [Accepted: 09/01/2021] [Indexed: 12/19/2022]
Abstract
BACKGROUND Alzheimer's disease (AD) is one of the most commonly seen brain ailments worldwide. Therefore, many researches have been presented about AD detection and cure. In addition, machine learning models have also been proposed to detect AD promptly. MATERIALS AND METHOD In this work, a new brain image dataset was collected. This dataset contains two categories, and these categories are healthy and AD. This dataset was collected from 1070 subjects. This work presents an automatic AD detection model to detect AD using brain images automatically. The presented model is called a feed-forward local phase quantization network (LPQNet). LPQNet consists of (i) multilevel feature generation based on LPQ and average pooling, (ii) feature selection using neighborhood component analysis (NCA), and (iii) classification phases. The prime objective of the presented LPQNet is to reach high accuracy with low computational complexity. LPQNet generates features on six levels. Therefore, 256 × 6 = 1536 features are generated from an image, and the most important 256 out 1536 features are selected. The selected 256 features are classified on the conventional classifiers to denote the classification capability of the generated and selected features by LPQNet. RESULTS The presented LPQNet was tested on three image datasets to demonstrate the universal classification ability of the LPQNet. The proposed LPQNet attained 99.68%, 100%, and 99.64% classification accuracy on the collected AD image dataset, the Harvard Brain Atlas AD dataset, and the Kaggle AD dataset. Moreover, LPQNet attained 99.62% accuracy on the Kaggle AD dataset using four classes. CONCLUSIONS Moreover, the calculated results from LPQNet are compared to other automatic AD detection models. Comparisons, results, and findings clearly denote the superiority of the presented model. In addition, a new intelligent AD detector application can be developed for use in magnetic resonance (MR) and computed tomography (CT) devices. By using the developed automated AD detector, new generation intelligence MR and CT devices can be developed.
Collapse
Affiliation(s)
- Ela Kaplan
- Department of Radiology, Adiyaman Training and Research Hospital, Adiyaman, Turkey.
| | - Sengul Dogan
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig, Turkey.
| | - Turker Tuncer
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig, Turkey.
| | - Mehmet Baygin
- Department of Computer Engineering, College of Engineering, Ardahan University, Ardahan, Turkey.
| | - Erman Altunisik
- Department of Neurology, Adiyaman University Medicine Faculty, Adiyaman, Turkey.
| |
Collapse
|
36
|
Saratxaga CL, Moya I, Picón A, Acosta M, Moreno-Fernandez-de-Leceta A, Garrote E, Bereciartua-Perez A. MRI Deep Learning-Based Solution for Alzheimer's Disease Prediction. J Pers Med 2021; 11:902. [PMID: 34575679 PMCID: PMC8466762 DOI: 10.3390/jpm11090902] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Revised: 08/31/2021] [Accepted: 09/02/2021] [Indexed: 12/30/2022] Open
Abstract
BACKGROUND Alzheimer's is a degenerative dementing disorder that starts with a mild memory impairment and progresses to a total loss of mental and physical faculties. The sooner the diagnosis is made, the better for the patient, as preventive actions and treatment can be started. Although tests such as the Mini-Mental State Tests Examination are usually used for early identification, diagnosis relies on magnetic resonance imaging (MRI) brain analysis. METHODS Public initiatives such as the OASIS (Open Access Series of Imaging Studies) collection provide neuroimaging datasets openly available for research purposes. In this work, a new method based on deep learning and image processing techniques for MRI-based Alzheimer's diagnosis is proposed and compared with previous literature works. RESULTS Our method achieves a balance accuracy (BAC) up to 0.93 for image-based automated diagnosis of the disease, and a BAC of 0.88 for the establishment of the disease stage (healthy tissue, very mild and severe stage). CONCLUSIONS Results obtained surpassed the state-of-the-art proposals using the OASIS collection. This demonstrates that deep learning-based strategies are an effective tool for building a robust solution for Alzheimer's-assisted diagnosis based on MRI data.
Collapse
Affiliation(s)
- Cristina L. Saratxaga
- TECNALIA, Basque Research and Technology Alliance (BRTA), Parque Tecnológico de Bizkaia, C/Geldo. Edificio 700, 48160 Derio, Spain; (A.P.); (E.G.); (A.B.-P.)
| | - Iratxe Moya
- Instituto Ibermática de Innovación, Unidad de Inteligencia Artificial Avenida de los Huetos, Edificio Azucarera, 01010 Vitoria, Spain; (I.M.); (M.A.); (A.M.-F.-d.-L.)
| | - Artzai Picón
- TECNALIA, Basque Research and Technology Alliance (BRTA), Parque Tecnológico de Bizkaia, C/Geldo. Edificio 700, 48160 Derio, Spain; (A.P.); (E.G.); (A.B.-P.)
| | - Marina Acosta
- Instituto Ibermática de Innovación, Unidad de Inteligencia Artificial Avenida de los Huetos, Edificio Azucarera, 01010 Vitoria, Spain; (I.M.); (M.A.); (A.M.-F.-d.-L.)
| | - Aitor Moreno-Fernandez-de-Leceta
- Instituto Ibermática de Innovación, Unidad de Inteligencia Artificial Avenida de los Huetos, Edificio Azucarera, 01010 Vitoria, Spain; (I.M.); (M.A.); (A.M.-F.-d.-L.)
| | - Estibaliz Garrote
- TECNALIA, Basque Research and Technology Alliance (BRTA), Parque Tecnológico de Bizkaia, C/Geldo. Edificio 700, 48160 Derio, Spain; (A.P.); (E.G.); (A.B.-P.)
- Department of Cell Biology and Histology, Faculty of Medicine and Dentistry, University of the Basque Country, 48940 Leioa, Spain
| | - Arantza Bereciartua-Perez
- TECNALIA, Basque Research and Technology Alliance (BRTA), Parque Tecnológico de Bizkaia, C/Geldo. Edificio 700, 48160 Derio, Spain; (A.P.); (E.G.); (A.B.-P.)
| |
Collapse
|
37
|
Akyol K, Şen B. Automatic Detection of Covid-19 with Bidirectional LSTM Network Using Deep Features Extracted from Chest X-ray Images. Interdiscip Sci 2021; 14:89-100. [PMID: 34313974 PMCID: PMC8313418 DOI: 10.1007/s12539-021-00463-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2021] [Revised: 07/08/2021] [Accepted: 07/12/2021] [Indexed: 12/23/2022]
Abstract
Coronavirus disease, which comes up in China at the end of 2019 and showed different symptoms in people infected, affected millions of people. Computer-aided expert systems are needed due to the inadequacy of the reverse transcription-polymerase chain reaction kit, which is widely used in the diagnosis of this disease. Undoubtedly, expert systems that provide effective solutions to many problems will be very useful in the detection of Covid-19 disease, especially when unskilled personnel and financial deficiencies in underdeveloped countries are taken into consideration. In the literature, there are numerous machine learning approaches built with different classifiers in the detection of this disease. This paper proposes an approach based on deep learning which detects Covid-19 and no-finding cases using chest X-ray images. Here, the classification performance of the Bi-LSTM network on the deep features was compared with the Deep Neural Network within the frame of the fivefold cross-validation technique. Accuracy, sensitivity, specificity and precision metrics were used to evaluate the classification performance of the trained models. Bi-LSTM network presented better performance compare to DNN with 97.6% value of high accuracy despite the few numbers of Covid-19 images in the dataset. In addition, it is understood that concatenated deep features more meaningful than deep features obtained with pre-trained networks by one by, as well. Consequently, it is thought that the proposed study based on the Bi-LSTM network and concatenated deep features will be noteworthy in the design of highly sensitive automated Covid-19 monitoring systems.
Collapse
Affiliation(s)
- Kemal Akyol
- Department of Computer Engineering, Faculty of Engineering and Architecture, Kastamonu University, Kastamonu, Turkey.
| | - Baha Şen
- Department of Computer Engineering, Faculty of Engineering and Natural Sciences, Ankara Yıldırım Beyazıt University, Ankara, Turkey
| |
Collapse
|
38
|
Diagnosis of interproximal caries lesions with deep convolutional neural network in digital bitewing radiographs. Clin Oral Investig 2021; 26:623-632. [PMID: 34173051 PMCID: PMC8232993 DOI: 10.1007/s00784-021-04040-1] [Citation(s) in RCA: 53] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2021] [Accepted: 06/16/2021] [Indexed: 01/06/2023]
Abstract
Objectives This study aimed to investigate the effectiveness of deep convolutional neural network (CNN) in the diagnosis of interproximal caries lesions in digital bitewing radiographs. Methods and materials A total of 1,000 digital bitewing radiographs were randomly selected from the database. Of these, 800 were augmented and annotated as “decay” by two experienced dentists using a labeling tool developed in Python programming language. The 800 radiographs were consisted of 11,521 approximal surfaces of which 1,847 were decayed (lesion prevalence for train data was 16.03%). A CNN model known as you only look once (YOLO) was modified and trained to detect caries lesions in bitewing radiographs. After using the other 200 radiographs to test the effectiveness of the proposed CNN model, the accuracy, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and area under the receiver operating characteristic curve (AUC) were calculated. Results The lesion prevalence for test data was 13.89%. The overall accuracy of the CNN model was 94.59% (94.19% for premolars, 94.97% for molars), sensitivity was 72.26% (75.51% for premolars, 68.71% for molars), specificity was 98.19% (97.43% for premolars, 98.91% for molars), PPV was 86.58% (83.61% for premolars, 90.44% for molars), and NPV was 95.64% (95.82% for premolars, 95.47% for molars). The overall AUC was measured as 87.19%. Conclusions The proposed CNN model showed good performance with high accuracy scores demonstrating that it could be used in the diagnosis of caries lesions in bitewing radiographs. Clinical significance Correct diagnosis of dental caries is essential for a correct treatment procedure. CNNs can assist dentists in diagnosing approximal caries lesions in bitewing radiographs.
Collapse
|
39
|
Valverde JM, Imani V, Abdollahzadeh A, De Feo R, Prakash M, Ciszek R, Tohka J. Transfer Learning in Magnetic Resonance Brain Imaging: A Systematic Review. J Imaging 2021; 7:66. [PMID: 34460516 PMCID: PMC8321322 DOI: 10.3390/jimaging7040066] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2021] [Revised: 03/26/2021] [Accepted: 03/29/2021] [Indexed: 11/25/2022] Open
Abstract
(1) Background: Transfer learning refers to machine learning techniques that focus on acquiring knowledge from related tasks to improve generalization in the tasks of interest. In magnetic resonance imaging (MRI), transfer learning is important for developing strategies that address the variation in MR images from different imaging protocols or scanners. Additionally, transfer learning is beneficial for reutilizing machine learning models that were trained to solve different (but related) tasks to the task of interest. The aim of this review is to identify research directions, gaps in knowledge, applications, and widely used strategies among the transfer learning approaches applied in MR brain imaging; (2) Methods: We performed a systematic literature search for articles that applied transfer learning to MR brain imaging tasks. We screened 433 studies for their relevance, and we categorized and extracted relevant information, including task type, application, availability of labels, and machine learning methods. Furthermore, we closely examined brain MRI-specific transfer learning approaches and other methods that tackled issues relevant to medical imaging, including privacy, unseen target domains, and unlabeled data; (3) Results: We found 129 articles that applied transfer learning to MR brain imaging tasks. The most frequent applications were dementia-related classification tasks and brain tumor segmentation. The majority of articles utilized transfer learning techniques based on convolutional neural networks (CNNs). Only a few approaches utilized clearly brain MRI-specific methodology, and considered privacy issues, unseen target domains, or unlabeled data. We proposed a new categorization to group specific, widely-used approaches such as pretraining and fine-tuning CNNs; (4) Discussion: There is increasing interest in transfer learning for brain MRI. Well-known public datasets have clearly contributed to the popularity of Alzheimer's diagnostics/prognostics and tumor segmentation as applications. Likewise, the availability of pretrained CNNs has promoted their utilization. Finally, the majority of the surveyed studies did not examine in detail the interpretation of their strategies after applying transfer learning, and did not compare their approach with other transfer learning approaches.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Jussi Tohka
- A.I. Virtanen Institute for Molecular Sciences, University of Eastern Finland, 70150 Kuopio, Finland; (J.M.V.); (V.I.); (A.A.); (R.D.F.); (M.P.); (R.C.)
| |
Collapse
|
40
|
Sharma S, Dudeja RK, Aujla GS, Bali RS, Kumar N. DeTrAs: deep learning-based healthcare framework for IoT-based assistance of Alzheimer patients. Neural Comput Appl 2020. [DOI: 10.1007/s00521-020-05327-2] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
AbstractHealthcare 4.0 paradigm aims at realization of data-driven and patient-centric health systems wherein advanced sensors can be deployed to provide personalized assistance. Hence, extreme mentally affected patients from diseases like Alzheimer can be assisted using sophisticated algorithms and enabling technologies. Motivated from this fact, in this paper,
DeTrAs: Deep Learning-based Internet of Health Framework for the Assistance of Alzheimer Patients is proposed. DeTrAs works in three phases: (1) A recurrent neural network-based Alzheimer prediction scheme is proposed which uses sensory movement data, (2) an ensemble approach for abnormality tracking for Alzheimer patients is designed which comprises two parts:
(a) convolutional neural network-based emotion detection scheme and (b) timestamp window-based natural language processing scheme, and (3) an IoT-based assistance mechanism for the Alzheimer patients is also presented. The evaluation of DeTrAs depicts almost 10–20% improvement in terms of accuracy in contrast to the different existing machine learning algorithms.
Collapse
|