1
|
Chen D, Yang H, Li H, He X, Mu H. MRI-based diagnostic model for Alzheimer's disease using 3D-ResNet. Biomed Phys Eng Express 2025; 11:035031. [PMID: 40354785 DOI: 10.1088/2057-1976/add73d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2025] [Accepted: 05/12/2025] [Indexed: 05/14/2025]
Abstract
Alzheimer's disease (AD), a progressive neurodegenerative disorder, is the leading cause of dementia worldwide and remains incurable once it begins. Therefore, early and accurate diagnosis is essential for effective intervention. Leveraging recent advances in deep learning, this study proposes a novel diagnostic model based on the 3D-ResNet architecture to classify three cognitive states: AD, mild cognitive impairment (MCI), and cognitively normal (CN) individuals, using MRI data. The model integrates the strengths of ResNet and 3D convolutional neural networks (3D-CNN), and incorporates a special attention mechanism(SAM) within the residual structure to enhance feature representation. The study utilized the ADNI dataset, comprising 800 brain MRI scans. The dataset was split in a 7:3 ratio for training and testing, and the network was trained using data augmentation and cross-validation strategies. The proposed model achieved 92.33% accuracy in the three-class classification task, and 97.61%, 95.83%, and 93.42% accuracy in binary classifications of AD versus CN, AD versus MCI, and CN versus MCI, respectively, outperforming existing state-of-the-art methods. Furthermore, Grad-CAM heatmaps and 3D MRI reconstructions revealed that the cerebral cortex and hippocampus are critical regions for AD classification. These findings demonstrate a robust and interpretable AI-based diagnostic framework for AD, providing valuable technical support for its timely detection and clinical intervention.
Collapse
Affiliation(s)
- Dongkui Chen
- College of Science, Northeast Forestry University, Harbin, 150040, People's Republic of China
| | - Hong Yang
- Research Institute of Intelligent Control and Systems, Harbin Institute of Technology, Harbin, 150001, People's Republic of China
| | - Hao Li
- College of Science, Northeast Forestry University, Harbin, 150040, People's Republic of China
| | - Xuanlong He
- College of Science, Northeast Forestry University, Harbin, 150040, People's Republic of China
| | - Hongbo Mu
- College of Science, Northeast Forestry University, Harbin, 150040, People's Republic of China
| |
Collapse
|
2
|
Ka H, Razmara J, Parvizpour S, Hadizadeh M. Alzheimer's diagnosis by an efficient pipelined gene selection model based on statistical and biological data analysis. Comput Biol Chem 2025; 119:108511. [PMID: 40403352 DOI: 10.1016/j.compbiolchem.2025.108511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2024] [Revised: 04/05/2025] [Accepted: 05/14/2025] [Indexed: 05/24/2025]
Abstract
Diagnosing Alzheimer's disease based on gene expression data extracted from microarrays is still an open field of research. Due to the availability of whole-genome data through microarrays technology, diagnosis accuracy is expected to be improved. Despite the high potential of the data prepared by the technology, their analysis on different platforms shows that they may differ for different samples concerning biomarker status. This affects the diagnosis accuracy because of the existing bias between two experimental conditions. To address this problem, we propose a pipeline-based approach to diagnose Alzheimer's disease using statistical analysis of biological data combined with artificial intelligence techniques. At first, the B-statistics and a new score based on a gene interaction network are used to evaluate genes. The B-statistics helps us to find differentially expressed genes. The new score, called the evidence score, measures the compliance level of the differentially expressed genes with past biological evidence. Next, we use artificial intelligence methods to find the subset of genes that define high separability between normal and affected samples. To this end, we employed a genetic algorithm to find the optimal subset. The performance of the pipeline was compared with other state-of-the-art methods. The results indicate that the proposed method can obtain fruitful predictive performance for diagnosing Alzheimer's disease. All the codes implemented in this study are available online at https://github.com/HamedKAAC/AD-gene-selection.
Collapse
Affiliation(s)
- Hamed Ka
- Department of Computer Science, Faculty of Mathematics, Statistics, and Computer Science, University of Tabriz, Tabriz, Iran
| | - Jafar Razmara
- Department of Computer Science, Faculty of Mathematics, Statistics, and Computer Science, University of Tabriz, Tabriz, Iran.
| | - Sepideh Parvizpour
- Research Center for Pharmaceutical Nanotechnology, Biomedicine Institute, Tabriz University of Medical Sciences, Tabriz, Iran.
| | - Morteza Hadizadeh
- Physiology Research Center, Institute of Neuropharmacology, Kerman University of Medical Sciences, Kerman, Iran
| |
Collapse
|
3
|
Duenias D, Nichyporuk B, Arbel T, Riklin Raviv T. Hyperfusion: A hypernetwork approach to multimodal integration of tabular and medical imaging data for predictive modeling. Med Image Anal 2025; 102:103503. [PMID: 40037055 DOI: 10.1016/j.media.2025.103503] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Revised: 01/11/2025] [Accepted: 02/10/2025] [Indexed: 03/06/2025]
Abstract
The integration of diverse clinical modalities such as medical imaging and the tabular data extracted from patients' Electronic Health Records (EHRs) is a crucial aspect of modern healthcare. Integrative analysis of multiple sources can provide a comprehensive understanding of the clinical condition of a patient, improving diagnosis and treatment decision. Deep Neural Networks (DNNs) consistently demonstrate outstanding performance in a wide range of multimodal tasks in the medical domain. However, the complex endeavor of effectively merging medical imaging with clinical, demographic and genetic information represented as numerical tabular data remains a highly active and ongoing research pursuit. We present a novel framework based on hypernetworks to fuse clinical imaging and tabular data by conditioning the image processing on the EHR's values and measurements. This approach aims to leverage the complementary information present in these modalities to enhance the accuracy of various medical applications. We demonstrate the strength and generality of our method on two different brain Magnetic Resonance Imaging (MRI) analysis tasks, namely, brain age prediction conditioned by subject's sex and multi-class Alzheimer's Disease (AD) classification conditioned by tabular data. We show that our framework outperforms both single-modality models and state-of-the-art MRI tabular data fusion methods. A link to our code can be found at https://github.com/daniel4725/HyperFusion.
Collapse
Affiliation(s)
- Daniel Duenias
- Ben Gurion University of the Negev, blvd 1, Beer Sheva 84105, Israel
| | - Brennan Nichyporuk
- Centre for Intelligent Machines, McGill University, 3480 University St, Montreal, QC, H3A 0E9, Canada; Mila - Quebec AI Institute, 6666 Rue Saint-Urbain, Montréal, QC H2S 3H1, Canada
| | - Tal Arbel
- Centre for Intelligent Machines, McGill University, 3480 University St, Montreal, QC, H3A 0E9, Canada; Mila - Quebec AI Institute, 6666 Rue Saint-Urbain, Montréal, QC H2S 3H1, Canada
| | | |
Collapse
|
4
|
Li C, Xu Q, Lu Y, Feng D, Chen P, Pu M, Hu J, Wang M. A new method for Tomicus classification of forest pests based on improved ResNet50 algorithm. Sci Rep 2025; 15:9665. [PMID: 40113834 PMCID: PMC11926102 DOI: 10.1038/s41598-025-93407-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2024] [Accepted: 03/06/2025] [Indexed: 03/22/2025] Open
Abstract
Tomicus is a globally significant forestry pest, with Yunnan Province in southwestern China experiencing particularly severe infestations. The morphological differences among Tomicus species are minimal, making accurate identification challenging. While traditional molecular identification and morphological recognition methods are reliable, they require specialized personnel and equipment and are time-consuming. For individuals with limited expertise, accurate identification becomes particularly difficult. This highlights the challenge of developing a rapid, efficient, and accurate classification model for Tomicus. This study investigates four major Tomicus species in Yunnan Province: Tomicus yunnanensis, Tomicus minor, Tomicus brevipilosus, and Tomicus armandii. We collected samples from infested pine trees and constructed a dataset comprising 6,371 high-resolution images captured using a handheld microscope. A novel Tomicus classification model, DEMNet, was proposed based on an improved ResNet50 architecture. Experimental results demonstrate that DEMNet outperforms ResNet50 across key metrics, achieving a classification accuracy of 92.8%, a parameter count of 1.6 M, and an inference speed of 0.1193 s per image. Specifically, DEMNet reduces the parameter count by 90% while improving classification accuracy by 9.5%. Its lightweight and high-precision design makes DEMNet highly suitable for deployment on embedded devices, offering significant potential for real-time Tomicus identification and pest management applications.
Collapse
Affiliation(s)
- Caiyi Li
- College of Big Data and Intelligent Engineering, Southwest Forestry University, Kunming, 650224, China
| | - Quanyuan Xu
- College of Big Data and Intelligent Engineering, Southwest Forestry University, Kunming, 650224, China.
- Key Laboratory of Forestry and Ecological, Big Data State Forestry Administration on Southwest Forestry University, Kunming, 650024, China.
| | - Ying Lu
- College of Big Data and Intelligent Engineering, Southwest Forestry University, Kunming, 650224, China.
- Key Laboratory of Forestry and Ecological, Big Data State Forestry Administration on Southwest Forestry University, Kunming, 650024, China.
| | - Dan Feng
- Yunnan Academy of Forestry and Grassland, Kunming, China
| | - Peng Chen
- Yunnan Academy of Forestry and Grassland, Kunming, China
| | - Mengxue Pu
- College of Ecology and Environmental Sciences, Southwest Forestry University, Kunming, 650224, China
| | - Junzhu Hu
- College of Big Data and Intelligent Engineering, Southwest Forestry University, Kunming, 650224, China
| | - Mingyang Wang
- College of Big Data and Intelligent Engineering, Southwest Forestry University, Kunming, 650224, China
| |
Collapse
|
5
|
Wang M, Wang J, Ji J, Ma C, Wang H, He J, Song Y, Zhang X, Cao Y, Dai Y, Hua M, Qin R, Li K, Cao L. Improving compound-protein interaction prediction by focusing on intra-modality and inter-modality dynamics with a multimodal tensor fusion strategy. Comput Struct Biotechnol J 2024; 23:3714-3729. [PMID: 39525082 PMCID: PMC11544084 DOI: 10.1016/j.csbj.2024.10.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2024] [Revised: 10/01/2024] [Accepted: 10/01/2024] [Indexed: 11/16/2024] Open
Abstract
Identifying novel compound-protein interactions (CPIs) plays a pivotal role in target identification and drug discovery. Although the recent multimodal methods have achieved outstanding advances in CPI prediction, they fail to effectively learn both intra-modality and inter-modality dynamics, which limits their prediction performance. To address the limitation, we propose a novel multimodal tensor fusion CPI prediction framework, named MMTF-CPI, which contains three unimodal learning modules for structure, heterogeneous network and transcriptional profiling modalities, a tensor fusion module and a prediction module. MMTF-CPI is capable of focusing on both intra-modality and inter-modality dynamics with the tensor fusion module. We demonstrated that MMTF-CPI is superior to multiple state-of-the-art multimodal methods across seven datasets. The prediction performance of MMTF-CPI is significantly improved with the tensor fusion module compared to other fusion methods. Moreover, our case studies confirmed the practical value of MMTF-CPI in target identification. Via MMTF-CPI, we also discovered several candidate compounds for the therapy of breast cancer and non-small cell lung cancer.
Collapse
Affiliation(s)
- Meng Wang
- Department of Biostatistics, Harbin Medical University, Harbin 150081, China
| | - Jianmin Wang
- Department of Integrative Biotechnology, Yonsei University, Incheon 21983, South Korea
| | - Jianxin Ji
- Department of Biostatistics, Harbin Medical University, Harbin 150081, China
| | - Chenjing Ma
- Department of Biostatistics, Harbin Medical University, Harbin 150081, China
| | - Hesong Wang
- Department of Biostatistics, Harbin Medical University, Harbin 150081, China
| | - Jia He
- Department of Biostatistics, Harbin Medical University, Harbin 150081, China
| | - Yongzhen Song
- Department of Biostatistics, Harbin Medical University, Harbin 150081, China
| | - Xuan Zhang
- Department of Biostatistics, Harbin Medical University, Harbin 150081, China
| | - Yong Cao
- Department of Biostatistics, Harbin Medical University, Harbin 150081, China
| | - Yanyan Dai
- Department of Biostatistics, Harbin Medical University, Harbin 150081, China
| | - Menglei Hua
- Department of Biostatistics, Harbin Medical University, Harbin 150081, China
| | - Ruihao Qin
- Department of Biostatistics, Harbin Medical University, Harbin 150081, China
| | - Kang Li
- Department of Biostatistics, Harbin Medical University, Harbin 150081, China
| | - Lei Cao
- Department of Biostatistics, Harbin Medical University, Harbin 150081, China
| |
Collapse
|
6
|
Pérez-Millan A, Thirion B, Falgàs N, Borrego-Écija S, Bosch B, Juncà-Parella J, Tort-Merino A, Sarto J, Augé JM, Antonell A, Bargalló N, Balasa M, Lladó A, Sánchez-Valle R, Sala-Llonch R. Beyond group classification: Probabilistic differential diagnosis of frontotemporal dementia and Alzheimer's disease with MRI and CSF biomarkers. Neurobiol Aging 2024; 144:1-11. [PMID: 39232438 DOI: 10.1016/j.neurobiolaging.2024.08.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2024] [Revised: 08/27/2024] [Accepted: 08/28/2024] [Indexed: 09/06/2024]
Abstract
Neuroimaging and fluid biomarkers are used to differentiate frontotemporal dementia (FTD) from Alzheimer's disease (AD). We implemented a machine learning algorithm that provides individual probabilistic scores based on magnetic resonance imaging (MRI) and cerebrospinal fluid (CSF) data. We investigated whether combining MRI and CSF levels could improve the diagnosis confidence. 215 AD patients, 103 FTD patients, and 173 healthy controls (CTR) were studied. With MRI data, we obtained an accuracy of 82 % for AD vs. FTD. A total of 74 % of FTD and 73 % of AD participants have a high probability of accurate diagnosis. Adding CSF-NfL and 14-3-3 levels improved the accuracy and the number of patients in the confidence group for differentiating FTD from AD. We obtain individual diagnostic probabilities with high precision to address the problem of confidence in the diagnosis. We suggest when MRI, CSF, or the combination are necessary to improve the FTD and AD diagnosis. This algorithm holds promise towards clinical applications as support to clinical findings or in settings with limited access to expert diagnoses.
Collapse
Affiliation(s)
- Agnès Pérez-Millan
- Alzheimer's disease and other cognitive disorders unit. Service of Neurology, Hospital Clínic de Barcelona. Fundació Recerca Clínic Barcelona-IDIBAPS, Barcelona, Spain; Institut de Neurociències, University of Barcelona, Barcelona, Spain; Department of Biomedicine, Faculty of Medicine, University of Barcelona, Barcelona, Spain; Inria, CEA, Université Paris-Saclay, Paris, France
| | | | - Neus Falgàs
- Alzheimer's disease and other cognitive disorders unit. Service of Neurology, Hospital Clínic de Barcelona. Fundació Recerca Clínic Barcelona-IDIBAPS, Barcelona, Spain
| | - Sergi Borrego-Écija
- Alzheimer's disease and other cognitive disorders unit. Service of Neurology, Hospital Clínic de Barcelona. Fundació Recerca Clínic Barcelona-IDIBAPS, Barcelona, Spain
| | - Beatriz Bosch
- Alzheimer's disease and other cognitive disorders unit. Service of Neurology, Hospital Clínic de Barcelona. Fundació Recerca Clínic Barcelona-IDIBAPS, Barcelona, Spain
| | - Jordi Juncà-Parella
- Alzheimer's disease and other cognitive disorders unit. Service of Neurology, Hospital Clínic de Barcelona. Fundació Recerca Clínic Barcelona-IDIBAPS, Barcelona, Spain
| | - Adrià Tort-Merino
- Alzheimer's disease and other cognitive disorders unit. Service of Neurology, Hospital Clínic de Barcelona. Fundació Recerca Clínic Barcelona-IDIBAPS, Barcelona, Spain
| | - Jordi Sarto
- Alzheimer's disease and other cognitive disorders unit. Service of Neurology, Hospital Clínic de Barcelona. Fundació Recerca Clínic Barcelona-IDIBAPS, Barcelona, Spain
| | - Josep Maria Augé
- Biochemistry and Molecular Genetics Department, Hospital Clínic de Barcelona, Barcelona, Spain
| | - Anna Antonell
- Alzheimer's disease and other cognitive disorders unit. Service of Neurology, Hospital Clínic de Barcelona. Fundació Recerca Clínic Barcelona-IDIBAPS, Barcelona, Spain
| | - Nuria Bargalló
- Image Diagnostic Centre, Hospital Clínic de Barcelona, CIBER de Salud Mental, Instituto de Salud Carlos III.Magnetic Resonance Image Core Facility, IDIBAPS, Barcelona, Spain
| | - Mircea Balasa
- Alzheimer's disease and other cognitive disorders unit. Service of Neurology, Hospital Clínic de Barcelona. Fundació Recerca Clínic Barcelona-IDIBAPS, Barcelona, Spain
| | - Albert Lladó
- Alzheimer's disease and other cognitive disorders unit. Service of Neurology, Hospital Clínic de Barcelona. Fundació Recerca Clínic Barcelona-IDIBAPS, Barcelona, Spain; Institut de Neurociències, University of Barcelona, Barcelona, Spain
| | - Raquel Sánchez-Valle
- Alzheimer's disease and other cognitive disorders unit. Service of Neurology, Hospital Clínic de Barcelona. Fundació Recerca Clínic Barcelona-IDIBAPS, Barcelona, Spain; Institut de Neurociències, University of Barcelona, Barcelona, Spain
| | - Roser Sala-Llonch
- Institut de Neurociències, University of Barcelona, Barcelona, Spain; Department of Biomedicine, Faculty of Medicine, University of Barcelona, Barcelona, Spain; Centro de Investigación Biomédica en Red de Bioingeniería, Biomateriales y Nanomedicina (CIBER-BBN), Barcelona, Spain; Fundació de Recerca Clínic Barcelona-Institut d'Investigacions Biomèdiques August Pi I Sunyer (FRCB-IDIBAPS), Barcelona, Spain.
| |
Collapse
|
7
|
Rudroff T, Rainio O, Klén R. AI for the prediction of early stages of Alzheimer's disease from neuroimaging biomarkers - A narrative review of a growing field. Neurol Sci 2024; 45:5117-5127. [PMID: 38866971 DOI: 10.1007/s10072-024-07649-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2024] [Accepted: 06/10/2024] [Indexed: 06/14/2024]
Abstract
OBJECTIVES The objectives of this narrative review are to summarize the current state of AI applications in neuroimaging for early Alzheimer's disease (AD) prediction and to highlight the potential of AI techniques in improving early AD diagnosis, prognosis, and management. METHODS We conducted a narrative review of studies using AI techniques applied to neuroimaging data for early AD prediction. We examined single-modality studies using structural MRI and PET imaging, as well as multi-modality studies integrating multiple neuroimaging techniques and biomarkers. Furthermore, they reviewed longitudinal studies that model AD progression and identify individuals at risk of rapid decline. RESULTS Single-modality studies using structural MRI and PET imaging have demonstrated high accuracy in classifying AD and predicting progression from mild cognitive impairment (MCI) to AD. Multi-modality studies, integrating multiple neuroimaging techniques and biomarkers, have shown improved performance and robustness compared to single-modality approaches. Longitudinal studies have highlighted the value of AI in modeling AD progression and identifying individuals at risk of rapid decline. However, challenges remain in data standardization, model interpretability, generalizability, clinical integration, and ethical considerations. CONCLUSION AI techniques applied to neuroimaging data have the potential to improve early AD diagnosis, prognosis, and management. Addressing challenges related to data standardization, model interpretability, generalizability, clinical integration, and ethical considerations is crucial for realizing the full potential of AI in AD research and clinical practice. Collaborative efforts among researchers, clinicians, and regulatory agencies are needed to develop reliable, robust, and ethical AI tools that can benefit AD patients and society.
Collapse
Affiliation(s)
- Thorsten Rudroff
- Department of Health and Human Physiology, University of Iowa, Iowa City, IA, 52242, USA.
- Department of Neurology, University of Iowa Hospitals and Clinics, Iowa City, IA, 52242, USA.
| | - Oona Rainio
- Turku PET Centre, University of Turku and Turku University Hospital, Turku, Finland
| | - Riku Klén
- Turku PET Centre, University of Turku and Turku University Hospital, Turku, Finland
| |
Collapse
|
8
|
Iqbal MS, Belal Bin Heyat M, Parveen S, Ammar Bin Hayat M, Roshanzamir M, Alizadehsani R, Akhtar F, Sayeed E, Hussain S, Hussein HS, Sawan M. Progress and trends in neurological disorders research based on deep learning. Comput Med Imaging Graph 2024; 116:102400. [PMID: 38851079 DOI: 10.1016/j.compmedimag.2024.102400] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Revised: 05/07/2024] [Accepted: 05/13/2024] [Indexed: 06/10/2024]
Abstract
In recent years, deep learning (DL) has emerged as a powerful tool in clinical imaging, offering unprecedented opportunities for the diagnosis and treatment of neurological disorders (NDs). This comprehensive review explores the multifaceted role of DL techniques in leveraging vast datasets to advance our understanding of NDs and improve clinical outcomes. Beginning with a systematic literature review, we delve into the utilization of DL, particularly focusing on multimodal neuroimaging data analysis-a domain that has witnessed rapid progress and garnered significant scientific interest. Our study categorizes and critically analyses numerous DL models, including Convolutional Neural Networks (CNNs), LSTM-CNN, GAN, and VGG, to understand their performance across different types of Neurology Diseases. Through particular analysis, we identify key benchmarks and datasets utilized in training and testing DL models, shedding light on the challenges and opportunities in clinical neuroimaging research. Moreover, we discuss the effectiveness of DL in real-world clinical scenarios, emphasizing its potential to revolutionize ND diagnosis and therapy. By synthesizing existing literature and describing future directions, this review not only provides insights into the current state of DL applications in ND analysis but also covers the way for the development of more efficient and accessible DL techniques. Finally, our findings underscore the transformative impact of DL in reshaping the landscape of clinical neuroimaging, offering hope for enhanced patient care and groundbreaking discoveries in the field of neurology. This review paper is beneficial for neuropathologists and new researchers in this field.
Collapse
Affiliation(s)
- Muhammad Shahid Iqbal
- Department of Computer Science and Information Technology, Women University of Azad Jammu & Kashmir, Bagh, Pakistan.
| | - Md Belal Bin Heyat
- CenBRAIN Neurotech Center of Excellence, School of Engineering, Westlake University, Hangzhou, Zhejiang, China.
| | - Saba Parveen
- College of Electronics and Information Engineering, Shenzhen University, Shenzhen 518060, China.
| | | | - Mohamad Roshanzamir
- Department of Computer Engineering, Faculty of Engineering, Fasa University, Fasa, Iran.
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation, Deakin University, VIC 3216, Australia.
| | - Faijan Akhtar
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China.
| | - Eram Sayeed
- Kisan Inter College, Dhaurahara, Kushinagar, India.
| | - Sadiq Hussain
- Department of Examination, Dibrugarh University, Assam 786004, India.
| | - Hany S Hussein
- Electrical Engineering Department, Faculty of Engineering, King Khalid University, Abha 61411, Saudi Arabia; Electrical Engineering Department, Faculty of Engineering, Aswan University, Aswan 81528, Egypt.
| | - Mohamad Sawan
- CenBRAIN Neurotech Center of Excellence, School of Engineering, Westlake University, Hangzhou, Zhejiang, China.
| |
Collapse
|
9
|
Yousefpanah K, Ebadi MJ, Sabzekar S, Zakaria NH, Osman NA, Ahmadian A. An emerging network for COVID-19 CT-scan classification using an ensemble deep transfer learning model. Acta Trop 2024; 257:107277. [PMID: 38878849 DOI: 10.1016/j.actatropica.2024.107277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Revised: 05/28/2024] [Accepted: 05/31/2024] [Indexed: 07/09/2024]
Abstract
Over the past few years, the widespread outbreak of COVID-19 has caused the death of millions of people worldwide. Early diagnosis of the virus is essential to control its spread and provide timely treatment. Artificial intelligence methods are often used as powerful tools to reach a COVID-19 diagnosis via computed tomography (CT) samples. In this paper, artificial intelligence-based methods are introduced to diagnose COVID-19. At first, a network called CT6-CNN is designed, and then two ensemble deep transfer learning models are developed based on Xception, ResNet-101, DenseNet-169, and CT6-CNN to reach a COVID-19 diagnosis by CT samples. The publicly available SARS-CoV-2 CT dataset is utilized for our implementation, including 2481 CT scans. The dataset is separated into 2108, 248, and 125 images for training, validation, and testing, respectively. Based on experimental results, the CT6-CNN model achieved 94.66% accuracy, 94.67% precision, 94.67% sensitivity, and 94.65% F1-score rate. Moreover, the ensemble learning models reached 99.2% accuracy. Experimental results affirm the effectiveness of designed models, especially the ensemble deep learning models, to reach a diagnosis of COVID-19.
Collapse
Affiliation(s)
| | - M J Ebadi
- Section of Mathematics, International Telematic University Uninettuno, Corso Vittorio Emanuele II, 39, 00186, Roma, Italy.
| | - Sina Sabzekar
- Civil Engineering Department, Sharif University of Technology, Tehran, Iran
| | - Nor Hidayati Zakaria
- Azman Hashim International Business School, Universiti Teknologi Malaysia, Kuala Lumpur, 54100, Malaysia
| | - Nurul Aida Osman
- Computer and Information Sciences Department, Faculty of Science and Information Technology, Universiti Teknologi Petronas, Malaysia
| | - Ali Ahmadian
- Decisions Lab, Mediterranea University of Reggio Calabria, Reggio Calabria, Italy; Faculty of Engineering and Natural Sciences, Istanbul Okan University, Istanbul, Turkey.
| |
Collapse
|
10
|
Zhou Z, Wang Q, An X, Chen S, Sun Y, Wang G, Yan G. A novel graph neural network method for Alzheimer's disease classification. Comput Biol Med 2024; 180:108869. [PMID: 39096607 DOI: 10.1016/j.compbiomed.2024.108869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2024] [Revised: 06/19/2024] [Accepted: 07/07/2024] [Indexed: 08/05/2024]
Abstract
Alzheimer's disease (AD) is a chronic neurodegenerative disease. Early diagnosis are very important to timely treatment and delay the progression of the disease. In the past decade, many computer-aided diagnostic (CAD) algorithms have been proposed for classification of AD. In this paper, we propose a novel graph neural network method, termed Brain Graph Attention Network (BGAN) for classification of AD. First, brain graph data are used to model classification of AD as a graph classification task. Second, a local attention layer is designed to capture and aggregate messages of interactions between node neighbors. And, a global attention layer is introduced to obtain the contribution of each node for graph representation. Finally, using the BGAN to implement AD classification. We train and test on two open public databases for AD classification task. Compared to classic models, the experimental results show that our model is superior to six classic models. We demonstrate that BGAN is a powerful classification model for AD. In addition, our model can provide an analysis of brain regions in order to judge which regions are related to AD disease and which regions are related to AD progression.
Collapse
Affiliation(s)
- Zhiheng Zhou
- Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing, China; School of Mathematical Sciences, University of Chinese Academy of Sciences, Beijing, China
| | - Qi Wang
- College of Science, China Agricultural University, Beijing, China
| | - Xiaoyu An
- Research Center for Mathematics and Interdisciplinary Sciences, Shandong University, Qingdao, China
| | - Siwei Chen
- Department of Neurology, Peking University First Hospital, Beijing, China
| | - Yongan Sun
- Department of Neurology, Peking University First Hospital, Beijing, China
| | - Guanghui Wang
- School of Mathematics, Shandong University, Jinan, China
| | - Guiying Yan
- Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing, China; School of Mathematical Sciences, University of Chinese Academy of Sciences, Beijing, China.
| |
Collapse
|
11
|
García-Gutiérrez F, Hernández-Lorenzo L, Cabrera-Martín MN, Matias-Guiu JA, Ayala JL. Predicting changes in brain metabolism and progression from mild cognitive impairment to dementia using multitask Deep Learning models and explainable AI. Neuroimage 2024; 297:120695. [PMID: 38942101 DOI: 10.1016/j.neuroimage.2024.120695] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2024] [Accepted: 06/18/2024] [Indexed: 06/30/2024] Open
Abstract
BACKGROUND The prediction of Alzheimer's disease (AD) progression from its early stages is a research priority. In this context, the use of Artificial Intelligence (AI) in AD has experienced a notable surge in recent years. However, existing investigations predominantly concentrate on distinguishing clinical phenotypes through cross-sectional approaches. This study aims to investigate the potential of modeling additional dimensions of the disease, such as variations in brain metabolism assessed via [18F]-fluorodeoxyglucose positron emission tomography (FDG-PET), and utilize this information to identify patients with mild cognitive impairment (MCI) who will progress to dementia (pMCI). METHODS We analyzed data from 1,617 participants from the Alzheimer's Disease Neuroimaging Initiative (ADNI) who had undergone at least one FDG-PET scan. We identified the brain regions with the most significant hypometabolism in AD and used Deep Learning (DL) models to predict future changes in brain metabolism. The best-performing model was then adapted under a multi-task learning framework to identify pMCI individuals. Finally, this model underwent further analysis using eXplainable AI (XAI) techniques. RESULTS Our results confirm a strong association between hypometabolism, disease progression, and cognitive decline. Furthermore, we demonstrated that integrating data on changes in brain metabolism during training enhanced the models' ability to detect pMCI individuals (sensitivity=88.4%, specificity=86.9%). Lastly, the application of XAI techniques enabled us to delve into the brain regions with the most significant impact on model predictions, highlighting the importance of the hippocampus, cingulate cortex, and some subcortical structures. CONCLUSION This study introduces a novel dimension to predictive modeling in AD, emphasizing the importance of projecting variations in brain metabolism under a multi-task learning paradigm.
Collapse
Affiliation(s)
| | | | - María Nieves Cabrera-Martín
- Department of Nuclear Medicine, Hospital Clínico San Carlos, Instituto de Investigación Sanitaria San Carlos (IdISSC), Madrid, Spain.
| | - Jordi A Matias-Guiu
- Department of Neurology, Hospital Clínico San Carlos, Instituto de Investigación Sanitaria San Carlos (IdISSC), Madrid, Spain.
| | - José L Ayala
- Department of Computer Architecture and Automation, Universidad Complutense, Madrid, Spain.
| |
Collapse
|
12
|
Liu M, Wu S, Chen R, Lin Z, Wang Y, Meijering E. Brain Image Segmentation for Ultrascale Neuron Reconstruction via an Adaptive Dual-Task Learning Network. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:2574-2586. [PMID: 38373129 DOI: 10.1109/tmi.2024.3367384] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/21/2024]
Abstract
Accurate morphological reconstruction of neurons in whole brain images is critical for brain science research. However, due to the wide range of whole brain imaging, uneven staining, and optical system fluctuations, there are significant differences in image properties between different regions of the ultrascale brain image, such as dramatically varying voxel intensities and inhomogeneous distribution of background noise, posing an enormous challenge to neuron reconstruction from whole brain images. In this paper, we propose an adaptive dual-task learning network (ADTL-Net) to quickly and accurately extract neuronal structures from ultrascale brain images. Specifically, this framework includes an External Features Classifier (EFC) and a Parameter Adaptive Segmentation Decoder (PASD), which share the same Multi-Scale Feature Encoder (MSFE). MSFE introduces an attention module named Channel Space Fusion Module (CSFM) to extract structure and intensity distribution features of neurons at different scales for addressing the problem of anisotropy in 3D space. Then, EFC is designed to classify these feature maps based on external features, such as foreground intensity distributions and image smoothness, and select specific PASD parameters to decode them of different classes to obtain accurate segmentation results. PASD contains multiple sets of parameters trained by different representative complex signal-to-noise distribution image blocks to handle various images more robustly. Experimental results prove that compared with other advanced segmentation methods for neuron reconstruction, the proposed method achieves state-of-the-art results in the task of neuron reconstruction from ultrascale brain images, with an improvement of about 49% in speed and 12% in F1 score.
Collapse
|
13
|
Razzak I, Naz S, Alinejad-Rokny H, Nguyen TN, Khalifa F. A Cascaded Mutliresolution Ensemble Deep Learning Framework for Large Scale Alzheimer's Disease Detection Using Brain MRIs. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2024; 21:573-581. [PMID: 36322495 DOI: 10.1109/tcbb.2022.3219032] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Alzheimer's is progressive and irreversible type of dementia, which causes degeneration and death of cells and their connections in the brain. AD worsens over time and greatly impacts patients' life and affects their important mental functions, including thinking, the ability to carry on a conversation, and judgment and response to environment. Clinically, there is no single test to effectively diagnose Alzheimer disease. However, computed tomography (CT) and magnetic resonance imaging (MRI) scans can be used to help in AD diagnosis by observing critical changes in the size of different brain areas, typically parietal and temporal lobes areas. In this work, an integrative mulitresolutional ensemble deep learning-based framework is proposed to achieve better predictive performance for the diagnosis of Alzheimer disease. Unlike ResNet, DenseNet and their variants proposed pipeline utilizes PartialNet in a hierarchical design tailored to AD detection using brain MRIs. The advantage of the proposed analysis system is that PartialNet diversified the depth and deep supervision. Additionally, it also incorporates the properties of identity mappings which makes it powerful in better learning due to feature reuse. Besides, the proposed ensemble PartialNet is better in vanishing gradient, diminishing forward-flow with low number of parameters and better training time in comparison to its counter network. The proposed analysis pipeline has been tested and evaluated on benchmark ADNI dataset collected from 379 subjects patients. Quantitative validation of the obtained results documented our framework's capability, outperforming state-of-the-art learning approaches for both multi-and binary-class AD detection.
Collapse
|
14
|
Li J, Xu F, Song S, Qi J. A maize seed variety identification method based on improving deep residual convolutional network. FRONTIERS IN PLANT SCIENCE 2024; 15:1382715. [PMID: 38803603 PMCID: PMC11128617 DOI: 10.3389/fpls.2024.1382715] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Accepted: 04/19/2024] [Indexed: 05/29/2024]
Abstract
Seed quality and safety are related to national food security, and seed variety purity is an essential indicator in seed quality detection. This study established a maize seed dataset comprising 5877 images of six different types and proposed a maize seed recognition model based on an improved ResNet50 framework. Firstly, we introduced the ResStage structure in the early stage of the original model, which facilitated the network's learning process and enabled more efficient information propagation across the network layers. Meanwhile, in the later residual blocks of the model, we introduced both the efficient channel attention (ECA) mechanism and depthwise separable (DS) convolution, which reduced the model's parameter cost and enabled the capturing of more precise and detailed features. Finally, a Swish-PReLU mixed activation function was introduced globally to improve the overall predictive power of the model. The results showed that our model achieved an impressive accuracy of 91.23% in corn seed classification, surpassing other related models. Compared with the original model, our model improved the accuracy by 7.07%, reduced the loss value by 0.19, and decreased the number of parameters by 40%. The research suggested that this method can efficiently classify corn seeds, holding significant value in seed variety identification.
Collapse
Affiliation(s)
- Jian Li
- College of Information Technology, Jilin Agricultural University, Changchun, China
- College of Information Technology, Jilin Bioinformatics Research Center, Changchun, China
| | - Fan Xu
- College of Information Technology, Jilin Agricultural University, Changchun, China
- College of Information Technology, Jilin Bioinformatics Research Center, Changchun, China
| | - Shaozhong Song
- School of Data Science and Artificial Intelligence, Jilin Engineering Normal University, Changchun, China
| | - Ji Qi
- College of Engineering Technical, Jilin Agricultural University, Changchun, China
| |
Collapse
|
15
|
AlHarkan K, Sultana N, Al Mulhim N, AlAbdulKader AM, Alsafwani N, Barnawi M, Alasqah K, Bazuhair A, Alhalwah Z, Bokhamseen D, Aljameel SS, Alamri S, Alqurashi Y, Ghamdi KA. Artificial intelligence approaches for early detection of neurocognitive disorders among older adults. Front Comput Neurosci 2024; 18:1307305. [PMID: 38444404 PMCID: PMC10913197 DOI: 10.3389/fncom.2024.1307305] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 01/29/2024] [Indexed: 03/07/2024] Open
Abstract
Introduction Dementia is one of the major global health issues among the aging population, characterized clinically by a progressive decline in higher cognitive functions. This paper aims to apply various artificial intelligence (AI) approaches to detect patients with mild cognitive impairment (MCI) or dementia accurately. Methods Quantitative research was conducted to address the objective of this study using randomly selected 343 Saudi patients. The Chi-square test was conducted to determine the association of the patient's cognitive function with various features, including demographical and medical history. Two widely used AI algorithms, logistic regression and support vector machine (SVM), were used for detecting cognitive decline. This study also assessed patients' cognitive function based on gender and developed the predicting models for males and females separately. Results Fifty four percent of patients have normal cognitive function, 34% have MCI, and 12% have dementia. The prediction accuracies for all the developed models are greater than 71%, indicating good prediction capability. However, the developed SVM models performed the best, with an accuracy of 93.3% for all patients, 94.4% for males only, and 95.5% for females only. The top 10 significant predictors based on the developed SVM model are education, bedtime, taking pills for chronic pain, diabetes, stroke, gender, chronic pains, coronary artery diseases, and wake-up time. Conclusion The results of this study emphasize the higher accuracy and reliability of the proposed methods in cognitive decline prediction that health practitioners can use for the early detection of dementia. This research can also stipulate substantial direction and supportive intuitions for scholars to enhance their understanding of crucial research, emerging trends, and new developments in future cognitive decline studies.
Collapse
Affiliation(s)
- Khalid AlHarkan
- Department of Family and Community Medicine, College of Medicine, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Nahid Sultana
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Noura Al Mulhim
- Department of Physiology, College of Medicine, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Assim M. AlAbdulKader
- Department of Family and Community Medicine, College of Medicine, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Noor Alsafwani
- Department of Pathology, College of Medicine, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Marwah Barnawi
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Khulud Alasqah
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Anhar Bazuhair
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Zainab Alhalwah
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Dina Bokhamseen
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Sumayh S. Aljameel
- Department of Computer Science, College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Sultan Alamri
- Department of Family Medicine, College of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Yousef Alqurashi
- Respiratory Care Department, College of Applied Medical Sciences, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Kholoud Al Ghamdi
- Department of Physiology, College of Medicine, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| |
Collapse
|
16
|
Pan D, Luo G, Zeng A, Zou C, Liang H, Wang J, Zhang T, Yang B. Adaptive 3DCNN-based Interpretable Ensemble Model for Early Diagnosis of Alzheimer's Disease. IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS 2024; 11:247-266. [PMID: 39239536 PMCID: PMC11374388 DOI: 10.1109/tcss.2022.3223999] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/07/2024]
Abstract
Adaptive interpretable ensemble model based on three-dimensional Convolutional Neural Network (3DCNN) and Genetic Algorithm (GA), i.e., 3DCNN+EL+GA, was proposed to differentiate the subjects with Alzheimer's Disease (AD) or Mild Cognitive Impairment (MCI) and further identify the discriminative brain regions significantly contributing to the classifications in a data-driven way. Plus, the discriminative brain sub-regions at a voxel level were further located in these achieved brain regions, with a gradient-based attribution method designed for CNN. Besides disclosing the discriminative brain sub-regions, the testing results on the datasets from the Alzheimer's Disease Neuroimaging Initiative (ADNI) and the Open Access Series of Imaging Studies (OASIS) indicated that 3DCNN+EL+GA outperformed other state-of-the-art deep learning algorithms and that the achieved discriminative brain regions (e.g., the rostral hippocampus, caudal hippocampus, and medial amygdala) were linked to emotion, memory, language, and other essential brain functions impaired early in the AD process. Future research is needed to examine the generalizability of the proposed method and ideas to discern discriminative brain regions for other brain disorders, such as severe depression, schizophrenia, autism, and cerebrovascular diseases, using neuroimaging.
Collapse
|
17
|
Kumar PR, Jha RK, Katti A. Brain tissue segmentation in neurosurgery: a systematic analysis for quantitative tractography approaches. Acta Neurol Belg 2024; 124:1-15. [PMID: 36609837 DOI: 10.1007/s13760-023-02170-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Accepted: 12/31/2022] [Indexed: 01/09/2023]
Abstract
Diffusion magnetic resonance imaging (dMRI) is a cutting-edge imaging method that provides a macro-scale in vivo map of the white matter pathways in the brain. The measurement of brain microstructure and the enhancement of tractography rely heavily on dMRI tissue segmentation. Anatomical MRI technique (e.g., T1- and T2-weighted imaging) is the most widely used method for segmentation in dMRI. In comparison to anatomical MRI, dMRI suffers from higher image distortions, lower image quality, and making inter-modality registration more difficult. The dMRI tractography study of brain connectivity has become a major part of the neuroimaging landscape in recent years. In this research, we provide a high-level overview of the methods used to segment several brain tissues types, including grey and white matter and cerebrospinal fluid, to enable quantitative studies of structural connectivity in the brain in health and illness. In the first part of our review, we discuss the three main phases in the quantitative analysis of tractography, which are correction, segmentation, and quantification. Methodological possibilities are described for each phase, along with their popularity and potential benefits and drawbacks. After that, we will look at research that used quantitative tractography approaches to examine the white and grey matter of the brain, with an emphasis on neurodevelopment, ageing, neurological illnesses, mental disorders, and neurosurgery as possible applications. Even though there have been substantial advancements in methodological technology and the spectrum of applications, there is still no consensus regarding the "optimal" approach in the quantitative analysis of tractography. As a result, researchers should tread carefully when interpreting the findings of quantitative analysis of tractography.
Collapse
Affiliation(s)
- Puranam Revanth Kumar
- Department of Electronics and Communication Engineering, IcfaiTech (Faculty of Science and Technology), IFHE University, Hyderabad, 501203, India.
| | - Rajesh Kumar Jha
- Department of Electronics and Communication Engineering, IcfaiTech (Faculty of Science and Technology), IFHE University, Hyderabad, 501203, India
| | - Amogh Katti
- Department of Computer Science and Engineering, Gitam School of Technology, GITAM University, Hyderabad, 502329, India
| |
Collapse
|
18
|
Parvin S, Nimmy SF, Kamal MS. Convolutional neural network based data interpretable framework for Alzheimer's treatment planning. Vis Comput Ind Biomed Art 2024; 7:3. [PMID: 38296864 PMCID: PMC10830981 DOI: 10.1186/s42492-024-00154-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2023] [Accepted: 01/08/2024] [Indexed: 02/02/2024] Open
Abstract
Alzheimer's disease (AD) is a neurological disorder that predominantly affects the brain. In the coming years, it is expected to spread rapidly, with limited progress in diagnostic techniques. Various machine learning (ML) and artificial intelligence (AI) algorithms have been employed to detect AD using single-modality data. However, recent developments in ML have enabled the application of these methods to multiple data sources and input modalities for AD prediction. In this study, we developed a framework that utilizes multimodal data (tabular data, magnetic resonance imaging (MRI) images, and genetic information) to classify AD. As part of the pre-processing phase, we generated a knowledge graph from the tabular data and MRI images. We employed graph neural networks for knowledge graph creation, and region-based convolutional neural network approach for image-to-knowledge graph generation. Additionally, we integrated various explainable AI (XAI) techniques to interpret and elucidate the prediction outcomes derived from multimodal data. Layer-wise relevance propagation was used to explain the layer-wise outcomes in the MRI images. We also incorporated submodular pick local interpretable model-agnostic explanations to interpret the decision-making process based on the tabular data provided. Genetic expression values play a crucial role in AD analysis. We used a graphical gene tree to identify genes associated with the disease. Moreover, a dashboard was designed to display XAI outcomes, enabling experts and medical professionals to easily comprehend the prediction results.
Collapse
Affiliation(s)
- Sazia Parvin
- Information Technology, Melbourne Polytechnic, Melbourne, VIC 3072, Australia.
| | - Sonia Farhana Nimmy
- Faculty of Economics and Business, University of New South Wales, Sydney, ACT 2612, Australia
| | - Md Sarwar Kamal
- School of Computer Science, Faculty of Engineering and IT, University of Technology Sydney, Sydney, NSW 2007, Australia
| |
Collapse
|
19
|
Scherl C, Otto M, Ghanem I, Moviglia J, Sadi F, Gnilka T, Rotter N, Zaubitzer L, Stallkamp J. [Development and evaluation of ultrasound navigation for free-hand biopsies of small masses in the head and neck area]. HNO 2024; 72:76-82. [PMID: 38051313 PMCID: PMC11362245 DOI: 10.1007/s00106-023-01385-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/22/2023] [Indexed: 12/07/2023]
Abstract
BACKGROUND Ultrasound is an important imaging method in the head and neck area. It is readily available, dynamic, inexpensive, and does not involve radiation exposure. Interventions in the complex head and neck anatomy require good orientation, which is supported by navigation systems. OBJECTIVE This work aimed to develop a new ultrasound-controlled navigation system for taking biopsies of small target structures in the head and neck region. METHODS A neck phantom with sonographically detectable masses (size: 8-10 mm) was constructed. These were automatically segmented using a ResNet-50-based deep neural network. The ultrasound scanner was equipped with an individually manufactured tracking tool. RESULTS The positions of the ultrasound device, the masses, and a puncture needle were recorded in the world coordinate system. In 8 out of 10 cases, an 8‑mm mass was hit. In a special evaluation phantom, the average deviation was calculated to be 2.5 mm. The tracked biopsy needle is aligned and navigated to the masses by auditory feedback. CONCLUSION Outstanding advantages compared to conventional navigation systems include renunciation of preoperative tomographic imaging, automatic three-dimensional real-time registration that considers intraoperative tissue displacements, maintenance of the surgeon's optical axis at the surgical site without having to look at a navigation monitor, and working freely with both hands without holding the ultrasound scanner during biopsy taking. The described functional model can also be used in open head and neck surgery.
Collapse
Affiliation(s)
- Claudia Scherl
- Klinik für Hals-Nasen-Ohrenheilkunde, Kopf- und Halschirurgie, Medizinische Fakultät Mannheim, Universität Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Deutschland.
- AI Health Innovation Cluster, Heidelberg-Mannheim Health and Life Science Alliance, Heidelberg, Deutschland.
| | - Marie Otto
- Mannheim Institute for Intelligent Systems in Medicine (MIISM), Medizinische Fakultät Mannheim, Universität Heidelberg, Heidelberg, Deutschland
| | - Ibrahim Ghanem
- Klinik für Hals-Nasen-Ohrenheilkunde, Kopf- und Halschirurgie, Medizinische Fakultät Mannheim, Universität Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Deutschland
| | - Javier Moviglia
- Mannheim Institute for Intelligent Systems in Medicine (MIISM), Medizinische Fakultät Mannheim, Universität Heidelberg, Heidelberg, Deutschland
| | - Fabian Sadi
- Mannheim Institute for Intelligent Systems in Medicine (MIISM), Medizinische Fakultät Mannheim, Universität Heidelberg, Heidelberg, Deutschland
| | - Tirza Gnilka
- Mannheim Institute for Intelligent Systems in Medicine (MIISM), Medizinische Fakultät Mannheim, Universität Heidelberg, Heidelberg, Deutschland
| | - Nicole Rotter
- Klinik für Hals-Nasen-Ohrenheilkunde, Kopf- und Halschirurgie, Medizinische Fakultät Mannheim, Universität Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Deutschland
| | - Lena Zaubitzer
- Klinik für Hals-Nasen-Ohrenheilkunde, Kopf- und Halschirurgie, Medizinische Fakultät Mannheim, Universität Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Deutschland
| | - Jan Stallkamp
- Mannheim Institute for Intelligent Systems in Medicine (MIISM), Medizinische Fakultät Mannheim, Universität Heidelberg, Heidelberg, Deutschland
| |
Collapse
|
20
|
Sharif MI, Li JP, Khan MA, Kadry S, Tariq U. M3BTCNet: multi model brain tumor classification using metaheuristic deep neural network features optimization. Neural Comput Appl 2024; 36:95-110. [DOI: 10.1007/s00521-022-07204-6] [Citation(s) in RCA: 14] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2021] [Accepted: 03/29/2022] [Indexed: 12/01/2022]
|
21
|
Koc E, Kalkan H, Bilgen S. Autism Spectrum Disorder Detection by Hybrid Convolutional Recurrent Neural Networks from Structural and Resting State Functional MRI Images. AUTISM RESEARCH AND TREATMENT 2023; 2023:4136087. [PMID: 38152612 PMCID: PMC10752691 DOI: 10.1155/2023/4136087] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Revised: 10/19/2023] [Accepted: 11/22/2023] [Indexed: 12/29/2023]
Abstract
This study aims to increase the accuracy of autism spectrum disorder (ASD) diagnosis based on cognitive and behavioral phenotypes through multiple neuroimaging modalities. We apply machine learning (ML) algorithms to classify ASD patients and healthy control (HC) participants using structural magnetic resonance imaging (s-MRI) together with resting state functional MRI (rs-f-MRI and f-MRI) data from the large multisite data repository ABIDE (autism brain imaging data exchange) and identify important brain connectivity features. The 2D f-MRI images were converted into 3D s-MRI images, and datasets were preprocessed using the Montreal Neurological Institute (MNI) atlas. The data were then denoised to remove any confounding factors. We show, by using three fusion strategies such as early fusion, late fusion, and cross fusion, that, in this implementation, hybrid convolutional recurrent neural networks achieve better performance in comparison to either convolutional neural networks (CNNs) or recurrent neural networks (RNNs). The proposed model classifies subjects as autistic or not according to how functional and anatomical connectivity metrics provide an overall diagnosis based on the autism diagnostic observation schedule (ADOS) standard. Our hybrid network achieved an accuracy of 96% by fusing s-MRI and f-MRI together, which outperforms the methods used in previous studies.
Collapse
Affiliation(s)
- Emel Koc
- Istanbul Okan University, Istanbul, Türkiye
| | | | | |
Collapse
|
22
|
Bolla G, Berente DB, Andrássy A, Zsuffa JA, Hidasi Z, Csibri E, Csukly G, Kamondi A, Kiss M, Horvath AA. Comparison of the diagnostic accuracy of resting-state fMRI driven machine learning algorithms in the detection of mild cognitive impairment. Sci Rep 2023; 13:22285. [PMID: 38097674 PMCID: PMC10721802 DOI: 10.1038/s41598-023-49461-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Accepted: 12/08/2023] [Indexed: 12/17/2023] Open
Abstract
Mild cognitive impairment (MCI) is a potential therapeutic window in the prevention of dementia; however, automated detection of early cognitive deterioration is an unresolved issue. The aim of our study was to compare various classification approaches to differentiate MCI patients from healthy controls, based on rs-fMRI data, using machine learning (ML) algorithms. Own dataset (from two centers) and ADNI database were used during the analysis. Three fMRI parameters were applied in five feature selection algorithms: local correlation, intrinsic connectivity, and fractional amplitude of low frequency fluctuations. Support vector machine (SVM) and random forest (RF) methods were applied for classification. We achieved a relatively wide range of 78-87% accuracy for the various feature selection methods with SVM combining the three rs-fMRI parameters. In the ADNI datasets case we can also see even 90% accuracy scores. RF provided a more harmonized result among the feature selection algorithms in both datasets with 80-84% accuracy for our local and 74-82% for the ADNI database. Despite some lower performance metrics of some algorithms, most of the results were positive and could be seen in two unrelated datasets which increase the validity of our methods. Our results highlight the potential of ML-based fMRI applications for automated diagnostic techniques to recognize MCI patients.
Collapse
Affiliation(s)
- Gergo Bolla
- Neurocognitive Research Center, National Institute of Mental Health, Neurology and Neurosurgery, Budapest, Hungary
- School of PhD Studies, Semmelweis University, Budapest, Hungary
| | - Dalida Borbala Berente
- Neurocognitive Research Center, National Institute of Mental Health, Neurology and Neurosurgery, Budapest, Hungary
- School of PhD Studies, Semmelweis University, Budapest, Hungary
| | - Anita Andrássy
- Neurocognitive Research Center, National Institute of Mental Health, Neurology and Neurosurgery, Budapest, Hungary
| | - Janos Andras Zsuffa
- Neurocognitive Research Center, National Institute of Mental Health, Neurology and Neurosurgery, Budapest, Hungary
- Department of Family Medicine, Semmelweis University, Budapest, Hungary
| | - Zoltan Hidasi
- Department of Psychiatry and Psychotherapy, Semmelweis University, Budapest, Hungary
| | - Eva Csibri
- Department of Psychiatry and Psychotherapy, Semmelweis University, Budapest, Hungary
| | - Gabor Csukly
- Neurocognitive Research Center, National Institute of Mental Health, Neurology and Neurosurgery, Budapest, Hungary
- Department of Psychiatry and Psychotherapy, Semmelweis University, Budapest, Hungary
| | - Anita Kamondi
- Neurocognitive Research Center, National Institute of Mental Health, Neurology and Neurosurgery, Budapest, Hungary
- Department of Neurology, Semmelweis University, Budapest, Hungary
| | - Mate Kiss
- Siemens Healthcare, Budapest, Hungary
| | - Andras Attila Horvath
- Department of Anatomy Histology and Embryology, Semmelweis University, Budapest, Hungary.
| |
Collapse
|
23
|
Abdelwahab MM, Al-Karawi KA, Semary HE. Deep Learning-Based Prediction of Alzheimer's Disease Using Microarray Gene Expression Data. Biomedicines 2023; 11:3304. [PMID: 38137524 PMCID: PMC10741889 DOI: 10.3390/biomedicines11123304] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 12/02/2023] [Accepted: 12/04/2023] [Indexed: 12/24/2023] Open
Abstract
Alzheimer's disease is a genetically complex disorder, and microarray technology provides valuable insights into it. However, the high dimensionality of microarray datasets and small sample sizes pose challenges. Gene selection techniques have emerged as a promising solution to this challenge, potentially revolutionizing AD diagnosis. The study aims to investigate deep learning techniques, specifically neural networks, in predicting Alzheimer's disease using microarray gene expression data. The goal is to develop a reliable predictive model for early detection and diagnosis, potentially improving patient care and intervention strategies. This study employed gene selection techniques, including Singular Value Decomposition (SVD) and Principal Component Analysis (PCA), to pinpoint pertinent genes within microarray datasets. Leveraging deep learning principles, we harnessed a Convolutional Neural Network (CNN) as our classifier for Alzheimer's disease (AD) prediction. Our approach involved the utilization of a seven-layer CNN with diverse configurations to process the dataset. Empirical outcomes on the AD dataset underscored the effectiveness of the PCA-CNN model, yielding an accuracy of 96.60% and a loss of 0.3503. Likewise, the SVD-CNN model showcased remarkable accuracy, attaining 97.08% and a loss of 0.2466. These results accentuate the potential of our method for gene dimension reduction and classification accuracy enhancement by selecting a subset of pertinent genes. Integrating gene selection methodologies with deep learning architectures presents a promising framework for elevating AD prediction and promoting precision medicine in neurodegenerative disorders. Ongoing research endeavors aim to generalize this approach for diverse applications, explore alternative gene selection techniques, and investigate a variety of deep learning architectures.
Collapse
Affiliation(s)
- Mahmoud M. Abdelwahab
- Department of Mathematics and Statistics, College of Science, Imam Mohammad Ibn Saud Islamic University, Riyadh 11564, Saudi Arabia;
- Department of Basic Sciences, Higher Institute of Administrative Sciences, Belbeis 44621, Egypt
| | - Khamis A. Al-Karawi
- School of Science, Engineering and Environment, Salford University, Salford M5 4WT, UK;
- College of Veterinary Medicine, Diyala University, Baquba 32001, Iraq
| | - Hatem E. Semary
- Department of Mathematics and Statistics, College of Science, Imam Mohammad Ibn Saud Islamic University, Riyadh 11564, Saudi Arabia;
- Department of Statistics and Insurance, Faculty of Commerce, Zagazig University, Zagazig 44519, Egypt
| |
Collapse
|
24
|
Nagarajan B, Chakravarthy S, Venkatesan VK, Ramakrishna MT, Khan SB, Basheer S, Albalawi E. A Deep Learning Framework with an Intermediate Layer Using the Swarm Intelligence Optimizer for Diagnosing Oral Squamous Cell Carcinoma. Diagnostics (Basel) 2023; 13:3461. [PMID: 37998597 PMCID: PMC10670914 DOI: 10.3390/diagnostics13223461] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Revised: 11/07/2023] [Accepted: 11/08/2023] [Indexed: 11/25/2023] Open
Abstract
One of the most prevalent cancers is oral squamous cell carcinoma, and preventing mortality from this disease primarily depends on early detection. Clinicians will greatly benefit from automated diagnostic techniques that analyze a patient's histopathology images to identify abnormal oral lesions. A deep learning framework was designed with an intermediate layer between feature extraction layers and classification layers for classifying the histopathological images into two categories, namely, normal and oral squamous cell carcinoma. The intermediate layer is constructed using the proposed swarm intelligence technique called the Modified Gorilla Troops Optimizer. While there are many optimization algorithms used in the literature for feature selection, weight updating, and optimal parameter identification in deep learning models, this work focuses on using optimization algorithms as an intermediate layer to convert extracted features into features that are better suited for classification. Three datasets comprising 2784 normal and 3632 oral squamous cell carcinoma subjects are considered in this work. Three popular CNN architectures, namely, InceptionV2, MobileNetV3, and EfficientNetB3, are investigated as feature extraction layers. Two fully connected Neural Network layers, batch normalization, and dropout are used as classification layers. With the best accuracy of 0.89 among the examined feature extraction models, MobileNetV3 exhibits good performance. This accuracy is increased to 0.95 when the suggested Modified Gorilla Troops Optimizer is used as an intermediary layer.
Collapse
Affiliation(s)
- Bharanidharan Nagarajan
- School of Computer Science Engineering and Information Systems (SCORE), Vellore Institute of Technology, Vellore 632014, India; (B.N.); (V.K.V.)
| | - Sannasi Chakravarthy
- Department of ECE, Bannari Amman Institute of Technology, Sathyamangalam 638401, India;
| | - Vinoth Kumar Venkatesan
- School of Computer Science Engineering and Information Systems (SCORE), Vellore Institute of Technology, Vellore 632014, India; (B.N.); (V.K.V.)
| | - Mahesh Thyluru Ramakrishna
- Department of Computer Science and Engineering, Faculty of Engineering and Technology, JAIN (Deemed-to-Be University), Bangalore 562112, India
| | - Surbhi Bhatia Khan
- Department of Data Science, School of Science Engineering and Environment, University of Salford, Manchester M5 4WT, UK
- Department of Engineering and Environment, University of Religions and Denominations, Qom 13357, Iran
- Department of Electrical and Computer Engineering, Lebanese American University, Byblos P.O. Box 13-5053, Lebanon
| | - Shakila Basheer
- Department of Information Systems, College of Computer and Information Science, Princess Nourah bint Abdulrahman University, Riyadh 11671, Saudi Arabia;
| | - Eid Albalawi
- Department of Computer Science, School of Computer Science and Information Technology, King Faisal University, Al-Ahsa 31982, Saudi Arabia;
| |
Collapse
|
25
|
Gu G, Shen L, Zhou X. An online diagnosis method for cancer lesions based on intelligent imaging analysis. Open Life Sci 2023; 18:20220625. [PMID: 37426622 PMCID: PMC10329275 DOI: 10.1515/biol-2022-0625] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2023] [Revised: 04/21/2023] [Accepted: 05/04/2023] [Indexed: 07/11/2023] Open
Abstract
With the popularization and application of artificial intelligence and medical image big data in the field of medical image, the universality of modes and the rapid development of deep learning have endowed multi-mode fusion technology with great development potential. Technologies of 5G and artificial intelligence have rapidly promoted the innovation of online hospitals. To assist doctors in the remote diagnosis of cancer lesions, this article proposes a cancer localization and recognition model based on magnetic resonance images. We combine a convolution neural network with Transformer to achieve local features and global context information, which can suppress the interference of noise and background regions in magnetic resonance imaging. We design a module combining convolutional neural networks and Transformer architecture, which interactively fuses the extracted features to increase the cancer localization accuracy of magnetic resonance imaging (MRI) images. We extract tumor regions and perform feature fusion to further improve the interactive ability of features and achieve cancer recognition. Our model can achieve an accuracy of 88.65%, which means our model can locate cancer regions in MRI images and effectively identify them. Furthermore, our model can be embedded into the online hospital system by 5G technology to provide technical support for the construction of network hospitals.
Collapse
Affiliation(s)
- Guangliang Gu
- Department of Radiology, Tongxiang First People’s Hospital, Jiaxing314500, Zhejiang, China
| | - Lijuan Shen
- Department of Nuclear Medicine, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai200080, Shanghai, China
| | - Xisheng Zhou
- Department of Radiology, Tongxiang First People’s Hospital, Jiaxing314500, Zhejiang, China
| |
Collapse
|
26
|
Dash S, Parida P, Mohanty JR. Illumination robust deep convolutional neural network for medical image classification. Soft comput 2023. [DOI: 10.1007/s00500-023-07918-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/19/2023]
|
27
|
Zhao Z, Chuah JH, Lai KW, Chow CO, Gochoo M, Dhanalakshmi S, Wang N, Bao W, Wu X. Conventional machine learning and deep learning in Alzheimer's disease diagnosis using neuroimaging: A review. Front Comput Neurosci 2023; 17:1038636. [PMID: 36814932 PMCID: PMC9939698 DOI: 10.3389/fncom.2023.1038636] [Citation(s) in RCA: 26] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2022] [Accepted: 01/13/2023] [Indexed: 02/08/2023] Open
Abstract
Alzheimer's disease (AD) is a neurodegenerative disorder that causes memory degradation and cognitive function impairment in elderly people. The irreversible and devastating cognitive decline brings large burdens on patients and society. So far, there is no effective treatment that can cure AD, but the process of early-stage AD can slow down. Early and accurate detection is critical for treatment. In recent years, deep-learning-based approaches have achieved great success in Alzheimer's disease diagnosis. The main objective of this paper is to review some popular conventional machine learning methods used for the classification and prediction of AD using Magnetic Resonance Imaging (MRI). The methods reviewed in this paper include support vector machine (SVM), random forest (RF), convolutional neural network (CNN), autoencoder, deep learning, and transformer. This paper also reviews pervasively used feature extractors and different types of input forms of convolutional neural network. At last, this review discusses challenges such as class imbalance and data leakage. It also discusses the trade-offs and suggestions about pre-processing techniques, deep learning, conventional machine learning methods, new techniques, and input type selection.
Collapse
Affiliation(s)
- Zhen Zhao
- Department of Electrical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur, Malaysia
| | - Joon Huang Chuah
- Department of Electrical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur, Malaysia,*Correspondence: Joon Huang Chuah ✉
| | - Khin Wee Lai
- Department of Biomedical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur, Malaysia,Khin Wee Lai ✉
| | - Chee-Onn Chow
- Department of Electrical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur, Malaysia
| | - Munkhjargal Gochoo
- Department of Computer Science and Software Engineering, United Arab Emirates University, Al Ain, United Arab Emirates
| | - Samiappan Dhanalakshmi
- Department of Electronics and Communication Engineering, SRM Institute of Science and Technology, Chennai, India
| | - Na Wang
- School of Automation, Guangdong Polytechnic Normal University, Guangzhou, China
| | - Wei Bao
- China Electronics Standardization Institute, Beijing, China,Wei Bao ✉
| | - Xiang Wu
- School of Medical Information Engineering, Xuzhou Medical University, Xuzhou, China
| |
Collapse
|
28
|
Abbas Q, Hussain A, Baig AR. CAD-ALZ: A Blockwise Fine-Tuning Strategy on Convolutional Model and Random Forest Classifier for Recognition of Multistage Alzheimer's Disease. Diagnostics (Basel) 2023; 13:167. [PMID: 36611459 PMCID: PMC9818479 DOI: 10.3390/diagnostics13010167] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 12/24/2022] [Accepted: 12/31/2022] [Indexed: 01/05/2023] Open
Abstract
Mental deterioration or Alzheimer's (ALZ) disease is progressive and causes both physical and mental dependency. There is a need for a computer-aided diagnosis (CAD) system that can help doctors make an immediate decision. (1) Background: Currently, CAD systems are developed based on hand-crafted features, machine learning (ML), and deep learning (DL) techniques. Those CAD systems frequently require domain-expert knowledge and massive datasets to extract deep features or model training, which causes problems with class imbalance and overfitting. Additionally, there are still manual approaches used by radiologists due to the lack of dataset availability and to train the model with cost-effective computation. Existing works rely on performance improvement by neglecting the problems of the limited dataset, high computational complexity, and unavailability of lightweight and efficient feature descriptors. (2) Methods: To address these issues, a new approach, CAD-ALZ, is developed by extracting deep features through a ConvMixer layer with a blockwise fine-tuning strategy on a very small original dataset. At first, we apply the data augmentation method to images to increase the size of datasets. In this study, a blockwise fine-tuning strategy is employed on the ConvMixer model to detect robust features. Afterwards, a random forest (RF) is used to classify ALZ disease stages. (3) Results: The proposed CAD-ALZ model obtained significant results by using six evaluation metrics such as the F1-score, Kappa, accuracy, precision, sensitivity, and specificity. The CAD-ALZ model performed with a sensitivity of 99.69% and an F1-score of 99.61%. (4) Conclusions: The suggested CAD-ALZ approach is a potential technique for clinical use and computational efficiency compared to state-of-the-art approaches. The CAD-ALZ model code is freely available on GitHub for the scientific community.
Collapse
Affiliation(s)
- Qaisar Abbas
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia
| | - Ayyaz Hussain
- Department of Computer Science, Quaid-i-Azam University, Islamabad 44000, Pakistan
| | - Abdul Rauf Baig
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia
| |
Collapse
|
29
|
Li M, Jiang Y, Li X, Yin S, Luo H. Ensemble of convolutional neural networks and multilayer perceptron for the diagnosis of mild cognitive impairment and Alzheimer's disease. Med Phys 2023; 50:209-225. [PMID: 36121183 DOI: 10.1002/mp.15985] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2022] [Revised: 08/09/2022] [Accepted: 09/07/2022] [Indexed: 01/25/2023] Open
Abstract
BACKGROUND Structural magnetic resonance imaging (sMRI) can provide morphological information about the structure and function of the brain in the same scanning process. It has been widely used in the diagnosis of Alzheimer's disease (AD) and mild cognitive impairment (MCI). PURPOSE To capture the anatomical changes in the brain caused by AD/MCI, deep learning-based MRI image analysis methods have been proposed in recent years. However, it is observed that the performance of most existing methods is limited as they only construct a single type of deep network and ignore the significance of other clinical information. METHODS To make up for these defects, an ensemble framework that incorporates three types of dedicatedly-designed convolutional neural networks (CNNs) and a multilayer perceptron (MLP) network is proposed, where three CNNs with entropy-based multi-instance learning pooling layers have more reliable feature selection abilities. The dedicatedly-designed base classifiers can make use of the heterogeneous data, and empower the framework with enhanced diversity and robustness. In particular, to consider the interactions among the base classifiers, a novel multi-head self-attention voting scheme is designed. Moreover, considering the chance that MCI can be transformed to AD, the proposed framework is designed to diagnose AD and predict MCI conversion simultaneously, with the aid of the transfer learning technique. RESULTS For performance evaluation and comparison, extensive experiments are conducted on the public dataset of the Alzheimer's Disease Neuroimaging Initiative (ADNI). The results show that the proposed ensemble framework provides superior performance under most of the evaluation metrics. Especially, the proposed framework achieves state-of-the-art diagnostic accuracy (98.61% for the AD diagnosis task, and 84.49% for the MCI conversion prediction task). CONCLUSIONS These promising results demonstrate the proposed ensemble framework can accurately diagnose AD patients and predict the conversion of MCI patients, which has the potential of clinical practice for diagnosing AD and MCI.
Collapse
Affiliation(s)
- Minglei Li
- Department of Control Science and Engineering, Harbin Institute of Technology, Harbin, Heilongjiang, China
| | - Yuchen Jiang
- Department of Control Science and Engineering, Harbin Institute of Technology, Harbin, Heilongjiang, China
| | - Xiang Li
- Department of Control Science and Engineering, Harbin Institute of Technology, Harbin, Heilongjiang, China
| | - Shen Yin
- Department of Mechanical and Industrial Engineering, Norwegian University of Science and Technology, Trondheim, Norway
| | - Hao Luo
- Department of Control Science and Engineering, Harbin Institute of Technology, Harbin, Heilongjiang, China
| |
Collapse
|
30
|
Wei X, Liu Q, Liu M, Wang Y, Meijering E. 3D Soma Detection in Large-Scale Whole Brain Images via a Two-Stage Neural Network. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:148-157. [PMID: 36103445 DOI: 10.1109/tmi.2022.3206605] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
3D soma detection in whole brain images is a critical step for neuron reconstruction. However, existing soma detection methods are not suitable for whole mouse brain images with large amounts of data and complex structure. In this paper, we propose a two-stage deep neural network to achieve fast and accurate soma detection in large-scale and high-resolution whole mouse brain images (more than 1TB). For the first stage, a lightweight Multi-level Cross Classification Network (MCC-Net) is proposed to filter out images without somas and generate coarse candidate images by combining the advantages of the multi convolution layer's feature extraction ability. It can speed up the detection of somas and reduce the computational complexity. For the second stage, to further obtain the accurate locations of somas in the whole mouse brain images, the Scale Fusion Segmentation Network (SFS-Net) is developed to segment soma regions from candidate images. Specifically, the SFS-Net captures multi-scale context information and establishes a complementary relationship between encoder and decoder by combining the encoder-decoder structure and a 3D Scale-Aware Pyramid Fusion (SAPF) module for better segmentation performance. The experimental results on three whole mouse brain images verify that the proposed method can achieve excellent performance and provide the reconstruction of neurons with beneficial information. Additionally, we have established a public dataset named WBMSD, including 798 high-resolution and representative images ( 256 ×256 ×256 voxels) from three whole mouse brain images, dedicated to the research of soma detection, which will be released along with this paper.
Collapse
|
31
|
Khan YF, Kaushik B, Chowdhary CL, Srivastava G. Ensemble Model for Diagnostic Classification of Alzheimer's Disease Based on Brain Anatomical Magnetic Resonance Imaging. Diagnostics (Basel) 2022; 12:diagnostics12123193. [PMID: 36553199 PMCID: PMC9777931 DOI: 10.3390/diagnostics12123193] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Revised: 11/08/2022] [Accepted: 11/15/2022] [Indexed: 12/24/2022] Open
Abstract
Alzheimer's is one of the fast-growing diseases among people worldwide leading to brain atrophy. Neuroimaging reveals extensive information about the brain's anatomy and enables the identification of diagnostic features. Artificial intelligence (AI) in neuroimaging has the potential to significantly enhance the treatment process for Alzheimer's disease (AD). The objective of this study is two-fold: (1) to compare existing Machine Learning (ML) algorithms for the classification of AD. (2) To propose an effective ensemble-based model for the same and to perform its comparative analysis. In this study, data from the Alzheimer's Diseases Neuroimaging Initiative (ADNI), an online repository, is utilized for experimentation consisting of 2125 neuroimages of Alzheimer's disease (n = 975), mild cognitive impairment (n = 538) and cognitive normal (n = 612). For classification, the framework incorporates a Decision Tree (DT), Random Forest (RF), Naïve Bayes (NB), and K-Nearest Neighbor (K-NN) followed by some variations of Support Vector Machine (SVM), such as SVM (RBF kernel), SVM (Polynomial Kernel), and SVM (Sigmoid kernel), as well as Gradient Boost (GB), Extreme Gradient Boosting (XGB) and Multi-layer Perceptron Neural Network (MLP-NN). Afterwards, an Ensemble Based Generic Kernel is presented where Master-Slave architecture is combined to attain better performance. The proposed model is an ensemble of Extreme Gradient Boosting, Decision Tree and SVM_Polynomial kernel (XGB + DT + SVM). At last, the proposed method is evaluated using cross-validation using statistical techniques along with other ML models. The presented ensemble model (XGB + DT + SVM) outperformed existing state-of-the-art algorithms with an accuracy of 89.77%. The efficiency of all the models was optimized using Grid-based tuning, and the results obtained after such process showed significant improvement. XGB + DT + SVM with optimized parameters outperformed all other models with an efficiency of 95.75%. The implication of the proposed ensemble-based learning approach clearly shows the best results compared to other ML models. This experimental comparative analysis improved understanding of the above-defined methods and enhanced their scope and significance in the early detection of Alzheimer's disease.
Collapse
Affiliation(s)
| | - Baijnath Kaushik
- School of CSE, Shri Mata Vaishno Devi University, Katra 182320, India
| | - Chiranji Lal Chowdhary
- School of Information Technology and Engineering, Vellore Institute of Technology, Vellore 632014, India
- Correspondence:
| | - Gautam Srivastava
- Department of Mathematics and Computer Science, Brandon University, Brandon, MB R7A 6A9, Canada
- Research Centre for Interneural Computing, China Medical University, Taichung 40402, Taiwan
- Department of Computer Science and Math, Lebanese American University, Beirut 1102, Lebanon
| |
Collapse
|
32
|
TomFusioNet: A tomato crop analysis framework for mobile applications using the multi-objective optimization based late fusion of deep models and background elimination. Appl Soft Comput 2022. [DOI: 10.1016/j.asoc.2022.109898] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/02/2022]
|
33
|
Multi-modality MRI for Alzheimer's disease detection using deep learning. Phys Eng Sci Med 2022; 45:1043-1053. [PMID: 36063346 DOI: 10.1007/s13246-022-01165-9] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2021] [Accepted: 07/20/2022] [Indexed: 12/15/2022]
Abstract
Diffusion tensor imaging (DTI) is a new technology in magnetic resonance imaging, which allows us to observe the insightful structure of the human body in vivo and non-invasively. It identifies the microstructure of white matter (WM) connectivity by estimating the movement of water molecules at each voxel. This makes possible the identification of the damage to WM integrity caused by Alzheimer's disease (AD) at its early stage, called mild cognitive impairment (MCI). Furthermore, the brain's gray matter (GM) atrophy characterizes the main structural changes in AD, which can be sensitively detected by structural MRI (sMRI) modality. In this research, we aimed to classify the Alzheimer's diseases stages by developing a novel multi-modality MRI (DTI and sMRI) fusion strategy to detect WM alterations and GM atrophy in AD patients. The latter is based on a 2-dimensional deep convolutional neural network (CNN) features extractor and a support vector machine (SVM) classifier. The fusion framework consists of merging features extracted from DTI scalar metrics [(fractional anisotropy (FA) and mean diffusivity (MD)], and GM using 2D-CNN and feeding them to SVM to classify AD versus cognitively normal (CN), AD versus MCI, and MCI versus CN. Our novel multimodal AD method demonstrates a superior performance with an accuracy of 99.79%, 99.6%, and 97.00% for AD/CN, AD/MCI, and MCI/CN respectively.
Collapse
|
34
|
Rana A, Dumka A, Singh R, Panda MK, Priyadarshi N. A Computerized Analysis with Machine Learning Techniques for the Diagnosis of Parkinson's Disease: Past Studies and Future Perspectives. Diagnostics (Basel) 2022; 12:2708. [PMID: 36359550 PMCID: PMC9689408 DOI: 10.3390/diagnostics12112708] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Revised: 10/30/2022] [Accepted: 11/02/2022] [Indexed: 08/03/2023] Open
Abstract
According to the World Health Organization (WHO), Parkinson's disease (PD) is a neurodegenerative disease of the brain that causes motor symptoms including slower movement, rigidity, tremor, and imbalance in addition to other problems like Alzheimer's disease (AD), psychiatric problems, insomnia, anxiety, and sensory abnormalities. Techniques including artificial intelligence (AI), machine learning (ML), and deep learning (DL) have been established for the classification of PD and normal controls (NC) with similar therapeutic appearances in order to address these problems and improve the diagnostic procedure for PD. In this article, we examine a literature survey of research articles published up to September 2022 in order to present an in-depth analysis of the use of datasets, various modalities, experimental setups, and architectures that have been applied in the diagnosis of subjective disease. This analysis includes a total of 217 research publications with a list of the various datasets, methodologies, and features. These findings suggest that ML/DL methods and novel biomarkers hold promising results for application in medical decision-making, leading to a more methodical and thorough detection of PD. Finally, we highlight the challenges and provide appropriate recommendations on selecting approaches that might be used for subgrouping and connection analysis with structural magnetic resonance imaging (sMRI), DaTSCAN, and single-photon emission computerized tomography (SPECT) data for future Parkinson's research.
Collapse
Affiliation(s)
- Arti Rana
- Computer Science & Engineering, Veer Madho Singh Bhandari Uttarakhand Technical University, Dehradun 248007, Uttarakhand, India
| | - Ankur Dumka
- Department of Computer Science and Engineering, Women Institute of Technology, Dehradun 248007, Uttarakhand, India
- Department of Computer Science & Engineering, Graphic Era Deemed to be University, Dehradun 248001, Uttarakhand, India
| | - Rajesh Singh
- Division of Research and Innovation, Uttaranchal Institute of Technology, Uttaranchal University, Dehradun 248007, Uttarakhand, India
- Department of Project Management, Universidad Internacional Iberoamericana, Campeche 24560, Mexico
| | - Manoj Kumar Panda
- Department of Electrical Engineering, G.B. Pant Institute of Engineering and Technology, Pauri 246194, Uttarakhand, India
| | - Neeraj Priyadarshi
- Department of Electrical Engineering, JIS College of Engineering, Kolkata 741235, West Bengal, India
| |
Collapse
|
35
|
Roy S, Nagrale P. Encoding the Photoreceptors of the Human Eye. Cureus 2022; 14:e30125. [PMID: 36381896 PMCID: PMC9644661 DOI: 10.7759/cureus.30125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2022] [Accepted: 10/10/2022] [Indexed: 01/25/2023] Open
Abstract
This review aims to assess the anatomy of the human eye with a focus on exploring opportunities to mimic certain functionalities of photoreceptors in the optical system. This can help restore vision issues in people who had normal vision earlier, but their vision was impaired due to reasons that damaged parts of the eye; however, the functionality of the optic nerve remained intact. It is a conceptual article where the methodology to simulate artificial photoreceptors is discussed.
Collapse
Affiliation(s)
- Shreya Roy
- Medical Student, Jawaharlal Nehru Medical College, Datta Meghe Institute of Medical Sciences, Wardha, IND
| | - Prachi Nagrale
- Ophthalmology, Jawaharlal Nehru Medical College, Datta Meghe Institute of Medical Sciences, Wardha, IND
| |
Collapse
|
36
|
Xia D, Chen G, Wu K, Yu M, Zhang Z, Lu Y, Xu L, Wang Y. Research progress and hotspot of the artificial intelligence application in the ultrasound during 2011-2021: A bibliometric analysis. Front Public Health 2022; 10:990708. [PMID: 36187670 PMCID: PMC9520910 DOI: 10.3389/fpubh.2022.990708] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2022] [Accepted: 08/26/2022] [Indexed: 01/26/2023] Open
Abstract
Ultrasound, as a common clinical examination tool, inevitably has human errors due to the limitations of manual operation. Artificial intelligence is an advanced computer program that can solve this problem. Therefore, the relevant literature on the application of artificial intelligence in the ultrasonic field from 2011 to 2021 was screened by authors from the Web of Science Core Collection, which aims to summarize the trend of artificial intelligence application in the field of ultrasound, meanwhile, visualize and predict research hotspots. A total of 908 publications were included in the study. Overall, the number of global publications is on the rise, and studies on the application of artificial intelligence in the field of ultrasound continue to increase. China has made the largest contribution in this field. In terms of institutions, Fudan University has the most number of publications. Recently, IEEE Access is the most published journal. Suri J. S. published most of the articles and had the highest number of citations in this field (29 articles). It's worth noting that, convolutional neural networks (CNN), as a kind of deep learning algorithm, was considered to bring better image analysis and processing ability in recent most-cited articles. According to the analysis of keywords, the latest keyword is "COVID-19" (2020.8). The co-occurrence analysis of keywords by VOSviewer visually presented four clusters which consisted of "deep learning," "machine learning," "application in the field of visceral organs," and "application in the field of cardiovascular". The latest hot words of these clusters were "COVID-19; neural-network; hepatocellular carcinoma; atherosclerotic plaques". This study reveals the importance of multi-institutional and multi-field collaboration in promoting research progress.
Collapse
Affiliation(s)
- Demeng Xia
- Luodian Clinical Drug Research Center, Shanghai Baoshan Luodian Hospital, Shanghai University, Shanghai, China
| | - Gaoqi Chen
- Department of Pancreatic Hepatobiliary Surgery, Changhai Hospital, Naval Medical University, Shanghai, China
| | - Kaiwen Wu
- Department of Gastroenterology, The Third People's Hospital of Chengdu, The Affiliated Hospital of Southwest Jiaotong University, Chengdu, China
| | - Mengxin Yu
- Department of Ultrasound, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, China
| | - Zhentao Zhang
- Department of Clinical Medicine, The Naval Medical University, Shanghai, China
| | - Yixian Lu
- Department of Clinical Medicine, The Naval Medical University, Shanghai, China
| | - Lisha Xu
- Department of Ultrasound, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, China,Lisha Xu
| | - Yin Wang
- Department of Ultrasound, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, China,*Correspondence: Yin Wang
| |
Collapse
|
37
|
Preemptive Diagnosis of Alzheimer’s Disease in the Eastern Province of Saudi Arabia Using Computational Intelligence Techniques. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:5476714. [PMID: 36052046 PMCID: PMC9427223 DOI: 10.1155/2022/5476714] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/01/2022] [Revised: 06/24/2022] [Accepted: 07/11/2022] [Indexed: 11/17/2022]
Abstract
Alzheimer’s Disease (AD) is a silent disease that causes the brain cells to die progressively, influencing consciousness, behavior, planning ability, and language to name a few. AD increases exponentially with aging, where it doubles every 5-6 years, causing profound implications, such as swallowing difficulties and losing the ability to speak before death. According to the Ministry of Health in Saudi Arabia, AD patients will triple by 2060 to reach 14 million patients worldwide. The rapid rise of patients is caused by the silent progress of the disease, leading to late diagnosis as the symptoms will not be distinguished from normal aging affect. Moreover, with the current medical capabilities, it is impossible to confirm AD with 100% certainty via specific medical examinations. The literature review revealed that most recent publications used images to diagnose AD, which is insufficient for local hospitals with limited imaging capabilities. Other studies that used clinical and demographical data failed to achieve adequate results. Consequently, this study aims to preemptively predict AD in Saudi Arabia by employing machine learning (ML) techniques. The dataset was acquired from King Fahad Specialist Hospital (KFSH) in Dammam, Saudi Arabia, containing standard clinical tests for 152 patients. Four ML algorithms, namely, support vector machine (SVM), k-nearest neighbors (k-NN), Adaptive Boosting (AdaBoost), and eXtreme Gradient Boosting (XGBoost), were employed to preemptively diagnose the disease. The empirical results demonstrated the robustness of SVM in the pre-emptive diagnosis of AD with accuracy, precision, recall, and area under the receiver operating characteristics (AUROC) of 95.56%, 94.70%, 97.78%, and 0.97, respectively, with 13 features after applying the sequential forward feature selection technique. This model can assist the medical staff in controlling the progression of the disease at low costs.
Collapse
|
38
|
Object Detection in Medical Images Based on Hierarchical Transformer and Mask Mechanism. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:5863782. [PMID: 35965770 PMCID: PMC9371842 DOI: 10.1155/2022/5863782] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Revised: 06/28/2022] [Accepted: 07/04/2022] [Indexed: 01/17/2023]
Abstract
The object detection task in the medical field is challenging in terms of classification and regression. Due to its crucial applications in computer-aided diagnosis and computer-aided detection techniques, an increasing number of researchers are transferring the object detection techniques to the medical field. However, in existing work on object detection, researchers do not consider the low resolution of medical images, the high amount of noise, and the small size of the objects to be detected. Based on this, this paper proposes a new algorithmic model called the MS Transformer, where a self-supervised learning approach is used to perform a random mask on the input image to reconstruct the input features, learn a richer feature vector, and filter out excessive noise. To focus the model on the small objects that are being detected, the hierarchical transformer model is introduced in this paper, and a sliding window with a local self-attention mechanism is used to give a higher attention score to the small objects to be detected. Finally, a single-stage object detection framework is used to predict the sequence of sets at the location of the bounding box and the class of objects to be detected. On the DeepLesion and BCDD benchmark dataset, the model proposed in this paper achieves better performance improvement on multiple evaluation metric categories.
Collapse
|
39
|
Real-Time Semantic Understanding and Segmentation of Urban Scenes for Vehicle Visual Sensors by Optimized DCNN Algorithm. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12157811] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
The modern urban environment is becoming more and more complex. In helping us identify surrounding objects, vehicle vision sensors rely more on the semantic segmentation ability of deep learning networks. The performance of a semantic segmentation network is essential. This factor will directly affect the comprehensive level of driving assistance technology in road environment perception. However, the existing semantic segmentation network has a redundant structure, many parameters, and low operational efficiency. Therefore, to reduce the complexity of the network and reduce the number of parameters to improve the network efficiency, based on the deep learning (DL) theory, a method for efficient image semantic segmentation using Deep Convolutional Neural Network (DCNN) is deeply studied. First, the theoretical basis of the convolutional neural network (CNN) is briefly introduced, and the real-time semantic segmentation technology of urban scenes based on DCNN is recommended in detail. Second, the atrous convolution algorithm and the multi-scale parallel atrous spatial pyramid model are introduced. On the basis of this, an Efficient Symmetric Network (ESNet) of real-time semantic segmentation model for autonomous driving scenarios is proposed. The experimental results show that: (1) On the Cityscapes dataset, the ESNet structure achieves 70.7% segmentation accuracy for the 19 semantic categories set, and 87.4% for the seven large grouping categories. Compared with other algorithms, the accuracy has increased to varying degrees. (2) On the CamVid dataset, compared with segmentation networks of multiple lightweight real-time images, the parameters of the ESNet model are around 1.2 m, the highest FPS value is around 90 Hz, and the highest mIOU value is around 70%. In seven semantic categories, the segmentation accuracy of the ESNet model is the highest at around 98%. From this, we found that the ESNet significantly improves segmentation accuracy while maintaining faster forward inference speed. Overall, the research not only provides technical support for the development of real-time semantic understanding and segmentation of DCNN algorithms but also contributes to the development of artificial intelligence technology.
Collapse
|
40
|
Khojaste-Sarakhsi M, Haghighi SS, Ghomi SF, Marchiori E. Deep learning for Alzheimer's disease diagnosis: A survey. Artif Intell Med 2022; 130:102332. [PMID: 35809971 DOI: 10.1016/j.artmed.2022.102332] [Citation(s) in RCA: 36] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2020] [Revised: 04/29/2022] [Accepted: 05/30/2022] [Indexed: 11/28/2022]
|
41
|
Tu Y, Lin S, Qiao J, Zhuang Y, Zhang P. Alzheimer's disease diagnosis via multimodal feature fusion. Comput Biol Med 2022; 148:105901. [PMID: 35908497 DOI: 10.1016/j.compbiomed.2022.105901] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2022] [Revised: 06/26/2022] [Accepted: 07/16/2022] [Indexed: 11/19/2022]
Abstract
Alzheimer's disease (AD) is the most common neurodegenerative disorder in the elderly. Early diagnosis of AD plays a vital role in slowing down the progress of AD because there is no effective drug to treat the disease. Some deep learning models have recently been presented for AD diagnosis and have more satisfactory performance than classic machine learning methods. Nevertheless, most of the existing computer-aided diagnostic models used neuroimaging features for diagnosis, ignoring patients' clinical and biological information. This makes the AD diagnosis inaccurate. In this study, we propose a novel multimodal feature transformation and fusion model for AD diagnosis. The feature transformation aims to avoid the difference in feature dimensions between different modal data and further mine the significant features for AD diagnosis. A geometric algebra-based feature extension method is proposed to obtain different levels of high-dimensional features from patients' clinical and personal biological data. Then, an influence degree-based feature filtration algorithm is proposed to filtrate those features that have no apparent guiding significance for AD diagnosis. Finally, an ANN (Artificial Neural Network)-based framework is designed to fuse transformed features with neuroimaging features extracted by CNN (Convolutional Neural Network) for AD diagnosis. The more in-depth feature mining of patients' clinical information and biological information can significantly improve the performance of computer-aided AD diagnosis. The experiments are obtained on the ADNI dataset. Our proposed model can converge faster and achieves 96.2% accuracy in AD diagnostic task and 87.4% accuracy in MCI (Mild Cognitive Impairment) diagnostic task. Compared with other methods, our proposed approach has an excellent performance in AD diagnosis and surpasses SOTA (state-of-the-art) methods. Therefore, our model can provide more reasonable suggestions for clinicians to diagnose and treat disease.
Collapse
Affiliation(s)
- Yue Tu
- School of Computer Science and Engineering, Northeastern University, Shenyang, China
| | - Shukuan Lin
- School of Computer Science and Engineering, Northeastern University, Shenyang, China.
| | - Jianzhong Qiao
- School of Computer Science and Engineering, Northeastern University, Shenyang, China.
| | - Yilin Zhuang
- School of Computer Science and Engineering, Northeastern University, Shenyang, China
| | - Peng Zhang
- School of Computer Science and Engineering, Northeastern University, Shenyang, China
| |
Collapse
|
42
|
Xu L, Li X, Yang Q, Tan L, Liu Q, Liu Y. Application of Bidirectional Generative Adversarial Networks to Predict Potential miRNAs Associated With Diseases. Front Genet 2022; 13:936823. [PMID: 35903359 PMCID: PMC9314862 DOI: 10.3389/fgene.2022.936823] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Accepted: 06/08/2022] [Indexed: 11/18/2022] Open
Abstract
Substantial evidence has shown that microRNAs are crucial for biological processes within complex human diseases. Identifying the association of miRNA–disease pairs will contribute to accelerating the discovery of potential biomarkers and pathogenesis. Researchers began to focus on constructing computational models to facilitate the progress of disease pathology and clinical medicine by identifying the potential disease-related miRNAs. However, most existing computational methods are expensive, and their use is limited to unobserved relationships for unknown miRNAs (diseases) without association information. In this manuscript, we proposed a creatively semi-supervised model named bidirectional generative adversarial network for miRNA-disease association prediction (BGANMDA). First, we constructed a microRNA similarity network, a disease similarity network, and Gaussian interaction profile kernel similarity based on the known miRNA–disease association and comprehensive similarity of miRNAs (diseases). Next, an integrated similarity feature network with the full underlying relationships of miRNA–disease pairwise was obtained. Then, the similarity feature network was fed into the BGANMDA model to learn advanced traits in latent space. Finally, we ranked an association score list and predicted the associations between miRNA and disease. In our experiment, a five-fold cross validation was applied to estimate BGANMDA’s performance, and an area under the curve (AUC) of 0.9319 and a standard deviation of 0.00021 were obtained. At the same time, in the global and local leave-one-out cross validation (LOOCV), the AUC value and standard deviation of BGANMDA were 0.9116 ± 0.0025 and 0.8928 ± 0.0022, respectively. Furthermore, BGANMDA was employed in three different case studies to validate its prediction capability and accuracy. The experimental results of the case studies showed that 46, 46, and 48 of the top 50 prediction lists had been identified in previous studies.
Collapse
Affiliation(s)
- Long Xu
- School of Computer Science and Technology, Heilongjiang University, Harbin, China
| | - Xiaokun Li
- School of Computer Science and Technology, Heilongjiang University, Harbin, China
- Postdoctoral Program of Heilongjiang Hengxun Technology Co., Ltd., Heilongjiang University, Harbin, China
- *Correspondence: Xiaokun Li, ; Yong Liu,
| | - Qiang Yang
- School of Electronic Engineering, Heilongjiang University, Harbin, China
| | - Long Tan
- School of Computer Science and Technology, Heilongjiang University, Harbin, China
| | - Qingyuan Liu
- Postdoctoral Program of Heilongjiang Hengxun Technology Co., Ltd., Heilongjiang University, Harbin, China
| | - Yong Liu
- School of Computer Science and Technology, Heilongjiang University, Harbin, China
- *Correspondence: Xiaokun Li, ; Yong Liu,
| |
Collapse
|
43
|
Saba T, Khan AR, Abunadi I, Bahaj SA, Ali H, Alruwaythi M. Arabic Speech Analysis for Classification and Prediction of Mental Illness due to Depression Using Deep Learning. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:8622022. [PMID: 35669665 PMCID: PMC9166990 DOI: 10.1155/2022/8622022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/03/2022] [Revised: 03/30/2022] [Accepted: 04/18/2022] [Indexed: 11/18/2022]
Abstract
Depression is a global prevalent ailment for possible mental illness or mental disorder globally. Recognizing depressed early signs is critical for evaluating and preventing mental illness. With the progress of machine learning, it is possible to make intelligent systems capable of detecting depressive symptoms using speech analysis. This study presents a hybrid model to identify and predict mental illness from Arabic speech analysis due to depression. The proposed hybrid model comprises convolutional neural network (CNN) and a support vector machine (SVM) to identify and predict mental disorders. Experiments are performed on the Arabic speech benchmark data set of 200 speeches. A total of 70% of data were reserved for training, while 30% of data were to test the proposed model. The hybrid model (CNN + SVM) attained a 90.0% and 91.60% accuracy rate to predict the depression from Arabic speech analysis for training and testing stages. To authenticate the results of a proposed hybrid model, recurrent neural network (RNN) and CNN are also applied to the same data set individually, and the results are compared with each other. The RNN achieved an 80.70% and 81.60% accuracy rate to predict depression while speaking in the training and testing stages. The CNN predicted the depression in the training and testing stages with 88.50% and 86.60% accuracy rates. Based on the analysis, the proposed hybrid model secured better prediction results than individual RNN and CNN models on the same data set. Furthermore, the suggested model had a lower FPR, FNR, and higher accuracy, AUC, sensitivity, and specificity rate than individual RNN, CNN model performance in predicting depression. Finally, the achieved findings will be helpful to classify depression while speaking Arabic/speech and will be beneficial for physicians, psychiatrists, and psychologists in the detection of depression.
Collapse
Affiliation(s)
- Tanzila Saba
- Artificial Intelligence and Data Analytics Lab CCIS, Prince Sultan University, Riyadh, Saudi Arabia
| | - Amjad Rehman Khan
- Artificial Intelligence and Data Analytics Lab CCIS, Prince Sultan University, Riyadh, Saudi Arabia
| | - Ibrahim Abunadi
- Artificial Intelligence and Data Analytics Lab CCIS, Prince Sultan University, Riyadh, Saudi Arabia
| | - Saeed Ali Bahaj
- MIS Department College of Business Administration, Prince Sattam Bin Abdulaziz University, Alkharj 11942, Saudi Arabia
| | - Haider Ali
- Department of Statistics, University of Gujrat, Gujrat, Pakistan
| | - Maryam Alruwaythi
- Artificial Intelligence and Data Analytics Lab CCIS, Prince Sultan University, Riyadh, Saudi Arabia
| |
Collapse
|
44
|
Saleem TJ, Zahra SR, Wu F, Alwakeel A, Alwakeel M, Jeribi F, Hijji M. Deep Learning-Based Diagnosis of Alzheimer's Disease. J Pers Med 2022; 12:815. [PMID: 35629237 PMCID: PMC9143671 DOI: 10.3390/jpm12050815] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2022] [Revised: 05/15/2022] [Accepted: 05/16/2022] [Indexed: 12/27/2022] Open
Abstract
Alzheimer's disease (AD), the most familiar type of dementia, is a severe concern in modern healthcare. Around 5.5 million people aged 65 and above have AD, and it is the sixth leading cause of mortality in the US. AD is an irreversible, degenerative brain disorder characterized by a loss of cognitive function and has no proven cure. Deep learning techniques have gained popularity in recent years, particularly in the domains of natural language processing and computer vision. Since 2014, these techniques have begun to achieve substantial consideration in AD diagnosis research, and the number of papers published in this arena is rising drastically. Deep learning techniques have been reported to be more accurate for AD diagnosis in comparison to conventional machine learning models. Motivated to explore the potential of deep learning in AD diagnosis, this study reviews the current state-of-the-art in AD diagnosis using deep learning. We summarize the most recent trends and findings using a thorough literature review. The study also explores the different biomarkers and datasets for AD diagnosis. Even though deep learning has shown promise in AD diagnosis, there are still several challenges that need to be addressed.
Collapse
Affiliation(s)
- Tausifa Jan Saleem
- Department of Computer Science and Engineering, National Institute of Technology Srinagar, Srinagar 190006, J&K, India; (T.J.S.); (S.R.Z.)
| | - Syed Rameem Zahra
- Department of Computer Science and Engineering, National Institute of Technology Srinagar, Srinagar 190006, J&K, India; (T.J.S.); (S.R.Z.)
| | - Fan Wu
- Department of Computer Science, Tuskegee University, Tuskegee, AL 36088, USA;
| | - Ahmed Alwakeel
- Sensor Network and Cellular Systems Research Center, University of Tabuk, Tabuk 71491, Saudi Arabia
- Faculty of Computers & Information Technology, University of Tabuk, Tabuk 71491, Saudi Arabia; (M.A.); (M.H.)
| | - Mohammed Alwakeel
- Faculty of Computers & Information Technology, University of Tabuk, Tabuk 71491, Saudi Arabia; (M.A.); (M.H.)
| | - Fathe Jeribi
- College of Computer Science and Information Technology, Jazan University, Jazan 45142, Saudi Arabia;
| | - Mohammad Hijji
- Faculty of Computers & Information Technology, University of Tabuk, Tabuk 71491, Saudi Arabia; (M.A.); (M.H.)
| |
Collapse
|
45
|
Tabarestani S, Eslami M, Cabrerizo M, Curiel RE, Barreto A, Rishe N, Vaillancourt D, DeKosky ST, Loewenstein DA, Duara R, Adjouadi M. A Tensorized Multitask Deep Learning Network for Progression Prediction of Alzheimer's Disease. Front Aging Neurosci 2022; 14:810873. [PMID: 35601611 PMCID: PMC9120529 DOI: 10.3389/fnagi.2022.810873] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2021] [Accepted: 03/14/2022] [Indexed: 11/13/2022] Open
Abstract
With the advances in machine learning for the diagnosis of Alzheimer's disease (AD), most studies have focused on either identifying the subject's status through classification algorithms or on predicting their cognitive scores through regression methods, neglecting the potential association between these two tasks. Motivated by the need to enhance the prospects for early diagnosis along with the ability to predict future disease states, this study proposes a deep neural network based on modality fusion, kernelization, and tensorization that perform multiclass classification and longitudinal regression simultaneously within a unified multitask framework. This relationship between multiclass classification and longitudinal regression is found to boost the efficacy of the final model in dealing with both tasks. Different multimodality scenarios are investigated, and complementary aspects of the multimodal features are exploited to simultaneously delineate the subject's label and predict related cognitive scores at future timepoints using baseline data. The main intent in this multitask framework is to consolidate the highest accuracy possible in terms of precision, sensitivity, F1 score, and area under the curve (AUC) in the multiclass classification task while maintaining the highest similarity in the MMSE score as measured through the correlation coefficient and the RMSE for all time points under the prediction task, with both tasks, run simultaneously under the same set of hyperparameters. The overall accuracy for multiclass classification of the proposed KTMnet method is 66.85 ± 3.77. The prediction results show an average RMSE of 2.32 ± 0.52 and a correlation of 0.71 ± 5.98 for predicting MMSE throughout the time points. These results are compared to state-of-the-art techniques reported in the literature. A discovery from the multitasking of this consolidated machine learning framework is that a set of hyperparameters that optimize the prediction results may not necessarily be the same as those that would optimize the multiclass classification. In other words, there is a breakpoint beyond which enhancing further the results of one process could lead to the downgrading in accuracy for the other.
Collapse
Affiliation(s)
- Solale Tabarestani
- Center for Advanced Technology and Education, Florida International University, Miami, FL, United States
| | - Mohammad Eslami
- Harvard Ophthalmology AI Lab and Harvard Medical School, Schepens Eye Research Institute, Massachusetts Eye and Ear, Boston, MA, United States
| | - Mercedes Cabrerizo
- Center for Advanced Technology and Education, Florida International University, Miami, FL, United States
| | - Rosie E. Curiel
- Center for Cognitive Neuroscience and Aging, Psychiatry and Behavioral Sciences, University of Miami School of Medicine, Miami, FL, United States
- Florida Alzheimer’s Disease Research Center, University of Florida, Gainesville, FL, United States
| | - Armando Barreto
- Center for Advanced Technology and Education, Florida International University, Miami, FL, United States
| | - Naphtali Rishe
- Center for Advanced Technology and Education, Florida International University, Miami, FL, United States
| | - David Vaillancourt
- Florida Alzheimer’s Disease Research Center, University of Florida, Gainesville, FL, United States
- Department of Neurology, University of Florida, Gainesville, FL, United States
- Department of Applied Physiology and Kinesiology, University of Florida, Gainesville, FL, United States
| | - Steven T. DeKosky
- Florida Alzheimer’s Disease Research Center, University of Florida, Gainesville, FL, United States
- Department of Neurology, University of Florida, Gainesville, FL, United States
| | - David A. Loewenstein
- Center for Cognitive Neuroscience and Aging, Psychiatry and Behavioral Sciences, University of Miami School of Medicine, Miami, FL, United States
- Florida Alzheimer’s Disease Research Center, University of Florida, Gainesville, FL, United States
- Wien Center for Alzheimer’s Disease and Memory Disorders, Mount Sinai Medical Center, Miami Beach, FL, United States
| | - Ranjan Duara
- Florida Alzheimer’s Disease Research Center, University of Florida, Gainesville, FL, United States
- Wien Center for Alzheimer’s Disease and Memory Disorders, Mount Sinai Medical Center, Miami Beach, FL, United States
| | - Malek Adjouadi
- Center for Advanced Technology and Education, Florida International University, Miami, FL, United States
- Florida Alzheimer’s Disease Research Center, University of Florida, Gainesville, FL, United States
| |
Collapse
|
46
|
Frizzell TO, Glashutter M, Liu CC, Zeng A, Pan D, Hajra SG, D’Arcy RC, Song X. Artificial intelligence in brain MRI analysis of Alzheimer's disease over the past 12 years: A systematic review. Ageing Res Rev 2022; 77:101614. [PMID: 35358720 DOI: 10.1016/j.arr.2022.101614] [Citation(s) in RCA: 39] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2021] [Revised: 03/02/2022] [Accepted: 03/24/2022] [Indexed: 12/17/2022]
Abstract
INTRODUCTION Multiple structural brain changes in Alzheimer's disease (AD) and mild cognitive impairment (MCI) have been revealed on magnetic resonance imaging (MRI). There is a fast-growing effort in applying artificial intelligence (AI) to analyze these data. Here, we review and evaluate the AI studies in brain MRI analysis with synthesis. METHODS A systematic review of the literature, spanning the years from 2009 to 2020, was completed using the PubMed database. AI studies using MRI imaging to investigate normal aging, mild cognitive impairment, and AD-dementia were retrieved for review. Bias assessment was completed using the PROBAST criteria. RESULTS 97 relevant studies were included in the review. The studies were typically focused on the classification of AD, MCI, and normal aging (71% of the reported studies) and the prediction of MCI conversion to AD (25%). The best performance was achieved by using the deep learning-based convolution neural network algorithms (weighted average accuracy 89%), in contrast to 76-86% using Logistic Regression, Support Vector Machines, and other AI methods. DISCUSSION The synthesized evidence is paramount to developing sophisticated AI approaches to reliably capture and quantify multiple subtle MRI changes in the whole brain that exemplify the complexity and heterogeneity of AD and brain aging.
Collapse
|
47
|
Feng J, Zhang SW, Chen L. Extracting ROI-Based Contourlet Subband Energy Feature From the sMRI Image for Alzheimer's Disease Classification. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2022; 19:1627-1639. [PMID: 33434134 DOI: 10.1109/tcbb.2021.3051177] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Structural magnetic resonance imaging (sMRI)-based Alzheimer's disease (AD) classification and its prodromal stage-mild cognitive impairment (MCI) classification have attracted many attentions and been widely investigated in recent years. Owing to the high dimensionality, representation of the sMRI image becomes a difficult issue in AD classification. Furthermore, regions of interest (ROI) reflected in the sMRI image are not characterized properly by spatial analysis techniques, which has been a main cause of weakening the discriminating ability of the extracted spatial feature. In this study, we propose a ROI-based contourlet subband energy (ROICSE) feature to represent the sMRI image in the frequency domain for AD classification. Specifically, a preprocessed sMRI image is first segmented into 90 ROIs by a constructed brain mask. Instead of extracting features from the 90 ROIs in the spatial domain, the contourlet transform is performed on each of these ROIs to obtain their energy subbands. And then for an ROI, a subband energy (SE) feature vector is constructed to capture its energy distribution and contour information. Afterwards, SE feature vectors of the 90 ROIs are concatenated to form a ROICSE feature of the sMRI image. Finally, support vector machine (SVM) classifier is used to classify 880 subjects from ADNI and OASIS databases. Experimental results show that the ROICSE approach outperforms six other state-of-the-art methods, demonstrating that energy and contour information of the ROI are important to capture differences between the sMRI images of AD and HC subjects. Meanwhile, brain regions related to AD can also be found using the ROICSE feature, indicating that the ROICSE feature can be a promising assistant imaging marker for the AD diagnosis via the sMRI image. Code and Sample IDs of this paper can be downloaded at https://github.com/NWPU-903PR/ROICSE.git.
Collapse
|
48
|
You Q, Wang W, Tao T, Wang T, Zhang D, Wang L. miR-129 Regulates Cell Viability in Alzheimer’s Disease Through Targeting Amyloid Precursor Protein (APP). J BIOMATER TISS ENG 2022. [DOI: 10.1166/jbt.2022.2959] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
This study intends to explore miR-129’s effect on cell viability of Alzheimer’s disease by regulating the target gene APP. The hippocampal neurons were assigned into model group (MO group); mimetic group (SI group); inhibitor group (IN group) followed by analysis of hippocampal
neuronal cell proliferation and activity, APP protein content, miR-129 expression and cell apoptosis by CCK-8 assay, Western blot method, MTT assay, qRT-PCR and flow cytometry. miR-129 expression of hippocampal neurons in IN group was lowest. Compared with IN and MO groups, SI group had significantly
increased miR-129 level and reduced number of hippocampal neuron apoptosis (P < 0.05). Compared with IN group, MO group had significantly reduced cell apoptosis (P < 0.05). SI group had highest number of hippocampal neurons proliferation followed by IN group. SI group had
highest OD value followed by MO group and IN group. The cell activity of SI group was higher than that of IN group and MO group (both P < 0.05). Compared with SI group, rat neuron activity in MO group was significantly higher than IN group (P < 0.05). The APP protein expression
of hippocampal neuron cells in SI group was lowest followed by MO group and IN group (P < 0.05). In conclusion, the low miR-129 expression can inhibit the activity of hippocampal neurons possibly through up-regulation of APP protein content.
Collapse
Affiliation(s)
- Qunwei You
- Department of Neurology, Taizhou First People’s Hospital, Taizhou City, Zhejiang Province, 318001, China
| | - Wenjie Wang
- Department of Neurology, Taizhou Central Hospital (Taizhou University Hospital), Taizhou City, Zhejiang Province, 318001, China
| | - Taotao Tao
- Department of Neurology, Taizhou Central Hospital (Taizhou University Hospital), Taizhou City, Zhejiang Province, 318001, China
| | - Tianyu Wang
- Department of Neurology, Taizhou Central Hospital (Taizhou University Hospital), Taizhou City, Zhejiang Province, 318001, China
| | - Danhong Zhang
- Department of Neurology, Taizhou Central Hospital (Taizhou University Hospital), Taizhou City, Zhejiang Province, 318001, China
| | - Liaojun Wang
- Department of Neurology, Taizhou Municipal Hospital, Taizhou City, Zhejiang Province, 317099, China
| |
Collapse
|
49
|
Heising L, Angelopoulos S. Operationalising fairness in medical AI adoption: detection of early Alzheimer’s disease with 2D CNN. BMJ Health Care Inform 2022; 29:bmjhci-2021-100485. [PMID: 35477689 PMCID: PMC9047889 DOI: 10.1136/bmjhci-2021-100485] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Accepted: 01/09/2022] [Indexed: 11/05/2022] Open
Abstract
Objectives To operationalise fairness in the adoption of medical artificial intelligence (AI) algorithms in terms of access to computational resources, the proposed approach is based on a two-dimensional (2D) convolutional neural networks (CNN), which provides a faster, cheaper and accurate-enough detection of early Alzheimer’s disease (AD) and mild cognitive impairment (MCI), without the need for use of large training data sets or costly high-performance computing (HPC) infrastructures. Methods The standardised Alzheimer’s Disease Neuroimaging Initiative (ADNI) data sets are used for the proposed model, with additional skull stripping, using the Brain Extraction Tool V.2approach. The 2D CNN architecture is based on LeNet-5, the Leaky Rectified Linear Unit activation function and a Sigmoid function were used, and batch normalisation was added after every convolutional layer to stabilise the learning process. The model was optimised by manually tuning all its hyperparameters. Results The model was evaluated in terms of accuracy, recall, precision and f1-score. The results demonstrate that the model predicted MCI with an accuracy of 0.735, passing the random guessing baseline of 0.521 and predicted AD with an accuracy of 0.837, passing the random guessing baseline of 0.536. Discussion The proposed approach can assist clinicians in the early diagnosis of AD and MCI, with high-enough accuracy, based on relatively smaller data sets, and without the need of HPC infrastructures. Such an approach can alleviate disparities and operationalise fairness in the adoption of medical algorithms. Conclusion Medical AI algorithms should not be focused solely on accuracy but should also be evaluated with respect to how they might impact disparities and operationalise fairness in their adoption.
Collapse
Affiliation(s)
- Luca Heising
- Department of Radiation Oncology (Maastro), Maastricht University Medical Centre+, Maastricht, Netherlands
- Tilburg School of Economics and Management, Tilburg University, Tilburg, Netherlands
| | | |
Collapse
|
50
|
Li R, Wang X, Lawler K, Garg S, Bai Q, Alty J. Applications of artificial intelligence to aid early detection of dementia: A scoping review on current capabilities and future directions. J Biomed Inform 2022; 127:104030. [PMID: 35183766 DOI: 10.1016/j.jbi.2022.104030] [Citation(s) in RCA: 41] [Impact Index Per Article: 13.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Revised: 01/21/2022] [Accepted: 02/12/2022] [Indexed: 12/17/2022]
Abstract
BACKGROUND & OBJECTIVE With populations aging, the number of people with dementia worldwide is expected to triple to 152 million by 2050. Seventy percent of cases are due to Alzheimer's disease (AD) pathology and there is a 10-20 year 'pre-clinical' period before significant cognitive decline occurs. We urgently need, cost effective, objective biomarkers to detect AD, and other dementias, at an early stage. Risk factor modification could prevent 40% of cases and drug trials would have greater chances of success if participants are recruited at an earlier stage. Currently, detection of dementia is largely by pen and paper cognitive tests but these are time consuming and insensitive to the pre-clinical phase. Specialist brain scans and body fluid biomarkers can detect the earliest stages of dementia but are too invasive or expensive for widespread use. With the advancement of technology, Artificial Intelligence (AI) shows promising results in assisting with detection of early-stage dementia. This scoping review aims to summarise the current capabilities of AI-aided digital biomarkers to aid in early detection of dementia, and also discusses potential future research directions. METHODS & MATERIALS In this scoping review, we used PubMed and IEEE Xplore to identify relevant papers. The resulting records were further filtered to retrieve articles published within five years and written in English. Duplicates were removed, titles and abstracts were screened and full texts were reviewed. RESULTS After an initial yield of 1,463 records, 1,444 records were screened after removal of duplication. A further 771 records were excluded after screening titles and abstracts, and 496 were excluded after full text review. The final yield was 177 studies. Records were grouped into different artificial intelligence based tests: (a) computerized cognitive tests (b) movement tests (c) speech, conversion, and language tests and (d) computer-assisted interpretation of brain scans. CONCLUSIONS In general, AI techniques enhance the performance of dementia screening tests because more features can be retrieved from a single test, there are less errors due to subjective judgements and AI shifts the automation of dementia screening to a higher level. Compared with traditional cognitive tests, AI-based computerized cognitive tests improve the discrimination sensitivity by around 4% and specificity by around 3%. In terms of speech, conversation and language tests, combining both acoustic features and linguistic features achieve the best result with accuracy around 94%. Deep learning techniques applied in brain scan analysis achieves around 92% accuracy. Movement tests and setting smart environments to capture daily life behaviours are two potential future directions that may help discriminate dementia from normal aging. AI-based smart environments and multi-modal tests are promising future directions to improve detection of dementia in the earliest stages.
Collapse
Affiliation(s)
- Renjie Li
- School of Information and Communication Technology, University of Tasmania, TAS 7005, Australia.
| | - Xinyi Wang
- Wicking Dementia Research and Education Centre, University of Tasmania, TAS 7000, Australia.
| | - Katherine Lawler
- Wicking Dementia Research and Education Centre, University of Tasmania, TAS 7000, Australia; Royal Hobart Hospital, Tasmania, TAS 7000, Australia.
| | - Saurabh Garg
- School of Information and Communication Technology, University of Tasmania, TAS 7005, Australia.
| | - Quan Bai
- School of Information and Communication Technology, University of Tasmania, TAS 7005, Australia.
| | - Jane Alty
- Wicking Dementia Research and Education Centre, University of Tasmania, TAS 7000, Australia; Royal Hobart Hospital, Tasmania, TAS 7000, Australia.
| |
Collapse
|