1
|
Mehrnia SS, Safahi Z, Mousavi A, Panahandeh F, Farmani A, Yuan R, Rahmim A, Salmanpour MR. Landscape of 2D Deep Learning Segmentation Networks Applied to CT Scan from Lung Cancer Patients: A Systematic Review. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2025:10.1007/s10278-025-01458-x. [PMID: 40038137 DOI: 10.1007/s10278-025-01458-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/07/2024] [Revised: 02/06/2025] [Accepted: 02/16/2025] [Indexed: 03/06/2025]
Abstract
BACKGROUND The increasing rates of lung cancer emphasize the need for early detection through computed tomography (CT) scans, enhanced by deep learning (DL) to improve diagnosis, treatment, and patient survival. This review examines current and prospective applications of 2D- DL networks in lung cancer CT segmentation, summarizing research, highlighting essential concepts and gaps; Methods: Following the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines, a systematic search of peer-reviewed studies from 01/2020 to 12/2024 on data-driven population segmentation using structured data was conducted across databases like Google Scholar, PubMed, Science Direct, IEEE (Institute of Electrical and Electronics Engineers) and ACM (Association for Computing Machinery) library. 124 studies met the inclusion criteria and were analyzed. RESULTS The LIDC-LIDR dataset was the most frequently used; The finding particularly relies on supervised learning with labeled data. The UNet model and its variants were the most frequently used models in medical image segmentation, achieving Dice Similarity Coefficients (DSC) of up to 0.9999. The reviewed studies primarily exhibit significant gaps in addressing class imbalances (67%), underuse of cross-validation (21%), and poor model stability evaluations (3%). Additionally, 88% failed to address the missing data, and generalizability concerns were only discussed in 34% of cases. CONCLUSIONS The review emphasizes the importance of Convolutional Neural Networks, particularly UNet, in lung CT analysis and advocates for a combined 2D/3D modeling approach. It also highlights the need for larger, diverse datasets and the exploration of semi-supervised and unsupervised learning to enhance automated lung cancer diagnosis and early detection.
Collapse
Affiliation(s)
- Somayeh Sadat Mehrnia
- Department of Integrative Oncology, Breast Cancer Research Center, Motamed Cancer Institute, ACECR, Tehran, Iran
- Technological Virtual Collaboration (TECVICO Corp.), Vancouver, BC, Canada
| | - Zhino Safahi
- Technological Virtual Collaboration (TECVICO Corp.), Vancouver, BC, Canada
- Department of Computer Engineering, University of Kurdistan, Sanandaj, Iran
| | - Amin Mousavi
- Technological Virtual Collaboration (TECVICO Corp.), Vancouver, BC, Canada
| | - Fatemeh Panahandeh
- Technological Virtual Collaboration (TECVICO Corp.), Vancouver, BC, Canada
| | - Arezoo Farmani
- Technological Virtual Collaboration (TECVICO Corp.), Vancouver, BC, Canada
| | - Ren Yuan
- Department of Radiology, University of British Columbia, Vancouver, BC, Canada
- BC Cancer, Vancouver Center, Vancouver, BC, Canada
| | - Arman Rahmim
- Department of Radiology, University of British Columbia, Vancouver, BC, Canada
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, V5Z 1L3, Canada
- Department of Physics & Astronomy, University of British Columbia, Vancouver, BC, Canada
| | - Mohammad R Salmanpour
- Technological Virtual Collaboration (TECVICO Corp.), Vancouver, BC, Canada.
- Department of Radiology, University of British Columbia, Vancouver, BC, Canada.
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, V5Z 1L3, Canada.
| |
Collapse
|
2
|
Li W, Rao Q, Dong S, Zhu M, Yang Z, Huang X, Liu G. PIDGN: An explainable multimodal deep learning framework for early prediction of Parkinson's disease. J Neurosci Methods 2025; 415:110363. [PMID: 39832626 DOI: 10.1016/j.jneumeth.2025.110363] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2024] [Revised: 12/29/2024] [Accepted: 01/16/2025] [Indexed: 01/22/2025]
Abstract
BACKGROUND Parkinson's disease (PD), the second most common neurodegenerative disease in the world, is usually not diagnosed until the later stages of the disease, when patients might have already missed the best treatment period. Therefore, more effective prediction methods based on artificial intelligence (AI) are needed to assist physicians in timely diagnosis. NEW METHODS An explainable deep learning-based early Parkinson's disease diagnostic model, Parkinson's Integrative Diagnostic Gated Network (PIDGN), was designed by fusing Single Nucleotide Polymorphism (SNP) and brain sMRI data. Firstly, unimodal internal information was extracted using EmsembleTree dimensionality reduction method, Transformer encoder and 3D ResNet. Secondly, gated attention fusion technique was utilized to explore the inter-modal interactions. Finally, the classification results were output through the fully connected layer. SHapley additive interpretation (SHAP) values and Gradient-weighted Class Activation Mapping (Grad-CAM) techniques were used to help explain the importance of SNPs and brain regions for PD. RESULTS The results showed that the PIDGN model achieved the best results with the accuracy of 0.858 and AUROC of 0.897. Top 20 SNPs and the brain regions near the midbrain potentially related to PD were identified using two explainable techniques via SHAP values and Grad-CAM respectively. COMPARISON WITH EXISTING METHODS AND CONCLUSION The PIDGN model trained by fusing genetic and imaging data outperforms 13 other commonly used unimodal or bimodal models. Explainable PIDGN model helps deepen understanding of several SNPs and sMRI key factors that may affect PD. This study provides a potentially effective solution for automated early diagnosis of PD using AI.
Collapse
Affiliation(s)
- Wenjia Li
- School of Mathematics and Statistics, Ludong University, Yantai 264025, China
| | - Quanrui Rao
- School of Information and Electrical Engineering, Ludong University, Yantai 264025, China
| | - Shuying Dong
- School of Mathematics and Statistics, Ludong University, Yantai 264025, China
| | - Mengyuan Zhu
- School of Mathematics and Statistics, Ludong University, Yantai 264025, China
| | - Zhen Yang
- School of Mathematics and Statistics, Ludong University, Yantai 264025, China
| | - Xianggeng Huang
- School of Mathematics and Statistics, Ludong University, Yantai 264025, China
| | - Guangchen Liu
- School of Mathematics and Statistics, Ludong University, Yantai 264025, China.
| |
Collapse
|
3
|
Ye Q, Lin C, Xiao F, Jiang T, Hou J, Zheng Y, Xu J, Huang J, Chen K, Cai J, Qian J, Quan W, Chen Y. Individualized diagnosis of Parkinson's disease based on multivariate magnetic resonance imaging radiomics and clinical indexes. Front Aging Neurosci 2025; 17:1504733. [PMID: 39957801 PMCID: PMC11825468 DOI: 10.3389/fnagi.2025.1504733] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2024] [Accepted: 01/13/2025] [Indexed: 02/18/2025] Open
Abstract
Objective To explore MRI-based radiomics models, integrating clinical characteristics, for differential diagnosis of Parkinson's disease (PD) to evaluate their diagnostic performance. Methods A total of 256 participants [153 PD, 103 healthy controls (HCs)] from the First Affiliated Hospital of Wenzhou Medical Hospital, were enrolled as the training set, and 120 subjects (74 PD, 46 HCs) from the PPMI dataset served as the test set. Radiomics features were extracted from structural MRI (T1WI and T2-FLair). Support Vector Machine (SVM) classifiers were developed using MRI radiomics data from both monomodal and multimodal radiomics models. The clinical-radiomics model was constructed by integrating clinical variables, including UPDRS, Hoehn-Yahr stage, age, sex, and MMSE scores. Receiver operating characteristic (ROC) curves were generated to evaluate the performance of the models. Decision curve analysis (DCA) was performed to access the clinical usefulness of the models. Results In the training set, the T2-FLair and T1WI radiomics model achieved an AUC of 0.896 (95% CI, 0.812-0.900) and 0.899 (95% CI, 0.818-0.908), respectively. The double-sequence radiomics model demonstrated superior diagnostic performance, with an AUC of 0.965 (95% CI, 0.885-0.978) in the training set and an AUC of 0.852 (95% CI, 0.748-0.910) in the test set. The integrated clinical-radiomics model showed enhanced diagnostic accuracy, with AUC = 0.983 (95% CI, 0.897-0.996) in the training set and AUC = 0.837 (95% CI, 0.786-0.902) in the test set. Rad-scores derived from the radiomics model were significantly correlated with diagnostic outcomes (P < 0.001). DCA confirmed the substantial clinical usefulness of the clinical-radiomics integrated model. Conclusion The integrated clinical-radiomics model offered superior diagnostic performance compared to models based relying solely on imaging or clinical data, underscoring its potential as a non-invasive and effective tool in routine clinical practice for the early diagnosis of PD.
Collapse
Affiliation(s)
- Qianqian Ye
- Department of Neurology, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Chenhui Lin
- Department of Neurology, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Fangyi Xiao
- Department of Cardiology, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Tao Jiang
- Department of Neurology, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Jialong Hou
- Department of Neurology, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Yi Zheng
- Department of Neurology, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Jiaxue Xu
- Department of Neurology, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Jiani Huang
- Department of Neurology, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Keke Chen
- Department of Neurology, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Jinlai Cai
- Department of Neurology, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Jingjing Qian
- Department of Neurology, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Weiwei Quan
- Department of Neurology, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Yanyan Chen
- Department of Neurology, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| |
Collapse
|
4
|
Cheng L, Gao H, Wang Z, Guo L, Wang X, Jin G. Prospective study of dual-phase 99mTc-MIBI SPECT/CT nomogram for differentiating non-small cell lung cancer from benign pulmonary lesions. Eur J Radiol 2024; 179:111657. [PMID: 39163806 DOI: 10.1016/j.ejrad.2024.111657] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2024] [Revised: 07/15/2024] [Accepted: 07/29/2024] [Indexed: 08/22/2024]
Abstract
OBJECTIVES To establish and validate a technetium 99m sestamibi (99mTc-MIBI) single-photon emission computed tomography/computed tomography (SPECT/CT) nomogram for predicting non-small cell lung cancer (NSCLC). Comparing the diagnostic performance of early and delayed SPECT/CT nomogram, and compare the diagnostic performance of SPECT/CT radiomics models with single SPECT and CT radiomics models. METHODS This prospective study included 119 lesions (NSCLC: n = 92, benign pulmonary lesions: n = 27) from 103 patients (mean age: 59.68 ± 8.94 years). Patients underwent dual-phase 99mTc-MIBI SPECT/CT imaging. They were divided into the training (n = 83) and validation (n = 36) cohorts. Logistic regression, support vector machine, random forest, and light-gradient boosting machine were applied to train and determine the optimal machine learning model. Then, combining radiomics score and clinical factors, establish nomograms for diagnosing NSCLC. RESULT CYFRA21-1 was selected for constructing the clinical model. In early imaging, the areas under the curve (AUCs) of the clinical model, radiomics model, and nomogram were 0.571, 0.830, and 0.875, respectively. The nomogram performed better than the clinical model and similarly to the radiomics model (P=0.020, P=0.216), and there are no statistically significant differences in the predictive performance between the radiomics model and the clinical model (P=0.103). In delayed imaging, the AUC was 0.643, 0.888, and 0.893, respectively. The predictive performance of the nomogram was superior compared to the clinical model and comparable to the radiomics model (P=0.042, P=0.480), and the radiomics model also demonstrated superior diagnostic performance compared to the clinical model (P=0.049). Compared to early SPECT/CT results, the AUC values of the nomogram and radiomics models in the delayed phase were higher, although no statistical differences were found (P=0.831, P=0.568). In delayed imaging, the AUC of the radiomics models for CT and SPECT was 0.696 and 0.768, respectively, SPECT/CT radiomics exhibited significant differences compared with CT and SPECT alone (P=0.042, P=0.038). CONCLUSION Dual-phase 99mTc-MIBI SPECT/CT nomograms and radiomics models can effectively predict NSCLC, providing an economically and non-invasive imaging method for diagnosing NSCLC, moreover, these findings provide a basis for early diagnosis and treatment strategies in NSCLC patients. Delayed-phase SPECT/CT imaging may offer greater practical value than early-phase imaging for diagnosing NSCLC. However, this novel approach necessitates further validation in larger, multi-center cohorts. CLINICAL RELEVANCE Radiomics nomogram based on SPECT/CT for discriminating NSCLC from benign lung lesions helps to aid early diagnosis and guide treatment. KEY POINTS Nomograms, based on dual-phase SPECT/CT, was constructed to discriminate between non-small cell lung cancer and benign lesions. SPECT/CT radiomics model has better predictive performance than SPECT and CT radiomics model.
Collapse
Affiliation(s)
- Liping Cheng
- Department of Nuclear Medicine, The Second Affiliated Hospital of Harbin Medical University, Harbin 150000, China
| | - Han Gao
- Department of Radiology, Taikang Xianlin Gulou Hospital, Nanjing 210000, China
| | - Zhensheng Wang
- Department of Hepatobiliary Surgery, The Second Affiliated Hospital of Harbin Medical University, Harbin 150000, China
| | - Lin Guo
- Department of Nuclear Medicine, The Second Affiliated Hospital of Harbin Medical University, Harbin 150000, China
| | - Xuehan Wang
- Department of Nuclear Medicine, The Second Affiliated Hospital of Harbin Medical University, Harbin 150000, China
| | - Gang Jin
- Department of Nuclear Medicine, The Second Affiliated Hospital of Harbin Medical University, Harbin 150000, China.
| |
Collapse
|
5
|
Reddy A, Reddy RP, Roghani AK, Garcia RI, Khemka S, Pattoor V, Jacob M, Reddy PH, Sehar U. Artificial intelligence in Parkinson's disease: Early detection and diagnostic advancements. Ageing Res Rev 2024; 99:102410. [PMID: 38972602 DOI: 10.1016/j.arr.2024.102410] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Accepted: 07/04/2024] [Indexed: 07/09/2024]
Abstract
Parkinson's disease (PD) is the second most common neurodegenerative disorder, globally affecting men and women at an exponentially growing rate, with currently no cure. Disease progression starts when dopaminergic neurons begin to die. In PD, the loss of neurotransmitter, dopamine is responsible for the overall communication of neural cells throughout the body. Clinical symptoms of PD are slowness of movement, involuntary muscular contractions, speech & writing changes, lessened automatic movement, and chronic tremors in the body. PD occurs in both familial and sporadic forms and modifiable and non-modifiable risk factors and socioeconomic conditions cause PD. Early detectable diagnostics and treatments have been developed in the last several decades. However, we still do not have precise early detectable biomarkers and therapeutic agents/drugs that prevent and/or delay the disease process. Recently, artificial intelligence (AI) science and machine learning tools have been promising in identifying early detectable markers with a greater rate of accuracy compared to past forms of treatment and diagnostic processes. Artificial intelligence refers to the intelligence exhibited by machines or software, distinct from the intelligence observed in humans that is based on neural networks in a form and can be used to diagnose the longevity and disease severity of disease. The term Machine Learning or Neural Networks is a blanket term used to identify an emerging technology that is created to work in the way of a "human brain" using many intertwined neurons to achieve the same level of raw intelligence as that of a brain. These processes have been used for neurodegenerative diseases such as Parkinson's disease and Alzheimer's disease, to assess the severity of the patient's condition. In the current article, we discuss the prevalence and incidence of PD, and currently available diagnostic biomarkers and therapeutic strategies. We also highlighted currently available artificial intelligence science and machine learning tools and their applications to detect disease and develop therapeutic interventions.
Collapse
Affiliation(s)
- Aananya Reddy
- Department of Internal Medicine, Texas Tech University Health Sciences Center, Lubbock, TX 79430, USA; Lubbock High School, Lubbock, TX 79401, USA.
| | - Ruhananhad P Reddy
- Department of Internal Medicine, Texas Tech University Health Sciences Center, Lubbock, TX 79430, USA; Lubbock High School, Lubbock, TX 79401, USA.
| | - Aryan Kia Roghani
- Department of Internal Medicine, Texas Tech University Health Sciences Center, Lubbock, TX 79430, USA; Frenship High School, Lubbock, TX 79382, USA.
| | - Ricardo Isaiah Garcia
- Department of Internal Medicine, Texas Tech University Health Sciences Center, Lubbock, TX 79430, USA.
| | - Sachi Khemka
- Department of Internal Medicine, Texas Tech University Health Sciences Center, Lubbock, TX 79430, USA.
| | - Vasanthkumar Pattoor
- Department of Internal Medicine, Texas Tech University Health Sciences Center, Lubbock, TX 79430, USA; University of South Florida, Tampa, FL 33620, USA.
| | - Michael Jacob
- Department of Internal Medicine, Texas Tech University Health Sciences Center, Lubbock, TX 79430, USA; Department of Biology, The University of Texas at San Antonio, San Antonio, TX 78249, USA.
| | - P Hemachandra Reddy
- Department of Internal Medicine, Texas Tech University Health Sciences Center, Lubbock, TX 79430, USA; Nutritional Sciences Department, College of Human Medicine, Texas Tech University Health Sciences Center, Lubbock, TX 79430, USA; Public Health Department of Graduate School of Biomedical Sciences, Texas Tech University Health Sciences Center, Lubbock, TX 79430, USA; Department pf Speech, Language and Hearing Services, School Health Professions, Texas Tech University Health Sciences Center, Lubbock, TX 79430, USA; Department of Pharmacology and Neuroscience, Texas Tech University Health Sciences Center, Lubbock, TX 79430, USA.
| | - Ujala Sehar
- Department of Internal Medicine, Texas Tech University Health Sciences Center, Lubbock, TX 79430, USA.
| |
Collapse
|
6
|
Jiang H, Du Y, Lu Z, Wang B, Zhao Y, Wang R, Zhang H, Mok GSP. Radiomics incorporating deep features for predicting Parkinson's disease in 123I-Ioflupane SPECT. EJNMMI Phys 2024; 11:60. [PMID: 38985382 PMCID: PMC11236833 DOI: 10.1186/s40658-024-00651-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2024] [Accepted: 05/24/2024] [Indexed: 07/11/2024] Open
Abstract
PURPOSE 123I-Ioflupane SPECT is an effective tool for the diagnosis and progression assessment of Parkinson's disease (PD). Radiomics and deep learning (DL) can be used to track and analyze the underlying image texture and features to predict the Hoehn-Yahr stages (HYS) of PD. In this study, we aim to predict HYS at year 0 and year 4 after the first diagnosis with combined imaging, radiomics and DL-based features using 123I-Ioflupane SPECT images at year 0. METHODS In this study, 161 subjects from the Parkinson's Progressive Marker Initiative database underwent baseline 3T MRI and 123I-Ioflupane SPECT, with HYS assessment at years 0 and 4 after first diagnosis. Conventional imaging features (IF) and radiomic features (RaF) for striatum uptakes were extracted from SPECT images using MRI- and SPECT-based (SPECT-V and SPECT-T) segmentations respectively. A 2D DenseNet was used to predict HYS of PD, and simultaneously generate deep features (DF). The random forest algorithm was applied to develop models based on DF, RaF, IF and combined features to predict HYS (stage 0, 1 and 2) at year 0 and (stage 0, 1 and ≥ 2) at year 4, respectively. Model predictive accuracy and receiver operating characteristic (ROC) analysis were assessed for various prediction models. RESULTS For the diagnostic accuracy at year 0, DL (0.696) outperformed most models, except DF + IF in SPECT-V (0.704), significantly superior based on paired t-test. For year 4, accuracy of DF + RaF model in MRI-based method is the highest (0.835), significantly better than DF + IF, IF + RaF, RaF and IF models. And DL (0.820) surpassed models in both SPECT-based methods. The area under the ROC curve (AUC) highlighted DF + RaF model (0.854) in MRI-based method at year 0 and DF + RaF model (0.869) in SPECT-T method at year 4, outperforming DL models, respectively. And then, there was no significant differences between SPECT-based and MRI-based segmentation methods except for the imaging feature models. CONCLUSION The combination of radiomic and deep features enhances the prediction accuracy of PD HYS compared to only radiomics or DL. This suggests the potential for further advancements in predictive model performance for PD HYS at year 0 and year 4 after first diagnosis using 123I-Ioflupane SPECT images at year 0, thereby facilitating early diagnosis and treatment for PD patients. No significant difference was observed in radiomics results obtained between MRI- and SPECT-based striatum segmentations for radiomic and deep features.
Collapse
Affiliation(s)
- Han Jiang
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Avenida da Universidade, Macau, Macau SAR, China
- PET-CT Center, Fujian Medical University Union Hospital, Fuzhou, China
| | - Yu Du
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Avenida da Universidade, Macau, Macau SAR, China
- Center for Cognitive and Brain Sciences, Institute of Collaborative Innovation, University of Macau, Taipa, Macau SAR, China
| | - Zhonglin Lu
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Avenida da Universidade, Macau, Macau SAR, China
- Center for Cognitive and Brain Sciences, Institute of Collaborative Innovation, University of Macau, Taipa, Macau SAR, China
| | - Bingjie Wang
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Avenida da Universidade, Macau, Macau SAR, China
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Yonghua Zhao
- State Key Laboratory of Quality Research in Chinese Medicine, Institute of Chinese Medical Sciences, University of Macau, Taipa, Macau SAR, China
| | - Ruibing Wang
- State Key Laboratory of Quality Research in Chinese Medicine, Institute of Chinese Medical Sciences, University of Macau, Taipa, Macau SAR, China
| | - Hong Zhang
- Department of Nuclear Medicine and PET Center, The Second Affiliated Hospital of Zhejiang, University School of Medicine, 88 Jiefang Road, Zhejiang, 310009, Zhejiang, China.
- Institute of Nuclear Medicine and Molecular, Imaging of Zhejiang University, Hangzhou, China.
- Key Laboratory of Medical Molecular Imaging of Zhejiang Province, Hangzhou, China.
- College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, China.
- Key Laboratory for Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou, China.
| | - Greta S P Mok
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Avenida da Universidade, Macau, Macau SAR, China.
- Center for Cognitive and Brain Sciences, Institute of Collaborative Innovation, University of Macau, Taipa, Macau SAR, China.
| |
Collapse
|
7
|
Mu X, Cui C, Liao J, Wu Z, Hu L. Regional changes in brain metabolism during the progression of mild cognitive impairment: a longitudinal study based on radiomics. EJNMMI REPORTS 2024; 8:19. [PMID: 38945980 PMCID: PMC11214937 DOI: 10.1186/s41824-024-00206-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/28/2024] [Accepted: 04/22/2024] [Indexed: 07/02/2024]
Abstract
BACKGROUND This study aimed to establish radiomics models based on positron emission tomography (PET) images to longitudinally predict transition from mild cognitive impairment (MCI) to Alzheimer's disease (AD). METHODS In our study, 278 MCI patients from the ADNI database were analyzed, where 60 transitioned to AD (pMCI) and 218 remained stable (sMCI) over 48 months. Patients were divided into a training set (n = 222) and a validation set (n = 56). We first employed voxel-based analysis of 18F-FDG PET images to identify brain regions that present significant SUV difference between pMCI and sMCI groups. Radiomic features were extracted from these regions, key features were selected, and predictive models were developed for individual and combined brain regions. The models' effectiveness was evaluated using metrics like AUC to determine the most accurate predictive model for MCI progression. RESULTS Voxel-based analysis revealed four brain regions implicated in the progression from MCI to AD. These include ROI1 within the Temporal lobe, ROI2 and ROI3 in the Thalamus, and ROI4 in the Limbic system. Among the predictive models developed for these individual regions, the model utilizing ROI4 demonstrated superior predictive accuracy. In the training set, the AUC for the ROI4 model was 0.803 (95% CI 0.736, 0.865), and in the validation set, it achieved an AUC of 0.733 (95% CI 0.559, 0.893). Conversely, the model based on ROI3 showed the lowest performance, with an AUC of 0.75 (95% CI 0.685, 0.809). Notably, the comprehensive model encompassing all identified regions (ROI total) outperformed the single-region models, achieving an AUC of 0.884 (95% CI 0.845, 0.921) in the training set and 0.816 (95% CI 0.705, 0.909) in the validation set, indicating significantly enhanced predictive capability for MCI progression to AD. CONCLUSION Our findings underscore the Limbic system as the brain region most closely associated with the progression from MCI to AD. Importantly, our study demonstrates that a PET brain radiomics model encompassing multiple brain regions (ROI total) significantly outperforms models based on single brain regions. This comprehensive approach more accurately identifies MCI patients at high risk of progressing to AD, offering valuable insights for non-invasive diagnostics and facilitating early and timely interventions in clinical settings.
Collapse
Affiliation(s)
- Xuxu Mu
- Shanxi Key Laboratory of Molecular Imaging, Shanxi Medical University, Taiyuan, 030001, Shanxi, People's Republic of China
- Department of Nuclear Medicine, First Hospital of Shanxi Medical University, Shanxi Medical University, Taiyuan, 030001, Shanxi, People's Republic of China
| | - Caozhe Cui
- Shanxi Key Laboratory of Molecular Imaging, Shanxi Medical University, Taiyuan, 030001, Shanxi, People's Republic of China
- Department of Nuclear Medicine, First Hospital of Shanxi Medical University, Shanxi Medical University, Taiyuan, 030001, Shanxi, People's Republic of China
| | - Jue Liao
- Shanxi Key Laboratory of Molecular Imaging, Shanxi Medical University, Taiyuan, 030001, Shanxi, People's Republic of China
- Collaborative Innovation Center for Molecular Imaging of Precision Medicine, Shanxi Medical University, Taiyuan, 030001, Shanxi, People's Republic of China
| | - Zhifang Wu
- Shanxi Key Laboratory of Molecular Imaging, Shanxi Medical University, Taiyuan, 030001, Shanxi, People's Republic of China
- Department of Nuclear Medicine, First Hospital of Shanxi Medical University, Shanxi Medical University, Taiyuan, 030001, Shanxi, People's Republic of China
- Collaborative Innovation Center for Molecular Imaging of Precision Medicine, Shanxi Medical University, Taiyuan, 030001, Shanxi, People's Republic of China
| | - Lingzhi Hu
- Collaborative Innovation Center for Molecular Imaging of Precision Medicine, Shanxi Medical University, Taiyuan, 030001, Shanxi, People's Republic of China.
| |
Collapse
|
8
|
Stake J, Spiekers C, Akkurt BH, Heindel W, Brix T, Mannil M, Musigmann M. Prediction of Seropositivity in Suspected Autoimmune Encephalitis by Use of Radiomics: A Radiological Proof-of-Concept Study. Diagnostics (Basel) 2024; 14:1070. [PMID: 38893597 PMCID: PMC11171889 DOI: 10.3390/diagnostics14111070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2024] [Revised: 05/14/2024] [Accepted: 05/16/2024] [Indexed: 06/21/2024] Open
Abstract
In this study, we sought to evaluate the capabilities of radiomics and machine learning in predicting seropositivity in patients with suspected autoimmune encephalitis (AE) from MR images obtained at symptom onset. In 83 patients diagnosed with AE between 2011 and 2022, manual bilateral segmentation of the amygdala was performed on pre-contrast T2 images using 3D Slicer open-source software. Our sample of 83 patients contained 43 seropositive and 40 seronegative AE cases. Images were obtained at our tertiary care center and at various secondary care centers in North Rhine-Westphalia, Germany. The sample was randomly split into training data and independent test data. A total of 107 radiomic features were extracted from bilateral regions of interest (ROIs). Automated machine learning (AutoML) was used to identify the most promising machine learning algorithms. Feature selection was performed using recursive feature elimination (RFE) and based on the determination of the most important features. Selected features were used to train various machine learning algorithms on 100 different data partitions. Performance was subsequently evaluated on independent test data. Our radiomics approach was able to predict the presence of autoantibodies in the independent test samples with a mean AUC of 0.90, a mean accuracy of 0.83, a mean sensitivity of 0.84 and a mean specificity of 0.82, with Lasso regression models yielding the most promising results. These results indicate that radiomics-based machine learning could be a promising tool in predicting the presence of autoantibodies in suspected AE patients. Given the implications of seropositivity for definitive diagnosis of suspected AE cases, this may expedite diagnostic workup even before results from specialized laboratory testing can be obtained. Furthermore, in conjunction with recent publications, our results indicate that characterization of AE subtypes by use of radiomics may become possible in the future, potentially allowing physicians to tailor treatment in the spirit of personalized medicine even before laboratory workup is completed.
Collapse
Affiliation(s)
- Jacob Stake
- University Clinic for Radiology, University of Münster and University Hospital Münster, Albert-Schweitzer-Campus 1, 48149 Münster, Germany; (J.S.)
| | - Christine Spiekers
- University Clinic for Radiology, University of Münster and University Hospital Münster, Albert-Schweitzer-Campus 1, 48149 Münster, Germany; (J.S.)
| | - Burak Han Akkurt
- University Clinic for Radiology, University of Münster and University Hospital Münster, Albert-Schweitzer-Campus 1, 48149 Münster, Germany; (J.S.)
| | - Walter Heindel
- University Clinic for Radiology, University of Münster and University Hospital Münster, Albert-Schweitzer-Campus 1, 48149 Münster, Germany; (J.S.)
| | - Tobias Brix
- Institute of Medical Informatics, University of Münster, Albert-Schweitzer-Campus 1, 48149 Münster, Germany
| | - Manoj Mannil
- University Clinic for Radiology, University of Münster and University Hospital Münster, Albert-Schweitzer-Campus 1, 48149 Münster, Germany; (J.S.)
| | - Manfred Musigmann
- University Clinic for Radiology, University of Münster and University Hospital Münster, Albert-Schweitzer-Campus 1, 48149 Münster, Germany; (J.S.)
| |
Collapse
|
9
|
Lu C, Jiang J, Chen Q, Liu H, Ju X, Wang H. Analysis and prediction of interactions between transmembrane and non-transmembrane proteins. BMC Genomics 2024; 25:401. [PMID: 38658824 PMCID: PMC11040819 DOI: 10.1186/s12864-024-10251-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Accepted: 03/25/2024] [Indexed: 04/26/2024] Open
Abstract
BACKGROUND Most of the important biological mechanisms and functions of transmembrane proteins (TMPs) are realized through their interactions with non-transmembrane proteins(nonTMPs). The interactions between TMPs and nonTMPs in cells play vital roles in intracellular signaling, energy metabolism, investigating membrane-crossing mechanisms, correlations between disease and drugs. RESULTS Despite the importance of TMP-nonTMP interactions, the study of them remains in the wet experimental stage, lacking specific and comprehensive studies in the field of bioinformatics. To fill this gap, we performed a comprehensive statistical analysis of known TMP-nonTMP interactions and constructed a deep learning-based predictor to identify potential interactions. The statistical analysis describes known TMP-nonTMP interactions from various perspectives, such as distributions of species and protein families, enrichment of GO and KEGG pathways, as well as hub proteins and subnetwork modules in the PPI network. The predictor implemented by an end-to-end deep learning model can identify potential interactions from protein primary sequence information. The experimental results over the independent validation demonstrated considerable prediction performance with an MCC of 0.541. CONCLUSIONS To our knowledge, we were the first to focus on TMP-nonTMP interactions. We comprehensively analyzed them using bioinformatics methods and predicted them via deep learning-based solely on their sequence. This research completes a key link in the protein network, benefits the understanding of protein functions, and helps in pathogenesis studies of diseases and associated drug development.
Collapse
Affiliation(s)
- Chang Lu
- School of Psychology, School of Information Science and Technology, Institute of Computational Biology, Northeast Normal University, Changchun, China
| | - Jiuhong Jiang
- School of Psychology, School of Information Science and Technology, Institute of Computational Biology, Northeast Normal University, Changchun, China
| | - Qiufen Chen
- School of Psychology, School of Information Science and Technology, Institute of Computational Biology, Northeast Normal University, Changchun, China
| | - Huanhuan Liu
- School of Psychology, School of Information Science and Technology, Institute of Computational Biology, Northeast Normal University, Changchun, China
| | - Xingda Ju
- School of Psychology, School of Information Science and Technology, Institute of Computational Biology, Northeast Normal University, Changchun, China.
| | - Han Wang
- School of Psychology, School of Information Science and Technology, Institute of Computational Biology, Northeast Normal University, Changchun, China.
| |
Collapse
|
10
|
Sun J, Cong C, Li X, Zhou W, Xia R, Liu H, Wang Y, Xu Z, Chen X. Identification of Parkinson's disease and multiple system atrophy using multimodal PET/MRI radiomics. Eur Radiol 2024; 34:662-672. [PMID: 37535155 DOI: 10.1007/s00330-023-10003-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Revised: 05/08/2023] [Accepted: 06/06/2023] [Indexed: 08/04/2023]
Abstract
OBJECTIVES To construct a machine learning model for differentiating Parkinson's disease (PD) and multiple system atrophy (MSA) by using multimodal PET/MRI radiomics and clinical characteristics. METHODS One hundred and nineteen patients (81 with PD and 38 with MSA) underwent brain PET/CT and MRI to obtain metabolic images ([18F]FDG, [11C]CFT PET) and structural MRI (T1WI, T2WI, and T2-FLAIR). Image analysis included automatic segmentation on MRI, co-registration of PET images onto the corresponding MRI. Radiomics features were then extracted from the putamina and caudate nuclei and selected to construct predictive models. Moreover, based on PET/MRI radiomics and clinical characteristics, we developed a nomogram. Receiver operating characteristic (ROC) curves were performed to evaluate the performance of the models. Decision curve analysis (DCA) was employed to access the clinical usefulness of the models. RESULTS The combined PET/MRI radiomics model of five sequences outperformed monomodal radiomics models alone. Further, PET/MRI radiomics-clinical combined model could perfectly distinguish PD from MSA (AUC = 0.993), which outperformed the clinical model (AUC = 0.923, p = 0.028) in training set, with no significant difference in test set (AUC = 0.860 vs 0.917, p = 0.390). However, no significant difference was found between PET/MRI radiomics-clinical model and PET/MRI radiomics model in training (AUC = 0.988, p = 0.276) and test sets (AUC = 0.860 vs 0.845, p = 0.632). DCA demonstrated the highest clinical benefit of PET/MRI radiomics-clinical model. CONCLUSIONS Our study indicates that multimodal PET/MRI radiomics could achieve promising performance to differentiate between PD and MSA in clinics. CLINICAL RELEVANCE STATEMENT This study developed an optimal radiomics signature and construct model to distinguish PD from MSA by multimodal PET/MRI imaging methods in clinics for parkinsonian syndromes, which achieved an excellent performance. KEY POINTS •Multimodal PET/MRI radiomics from putamina and caudate nuclei increase the diagnostic efficiency for distinguishing PD from MSA. •The radiomics-based nomogram was developed to differentiate between PD and MSA. •Combining PET/MRI radiomics-clinical model achieved promising performance to identify PD and MSA.
Collapse
Affiliation(s)
- Jinju Sun
- Department of Nuclear Medicine, Daping Hospital, Army Medical University, Chongqing, China
| | - Chao Cong
- Department of Nuclear Medicine, Daping Hospital, Army Medical University, Chongqing, China
- School of Electrical and Electronic Engineering, Chongqing University of Technology, Chongqing, China
| | - Xinpeng Li
- Department of Neurology, Daping Hospital, Army Medical University, Chongqing, China
| | - Weicheng Zhou
- Department of Nuclear Medicine, Daping Hospital, Army Medical University, Chongqing, China
| | - Renxiang Xia
- Department of Nuclear Medicine, Daping Hospital, Army Medical University, Chongqing, China
| | | | - Yi Wang
- Department of Nuclear Medicine, Daping Hospital, Army Medical University, Chongqing, China
| | - Zhiqiang Xu
- Department of Neurology, Daping Hospital, Army Medical University, Chongqing, China.
| | - Xiao Chen
- Department of Nuclear Medicine, Daping Hospital, Army Medical University, Chongqing, China.
- Chongqing Clinical Research Center for Imaging and Nuclear Medicine, Chongqing, China.
| |
Collapse
|
11
|
Jimenez-Mesa C, Arco JE, Martinez-Murcia FJ, Suckling J, Ramirez J, Gorriz JM. Applications of machine learning and deep learning in SPECT and PET imaging: General overview, challenges and future prospects. Pharmacol Res 2023; 197:106984. [PMID: 37940064 DOI: 10.1016/j.phrs.2023.106984] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 10/04/2023] [Accepted: 11/04/2023] [Indexed: 11/10/2023]
Abstract
The integration of positron emission tomography (PET) and single-photon emission computed tomography (SPECT) imaging techniques with machine learning (ML) algorithms, including deep learning (DL) models, is a promising approach. This integration enhances the precision and efficiency of current diagnostic and treatment strategies while offering invaluable insights into disease mechanisms. In this comprehensive review, we delve into the transformative impact of ML and DL in this domain. Firstly, a brief analysis is provided of how these algorithms have evolved and which are the most widely applied in this domain. Their different potential applications in nuclear imaging are then discussed, such as optimization of image adquisition or reconstruction, biomarkers identification, multimodal fusion and the development of diagnostic, prognostic, and disease progression evaluation systems. This is because they are able to analyse complex patterns and relationships within imaging data, as well as extracting quantitative and objective measures. Furthermore, we discuss the challenges in implementation, such as data standardization and limited sample sizes, and explore the clinical opportunities and future horizons, including data augmentation and explainable AI. Together, these factors are propelling the continuous advancement of more robust, transparent, and reliable systems.
Collapse
Affiliation(s)
- Carmen Jimenez-Mesa
- Department of Signal Theory, Networking and Communications, University of Granada, 18010, Spain
| | - Juan E Arco
- Department of Signal Theory, Networking and Communications, University of Granada, 18010, Spain; Department of Communications Engineering, University of Malaga, 29010, Spain
| | | | - John Suckling
- Department of Psychiatry, University of Cambridge, Cambridge CB21TN, UK
| | - Javier Ramirez
- Department of Signal Theory, Networking and Communications, University of Granada, 18010, Spain
| | - Juan Manuel Gorriz
- Department of Signal Theory, Networking and Communications, University of Granada, 18010, Spain; Department of Psychiatry, University of Cambridge, Cambridge CB21TN, UK.
| |
Collapse
|
12
|
Salmanpour MR, Hosseinzadeh M, Rezaeijo SM, Rahmim A. Fusion-based tensor radiomics using reproducible features: Application to survival prediction in head and neck cancer. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 240:107714. [PMID: 37473589 DOI: 10.1016/j.cmpb.2023.107714] [Citation(s) in RCA: 34] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/25/2022] [Revised: 05/19/2023] [Accepted: 07/07/2023] [Indexed: 07/22/2023]
Abstract
BACKGROUND Numerous features are commonly generated in radiomics applications as applied to medical imaging, and identification of robust radiomics features (RFs) can be an important step to derivation of reliable, reproducible solutions. In this work, we utilize a tensor radiomics (TR) framework, where numerous fusions are explored, to generate different flavours of RFs, and we aimed to identify RFs that are robust to fusion techniques in head and neck cancer. Overall, we aimed to predict progression-free survival (PFS) using Hybrid Machine Learning Systems (HMLS) and reproducible RFs. METHODS The study was performed on 408 patients with head and neck cancer from The Cancer Imaging Archive. After image preprocessing, 15 fusion techniques were employed to combine Positron Emission Tomography (PET) and Computed Tomography (CT) images. Subsequently, 215 RFs were extracted through a standardized radiomics software, with 17 'flavours' generated using PET-only, CT-only, and 15 fused PET&CT images. The variability of RFs across flavours was studied using the Intraclass Correlation Coefficient (ICC). Furthermore, the features were categorized into seven reliability groups, 106 reproducible RFs with ICC>0.75 were selected, highly correlated flavours were removed, Principal Component Analysis was used to convert 17 flavours to 1 attribute, the polynomial function was utilized to increase RFs, and Analysis of variance (ANOVA) was used to select the relevant attributes. Finally, 3 classifiers including Random Forest (RFC), Logistic regression (LR), and Multi-layer perceptron were applied to the preselected relevant attributes to predict binary PFS. In 5-fold cross-validation, 80% of 4 divisions were utilized to train the model, and the remaining 20% was utilized to evaluate the model. Further, the remaining fold was used for external nested testing. RESULTS Reliability analysis indicated that most morphological features belong to the high-reliability category. By contrast, local intensity and statistical features extracted from images belong to the low-reliability category. In the tensor framework, the highest 5-fold cross-validation accuracy of 76.7%±3.3% with an external nested testing of 70.6%±6.7% resulted from the reproducible TR+polynomial function+ANOVA+LR algorithm while the accuracy of 70.0%±4.2% with the external nested testing of 67.7%±4.9% was achieved through the PCA fusion+RFC (non-tensor paradigm). CONCLUSIONS This study demonstrated that using reproducible RFs as utilized within a tensor fusion radiomics framework, linked with ANOVA and LR, added value to prediction of progression-free survival outcome in head and neck cancer patients.
Collapse
Affiliation(s)
- Mohammad R Salmanpour
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada; Technological Virtual Collaboration (TECVICO Corp.), Vancouver, BC, Canada.
| | - Mahdi Hosseinzadeh
- Technological Virtual Collaboration (TECVICO Corp.), Vancouver, BC, Canada; Department of Electrical & Computer Engineering, University of Tarbiat Modares, Tehran, Iran
| | - Seyed Masoud Rezaeijo
- Department of Medical Physics, Faculty of Medicine, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran
| | - Arman Rahmim
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada; Departments of Radiology and Physics, University of British Columbia, Vancouver, BC, Canada
| |
Collapse
|
13
|
Hajianfar G, Kalayinia S, Hosseinzadeh M, Samanian S, Maleki M, Sossi V, Rahmim A, Salmanpour MR. Prediction of Parkinson's disease pathogenic variants using hybrid Machine learning systems and radiomic features. Phys Med 2023; 113:102647. [PMID: 37579523 DOI: 10.1016/j.ejmp.2023.102647] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/11/2022] [Revised: 05/08/2023] [Accepted: 07/29/2023] [Indexed: 08/16/2023] Open
Abstract
PURPOSE In Parkinson's disease (PD), 5-10% of cases are of genetic origin with mutations identified in several genes such as leucine-rich repeat kinase 2 (LRRK2) and glucocerebrosidase (GBA). We aim to predict these two gene mutations using hybrid machine learning systems (HMLS), via imaging and non-imaging data, with the long-term goal to predict conversion to active disease. METHODS We studied 264 and 129 patients with known LRRK2 and GBA mutations status from PPMI database. Each dataset includes 513 features such as clinical features (CFs), conventional imaging features (CIFs) and radiomic features (RFs) extracted from DAT-SPECT images. Features, normalized by Z-score, were univariately analyzed for statistical significance by the t-test and chi-square test, adjusted by Benjamini-Hochberg correction. Multiple HMLSs, including 11 features extraction (FEA) or 10 features selection algorithms (FSA) linked with 21 classifiers were utilized. We also employed Ensemble Voting (EV) to classify the genes. RESULTS For prediction of LRRK2 mutation status, a number of HMLSs resulted in accuracies of 0.98 ± 0.02 and 1.00 in 5-fold cross-validation (80% out of total data points) and external testing (remaining 20%), respectively. For predicting GBA mutation status, multiple HMLSs resulted in high accuracies of 0.90 ± 0.08 and 0.96 in 5-fold cross-validation and external testing, respectively. We additionally showed that SPECT-based RFs added value to the specific prediction of of GBA mutation status. CONCLUSION We demonstrated that combining medical information with SPECT-based imaging features, and optimal utilization of HMLS can produce excellent prediction of the mutations status in PD patients.
Collapse
Affiliation(s)
- Ghasem Hajianfar
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran; Technological Virtual Collaboration (TECVICO Corp.), Vancouver BC, Canada
| | - Samira Kalayinia
- Cardiogenetic Research Center, Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Mahdi Hosseinzadeh
- Technological Virtual Collaboration (TECVICO Corp.), Vancouver BC, Canada; Department of Electrical and Computer Engineering, Tarbiat Modares University, Tehran, Iran
| | - Sara Samanian
- Firoozgar Hospital Medical Genetics Laboratory, Iran University of Medical Sciences, Tehran, Iran
| | - Majid Maleki
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Vesna Sossi
- Department of Physics and Astronomy, University of British Columbia, Vancouver, BC, Canada
| | - Arman Rahmim
- Department of Physics and Astronomy, University of British Columbia, Vancouver, BC, Canada; Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada
| | - Mohammad R Salmanpour
- Technological Virtual Collaboration (TECVICO Corp.), Vancouver BC, Canada; Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada.
| |
Collapse
|
14
|
Ali AM, Salim F, Saeed F. Parkinson's Disease Detection Using Filter Feature Selection and a Genetic Algorithm with Ensemble Learning. Diagnostics (Basel) 2023; 13:2816. [PMID: 37685354 PMCID: PMC10486479 DOI: 10.3390/diagnostics13172816] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 08/17/2023] [Accepted: 08/25/2023] [Indexed: 09/10/2023] Open
Abstract
Parkinson's disease (PD) is a neurodegenerative disorder marked by motor and non-motor symptoms that have a severe impact on the quality of life of the affected individuals. This study explores the effect of filter feature selection, followed by ensemble learning methods and genetic selection, on the detection of PD patients from attributes extracted from voice clips from both PD patients and healthy patients. Two distinct datasets were employed in this study. Filter feature selection was carried out by eliminating quasi-constant features. Several classification models were then tested on the filtered data. Decision tree, random forest, and XGBoost classifiers produced remarkable results, especially on Dataset 1, where 100% accuracy was achieved by decision tree and random forest. Ensemble learning methods (voting, stacking, and bagging) were then applied to the best-performing models to see whether the results could be enhanced further. Additionally, genetic selection was applied to the filtered data and evaluated using several classification models for their accuracy and precision. It was found that in most cases, the predictions for PD patients showed more precision than those for healthy individuals. The overall performance was also better on Dataset 1 than on Dataset 2, which had a greater number of features.
Collapse
Affiliation(s)
- Abdullah Marish Ali
- Department of Computer Science, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia;
| | - Farsana Salim
- DAAI Research Group, College of Computing and Digital Technology, Birmingham City University, Birmingham B4 7XG, UK;
| | - Faisal Saeed
- DAAI Research Group, College of Computing and Digital Technology, Birmingham City University, Birmingham B4 7XG, UK;
| |
Collapse
|
15
|
Park CJ, Eom J, Park KS, Park YW, Chung SJ, Kim YJ, Ahn SS, Kim J, Lee PH, Sohn YH, Lee SK. An interpretable multiparametric radiomics model of basal ganglia to predict dementia conversion in Parkinson's disease. NPJ Parkinsons Dis 2023; 9:127. [PMID: 37648733 PMCID: PMC10468504 DOI: 10.1038/s41531-023-00566-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Accepted: 08/02/2023] [Indexed: 09/01/2023] Open
Abstract
Cognitive impairment in Parkinson's disease (PD) severely affects patients' prognosis, and early detection of patients at high risk of dementia conversion is important for establishing treatment strategies. We aimed to investigate whether multiparametric MRI radiomics from basal ganglia can improve the prediction of dementia development in PD when integrated with clinical profiles. In this retrospective study, 262 patients with newly diagnosed PD (June 2008-July 2017, follow-up >5 years) were included. MRI radiomic features (n = 1284) were extracted from bilateral caudate and putamen. Two models were developed to predict dementia development: (1) a clinical model-age, disease duration, and cognitive composite scores, and (2) a combined clinical and radiomics model. The area under the receiver operating characteristic curve (AUC) were calculated for each model. The models' interpretabilities were studied. Among total 262 PD patients (mean age, 68 years ± 8 [standard deviation]; 134 men), 51 (30.4%), and 24 (25.5%) patients developed dementia within 5 years of PD diagnosis in the training (n = 168) and test sets (n = 94), respectively. The combined model achieved superior predictive performance compared to the clinical model in training (AUCs 0.928 vs. 0.894, P = 0.284) and test set (AUCs 0.889 vs. 0.722, P = 0.016). The cognitive composite scores of the frontal/executive function domain contributed most to predicting dementia. Radiomics derived from the caudate were also highly associated with cognitive decline. Multiparametric MRI radiomics may have an incremental prognostic value when integrated with clinical profiles to predict future cognitive decline in PD.
Collapse
Affiliation(s)
- Chae Jung Park
- Department of Radiology, Yongin Severance Hospital, Yonsei University Health System, Yongin-si, Gyeonggi-do, South Korea
| | - Jihwan Eom
- Department of Computer Science, Yonsei University, Seoul, South Korea
| | - Ki Sung Park
- Department of Mechanical Engineering, Pohang University of Science and Technology, Pohang, Republic of Korea
| | - Yae Won Park
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, South Korea.
| | - Seok Jong Chung
- Department of Neurology, Yongin Severance Hospital, Yonsei University Health System, Yongin-si, Gyeonggi-do, South Korea.
- Department of Neurology, Yonsei University College of Medicine, Seoul, South Korea.
- YONSEI BEYOND LAB, Yongin-si, Gyeonggi-do, South Korea.
| | - Yun Joong Kim
- Department of Neurology, Yongin Severance Hospital, Yonsei University Health System, Yongin-si, Gyeonggi-do, South Korea
- Department of Neurology, Yonsei University College of Medicine, Seoul, South Korea
- YONSEI BEYOND LAB, Yongin-si, Gyeonggi-do, South Korea
| | - Sung Soo Ahn
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, South Korea
| | - Jinna Kim
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, South Korea
| | - Phil Hyu Lee
- Department of Neurology, Yonsei University College of Medicine, Seoul, South Korea
| | - Young Ho Sohn
- Department of Neurology, Yonsei University College of Medicine, Seoul, South Korea
| | - Seung-Koo Lee
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, South Korea
| |
Collapse
|
16
|
Salmanpour MR, Rezaeijo SM, Hosseinzadeh M, Rahmim A. Deep versus Handcrafted Tensor Radiomics Features: Prediction of Survival in Head and Neck Cancer Using Machine Learning and Fusion Techniques. Diagnostics (Basel) 2023; 13:1696. [PMID: 37238180 PMCID: PMC10217462 DOI: 10.3390/diagnostics13101696] [Citation(s) in RCA: 32] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 03/22/2023] [Accepted: 04/21/2023] [Indexed: 05/28/2023] Open
Abstract
BACKGROUND Although handcrafted radiomics features (RF) are commonly extracted via radiomics software, employing deep features (DF) extracted from deep learning (DL) algorithms merits significant investigation. Moreover, a "tensor'' radiomics paradigm where various flavours of a given feature are generated and explored can provide added value. We aimed to employ conventional and tensor DFs, and compare their outcome prediction performance to conventional and tensor RFs. METHODS 408 patients with head and neck cancer were selected from TCIA. PET images were first registered to CT, enhanced, normalized, and cropped. We employed 15 image-level fusion techniques (e.g., dual tree complex wavelet transform (DTCWT)) to combine PET and CT images. Subsequently, 215 RFs were extracted from each tumor in 17 images (or flavours) including CT only, PET only, and 15 fused PET-CT images through the standardized-SERA radiomics software. Furthermore, a 3 dimensional autoencoder was used to extract DFs. To predict the binary progression-free-survival-outcome, first, an end-to-end CNN algorithm was employed. Subsequently, we applied conventional and tensor DFs vs. RFs as extracted from each image to three sole classifiers, namely multilayer perceptron (MLP), random-forest, and logistic regression (LR), linked with dimension reduction algorithms. RESULTS DTCWT fusion linked with CNN resulted in accuracies of 75.6 ± 7.0% and 63.4 ± 6.7% in five-fold cross-validation and external-nested-testing, respectively. For the tensor RF-framework, polynomial transform algorithms + analysis of variance feature selector (ANOVA) + LR enabled 76.67 ± 3.3% and 70.6 ± 6.7% in the mentioned tests. For the tensor DF framework, PCA + ANOVA + MLP arrived at 87.0 ± 3.5% and 85.3 ± 5.2% in both tests. CONCLUSIONS This study showed that tensor DF combined with proper machine learning approaches enhanced survival prediction performance compared to conventional DF, tensor and conventional RF, and end-to-end CNN frameworks.
Collapse
Affiliation(s)
- Mohammad R. Salmanpour
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC V5Z 1L3, Canada
- Technological Virtual Collaboration (TECVICO CORP.), Vancouver, BC V5E 3J7, Canada
| | - Seyed Masoud Rezaeijo
- Department of Medical Physics, Faculty of Medicine, Ahvaz Jundishapur University of Medical Sciences, Ahvaz 6135715794, Iran
| | - Mahdi Hosseinzadeh
- Technological Virtual Collaboration (TECVICO CORP.), Vancouver, BC V5E 3J7, Canada
- Department of Electrical & Computer Engineering, University of Tarbiat Modares, Tehran 14115111, Iran
| | - Arman Rahmim
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC V5Z 1L3, Canada
- Department of Physics & Astronomy, University of British Columbia, Vancouver, BC V6T 1Z4, Canada
| |
Collapse
|
17
|
Hosseinzadeh M, Gorji A, Fathi Jouzdani A, Rezaeijo SM, Rahmim A, Salmanpour MR. Prediction of Cognitive Decline in Parkinson's Disease Using Clinical and DAT SPECT Imaging Features, and Hybrid Machine Learning Systems. Diagnostics (Basel) 2023; 13:1691. [PMID: 37238175 PMCID: PMC10217464 DOI: 10.3390/diagnostics13101691] [Citation(s) in RCA: 38] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 04/28/2023] [Accepted: 05/04/2023] [Indexed: 05/28/2023] Open
Abstract
BACKGROUND We aimed to predict Montreal Cognitive Assessment (MoCA) scores in Parkinson's disease patients at year 4 using handcrafted radiomics (RF), deep (DF), and clinical (CF) features at year 0 (baseline) applied to hybrid machine learning systems (HMLSs). METHODS 297 patients were selected from the Parkinson's Progressive Marker Initiative (PPMI) database. The standardized SERA radiomics software and a 3D encoder were employed to extract RFs and DFs from single-photon emission computed tomography (DAT-SPECT) images, respectively. The patients with MoCA scores over 26 were indicated as normal; otherwise, scores under 26 were indicated as abnormal. Moreover, we applied different combinations of feature sets to HMLSs, including the Analysis of Variance (ANOVA) feature selection, which was linked with eight classifiers, including Multi-Layer Perceptron (MLP), K-Neighbors Classifier (KNN), Extra Trees Classifier (ETC), and others. We employed 80% of the patients to select the best model in a 5-fold cross-validation process, and the remaining 20% were employed for hold-out testing. RESULTS For the sole usage of RFs and DFs, ANOVA and MLP resulted in averaged accuracies of 59 ± 3% and 65 ± 4% for 5-fold cross-validation, respectively, with hold-out testing accuracies of 59 ± 1% and 56 ± 2%, respectively. For sole CFs, a higher performance of 77 ± 8% for 5-fold cross-validation and a hold-out testing performance of 82 + 2% were obtained from ANOVA and ETC. RF+DF obtained a performance of 64 ± 7%, with a hold-out testing performance of 59 ± 2% through ANOVA and XGBC. Usage of CF+RF, CF+DF, and RF+DF+CF enabled the highest averaged accuracies of 78 ± 7%, 78 ± 9%, and 76 ± 8% for 5-fold cross-validation, and hold-out testing accuracies of 81 ± 2%, 82 ± 2%, and 83 ± 4%, respectively. CONCLUSIONS We demonstrated that CFs vitally contribute to predictive performance, and combining them with appropriate imaging features and HMLSs can result in the best prediction performance.
Collapse
Affiliation(s)
- Mahdi Hosseinzadeh
- Technological Virtual Collaboration (TECVICO Corp.), Vancouver, BC V5E 3J7, Canada;
- Department of Electrical & Computer Engineering, University of Tarbiat Modares, Tehran 14115111, Iran
| | - Arman Gorji
- Neuroscience and Artificial Intelligence Research Group (NAIRG), Student Research Committee, Hamadan University of Medical Sciences, Hamadan 6517838736, Iran
| | - Ali Fathi Jouzdani
- Neuroscience and Artificial Intelligence Research Group (NAIRG), Student Research Committee, Hamadan University of Medical Sciences, Hamadan 6517838736, Iran
| | - Seyed Masoud Rezaeijo
- Department of Medical Physics, Faculty of Medicine, Ahvaz Jundishapur University of Medical Sciences, Ahvaz 6135715794, Iran
| | - Arman Rahmim
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC V5Z 1L3, Canada
- Departments of Radiology and Physics, University of British Columbia, Vancouver, BC V6T 1Z4, Canada
| | - Mohammad R. Salmanpour
- Technological Virtual Collaboration (TECVICO Corp.), Vancouver, BC V5E 3J7, Canada;
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC V5Z 1L3, Canada
| |
Collapse
|
18
|
Aghakhanyan G, Di Salle G, Fanni SC, Francischello R, Cioni D, Cosottini M, Volterrani D, Neri E. Radiomics insight into the neurodegenerative " hot" brain: A narrative review from the nuclear medicine perspective. FRONTIERS IN NUCLEAR MEDICINE (LAUSANNE, SWITZERLAND) 2023; 3:1143256. [PMID: 39355054 PMCID: PMC11440921 DOI: 10.3389/fnume.2023.1143256] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Accepted: 02/10/2023] [Indexed: 10/03/2024]
Abstract
The application of radiomics for non-oncologic diseases is currently emerging. Despite its relative infancy state, the evidence highlights the potential of radiomics approaches to serve as neuroimaging biomarkers in the field of the neurodegenerative brain. This systematic review presents the last progress and potential application of radiomics in the field of neurodegenerative nuclear imaging applied to positron-emission tomography (PET) and single-photon emission computed tomography (SPECT) by focusing mainly on the two most common neurodegenerative disorders, Alzheimer's (AD) and Parkinson's disease (PD). A comprehensive review of the current literature was performed using the PubMed and Web of Science databases up to November 2022. The final collection of eighteen relevant publications was grouped as AD-related and PD-related. The main efforts in the field of AD dealt with radiomics-based early diagnosis of preclinical AD and the prediction of MCI to AD conversion, meanwhile, in the setting of PD, the radiomics techniques have been used in the attempt to improve the assessment of PD diagnosis, the differential diagnosis between PD and other parkinsonism, severity assessment, and outcome prediction. Although limited evidence with relatively small cohort studies, it seems that radiomics-based analysis using nuclear medicine tools, mainly [18F]Fluorodeoxyglucose (FDG) and β-amyloid (Aβ) PET, and dopamine transporter (DAT) SPECT, can be used for computer-aided diagnoses in AD-continuum and parkinsonian disorders. Combining nuclear radiomics analysis with clinical factors and introducing a multimodality approach can significantly improve classification and prediction efficiency in neurodegenerative disorders.
Collapse
Affiliation(s)
- Gayane Aghakhanyan
- Academic Radiology, Department of Translational Research and of New Surgical and Medical Technology, University of Pisa, Pisa, Italy
| | - Gianfranco Di Salle
- Academic Radiology, Department of Translational Research and of New Surgical and Medical Technology, University of Pisa, Pisa, Italy
| | - Salvatore Claudio Fanni
- Academic Radiology, Department of Translational Research and of New Surgical and Medical Technology, University of Pisa, Pisa, Italy
| | - Roberto Francischello
- Academic Radiology, Department of Translational Research and of New Surgical and Medical Technology, University of Pisa, Pisa, Italy
| | - Dania Cioni
- Academic Radiology, Department of Translational Research and of New Surgical and Medical Technology, University of Pisa, Pisa, Italy
| | - Mirco Cosottini
- Neuroradiology Unit, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| | - Duccio Volterrani
- Regional Center of Nuclear Medicine, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| | - Emanuele Neri
- Academic Radiology, Department of Translational Research and of New Surgical and Medical Technology, University of Pisa, Pisa, Italy
| |
Collapse
|
19
|
Wen P, Zhang Y, Wen G. Intelligent personalized diagnosis modeling in advanced medical system for Parkinson's disease using voice signals. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2023; 20:8085-8102. [PMID: 37161187 DOI: 10.3934/mbe.2023351] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/11/2023]
Abstract
Currently, machine learning methods have been utilized to realize the early detection of Parkinson's disease (PD) by using voice signals. Because the vocal system of each person is unique, and the same person's pronunciation can be different at different times, the training samples used in machine learning become very different from the speech signal of the patient to be diagnosed, frequently resulting in poor diagnostic performance. On this account, this paper presents a new intelligent personalized diagnosis method (PDM) for Parkinson's disease. The method was designed to begin with constructing new training data by assigning the best classifier to each training sample composed of features from the speech signals of patients. Subsequently, a meta-classifier was trained on the new training data. Finally, for the signal of each test patient, the method used the meta-classifier to select the most appropriate classifier, followed by adopting the selected classifier to classify the signal so that the more accurate diagnosis result of the test patient can be obtained. The novelty of the proposed method is that the proposed method uses different classifiers to perform the diagnosis of PD for diversified patients, whereas the current method uses the same classifier to diagnose all patients to be tested. Results of a large number of experiments show that PDM not only improves the performance but also exceeds the existing methods in speed.
Collapse
Affiliation(s)
- Pengcheng Wen
- College of Intelligent Systems Science and Engineering, Hubei University for Nationalities, Enshi 445000, China
| | - Yuhan Zhang
- Southern Medical University, Affiliated Dongguan Songshan Lake Central Hospital, Dongguan 523000, China
| | - Guihua Wen
- School of Computer Science & Engineering, South China University of Technology, Guangzhou 510000, China
| |
Collapse
|
20
|
McCague C, Ramlee S, Reinius M, Selby I, Hulse D, Piyatissa P, Bura V, Crispin-Ortuzar M, Sala E, Woitek R. Introduction to radiomics for a clinical audience. Clin Radiol 2023; 78:83-98. [PMID: 36639175 DOI: 10.1016/j.crad.2022.08.149] [Citation(s) in RCA: 40] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Accepted: 08/31/2022] [Indexed: 01/12/2023]
Abstract
Radiomics is a rapidly developing field of research focused on the extraction of quantitative features from medical images, thus converting these digital images into minable, high-dimensional data, which offer unique biological information that can enhance our understanding of disease processes and provide clinical decision support. To date, most radiomics research has been focused on oncological applications; however, it is increasingly being used in a raft of other diseases. This review gives an overview of radiomics for a clinical audience, including the radiomics pipeline and the common pitfalls associated with each stage. Key studies in oncology are presented with a focus on both those that use radiomics analysis alone and those that integrate its use with other multimodal data streams. Importantly, clinical applications outside oncology are also presented. Finally, we conclude by offering a vision for radiomics research in the future, including how it might impact our practice as radiologists.
Collapse
Affiliation(s)
- C McCague
- Department of Radiology, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK.
| | - S Ramlee
- Department of Radiology, University of Cambridge, Cambridge, UK
| | - M Reinius
- Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - I Selby
- Department of Radiology, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - D Hulse
- Department of Radiology, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - P Piyatissa
- Department of Radiology, University of Cambridge, Cambridge, UK
| | - V Bura
- Department of Radiology, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK; Department of Radiology and Medical Imaging, County Clinical Emergency Hospital, Cluj-Napoca, Romania
| | - M Crispin-Ortuzar
- Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK; Department of Oncology, University of Cambridge, Cambridge, UK
| | - E Sala
- Department of Radiology, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - R Woitek
- Department of Radiology, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK; Research Centre for Medical Image Analysis and Artificial Intelligence (MIAAI), Department of Medicine, Faculty of Medicine and Dentistry, Danube Private University, Krems, Austria
| |
Collapse
|
21
|
Harvey J, Reijnders RA, Cavill R, Duits A, Köhler S, Eijssen L, Rutten BPF, Shireby G, Torkamani A, Creese B, Leentjens AFG, Lunnon K, Pishva E. Machine learning-based prediction of cognitive outcomes in de novo Parkinson's disease. NPJ Parkinsons Dis 2022; 8:150. [PMID: 36344548 PMCID: PMC9640625 DOI: 10.1038/s41531-022-00409-5] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Accepted: 10/11/2022] [Indexed: 11/09/2022] Open
Abstract
Cognitive impairment is a debilitating symptom in Parkinson's disease (PD). We aimed to establish an accurate multivariate machine learning (ML) model to predict cognitive outcome in newly diagnosed PD cases from the Parkinson's Progression Markers Initiative (PPMI). Annual cognitive assessments over an 8-year time span were used to define two cognitive outcomes of (i) cognitive impairment, and (ii) dementia conversion. Selected baseline variables were organized into three subsets of clinical, biofluid and genetic/epigenetic measures and tested using four different ML algorithms. Irrespective of the ML algorithm used, the models consisting of the clinical variables performed best and showed better prediction of cognitive impairment outcome over dementia conversion. We observed a marginal improvement in the prediction performance when clinical, biofluid, and epigenetic/genetic variables were all included in one model. Several cerebrospinal fluid measures and an epigenetic marker showed high predictive weighting in multiple models when included alongside clinical variables.
Collapse
Affiliation(s)
- Joshua Harvey
- Medical School, Faculty of Health and Life Sciences, University of Exeter, Exeter, UK
| | - Rick A Reijnders
- Department of Psychiatry and Neuropsychology, School for Mental Health and Neuroscience (MHeNs), Maastricht University, Maastricht, The Netherlands
| | - Rachel Cavill
- Department of Advanced Computing Sciences, FSE, Maastricht University, Maastricht, The Netherlands
| | - Annelien Duits
- Department of Psychiatry and Neuropsychology, School for Mental Health and Neuroscience (MHeNs), Maastricht University, Maastricht, The Netherlands
- Department of Medical Psychology, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Sebastian Köhler
- Department of Psychiatry and Neuropsychology, School for Mental Health and Neuroscience (MHeNs), Maastricht University, Maastricht, The Netherlands
| | - Lars Eijssen
- Department of Psychiatry and Neuropsychology, School for Mental Health and Neuroscience (MHeNs), Maastricht University, Maastricht, The Netherlands
- Department of Bioinformatics-BiGCaT, School of Nutrition and Translational Research in Metabolism (NUTRIM), Maastricht University, Maastricht, The Netherlands
| | - Bart P F Rutten
- Department of Psychiatry and Neuropsychology, School for Mental Health and Neuroscience (MHeNs), Maastricht University, Maastricht, The Netherlands
| | - Gemma Shireby
- Medical School, Faculty of Health and Life Sciences, University of Exeter, Exeter, UK
| | - Ali Torkamani
- Department of Integrative Structural and Computational Biology, Scripps Research, La Jolla, CA, 92037, USA
| | - Byron Creese
- Medical School, Faculty of Health and Life Sciences, University of Exeter, Exeter, UK
| | - Albert F G Leentjens
- Department of Psychiatry and Neuropsychology, School for Mental Health and Neuroscience (MHeNs), Maastricht University, Maastricht, The Netherlands
| | - Katie Lunnon
- Medical School, Faculty of Health and Life Sciences, University of Exeter, Exeter, UK
| | - Ehsan Pishva
- Medical School, Faculty of Health and Life Sciences, University of Exeter, Exeter, UK.
- Department of Psychiatry and Neuropsychology, School for Mental Health and Neuroscience (MHeNs), Maastricht University, Maastricht, The Netherlands.
| |
Collapse
|
22
|
Parkinson’s disease diagnosis using neural networks: Survey and comprehensive evaluation. Inf Process Manag 2022. [DOI: 10.1016/j.ipm.2022.102909] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
23
|
Combining quantitative susceptibility mapping to radiomics in diagnosing Parkinson’s disease and assessing cognitive impairment. Eur Radiol 2022; 32:6992-7003. [DOI: 10.1007/s00330-022-08790-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2021] [Revised: 03/18/2022] [Accepted: 04/01/2022] [Indexed: 11/04/2022]
|
24
|
Multi-Class Classifier in Parkinson’s Disease Using an Evolutionary Multi-Objective Optimization Algorithm. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12063048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In this contribution, a novel methodology for multi-class classification in the field of Parkinson’s disease is proposed. The methodology is structured in two phases. In a first phase, the most relevant volumes of interest (VOI) of the brain are selected by means of an evolutionary multi-objective optimization (MOE) algorithm. Each of these VOIs are subjected to volumetric feature extraction using the Three-Dimensional Discrete Wavelet Transform (3D-DWT). When applying 3D-DWT, a high number of coefficients is obtained, requiring the use of feature selection/reduction algorithms to find the most relevant features. The method used in this contribution is based on Mutual Redundancy (MI) and Minimum Maximum Relevance (mRMR) and PCA. To optimize the VOI selection, a first group of 550 MRI was used for the 5 classes: PD, SWEDD, Prodromal, GeneCohort and Normal. Once the Pareto Front of the solutions is obtained (with varying degrees of complexity, reflected in the number of selected VOIs), these solutions are tested in a second phase. In order to analyze the SVM classifier accuracy, a test set of 367 MRI was used. The methodology obtains relevant results in multi-class classification, presenting several solutions with different levels of complexity and precision (Pareto Front solutions), reaching a result of 97% as the highest precision in the test data.
Collapse
|
25
|
Zhang X, Zhang Y, Zhang G, Qiu X, Tan W, Yin X, Liao L. Deep Learning With Radiomics for Disease Diagnosis and Treatment: Challenges and Potential. Front Oncol 2022; 12:773840. [PMID: 35251962 PMCID: PMC8891653 DOI: 10.3389/fonc.2022.773840] [Citation(s) in RCA: 58] [Impact Index Per Article: 19.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Accepted: 01/17/2022] [Indexed: 12/12/2022] Open
Abstract
The high-throughput extraction of quantitative imaging features from medical images for the purpose of radiomic analysis, i.e., radiomics in a broad sense, is a rapidly developing and emerging research field that has been attracting increasing interest, particularly in multimodality and multi-omics studies. In this context, the quantitative analysis of multidimensional data plays an essential role in assessing the spatio-temporal characteristics of different tissues and organs and their microenvironment. Herein, recent developments in this method, including manually defined features, data acquisition and preprocessing, lesion segmentation, feature extraction, feature selection and dimension reduction, statistical analysis, and model construction, are reviewed. In addition, deep learning-based techniques for automatic segmentation and radiomic analysis are being analyzed to address limitations such as rigorous workflow, manual/semi-automatic lesion annotation, and inadequate feature criteria, and multicenter validation. Furthermore, a summary of the current state-of-the-art applications of this technology in disease diagnosis, treatment response, and prognosis prediction from the perspective of radiology images, multimodality images, histopathology images, and three-dimensional dose distribution data, particularly in oncology, is presented. The potential and value of radiomics in diagnostic and therapeutic strategies are also further analyzed, and for the first time, the advances and challenges associated with dosiomics in radiotherapy are summarized, highlighting the latest progress in radiomics. Finally, a robust framework for radiomic analysis is presented and challenges and recommendations for future development are discussed, including but not limited to the factors that affect model stability (medical big data and multitype data and expert knowledge in medical), limitations of data-driven processes (reproducibility and interpretability of studies, different treatment alternatives for various institutions, and prospective researches and clinical trials), and thoughts on future directions (the capability to achieve clinical applications and open platform for radiomics analysis).
Collapse
Affiliation(s)
- Xingping Zhang
- Institute of Advanced Cyberspace Technology, Guangzhou University, Guangzhou, China
- Department of New Networks, Peng Cheng Laboratory, Shenzhen, China
| | - Yanchun Zhang
- Institute of Advanced Cyberspace Technology, Guangzhou University, Guangzhou, China
- Department of New Networks, Peng Cheng Laboratory, Shenzhen, China
| | - Guijuan Zhang
- Department of Respiratory Medicine, First Affiliated Hospital of Gannan Medical University, Ganzhou, China
| | - Xingting Qiu
- Department of Radiology, First Affiliated Hospital of Gannan Medical University, Ganzhou, China
| | - Wenjun Tan
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Shenyang, China
| | - Xiaoxia Yin
- Institute of Advanced Cyberspace Technology, Guangzhou University, Guangzhou, China
| | - Liefa Liao
- School of Information Engineering, Jiangxi University of Science and Technology, Ganzhou, China
| |
Collapse
|
26
|
Salmanpour MR, Shamsaei M, Hajianfar G, Soltanian-Zadeh H, Rahmim A. Longitudinal clustering analysis and prediction of Parkinson's disease progression using radiomics and hybrid machine learning. Quant Imaging Med Surg 2022; 12:906-919. [PMID: 35111593 DOI: 10.21037/qims-21-425] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Accepted: 08/13/2021] [Indexed: 11/06/2022]
Abstract
BACKGROUND We employed machine learning approaches to (I) determine distinct progression trajectories in Parkinson's disease (PD) (unsupervised clustering task), and (II) predict progression trajectories (supervised prediction task), from early (years 0 and 1) data, making use of clinical and imaging features. METHODS We studied PD-subjects derived from longitudinal datasets (years 0, 1, 2 & 4; Parkinson's Progressive Marker Initiative). We extracted and analyzed 981 features, including motor, non-motor, and radiomics features extracted for each region-of-interest (ROIs: left/right caudate and putamen) using our standardized standardized environment for radiomics analysis (SERA) radiomics software. Segmentation of ROIs on dopamine transposer - single photon emission computed tomography (DAT SPECT) images were performed via magnetic resonance images (MRI). After performing cross-sectional clustering on 885 subjects (original dataset) to identify disease subtypes, we identified optimal longitudinal trajectories using hybrid machine learning systems (HMLS), including principal component analysis (PCA) + K-Means algorithms (KMA) followed by Bayesian information criterion (BIC), Calinski-Harabatz criterion (CHC), and elbow criterion (EC). Subsequently, prediction of the identified trajectories from early year data was performed using multiple HMLSs including 16 Dimension Reduction Algorithms (DRA) and 10 classification algorithms. RESULTS We identified 3 distinct progression trajectories. Hotelling's t squared test (HTST) showed that the identified trajectories were distinct. The trajectories included those with (I, II) disease escalation (2 trajectories, 27% and 38% of patients) and (III) stable disease (1 trajectory, 35% of patients). For trajectory prediction from early year data, HMLSs including the stochastic neighbor embedding algorithm (SNEA, as a DRA) as well as locally linear embedding algorithm (LLEA, as a DRA), linked with the new probabilistic neural network classifier (NPNNC, as a classifier), resulted in accuracies of 78.4% and 79.2% respectively, while other HMLSs such as SNEA + Lib_SVM (library for support vector machines) and t_SNE (t-distributed stochastic neighbor embedding) + NPNNC resulted in 76.5% and 76.1% respectively. CONCLUSIONS This study moves beyond cross-sectional PD subtyping to clustering of longitudinal disease trajectories. We conclude that combining medical information with SPECT-based radiomics features, and optimal utilization of HMLSs, can identify distinct disease trajectories in PD patients, and enable effective prediction of disease trajectories from early year data.
Collapse
Affiliation(s)
- Mohammad R Salmanpour
- Department of Energy Engineering and Physics, Amirkabir University of Technology, Tehran, Iran.,Department of Physics & Astronomy, University of British Columbia, Vancouver BC, Canada
| | - Mojtaba Shamsaei
- Department of Energy Engineering and Physics, Amirkabir University of Technology, Tehran, Iran
| | - Ghasem Hajianfar
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Science, Tehran, Iran
| | - Hamid Soltanian-Zadeh
- CIPCE, School of Electrical & Computer Engineering, University of Tehran, Tehran, Iran.,Departments of Radiology and Research Administration, Henry Ford Health System, Detroit, USA
| | - Arman Rahmim
- Department of Physics & Astronomy, University of British Columbia, Vancouver BC, Canada.,Department of Radiology, University of British Columbia, Vancouver BC, Canada
| |
Collapse
|
27
|
Non-contrast Cine Cardiac Magnetic Resonance image radiomics features and machine learning algorithms for myocardial infarction detection. Comput Biol Med 2021; 141:105145. [PMID: 34929466 DOI: 10.1016/j.compbiomed.2021.105145] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Accepted: 12/13/2021] [Indexed: 12/22/2022]
Abstract
OBJECTIVE Robust differentiation between infarcted and normal tissue is important for clinical diagnosis and precision medicine. The aim of this work is to investigate the radiomic features and to develop a machine learning algorithm for the differentiation of myocardial infarction (MI) and viable tissues/normal cases in the left ventricular myocardium on non-contrast Cine Cardiac Magnetic Resonance (Cine-CMR) images. METHODS Seventy-two patients (52 with MI and 20 healthy control patients) were enrolled in this study. MR imaging was performed on a 1.5 T MRI using the following parameters: TR = 43.35 ms, TE = 1.22 ms, flip angle = 65°, temporal resolution of 30-40 ms. N4 bias field correction algorithm was applied to correct the inhomogeneity of images. All images were segmented and verified simultaneously by two cardiac imaging experts in consensus. Subsequently, features extraction was performed within the whole left ventricular myocardium (3D volume) in end-diastolic volume phase. Re-sampling to 1 × 1 × 1 mm3 voxels was performed for MR images. All intensities within the VOI of MR images were discretized to 64 bins. Radiomic features were normalized to obtain Z-scores, followed by Student's t-test statistical analysis for comparison. A p-value < 0.05 was used as a threshold for statistically significant differences and false discovery rate (FDR) correction performed to report q-value (FDR adjusted p-value). The extracted features were ranked using the MSVM-RFE algorithm, then Spearman correlation between features was performed to eliminate highly correlated features (R2 > 0.80). Ten different machine learning algorithms were used for classification and different metrics used for evaluation and various parameters used for models' evaluation. RESULTS In univariate analysis, the highest area under the curve (AUC) of receiver operating characteristic (ROC) value was achieved for the Maximum 2D diameter slice (M2DS) shape feature (AUC = 0.88, q-value = 1.02E-7), while the average of univariate AUCs was 0.62 ± 0.08. In multivariate analysis, Logistic Regression (AUC = 0.93 ± 0.03, Accuracy = 0.86 ± 0.05, Recall = 0.87 ± 0.1, Precision = 0.93 ± 0.03 and F1 Score = 0.90 ± 0.04) and SVM (AUC = 0.92 ± 0.05, Accuracy = 0.85 ± 0.04, Recall = 0.92 ± 0.01, Precision = 0.88 ± 0.04 and F1 Score = 0.90 ± 0.02) yielded optimal performance as the best machine learning algorithm for this radiomics analysis. CONCLUSION This study demonstrated that using radiomics analysis on non-contrast Cine-CMR images enables to accurately detect MI, which could potentially be used as an alternative diagnostic method for Late Gadolinium Enhancement Cardiac Magnetic Resonance (LGE-CMR).
Collapse
|
28
|
|
29
|
Explainable AI to improve acceptance of convolutional neural networks for automatic classification of dopamine transporter SPECT in the diagnosis of clinically uncertain parkinsonian syndromes. Eur J Nucl Med Mol Imaging 2021; 49:1176-1186. [PMID: 34651223 PMCID: PMC8921148 DOI: 10.1007/s00259-021-05569-9] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Accepted: 09/17/2021] [Indexed: 12/31/2022]
Abstract
Purpose Deep convolutional neural networks (CNN) provide high accuracy for automatic classification of dopamine transporter (DAT) SPECT images. However, CNN are inherently black-box in nature lacking any kind of explanation for their decisions. This limits their acceptance for clinical use. This study tested layer-wise relevance propagation (LRP) to explain CNN-based classification of DAT-SPECT in patients with clinically uncertain parkinsonian syndromes. Methods The study retrospectively included 1296 clinical DAT-SPECT with visual binary interpretation as “normal” or “reduced” by two experienced readers as standard-of-truth. A custom-made CNN was trained with 1008 randomly selected DAT-SPECT. The remaining 288 DAT-SPECT were used to assess classification performance of the CNN and to test LRP for explanation of the CNN-based classification. Results Overall accuracy, sensitivity, and specificity of the CNN were 95.8%, 92.8%, and 98.7%, respectively. LRP provided relevance maps that were easy to interpret in each individual DAT-SPECT. In particular, the putamen in the hemisphere most affected by nigrostriatal degeneration was the most relevant brain region for CNN-based classification in all reduced DAT-SPECT. Some misclassified DAT-SPECT showed an “inconsistent” relevance map more typical for the true class label. Conclusion LRP is useful to provide explanation of CNN-based decisions in individual DAT-SPECT and, therefore, can be recommended to support CNN-based classification of DAT-SPECT in clinical routine. Total computation time of 3 s is compatible with busy clinical workflow. The utility of “inconsistent” relevance maps to identify misclassified cases requires further investigation. Supplementary Information The online version contains supplementary material available at 10.1007/s00259-021-05569-9.
Collapse
|