1
|
Yassin MM, Zaman A, Lu J, Yang H, Cao A, Hassan H, Han T, Miao X, Shi Y, Guo Y, Luo Y, Kang Y. Leveraging Ensemble Models and Follow-up Data for Accurate Prediction of mRS Scores from Radiomic Features of DSC-PWI Images. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2025; 38:1467-1483. [PMID: 39367198 DOI: 10.1007/s10278-024-01280-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/28/2024] [Revised: 09/18/2024] [Accepted: 09/19/2024] [Indexed: 10/06/2024]
Abstract
Predicting long-term clinical outcomes based on the early DSC PWI MRI scan is valuable for prognostication, resource management, clinical trials, and patient expectations. Current methods require subjective decisions about which imaging features to assess and may require time-consuming postprocessing. This study's goal was to predict multilabel 90-day modified Rankin Scale (mRS) score in acute ischemic stroke patients by combining ensemble models and different configurations of radiomic features generated from Dynamic susceptibility contrast perfusion-weighted imaging. In Follow-up studies, a total of 70 acute ischemic stroke (AIS) patients underwent magnetic resonance imaging within 24 hours poststroke and had a follow-up scan. In the single study, 150 DSC PWI Image scans for AIS patients. The DRF are extracted from DSC-PWI Scans. Then Lasso algorithm is applied for feature selection, then new features are generated from initial and follow-up scans. Then we applied different ensemble models to classify between three classes normal outcome (0, 1 mRS score), moderate outcome (2,3,4 mRS score), and severe outcome (5,6 mRS score). ANOVA and post-hoc Tukey HSD tests confirmed significant differences in model style performance across various studies and classification techniques. Stacking models consistently on average outperformed others, achieving an Accuracy of 0.68 ± 0.15, Precision of 0.68 ± 0.17, Recall of 0.65 ± 0.14, and F1 score of 0.63 ± 0.15 in the follow-up time study. Techniques like Bo_Smote showed significantly higher recall and F1 scores, highlighting their robustness and effectiveness in handling imbalanced data. Ensemble models, particularly Bagging and Stacking, demonstrated superior performance, achieving nearly 0.93 in Accuracy, 0.95 in Precision, 0.94 in Recall, and 0.94 in F1 metrics in follow-up conditions, significantly outperforming single models. Ensemble models based on radiomics generated from combining Initial and follow-up scans can be used to predict multilabel 90-day stroke outcomes with reduced subjectivity and user burden.
Collapse
Affiliation(s)
- Mazen M Yassin
- School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, 518055, China
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- Biomedical Engineering Department, Faculty of Engineering, Minia University, Menia, 61111, Egypt
| | - Asim Zaman
- School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, 518055, China
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- School of Applied Technology, Shenzhen University, Shenzhen, 518055, China
| | - Jiaxi Lu
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- School of Applied Technology, Shenzhen University, Shenzhen, 518055, China
| | - Huihui Yang
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- School of Applied Technology, Shenzhen University, Shenzhen, 518055, China
| | - Anbo Cao
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- School of Applied Technology, Shenzhen University, Shenzhen, 518055, China
| | - Haseeb Hassan
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
| | - Taiyu Han
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- School of Applied Technology, Shenzhen University, Shenzhen, 518055, China
| | - Xiaoqiang Miao
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, 110169, China
| | - Yongkang Shi
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- School of Applied Technology, Shenzhen University, Shenzhen, 518055, China
| | - Yingwei Guo
- School of Electrical and Information Engineering, Northeast Petroleum University, Daqing, 163318, China
| | - Yu Luo
- Department of Radiology, Shanghai Fourth People's Hospital Affiliated to Tongji University School of Medicine, Shanghai, 200434, China.
| | - Yan Kang
- School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, 518055, China.
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China.
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, 110169, China.
- Faculty of Data Science, City University of Macau, Macau, China.
| |
Collapse
|
2
|
Dao TNP, Dang HNT, Pham MTK, Nguyen HT, Tran Chi C, Le MV. Prognosticating global functional outcome in the recurrent ischemic stroke using baseline clinical and pre-clinical features: A machine learning study. J Eval Clin Pract 2025; 31:e14100. [PMID: 39031001 DOI: 10.1111/jep.14100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/18/2024] [Revised: 06/16/2024] [Accepted: 07/07/2024] [Indexed: 07/22/2024]
Abstract
BACKGROUND AND PURPOSE Recurrent ischemic stroke (RIS) induces additional functional limitations in patients. Prognosticating globally functional outcome (GFO) in RIS patients is thereby important to plan a suitable rehabilitation programme. This study sought to investigate the ability of baseline features for classifying the patients with and without improving GFO (task 1) and identifying patients with poor GFO (task 2) at the third month after discharging from RIS. METHODS A total of 86 RIS patients were recruited and divided into the training set and testing set (50:50). The clinical and pre-clinical data were recorded. The outcome was the changes in Modified Rankin Scale (mRS) (task 1) and the mRS score at the third month (mRS 0-2: good GFO, mRS >2: poor GFO) (task 2). The permutation importance ranking method selected features. Four algorithms were trained on the training set with five-fold cross-validation. The best model was tested on the testing set. RESULTS In task 1, the support vector machine (SVM) model outperformed the other models, with the high performance matrix on the training set (sensitivity = 0.80; specificity = 1.00) and the testing set (sensitivity = 0.80; specificity = 0.95). In task 2, the SVM model with selected features also performed well on both datasets (training set: sensitivity = 0.76; specificity = 0.92; testing set: sensitivity = 0.72; specificity = 0.88). CONCLUSION A machine learning model could be used to classify GFO responses to treatment and identify the third-month poor GFO in RIS patients, supporting physicians in clinical practice.
Collapse
Affiliation(s)
- Tran Nhat Phong Dao
- Faculty of Traditional Medicine, Can Tho University of Medicine and Pharmacy, Can Tho, Vietnam
- Can Tho Traditional Medicine Hospital, Can Tho, Vietnam
| | | | - My Thi Kim Pham
- Department of Cardiac Surgery, Can Tho Central General Hospital, Can Tho, Vietnam
| | - Hien Thi Nguyen
- Department of Nutrition and Food Safety, Faculty of Public Health, Can Tho University of Medicine and Pharmacy, Can Tho, Vietnam
| | - Cuong Tran Chi
- Can Tho Stroke International Services (S.I.S) General Hospital, Can Tho, Vietnam
| | - Minh Van Le
- Department of Neurology, Faculty of Medicine, Can Tho University of Medicine and Pharmacy, Can Tho, Vietnam
- Department of Neurology, Can Tho University of Medicine and Pharmacy Hospital, Can Tho, Vietnam
- Department of Neurology, Can Tho Central General Hospital, Can Tho, Vietnam
| |
Collapse
|
3
|
Yassin MM, Lu J, Zaman A, Yang H, Cao A, Zeng X, Hassan H, Han T, Miao X, Shi Y, Guo Y, Luo Y, Kang Y. Advancing ischemic stroke diagnosis and clinical outcome prediction using improved ensemble techniques in DSC-PWI radiomics. Sci Rep 2024; 14:27580. [PMID: 39528656 PMCID: PMC11555321 DOI: 10.1038/s41598-024-78353-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2024] [Accepted: 10/30/2024] [Indexed: 11/16/2024] Open
Abstract
Ischemic stroke is a leading global cause of death and disability and is expected to rise in the future. The present diagnostic techniques, like CT and MRI, have some limitations in distinguishing acute from chronic ischemia and in early ischemia detection. This study investigates the function of ensemble models based on the dynamic radiomics features (DRF) from the dynamic susceptibility contrast perfusion-weighted imaging (DSC-PWI) ischemic stroke diagnosis, neurological impairment assessment, and modified Rankin Scale (mRS) outcome prediction). DRF is extracted from the 3D images, features are selected, and dimensionality is reduced. After that, ensemble models are applied. Two model structures were developed: a voting classifier with 6 bagging classifiers and a stacking classifier based on 4 bagging classifiers. The ensemble models were evaluated on three core tasks. The Stacking_ens_LR model performed best for ischemic stroke detection, the LR Bagging model for NIH Stroke Scale (NIHSS) prediction, and the NB Bagging model for outcome prediction. These outcomes illustrate the strength of ensemble models. The work showcases the role of ensemble models and DRF in the stroke management process.
Collapse
Affiliation(s)
- Mazen M Yassin
- School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, 518055, China
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- Biomedical Engineering Department, Faculty of Engineering, Minia University, Menia, 61111, Egypt
| | - Jiaxi Lu
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- School of Applied Technology, Shenzhen University, Shenzhen, 518055, China
| | - Asim Zaman
- School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, 518055, China
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- School of Applied Technology, Shenzhen University, Shenzhen, 518055, China
| | - Huihui Yang
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- School of Applied Technology, Shenzhen University, Shenzhen, 518055, China
| | - Anbo Cao
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- School of Applied Technology, Shenzhen University, Shenzhen, 518055, China
| | - Xueqiang Zeng
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- School of Applied Technology, Shenzhen University, Shenzhen, 518055, China
| | - Haseeb Hassan
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
| | - Taiyu Han
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- School of Applied Technology, Shenzhen University, Shenzhen, 518055, China
| | - Xiaoqiang Miao
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, 110169, China
| | - Yongkang Shi
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China
- School of Applied Technology, Shenzhen University, Shenzhen, 518055, China
| | - Yingwei Guo
- School of Electrical and Information Engineering, Northeast Petroleum University, Daqing, 163318, China
| | - Yu Luo
- Department of Radiology, Shanghai Fourth People's Hospital Affiliated to Tongji University School of Medicine, Shanghai, 200434, China
| | - Yan Kang
- School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, 518055, China.
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518118, China.
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, 110169, China.
- Faculty of Data Science, City University of Macau, Macau, China.
| |
Collapse
|
4
|
Senadheera I, Hettiarachchi P, Haslam B, Nawaratne R, Sheehan J, Lockwood KJ, Alahakoon D, Carey LM. AI Applications in Adult Stroke Recovery and Rehabilitation: A Scoping Review Using AI. SENSORS (BASEL, SWITZERLAND) 2024; 24:6585. [PMID: 39460066 PMCID: PMC11511449 DOI: 10.3390/s24206585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2024] [Revised: 10/08/2024] [Accepted: 10/09/2024] [Indexed: 10/28/2024]
Abstract
Stroke is a leading cause of long-term disability worldwide. With the advancements in sensor technologies and data availability, artificial intelligence (AI) holds the promise of improving the amount, quality and efficiency of care and enhancing the precision of stroke rehabilitation. We aimed to identify and characterize the existing research on AI applications in stroke recovery and rehabilitation of adults, including categories of application and progression of technologies over time. Data were collected from peer-reviewed articles across various electronic databases up to January 2024. Insights were extracted using AI-enhanced multi-method, data-driven techniques, including clustering of themes and topics. This scoping review summarizes outcomes from 704 studies. Four common themes (impairment, assisted intervention, prediction and imaging, and neuroscience) were identified, in which time-linked patterns emerged. The impairment theme revealed a focus on motor function, gait and mobility, while the assisted intervention theme included applications of robotic and brain-computer interface (BCI) techniques. AI applications progressed over time, starting from conceptualization and then expanding to a broader range of techniques in supervised learning, artificial neural networks (ANN), natural language processing (NLP) and more. Applications focused on upper limb rehabilitation were reviewed in more detail, with machine learning (ML), deep learning techniques and sensors such as inertial measurement units (IMU) used for upper limb and functional movement analysis. AI applications have potential to facilitate tailored therapeutic delivery, thereby contributing to the optimization of rehabilitation outcomes and promoting sustained recovery from rehabilitation to real-world settings.
Collapse
Affiliation(s)
- Isuru Senadheera
- Centre for Data Analytics and Cognition, La Trobe Business School, La Trobe University, Melbourne, VIC 3086, Australia; (I.S.); (P.H.); (R.N.); (D.A.)
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
| | - Prasad Hettiarachchi
- Centre for Data Analytics and Cognition, La Trobe Business School, La Trobe University, Melbourne, VIC 3086, Australia; (I.S.); (P.H.); (R.N.); (D.A.)
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
| | - Brendon Haslam
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
- Neurorehabilitation and Recovery, The Florey, Melbourne, VIC 3086, Australia
| | - Rashmika Nawaratne
- Centre for Data Analytics and Cognition, La Trobe Business School, La Trobe University, Melbourne, VIC 3086, Australia; (I.S.); (P.H.); (R.N.); (D.A.)
| | - Jacinta Sheehan
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
| | - Kylee J. Lockwood
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
| | - Damminda Alahakoon
- Centre for Data Analytics and Cognition, La Trobe Business School, La Trobe University, Melbourne, VIC 3086, Australia; (I.S.); (P.H.); (R.N.); (D.A.)
| | - Leeanne M. Carey
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
- Neurorehabilitation and Recovery, The Florey, Melbourne, VIC 3086, Australia
| |
Collapse
|
5
|
Cui Y, Xiang L, Zhao P, Chen J, Cheng L, Liao L, Yan M, Zhang X. Machine learning decision support model for discharge planning in stroke patients. J Clin Nurs 2024; 33:3145-3160. [PMID: 38358023 DOI: 10.1111/jocn.16999] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Revised: 12/28/2023] [Accepted: 01/07/2024] [Indexed: 02/16/2024]
Abstract
BACKGROUND/AIM Efficient discharge for stroke patients is crucial but challenging. The study aimed to develop early predictive models to explore which patient characteristics and variables significantly influence the discharge planning of patients, based on the data available within 24 h of admission. DESIGN Prospective observational study. METHODS A prospective cohort was conducted at a university hospital with 523 patients hospitalised for stroke. We built and trained six different machine learning (ML) models, followed by testing and tuning those models to find the best-suited predictor for discharge disposition, dichotomized into home and non-home. To evaluate the accuracy, reliability and interpretability of the best-performing models, we identified and analysed the features that had the greatest impact on the predictions. RESULTS In total, 523 patients met the inclusion criteria, with a mean age of 61 years. Of the patients with stroke, 30.01% had non-home discharge. Our model predicting non-home discharge achieved an area under the receiver operating characteristic curve of 0.95 and a precision of 0.776. After threshold was moved, the model had a recall of 0.809. Top 10 variables by importance were National Institutes of Health Stroke Scale (NIHSS) score, family income, Barthel index (BI) score, FRAIL score, fall risk, pressure injury risk, feeding method, depression, age and dysphagia. CONCLUSION The ML model identified higher NIHSS, BI, and FRAIL, family income, higher fall risk, pressure injury risk, older age, tube feeding, depression and dysphagia as the top 10 strongest risk predictors in identifying patients who required non-home discharge to higher levels of care. Modern ML techniques can support timely and appropriate clinical decision-making. RELEVANCE TO CLINICAL PRACTICE This study illustrates the characteristics and risk factors of non-home discharge in patients with stroke, potentially contributing to the improvement of the discharge process. REPORTING METHOD STROBE guidelines.
Collapse
Affiliation(s)
- Yanli Cui
- Department of Neurology, Nanfang Hospital, Southern Medical University, Guangzhou, China
- School of Nursing, Southern Medical University, Guangzhou, China
| | - Lijun Xiang
- Department of Neurology, Nanfang Hospital, Southern Medical University, Guangzhou, China
| | - Peng Zhao
- Department of Neurology, Nanfang Hospital, Southern Medical University, Guangzhou, China
- School of Nursing, Southern Medical University, Guangzhou, China
| | - Jian Chen
- Department of Neurology, Nanfang Hospital, Southern Medical University, Guangzhou, China
- School of Nursing, Southern Medical University, Guangzhou, China
| | - Lei Cheng
- Department of Neurology, Nanfang Hospital, Southern Medical University, Guangzhou, China
- School of Nursing, Southern Medical University, Guangzhou, China
| | - Lin Liao
- Department of Neurology, Nanfang Hospital, Southern Medical University, Guangzhou, China
- School of Nursing, Southern Medical University, Guangzhou, China
| | - Mingyu Yan
- Department of Neurology, Nanfang Hospital, Southern Medical University, Guangzhou, China
- School of Nursing, Southern Medical University, Guangzhou, China
| | - Xiaomei Zhang
- Department of Neurology, Nanfang Hospital, Southern Medical University, Guangzhou, China
| |
Collapse
|
6
|
Medenica V, Ivanovic L, Milosevic N. Applicability of artificial intelligence in neuropsychological rehabilitation of patients with brain injury. APPLIED NEUROPSYCHOLOGY. ADULT 2024:1-28. [PMID: 38912923 DOI: 10.1080/23279095.2024.2364229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/25/2024]
Abstract
Neuropsychological rehabilitation plays a critical role in helping those recovering from brain injuries restore cognitive and functional abilities. Artificial Intelligence, with its potential, may revolutionize this field further; therefore, this article explores applications of AI for neuropsychological rehabilitation of patients suffering brain injuries. This study employs a systematic review methodology to comprehensively review existing literature regarding Artificial Intelligence use in neuropsychological rehabilitation for people with brain injuries. The systematic review follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. A systematic search of electronic databases (PubMed, Scopus, PsycINFO, etc.) showed a total of 212 potentially relevant articles. After removing duplicates and screening titles and abstracts, 186 articles were selected for assessment. Following the assessment, 55 articles met the inclusion criteria and were included in this systematic review. A thematic analysis approach is employed to analyze and synthesize the extracted data. Themes, patterns, and trends are identified across the included studies, allowing for a comprehensive understanding of the applicability of AI in neuropsychological rehabilitation for patients with brain injuries. The identified topics were: AI Applications in Diagnostics of Brain Injuries and their Neuropsychological Repercussions; AI in Personalization and Monitoring of Neuropsychological Rehabilitation for traumatic brain injury (TBI); Leveraging AI for Predicting and Optimizing Neuropsychological Rehabilitation Outcomes in TBI Patients. Based on the review, it was concluded that AI has the potential to enhance neuropsychological rehabilitation for patients with brain injuries. By leveraging AI techniques, personalized rehabilitation programs can be developed, treatment outcomes can be predicted, and interventions can be optimized.
Collapse
Affiliation(s)
- Veselin Medenica
- Department of Occupational Therapy, The College of Human Development, Belgrade, Serbia
| | - Lidija Ivanovic
- Department of Occupational Therapy, The College of Human Development, Belgrade, Serbia
| | - Neda Milosevic
- Department of Occupational Therapy, The College of Human Development, Belgrade, Serbia
- Department of Speech Therapy, The College of Human Development, Belgrade, Serbia
| |
Collapse
|
7
|
Otieno JA, Häggström J, Darehed D, Eriksson M. Developing machine learning models to predict multi-class functional outcomes and death three months after stroke in Sweden. PLoS One 2024; 19:e0303287. [PMID: 38739586 PMCID: PMC11090298 DOI: 10.1371/journal.pone.0303287] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Accepted: 04/23/2024] [Indexed: 05/16/2024] Open
Abstract
Globally, stroke is the third-leading cause of mortality and disability combined, and one of the costliest diseases in society. More accurate predictions of stroke outcomes can guide healthcare organizations in allocating appropriate resources to improve care and reduce both the economic and social burden of the disease. We aim to develop and evaluate the performance and explainability of three supervised machine learning models and the traditional multinomial logistic regression (mLR) in predicting functional dependence and death three months after stroke, using routinely-collected data. This prognostic study included adult patients, registered in the Swedish Stroke Registry (Riksstroke) from 2015 to 2020. Riksstroke contains information on stroke care and outcomes among patients treated in hospitals in Sweden. Prognostic factors (features) included demographic characteristics, pre-stroke functional status, cardiovascular risk factors, medications, acute care, stroke type, and severity. The outcome was measured using the modified Rankin Scale at three months after stroke (a scale of 0-2 indicates independent, 3-5 dependent, and 6 dead). Outcome prediction models included support vector machines, artificial neural networks (ANN), eXtreme Gradient Boosting (XGBoost), and mLR. The models were trained and evaluated on 75% and 25% of the dataset, respectively. Model predictions were explained using SHAP values. The study included 102,135 patients (85.8% ischemic stroke, 53.3% male, mean age 75.8 years, and median NIHSS of 3). All models demonstrated similar overall accuracy (69%-70%). The ANN and XGBoost models performed significantly better than the mLR in classifying dependence with F1-scores of 0.603 (95% CI; 0.594-0.611) and 0.577 (95% CI; 0.568-0.586), versus 0.544 (95% CI; 0.545-0.563) for the mLR model. The factors that contributed most to the predictions were expectedly similar in the models, based on clinical knowledge. Our ANN and XGBoost models showed a modest improvement in prediction performance and explainability compared to mLR using routinely-collected data. Their improved ability to predict functional dependence may be of particular importance for the planning and organization of acute stroke care and rehabilitation.
Collapse
Affiliation(s)
| | - Jenny Häggström
- Department of Statistics, USBE, Umeå University, Umeå, Sweden
| | - David Darehed
- Department of Public Health and Clinical Medicine, Sunderby Research Unit, Umeå University, Umeå, Sweden
| | - Marie Eriksson
- Department of Statistics, USBE, Umeå University, Umeå, Sweden
| |
Collapse
|
8
|
Yang TH, Su YY, Tsai CL, Lin KH, Lin WY, Sung SF. Magnetic resonance imaging-based deep learning imaging biomarker for predicting functional outcomes after acute ischemic stroke. Eur J Radiol 2024; 174:111405. [PMID: 38447430 DOI: 10.1016/j.ejrad.2024.111405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Revised: 02/05/2024] [Accepted: 03/01/2024] [Indexed: 03/08/2024]
Abstract
PURPOSE Clinical risk scores are essential for predicting outcomes in stroke patients. The advancements in deep learning (DL) techniques provide opportunities to develop prediction applications using magnetic resonance (MR) images. We aimed to develop an MR-based DL imaging biomarker for predicting outcomes in acute ischemic stroke (AIS) and evaluate its additional benefit to current risk scores. METHOD This study included 3338 AIS patients. We trained a DL model using deep neural network architectures on MR images and radiomics to predict poor functional outcomes at three months post-stroke. The DL model generated a DL score, which served as the DL imaging biomarker. We compared the predictive performance of this biomarker to five risk scores on a holdout test set. Additionally, we assessed whether incorporating the imaging biomarker into the risk scores improved the predictive performance. RESULTS The DL imaging biomarker achieved an area under the receiver operating characteristic curve (AUC) of 0.788. The AUCs of the five studied risk scores were 0.789, 0.793, 0.804, 0.810, and 0.826, respectively. The imaging biomarker's predictive performance was comparable to four of the risk scores but inferior to one (p = 0.038). Adding the imaging biomarker to the risk scores improved the AUCs (p-values) to 0.831 (0.003), 0.825 (0.001), 0.834 (0.003), 0.836 (0.003), and 0.839 (0.177), respectively. The net reclassification improvement and integrated discrimination improvement indices also showed significant improvements (all p < 0.001). CONCLUSIONS Using DL techniques to create an MR-based imaging biomarker is feasible and enhances the predictive ability of current risk scores.
Collapse
Affiliation(s)
- Tzu-Hsien Yang
- Department of Radiology, Ditmanson Medical Foundation Chia-Yi Christian Hospital, Chiayi City, Taiwan
| | - Ying-Ying Su
- Department of Radiology, Ditmanson Medical Foundation Chia-Yi Christian Hospital, Chiayi City, Taiwan
| | - Chia-Ling Tsai
- Computer Science Department, Queens College, City University of New York, Flushing, NY, USA
| | - Kai-Hsuan Lin
- Department of Computer Science and Information Engineering, National Chung Cheng University, Chiayi, Taiwan
| | - Wei-Yang Lin
- Department of Computer Science and Information Engineering, National Chung Cheng University, Chiayi, Taiwan; Advanced Institute of Manufacturing with High-Tech Innovations, National Chung Cheng University, Chiayi, Taiwan.
| | - Sheng-Feng Sung
- Division of Neurology, Department of Internal Medicine, Ditmanson Medical Foundation Chia-Yi Christian Hospital, Chiayi City, Taiwan; Department of Beauty & Health Care, Min-Hwei Junior College of Health Care Management, Tainan, Taiwan.
| |
Collapse
|
9
|
Eguchi K, Yaguchi H, Kudo I, Kimura I, Nabekura T, Kumagai R, Fujita K, Nakashiro Y, Iida Y, Hamada S, Honma S, Takei A, Moriwaka F, Yabe I. Differentiation of speech in Parkinson's disease and spinocerebellar degeneration using deep neural networks. J Neurol 2024; 271:1004-1012. [PMID: 37989963 DOI: 10.1007/s00415-023-12091-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2023] [Revised: 10/29/2023] [Accepted: 10/30/2023] [Indexed: 11/23/2023]
Abstract
INTRODUCTION Assessing dysarthria features in patients with neurodegenerative diseases helps diagnose underlying pathologies. Although deep neural network (DNN) techniques have been widely adopted in various audio processing tasks, few studies have tested whether DNNs can help differentiate neurodegenerative diseases using patients' speech data. This study evaluated whether a DNN model using a transformer architecture could differentiate patients with Parkinson's disease (PD) from patients with spinocerebellar degeneration (SCD) using speech data. METHODS Speech data were obtained from 251 and 101 patients with PD and SCD, respectively, while they read a passage. We fine-tuned a pre-trained DNN model using log-mel spectrograms generated from speech data. The DNN model was trained to predict whether the input spectrogram was generated from patients with PD or SCD. We used fivefold cross-validation to evaluate the predictive performance using the area under the receiver operating characteristic curve (AUC) and accuracy, sensitivity, and specificity. RESULTS Average ± standard deviation of the AUC, accuracy, sensitivity, and specificity of the trained model for the fivefold cross-validation were 0.93 ± 0.04, 0.87 ± 0.03, 0.83 ± 0.05, and 0.89 ± 0.05, respectively. CONCLUSION The DNN model can differentiate speech data of patients with PD from that of patients with SCD with relatively high accuracy and AUC. The proposed method can be used as a non-invasive, easy-to-perform screening method to differentiate PD from SCD using patient speech and is expected to be applied to telemedicine.
Collapse
Affiliation(s)
- Katsuki Eguchi
- Hokuyukai Neurological Hospital, 4-30, 2jo, 2cho-me, Nijuyonken, Nishi-ku, Sapporo, 063-0802, Japan.
- Department of Neurology, Faculty of Medicine and Graduate School of Medicine, Hokkaido University, Kita 15, Nishi 7, Kita-ku, Sapporo, 060-8638, Japan.
| | - Hiroaki Yaguchi
- Department of Neurology, Faculty of Medicine and Graduate School of Medicine, Hokkaido University, Kita 15, Nishi 7, Kita-ku, Sapporo, 060-8638, Japan
| | - Ikue Kudo
- Hokuyukai Neurological Hospital, 4-30, 2jo, 2cho-me, Nijuyonken, Nishi-ku, Sapporo, 063-0802, Japan
| | - Ibuki Kimura
- Hokuyukai Neurological Hospital, 4-30, 2jo, 2cho-me, Nijuyonken, Nishi-ku, Sapporo, 063-0802, Japan
| | - Tomoko Nabekura
- Hokuyukai Neurological Hospital, 4-30, 2jo, 2cho-me, Nijuyonken, Nishi-ku, Sapporo, 063-0802, Japan
| | - Ryuto Kumagai
- Sapporo Parkinson MS Neurological Clinic, Sapporo Kita Sky Building F12, 7-6, Kita 7-Nishi 5, Kita-ku, Sapporo, Hokkaido, 060-0807, Japan
| | - Kenichi Fujita
- Hokuyukai Neurological Hospital, 4-30, 2jo, 2cho-me, Nijuyonken, Nishi-ku, Sapporo, 063-0802, Japan
| | - Yuichi Nakashiro
- Hokuyukai Neurological Hospital, 4-30, 2jo, 2cho-me, Nijuyonken, Nishi-ku, Sapporo, 063-0802, Japan
| | - Yuki Iida
- Hokuyukai Neurological Hospital, 4-30, 2jo, 2cho-me, Nijuyonken, Nishi-ku, Sapporo, 063-0802, Japan
| | - Shinsuke Hamada
- Hokuyukai Neurological Hospital, 4-30, 2jo, 2cho-me, Nijuyonken, Nishi-ku, Sapporo, 063-0802, Japan
| | - Sanae Honma
- Hokuyukai Neurological Hospital, 4-30, 2jo, 2cho-me, Nijuyonken, Nishi-ku, Sapporo, 063-0802, Japan
| | - Asako Takei
- Hokuyukai Neurological Hospital, 4-30, 2jo, 2cho-me, Nijuyonken, Nishi-ku, Sapporo, 063-0802, Japan
| | - Fumio Moriwaka
- Hokuyukai Neurological Hospital, 4-30, 2jo, 2cho-me, Nijuyonken, Nishi-ku, Sapporo, 063-0802, Japan
| | - Ichiro Yabe
- Department of Neurology, Faculty of Medicine and Graduate School of Medicine, Hokkaido University, Kita 15, Nishi 7, Kita-ku, Sapporo, 060-8638, Japan
| |
Collapse
|
10
|
Chen M, Qian D, Wang Y, An J, Meng K, Xu S, Liu S, Sun M, Li M, Pang C. Systematic Review of Machine Learning Applied to the Secondary Prevention of Ischemic Stroke. J Med Syst 2024; 48:8. [PMID: 38165495 DOI: 10.1007/s10916-023-02020-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Accepted: 11/13/2023] [Indexed: 01/03/2024]
Abstract
Ischemic stroke is a serious disease posing significant threats to human health and life, with the highest absolute and relative risks of a poor prognosis following the first occurrence, and more than 90% of strokes are attributable to modifiable risk factors. Currently, machine learning (ML) is widely used for the prediction of ischemic stroke outcomes. By identifying risk factors, predicting the risk of poor prognosis and thus developing personalized treatment plans, it effectively reduces the probability of poor prognosis, leading to more effective secondary prevention. This review includes 41 studies since 2018 that used ML algorithms to build prognostic prediction models for ischemic stroke, transient ischemic attack (TIA), and acute ischemic stroke (AIS). We analyzed in detail the risk factors used in these studies, the sources and processing methods of the required data, the model building and validation, and their application in different prediction time windows. The results indicate that among the included studies, the top five risk factors in terms of frequency were cardiovascular diseases, age, sex, national institutes of health stroke scale (NIHSS) score, and diabetes. Furthermore, 64% of the studies used single-center data, 65% of studies using imbalanced data did not perform data balancing, 88% of the studies did not utilize external validation datasets for model validation, and 72% of the studies did not provide explanations for their models. Addressing these issues is crucial for enhancing the credibility and effectiveness of the research, consequently improving the development and implementation of secondary prevention measures.
Collapse
Affiliation(s)
- Meng Chen
- School of Life Science and Technology, Changchun University of Science and Technology, Jilin Province, Changchun, 130022, People's Republic of China
| | - Dongbao Qian
- School of Life Science and Technology, Changchun University of Science and Technology, Jilin Province, Changchun, 130022, People's Republic of China
| | - Yixuan Wang
- Union Hospital of Jilin University, Jilin Province, Neurosurgery, Changchun, 130033, People's Republic of China
| | - Junyan An
- Union Hospital of Jilin University, Jilin Province, Neurosurgery, Changchun, 130033, People's Republic of China
| | - Ke Meng
- Union Hospital of Jilin University, Jilin Province, Neurosurgery, Changchun, 130033, People's Republic of China
| | - Shuai Xu
- School of Life Science and Technology, Changchun University of Science and Technology, Jilin Province, Changchun, 130022, People's Republic of China
| | - Sheng Liu
- School of Life Science and Technology, Changchun University of Science and Technology, Jilin Province, Changchun, 130022, People's Republic of China
| | - Meiyan Sun
- Union Hospital of Jilin University, Jilin Province, Neurosurgery, Changchun, 130033, People's Republic of China
| | - Miao Li
- School of Life Science and Technology, Changchun University of Science and Technology, Jilin Province, Changchun, 130022, People's Republic of China.
- Union Hospital of Jilin University, Jilin Province, Neurosurgery, Changchun, 130033, People's Republic of China.
| | - Chunying Pang
- School of Life Science and Technology, Changchun University of Science and Technology, Jilin Province, Changchun, 130022, People's Republic of China.
| |
Collapse
|
11
|
Oei CW, Ng EYK, Ng MHS, Tan RS, Chan YM, Chan LG, Acharya UR. Explainable Risk Prediction of Post-Stroke Adverse Mental Outcomes Using Machine Learning Techniques in a Population of 1780 Patients. SENSORS (BASEL, SWITZERLAND) 2023; 23:7946. [PMID: 37766004 PMCID: PMC10538068 DOI: 10.3390/s23187946] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/15/2023] [Revised: 09/13/2023] [Accepted: 09/15/2023] [Indexed: 09/29/2023]
Abstract
Post-stroke depression and anxiety, collectively known as post-stroke adverse mental outcome (PSAMO) are common sequelae of stroke. About 30% of stroke survivors develop depression and about 20% develop anxiety. Stroke survivors with PSAMO have poorer health outcomes with higher mortality and greater functional disability. In this study, we aimed to develop a machine learning (ML) model to predict the risk of PSAMO. We retrospectively studied 1780 patients with stroke who were divided into PSAMO vs. no PSAMO groups based on results of validated depression and anxiety questionnaires. The features collected included demographic and sociological data, quality of life scores, stroke-related information, medical and medication history, and comorbidities. Recursive feature elimination was used to select features to input in parallel to eight ML algorithms to train and test the model. Bayesian optimization was used for hyperparameter tuning. Shapley additive explanations (SHAP), an explainable AI (XAI) method, was applied to interpret the model. The best performing ML algorithm was gradient-boosted tree, which attained 74.7% binary classification accuracy. Feature importance calculated by SHAP produced a list of ranked important features that contributed to the prediction, which were consistent with findings of prior clinical studies. Some of these factors were modifiable, and potentially amenable to intervention at early stages of stroke to reduce the incidence of PSAMO.
Collapse
Affiliation(s)
- Chien Wei Oei
- Management Information Department, Office of Clinical Epidemiology, Analytics and kNowledge (OCEAN), Tan Tock Seng Hospital, Singapore 308433, Singapore;
- School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore 639798, Singapore
| | - Eddie Yin Kwee Ng
- School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore 639798, Singapore
| | - Matthew Hok Shan Ng
- Rehabilitation Research Institute of Singapore, Nanyang Technological University, Singapore 308232, Singapore;
| | - Ru-San Tan
- National Heart Centre Singapore, Singapore 169609, Singapore;
- Duke-NUS Medical School, Singapore 169857, Singapore
| | - Yam Meng Chan
- Department of General Surgery, Vascular Surgery Service, Tan Tock Seng Hospital, Singapore 308433, Singapore;
| | - Lai Gwen Chan
- Department of Psychiatry, Tan Tock Seng Hospital, Singapore 308433, Singapore;
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore 308232, Singapore
| | - Udyavara Rajendra Acharya
- School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield, QLD 4305, Australia;
| |
Collapse
|