1
|
Samak ZA, Clatworthy P, Mirmehdi M. Automatic prediction of stroke treatment outcomes: latest advances and perspectives. Biomed Eng Lett 2025; 15:467-488. [PMID: 40271393 PMCID: PMC12011689 DOI: 10.1007/s13534-025-00462-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2024] [Revised: 01/24/2025] [Accepted: 01/26/2025] [Indexed: 04/25/2025] Open
Abstract
Stroke is a major global health problem that causes mortality and morbidity. Predicting the outcomes of stroke intervention can facilitate clinical decision-making and improve patient care. Engaging and developing deep learning techniques can help to analyse large and diverse medical data, including brain scans, medical reports, and other sensor information, such as EEG, ECG, EMG, and so on. Despite the common data standardisation challenge within the medical image analysis domain, the future of deep learning in stroke outcome prediction lies in using multimodal information, including final infarct data, to achieve better prediction of long-term functional outcomes. This article provides a broad review of recent advances and applications of deep learning in the prediction of stroke outcomes, including (i) the data and models used, (ii) the prediction tasks and measures of success, (iii) the current challenges and limitations, and (iv) future directions and potential benefits. This comprehensive review aims to provide researchers, clinicians, and policy makers with an up-to-date understanding of this rapidly evolving and promising field.
Collapse
Affiliation(s)
- Zeynel A. Samak
- Department of Computer Engineering, Adiyaman University, 02040 Adiyaman, Turkey
| | - Philip Clatworthy
- Translational Health Sciences, University of Bristol, Bristol, BS8 1UD UK
- Stroke Neurology, Southmead Hospital, North Bristol NHS Trust, Street, Bristol, BS8 1UD UK
| | - Majid Mirmehdi
- School of Computer Science, University of Bristol, Bristol, BS8 1UB UK
| |
Collapse
|
2
|
Gutierrez A, Amador K, Winder A, Wilms M, Fiehler J, Forkert ND. Annotation-free prediction of treatment-specific tissue outcome from 4D CT perfusion imaging in acute ischemic stroke. Comput Med Imaging Graph 2024; 114:102376. [PMID: 38537536 DOI: 10.1016/j.compmedimag.2024.102376] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Revised: 01/31/2024] [Accepted: 03/21/2024] [Indexed: 04/01/2024]
Abstract
Acute ischemic stroke is a critical health condition that requires timely intervention. Following admission, clinicians typically use perfusion imaging to facilitate treatment decision-making. While deep learning models leveraging perfusion data have demonstrated the ability to predict post-treatment tissue infarction for individual patients, predictions are often represented as binary or probabilistic masks that are not straightforward to interpret or easy to obtain. Moreover, these models typically rely on large amounts of subjectively segmented data and non-standard perfusion analysis techniques. To address these challenges, we propose a novel deep learning approach that directly predicts follow-up computed tomography images from full spatio-temporal 4D perfusion scans through a temporal compression. The results show that this method leads to realistic follow-up image predictions containing the infarcted tissue outcomes. The proposed compression method achieves comparable prediction results to using perfusion maps as inputs but without the need for perfusion analysis or arterial input function selection. Additionally, separate models trained on 45 patients treated with thrombolysis and 102 treated with thrombectomy showed that each model correctly captured the different patient-specific treatment effects as shown by image difference maps. The findings of this work clearly highlight the potential of our method to provide interpretable stroke treatment decision support without requiring manual annotations.
Collapse
Affiliation(s)
- Alejandro Gutierrez
- Department of Radiology, University of Calgary, Calgary, AB T2N 1N4, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, AB T2N 1N4, Canada; Biomedical Engineering Graduate Program, University of Calgary, Calgary, AB T2N 1N4, Canada; Alberta Children's Hospital Research Institute, University of Calgary, Calgary, AB T2N 1N4, Canada.
| | - Kimberly Amador
- Department of Radiology, University of Calgary, Calgary, AB T2N 1N4, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, AB T2N 1N4, Canada; Biomedical Engineering Graduate Program, University of Calgary, Calgary, AB T2N 1N4, Canada; Alberta Children's Hospital Research Institute, University of Calgary, Calgary, AB T2N 1N4, Canada
| | - Anthony Winder
- Department of Radiology, University of Calgary, Calgary, AB T2N 1N4, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, AB T2N 1N4, Canada
| | - Matthias Wilms
- Department of Radiology, University of Calgary, Calgary, AB T2N 1N4, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, AB T2N 1N4, Canada; Alberta Children's Hospital Research Institute, University of Calgary, Calgary, AB T2N 1N4, Canada; Department of Pediatrics, University of Calgary, Calgary, AB T2N 1N4, Canada; Department of Community Health Sciences, University of Calgary, Calgary, AB T2N 1N4, Canada
| | - Jens Fiehler
- Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, Martinistr. 52, Hamburg 20251, Germany
| | - Nils D Forkert
- Department of Radiology, University of Calgary, Calgary, AB T2N 1N4, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, AB T2N 1N4, Canada; Alberta Children's Hospital Research Institute, University of Calgary, Calgary, AB T2N 1N4, Canada; Department of Clinical Neurosciences, University of Calgary, Calgary, AB T2N 1N4, Canada
| |
Collapse
|
3
|
Winder AJ, Stanley EA, Fiehler J, Forkert ND. Challenges and Potential of Artificial Intelligence in Neuroradiology. Clin Neuroradiol 2024; 34:293-305. [PMID: 38285239 DOI: 10.1007/s00062-024-01382-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Accepted: 01/03/2024] [Indexed: 01/30/2024]
Abstract
PURPOSE Artificial intelligence (AI) has emerged as a transformative force in medical research and is garnering increased attention in the public consciousness. This represents a critical time period in which medical researchers, healthcare providers, insurers, regulatory agencies, and patients are all developing and shaping their beliefs and policies regarding the use of AI in the healthcare sector. The successful deployment of AI will require support from all these groups. This commentary proposes that widespread support for medical AI must be driven by clear and transparent scientific reporting, beginning at the earliest stages of scientific research. METHODS A review of relevant guidelines and literature describing how scientific reporting plays a central role at key stages in the life cycle of an AI software product was conducted. To contextualize this principle within a specific medical domain, we discuss the current state of predictive tissue outcome modeling in acute ischemic stroke and the unique challenges presented therein. RESULTS AND CONCLUSION Translating AI methods from the research to the clinical domain is complicated by challenges related to model design and validation studies, medical product regulations, and healthcare providers' reservations regarding AI's efficacy and affordability. However, each of these limitations is also an opportunity for high-impact research that will help to accelerate the clinical adoption of state-of-the-art medical AI. In all cases, establishing and adhering to appropriate reporting standards is an important responsibility that is shared by all of the parties involved in the life cycle of a prospective AI software product.
Collapse
Affiliation(s)
- Anthony J Winder
- Department of Radiology, University of Calgary, Calgary, Canada.
- Hotchkiss Brain Institute, University of Calgary, Calgary, Canada.
| | - Emma Am Stanley
- Department of Radiology, University of Calgary, Calgary, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, Canada
- Biomedical Engineering Graduate Program, University of Calgary, Calgary, Canada
- Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Canada
| | - Jens Fiehler
- Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Nils D Forkert
- Department of Radiology, University of Calgary, Calgary, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, Canada
- Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Canada
- Department of Clinical Neuroscience, University of Calgary, Calgary, Canada
- Department of Electrical and Software Engineering, University of Calgary, Calgary, Canada
| |
Collapse
|
4
|
Zhao Z, Zhang Y, Su J, Yang L, Pang L, Gao Y, Wang H. A comprehensive review for artificial intelligence on neuroimaging in rehabilitation of ischemic stroke. Front Neurol 2024; 15:1367854. [PMID: 38606275 PMCID: PMC11007047 DOI: 10.3389/fneur.2024.1367854] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Accepted: 03/08/2024] [Indexed: 04/13/2024] Open
Abstract
Stroke is the second leading cause of death worldwide, with ischemic stroke accounting for a significant proportion of morbidity and mortality among stroke patients. Ischemic stroke often causes disability and cognitive impairment in patients, which seriously affects the quality of life of patients. Therefore, how to predict the recovery of patients can provide support for clinical intervention in advance and improve the enthusiasm of patients for rehabilitation treatment. With the popularization of imaging technology, the diagnosis and treatment of ischemic stroke patients are often accompanied by a large number of imaging data. Through machine learning and Deep Learning, information from imaging data can be used more effectively. In this review, we discuss recent advances in neuroimaging, machine learning, and Deep Learning in the rehabilitation of ischemic stroke.
Collapse
Affiliation(s)
- Zijian Zhao
- Rehabilitation Center, ShengJing Hospital of China Medical University, Shenyang, Liaoning Province, China
| | - Yuanyuan Zhang
- Rehabilitation Center, ShengJing Hospital of China Medical University, Shenyang, Liaoning Province, China
| | - Jiuhui Su
- Department of Orthopedics, Haicheng Bonesetting Hospital, Haicheng, Liaoning Province, China
| | - Lianbo Yang
- Department of Reparative and Reconstructive Surgery, The Second Hospital of Dalian Medical University, Dalian Liaoning Province, China
| | - Luhang Pang
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning Province, China
| | - Yingshan Gao
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning Province, China
| | - Hongbo Wang
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning Province, China
| |
Collapse
|
5
|
Palsson F, Forkert ND, Meyer L, Broocks G, Flottmann F, Maros ME, Bechstein M, Winkelmeier L, Schlemm E, Fiehler J, Gellißen S, Kniep HC. Prediction of tissue outcome in acute ischemic stroke based on single-phase CT angiography at admission. Front Neurol 2024; 15:1330497. [PMID: 38566856 PMCID: PMC10985353 DOI: 10.3389/fneur.2024.1330497] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Accepted: 03/05/2024] [Indexed: 04/04/2024] Open
Abstract
Introduction In acute ischemic stroke, prediction of the tissue outcome after reperfusion can be used to identify patients that might benefit from mechanical thrombectomy (MT). The aim of this work was to develop a deep learning model that can predict the follow-up infarct location and extent exclusively based on acute single-phase computed tomography angiography (CTA) datasets. In comparison to CT perfusion (CTP), CTA imaging is more widely available, less prone to artifacts, and the established standard of care in acute stroke imaging protocols. Furthermore, recent RCTs have shown that also patients with large established infarctions benefit from MT, which might not have been selected for MT based on CTP core/penumbra mismatch analysis. Methods All patients with acute large vessel occlusion of the anterior circulation treated at our institution between 12/2015 and 12/2020 were screened (N = 404) and 238 patients undergoing MT with successful reperfusion were included for final analysis. Ground truth infarct lesions were segmented on 24 h follow-up CT scans. Pre-processed CTA images were used as input for a U-Net-based convolutional neural network trained for lesion prediction, enhanced with a spatial and channel-wise squeeze-and-excitation block. Post-processing was applied to remove small predicted lesion components. The model was evaluated using a 5-fold cross-validation and a separate test set with Dice similarity coefficient (DSC) as the primary metric and average volume error as the secondary metric. Results The mean ± standard deviation test set DSC over all folds after post-processing was 0.35 ± 0.2 and the mean test set average volume error was 11.5 mL. The performance was relatively uniform across models with the best model according to the DSC achieved a score of 0.37 ± 0.2 after post-processing and the best model in terms of average volume error yielded 3.9 mL. Conclusion 24 h follow-up infarct prediction using acute CTA imaging exclusively is feasible with DSC measures comparable to results of CTP-based algorithms reported in other studies. The proposed method might pave the way to a wider acceptance, feasibility, and applicability of follow-up infarct prediction based on artificial intelligence.
Collapse
Affiliation(s)
- Frosti Palsson
- deCODE Genetics Inc., Reykjavik, Iceland
- Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Nils D. Forkert
- Department of Radiology, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
- Department of Clinical Neurosciences, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
- Alberta Children’s Hospital Research Institute, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
- Hotchkiss Brain Institute, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
| | - Lukas Meyer
- Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Gabriel Broocks
- Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Fabian Flottmann
- Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Máté E. Maros
- Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Matthias Bechstein
- Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Laurens Winkelmeier
- Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Eckhard Schlemm
- Department of Neurology, University Medical Centre Hamburg-Eppendorf, Hamburg, Germany
| | - Jens Fiehler
- Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Susanne Gellißen
- Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Helge C. Kniep
- Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
6
|
Chen M, Qian D, Wang Y, An J, Meng K, Xu S, Liu S, Sun M, Li M, Pang C. Systematic Review of Machine Learning Applied to the Secondary Prevention of Ischemic Stroke. J Med Syst 2024; 48:8. [PMID: 38165495 DOI: 10.1007/s10916-023-02020-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Accepted: 11/13/2023] [Indexed: 01/03/2024]
Abstract
Ischemic stroke is a serious disease posing significant threats to human health and life, with the highest absolute and relative risks of a poor prognosis following the first occurrence, and more than 90% of strokes are attributable to modifiable risk factors. Currently, machine learning (ML) is widely used for the prediction of ischemic stroke outcomes. By identifying risk factors, predicting the risk of poor prognosis and thus developing personalized treatment plans, it effectively reduces the probability of poor prognosis, leading to more effective secondary prevention. This review includes 41 studies since 2018 that used ML algorithms to build prognostic prediction models for ischemic stroke, transient ischemic attack (TIA), and acute ischemic stroke (AIS). We analyzed in detail the risk factors used in these studies, the sources and processing methods of the required data, the model building and validation, and their application in different prediction time windows. The results indicate that among the included studies, the top five risk factors in terms of frequency were cardiovascular diseases, age, sex, national institutes of health stroke scale (NIHSS) score, and diabetes. Furthermore, 64% of the studies used single-center data, 65% of studies using imbalanced data did not perform data balancing, 88% of the studies did not utilize external validation datasets for model validation, and 72% of the studies did not provide explanations for their models. Addressing these issues is crucial for enhancing the credibility and effectiveness of the research, consequently improving the development and implementation of secondary prevention measures.
Collapse
Affiliation(s)
- Meng Chen
- School of Life Science and Technology, Changchun University of Science and Technology, Jilin Province, Changchun, 130022, People's Republic of China
| | - Dongbao Qian
- School of Life Science and Technology, Changchun University of Science and Technology, Jilin Province, Changchun, 130022, People's Republic of China
| | - Yixuan Wang
- Union Hospital of Jilin University, Jilin Province, Neurosurgery, Changchun, 130033, People's Republic of China
| | - Junyan An
- Union Hospital of Jilin University, Jilin Province, Neurosurgery, Changchun, 130033, People's Republic of China
| | - Ke Meng
- Union Hospital of Jilin University, Jilin Province, Neurosurgery, Changchun, 130033, People's Republic of China
| | - Shuai Xu
- School of Life Science and Technology, Changchun University of Science and Technology, Jilin Province, Changchun, 130022, People's Republic of China
| | - Sheng Liu
- School of Life Science and Technology, Changchun University of Science and Technology, Jilin Province, Changchun, 130022, People's Republic of China
| | - Meiyan Sun
- Union Hospital of Jilin University, Jilin Province, Neurosurgery, Changchun, 130033, People's Republic of China
| | - Miao Li
- School of Life Science and Technology, Changchun University of Science and Technology, Jilin Province, Changchun, 130022, People's Republic of China.
- Union Hospital of Jilin University, Jilin Province, Neurosurgery, Changchun, 130033, People's Republic of China.
| | - Chunying Pang
- School of Life Science and Technology, Changchun University of Science and Technology, Jilin Province, Changchun, 130022, People's Republic of China.
| |
Collapse
|
7
|
Amador K, Gutierrez A, Winder A, Fiehler J, Wilms M, Forkert ND. Providing clinical context to the spatio-temporal analysis of 4D CT perfusion to predict acute ischemic stroke lesion outcomes. J Biomed Inform 2024; 149:104567. [PMID: 38096945 DOI: 10.1016/j.jbi.2023.104567] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Revised: 10/25/2023] [Accepted: 12/07/2023] [Indexed: 12/18/2023]
Abstract
Acute ischemic stroke is a leading cause of mortality and morbidity worldwide. Timely identification of the extent of a stroke is crucial for effective treatment, whereas spatio-temporal (4D) Computed Tomography Perfusion (CTP) imaging is playing a critical role in this process. Recently, the first deep learning-based methods that leverage the full spatio-temporal nature of perfusion imaging for predicting stroke lesion outcomes have been proposed. However, clinical information is typically not integrated into the learning process, which may be helpful to improve the tissue outcome prediction given the known influence of various factors (i.e., physiological, demographic, and treatment factors) on lesion growth. Cross-attention, a multimodal fusion strategy, has been successfully used to combine information from multiple sources, but it has yet to be applied to stroke lesion outcome prediction. Therefore, this work aimed to develop and evaluate a novel multimodal and spatio-temporal deep learning model that utilizes cross-attention to combine information from 4D CTP and clinical metadata simultaneously to predict stroke lesion outcomes. The proposed model was evaluated using a dataset of 70 acute ischemic stroke patients, demonstrating significantly improved volume estimates (mean error = 19 ml) compared to a baseline unimodal approach (mean error = 35 ml, p< 0.05). The proposed model allows generating attention maps and counterfactual outcome scenarios to investigate the relevance of clinical variables in predicting stroke lesion outcomes at a patient level, helping to provide a better understanding of the model's decision-making process.
Collapse
Affiliation(s)
- Kimberly Amador
- Biomedical Engineering Graduate Program, University of Calgary, Calgary, Canada; Department of Radiology, University of Calgary, Calgary, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, Canada; Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Canada.
| | - Alejandro Gutierrez
- Biomedical Engineering Graduate Program, University of Calgary, Calgary, Canada; Department of Radiology, University of Calgary, Calgary, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, Canada; Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Canada
| | - Anthony Winder
- Department of Radiology, University of Calgary, Calgary, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, Canada
| | - Jens Fiehler
- Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Matthias Wilms
- Hotchkiss Brain Institute, University of Calgary, Calgary, Canada; Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Canada; Departments of Pediatrics and Community Health Sciences, University of Calgary, Calgary, Canada
| | - Nils D Forkert
- Department of Radiology, University of Calgary, Calgary, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, Canada; Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Canada; Department of Clinical Neurosciences, University of Calgary, Calgary, Canada
| |
Collapse
|